[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:20:39.069893 17346 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.240.190:44201
I20260709 12:20:39.071661 17346 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:20:39.072896 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:39.093338 17353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:39.093328 17352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:39.095010 17346 server_base.cc:1061] running on GCE node
W20260709 12:20:39.093777 17355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:40.331919 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:40.332185 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:40.332429 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599640332407 us; error 0 us; skew 500 ppm
I20260709 12:20:40.333388 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:40.339108 17346 webserver.cc:533] Webserver started at http://127.16.240.190:36407/ using document root <none> and password file <none>
I20260709 12:20:40.340113 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:40.340361 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:40.340857 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:40.348086 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599638884573-17346-0/minicluster-data/master-0-root/instance:
uuid: "9c700316e26b40428f6f129754f63657"
format_stamp: "Formatted at 2026-07-09 12:20:40 on dist-test-slave-7xpw"
I20260709 12:20:40.356694 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:20:40.362401 17361 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:40.363938 17346 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:20:40.364629 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599638884573-17346-0/minicluster-data/master-0-root
uuid: "9c700316e26b40428f6f129754f63657"
format_stamp: "Formatted at 2026-07-09 12:20:40 on dist-test-slave-7xpw"
I20260709 12:20:40.365231 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599638884573-17346-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599638884573-17346-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599638884573-17346-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:40.442155 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:40.443853 17346 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:20:40.444371 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:40.526291 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.190:44201
I20260709 12:20:40.526355 17412 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.190:44201 every 8 connection(s)
I20260709 12:20:40.535655 17413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:40.570142 17413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657: Bootstrap starting.
I20260709 12:20:40.576534 17413 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:40.578567 17413 log.cc:826] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657: Log is configured to *not* fsync() on all Append() calls
I20260709 12:20:40.584148 17413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657: No bootstrap required, opened a new log
I20260709 12:20:40.607069 17413 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c700316e26b40428f6f129754f63657" member_type: VOTER }
I20260709 12:20:40.607802 17413 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:40.608074 17413 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c700316e26b40428f6f129754f63657, State: Initialized, Role: FOLLOWER
I20260709 12:20:40.608987 17413 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c700316e26b40428f6f129754f63657" member_type: VOTER }
I20260709 12:20:40.609532 17413 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:20:40.609838 17413 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:20:40.610194 17413 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:40.614493 17413 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c700316e26b40428f6f129754f63657" member_type: VOTER }
I20260709 12:20:40.615332 17413 leader_election.cc:304] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c700316e26b40428f6f129754f63657; no voters: 
I20260709 12:20:40.617298 17413 leader_election.cc:290] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:20:40.617901 17416 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:40.620930 17416 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657 [term 1 LEADER]: Becoming Leader. State: Replica: 9c700316e26b40428f6f129754f63657, State: Running, Role: LEADER
I20260709 12:20:40.621922 17416 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c700316e26b40428f6f129754f63657" member_type: VOTER }
I20260709 12:20:40.622978 17413 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:20:40.633165 17418 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c700316e26b40428f6f129754f63657. Latest consensus state: current_term: 1 leader_uuid: "9c700316e26b40428f6f129754f63657" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c700316e26b40428f6f129754f63657" member_type: VOTER } }
I20260709 12:20:40.633996 17418 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657 [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:40.633780 17417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c700316e26b40428f6f129754f63657" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c700316e26b40428f6f129754f63657" member_type: VOTER } }
I20260709 12:20:40.634519 17417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657 [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:40.637810 17425 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:20:40.652024 17425 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:20:40.653971 17346 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:20:40.671428 17425 catalog_manager.cc:1383] Generated new cluster ID: 5857f110e8754891a12fb4476126351a
I20260709 12:20:40.671823 17425 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:20:40.691213 17425 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:20:40.693024 17425 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:20:40.707382 17425 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657: Generated new TSK 0
I20260709 12:20:40.708473 17425 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:20:40.721704 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:40.732419 17435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:40.733645 17436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:40.738674 17438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:40.738783 17346 server_base.cc:1061] running on GCE node
I20260709 12:20:40.740120 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:40.740396 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:40.740602 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599640740584 us; error 0 us; skew 500 ppm
I20260709 12:20:40.741819 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:40.747160 17346 webserver.cc:533] Webserver started at http://127.16.240.129:39869/ using document root <none> and password file <none>
I20260709 12:20:40.747999 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:40.748273 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:40.748796 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:40.750475 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599638884573-17346-0/minicluster-data/ts-0-root/instance:
uuid: "fc50b7531b474e48adb0838c110df3c3"
format_stamp: "Formatted at 2026-07-09 12:20:40 on dist-test-slave-7xpw"
I20260709 12:20:40.757813 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.008s
I20260709 12:20:40.763912 17444 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:40.765048 17346 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:20:40.765482 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599638884573-17346-0/minicluster-data/ts-0-root
uuid: "fc50b7531b474e48adb0838c110df3c3"
format_stamp: "Formatted at 2026-07-09 12:20:40 on dist-test-slave-7xpw"
I20260709 12:20:40.765913 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599638884573-17346-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599638884573-17346-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599638884573-17346-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:40.808614 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:40.810071 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:40.812682 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:40.817638 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:40.817946 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:40.818235 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:40.818459 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:40.932997 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.129:45849
I20260709 12:20:40.933074 17506 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.129:45849 every 8 connection(s)
I20260709 12:20:40.940577 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:40.957787 17511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:40.957255 17512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:40.969830 17514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:40.970188 17346 server_base.cc:1061] running on GCE node
I20260709 12:20:40.971258 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:40.971505 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:40.971487 17507 heartbeater.cc:344] Connected to a master server at 127.16.240.190:44201
I20260709 12:20:40.971828 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599640971809 us; error 0 us; skew 500 ppm
I20260709 12:20:40.972080 17507 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:40.972679 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:40.973351 17507 heartbeater.cc:507] Master 127.16.240.190:44201 requested a full tablet report, sending...
I20260709 12:20:40.977763 17378 ts_manager.cc:194] Registered new tserver with Master: fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849)
I20260709 12:20:40.979074 17346 webserver.cc:533] Webserver started at http://127.16.240.130:40055/ using document root <none> and password file <none>
I20260709 12:20:40.980170 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:40.980703 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:40.981192 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:40.982163 17378 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36314
I20260709 12:20:40.982908 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599638884573-17346-0/minicluster-data/ts-1-root/instance:
uuid: "63b3cdaff6e940b197c26c7eea9889f3"
format_stamp: "Formatted at 2026-07-09 12:20:40 on dist-test-slave-7xpw"
I20260709 12:20:40.990492 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.010s	sys 0.000s
I20260709 12:20:40.995479 17519 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:40.996467 17346 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 12:20:40.996785 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599638884573-17346-0/minicluster-data/ts-1-root
uuid: "63b3cdaff6e940b197c26c7eea9889f3"
format_stamp: "Formatted at 2026-07-09 12:20:40 on dist-test-slave-7xpw"
I20260709 12:20:40.997080 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599638884573-17346-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599638884573-17346-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599638884573-17346-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:41.019531 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:41.021253 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:41.025004 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:41.029109 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:41.029321 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:41.029641 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:41.029815 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:41.137006 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.130:37035
I20260709 12:20:41.137172 17581 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.130:37035 every 8 connection(s)
I20260709 12:20:41.144524 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:41.156196 17585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:41.157169 17586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:41.159231 17582 heartbeater.cc:344] Connected to a master server at 127.16.240.190:44201
I20260709 12:20:41.159600 17582 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:41.160349 17582 heartbeater.cc:507] Master 127.16.240.190:44201 requested a full tablet report, sending...
I20260709 12:20:41.162918 17378 ts_manager.cc:194] Registered new tserver with Master: 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035)
I20260709 12:20:41.164510 17346 server_base.cc:1061] running on GCE node
I20260709 12:20:41.164695 17378 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36320
W20260709 12:20:41.164994 17589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:41.166246 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:41.166752 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:41.167107 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599641167077 us; error 0 us; skew 500 ppm
I20260709 12:20:41.167733 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:41.170511 17346 webserver.cc:533] Webserver started at http://127.16.240.131:37867/ using document root <none> and password file <none>
I20260709 12:20:41.171017 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:41.171242 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:41.171527 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:41.172649 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599638884573-17346-0/minicluster-data/ts-2-root/instance:
uuid: "d63a012a36464bb282cc473364dcbc1e"
format_stamp: "Formatted at 2026-07-09 12:20:41 on dist-test-slave-7xpw"
I20260709 12:20:41.177628 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:20:41.181418 17593 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:41.182749 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:20:41.183099 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599638884573-17346-0/minicluster-data/ts-2-root
uuid: "d63a012a36464bb282cc473364dcbc1e"
format_stamp: "Formatted at 2026-07-09 12:20:41 on dist-test-slave-7xpw"
I20260709 12:20:41.183408 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599638884573-17346-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599638884573-17346-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599638884573-17346-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:41.206768 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:41.208190 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:41.209750 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:41.212189 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:41.212489 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:41.212854 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:41.212999 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:41.318856 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.131:41511
I20260709 12:20:41.319377 17657 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.131:41511 every 8 connection(s)
I20260709 12:20:41.337054 17658 heartbeater.cc:344] Connected to a master server at 127.16.240.190:44201
I20260709 12:20:41.337460 17658 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:41.338339 17658 heartbeater.cc:507] Master 127.16.240.190:44201 requested a full tablet report, sending...
I20260709 12:20:41.340795 17378 ts_manager.cc:194] Registered new tserver with Master: d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:41.341861 17346 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017517628s
I20260709 12:20:41.342129 17378 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48232
I20260709 12:20:41.399564 17378 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48236:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:20:41.404863 17378 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:20:41.518392 17621 tablet_service.cc:1511] Processing CreateTablet for tablet a2de3e7d05e947efa97e42a696f6360b (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:41.520197 17621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2de3e7d05e947efa97e42a696f6360b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.529764 17472 tablet_service.cc:1511] Processing CreateTablet for tablet a2de3e7d05e947efa97e42a696f6360b (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:41.535847 17472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2de3e7d05e947efa97e42a696f6360b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.534159 17471 tablet_service.cc:1511] Processing CreateTablet for tablet 6d7bde90819e4906a5388c608a5b7a07 (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:41.547019 17469 tablet_service.cc:1511] Processing CreateTablet for tablet 497230b8fcb8404297bb61cf04549f78 (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:41.552076 17471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7bde90819e4906a5388c608a5b7a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.541518 17470 tablet_service.cc:1511] Processing CreateTablet for tablet 23fdbee0aed64eb7944d541434bc2eca (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:41.555187 17465 tablet_service.cc:1511] Processing CreateTablet for tablet d3b59956b80d41dd899e6b77cbdbdd89 (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:41.554354 17466 tablet_service.cc:1511] Processing CreateTablet for tablet 8250d6ce783641dbb54f3075c37c2594 (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:41.562619 17469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497230b8fcb8404297bb61cf04549f78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.556838 17467 tablet_service.cc:1511] Processing CreateTablet for tablet df95c0de53cc45e7bf9338f523ec21d6 (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:41.562569 17547 tablet_service.cc:1511] Processing CreateTablet for tablet a2de3e7d05e947efa97e42a696f6360b (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:41.559489 17468 tablet_service.cc:1511] Processing CreateTablet for tablet a5e7f42e0bcb4903912c56beb592ce5a (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:41.562021 17620 tablet_service.cc:1511] Processing CreateTablet for tablet 6d7bde90819e4906a5388c608a5b7a07 (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:41.554411 17618 tablet_service.cc:1511] Processing CreateTablet for tablet 497230b8fcb8404297bb61cf04549f78 (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:41.576519 17470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23fdbee0aed64eb7944d541434bc2eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.566843 17619 tablet_service.cc:1511] Processing CreateTablet for tablet 23fdbee0aed64eb7944d541434bc2eca (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:41.573565 17546 tablet_service.cc:1511] Processing CreateTablet for tablet 6d7bde90819e4906a5388c608a5b7a07 (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:41.586977 17464 tablet_service.cc:1511] Processing CreateTablet for tablet 80e4d65e63294f1bb0cba6e869adc91b (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:41.589987 17620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7bde90819e4906a5388c608a5b7a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.591284 17467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df95c0de53cc45e7bf9338f523ec21d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.587656 17617 tablet_service.cc:1511] Processing CreateTablet for tablet a5e7f42e0bcb4903912c56beb592ce5a (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:41.601825 17547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2de3e7d05e947efa97e42a696f6360b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.582396 17616 tablet_service.cc:1511] Processing CreateTablet for tablet df95c0de53cc45e7bf9338f523ec21d6 (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:41.605880 17543 tablet_service.cc:1511] Processing CreateTablet for tablet a5e7f42e0bcb4903912c56beb592ce5a (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:41.583838 17545 tablet_service.cc:1511] Processing CreateTablet for tablet 23fdbee0aed64eb7944d541434bc2eca (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:41.608382 17468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e7f42e0bcb4903912c56beb592ce5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.595862 17544 tablet_service.cc:1511] Processing CreateTablet for tablet 497230b8fcb8404297bb61cf04549f78 (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:41.609824 17618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497230b8fcb8404297bb61cf04549f78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.608403 17542 tablet_service.cc:1511] Processing CreateTablet for tablet df95c0de53cc45e7bf9338f523ec21d6 (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:41.618078 17615 tablet_service.cc:1511] Processing CreateTablet for tablet 8250d6ce783641dbb54f3075c37c2594 (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:41.619738 17546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7bde90819e4906a5388c608a5b7a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.628134 17619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23fdbee0aed64eb7944d541434bc2eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.625737 17466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8250d6ce783641dbb54f3075c37c2594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.628216 17540 tablet_service.cc:1511] Processing CreateTablet for tablet d3b59956b80d41dd899e6b77cbdbdd89 (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:41.634716 17464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e4d65e63294f1bb0cba6e869adc91b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.635941 17615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8250d6ce783641dbb54f3075c37c2594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.636749 17543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e7f42e0bcb4903912c56beb592ce5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.643082 17614 tablet_service.cc:1511] Processing CreateTablet for tablet d3b59956b80d41dd899e6b77cbdbdd89 (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:41.646855 17616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df95c0de53cc45e7bf9338f523ec21d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.651142 17465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b59956b80d41dd899e6b77cbdbdd89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.655700 17613 tablet_service.cc:1511] Processing CreateTablet for tablet 80e4d65e63294f1bb0cba6e869adc91b (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:41.642958 17541 tablet_service.cc:1511] Processing CreateTablet for tablet 8250d6ce783641dbb54f3075c37c2594 (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:41.650879 17539 tablet_service.cc:1511] Processing CreateTablet for tablet 80e4d65e63294f1bb0cba6e869adc91b (DEFAULT_TABLE table=test-workload [id=5f7bf1d7f41d4bb780ba67dcd594bcf9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:41.665727 17542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df95c0de53cc45e7bf9338f523ec21d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.667282 17540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b59956b80d41dd899e6b77cbdbdd89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.669750 17544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497230b8fcb8404297bb61cf04549f78. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:41.669996 17426 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:41.673151 17614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b59956b80d41dd899e6b77cbdbdd89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.694959 17545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23fdbee0aed64eb7944d541434bc2eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.701367 17539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e4d65e63294f1bb0cba6e869adc91b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.700233 17676 tablet_bootstrap.cc:492] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e: Bootstrap starting.
I20260709 12:20:41.707355 17613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e4d65e63294f1bb0cba6e869adc91b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.730177 17541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8250d6ce783641dbb54f3075c37c2594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.736030 17617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e7f42e0bcb4903912c56beb592ce5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.861994 17677 tablet_bootstrap.cc:492] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3: Bootstrap starting.
I20260709 12:20:41.876897 17676 tablet_bootstrap.cc:654] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:41.932982 17676 tablet_bootstrap.cc:492] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e: No bootstrap required, opened a new log
I20260709 12:20:41.933475 17676 ts_tablet_manager.cc:1403] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e: Time spent bootstrapping tablet: real 0.271s	user 0.015s	sys 0.006s
I20260709 12:20:41.939435 17678 tablet_bootstrap.cc:492] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3: Bootstrap starting.
I20260709 12:20:41.947206 17677 tablet_bootstrap.cc:654] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:41.947633 17676 raft_consensus.cc:359] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } }
I20260709 12:20:41.952944 17676 raft_consensus.cc:385] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:41.953860 17676 raft_consensus.cc:740] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Initialized, Role: FOLLOWER
I20260709 12:20:41.954774 17676 consensus_queue.cc:260] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } }
I20260709 12:20:41.959507 17658 heartbeater.cc:499] Master 127.16.240.190:44201 was elected leader, sending a full tablet report...
I20260709 12:20:41.960456 17676 ts_tablet_manager.cc:1434] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 12:20:41.961478 17676 tablet_bootstrap.cc:492] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e: Bootstrap starting.
I20260709 12:20:41.970189 17676 tablet_bootstrap.cc:654] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:41.971988 17677 tablet_bootstrap.cc:492] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3: No bootstrap required, opened a new log
I20260709 12:20:41.972506 17677 ts_tablet_manager.cc:1403] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3: Time spent bootstrapping tablet: real 0.112s	user 0.015s	sys 0.015s
I20260709 12:20:41.976343 17677 raft_consensus.cc:359] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:41.977413 17677 raft_consensus.cc:385] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:41.977803 17677 raft_consensus.cc:740] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:41.978859 17677 consensus_queue.cc:260] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:41.984398 17676 tablet_bootstrap.cc:492] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e: No bootstrap required, opened a new log
I20260709 12:20:41.985097 17676 ts_tablet_manager.cc:1403] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.006s
I20260709 12:20:41.985806 17678 tablet_bootstrap.cc:654] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:41.986748 17507 heartbeater.cc:499] Master 127.16.240.190:44201 was elected leader, sending a full tablet report...
I20260709 12:20:41.989166 17676 raft_consensus.cc:359] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:41.990224 17676 raft_consensus.cc:385] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:41.990630 17676 raft_consensus.cc:740] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Initialized, Role: FOLLOWER
I20260709 12:20:41.996456 17676 consensus_queue.cc:260] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.000126 17676 ts_tablet_manager.cc:1434] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.001s
I20260709 12:20:42.001437 17676 tablet_bootstrap.cc:492] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e: Bootstrap starting.
I20260709 12:20:42.010797 17677 ts_tablet_manager.cc:1434] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3: Time spent starting tablet: real 0.038s	user 0.018s	sys 0.020s
I20260709 12:20:42.011940 17677 tablet_bootstrap.cc:492] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3: Bootstrap starting.
I20260709 12:20:42.015429 17676 tablet_bootstrap.cc:654] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:42.019078 17677 tablet_bootstrap.cc:654] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:42.028640 17676 tablet_bootstrap.cc:492] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e: No bootstrap required, opened a new log
I20260709 12:20:42.029301 17676 ts_tablet_manager.cc:1403] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.003s
I20260709 12:20:42.033396 17676 raft_consensus.cc:359] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.034477 17676 raft_consensus.cc:385] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:42.034898 17676 raft_consensus.cc:740] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Initialized, Role: FOLLOWER
I20260709 12:20:42.037607 17676 consensus_queue.cc:260] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.040369 17677 tablet_bootstrap.cc:492] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3: No bootstrap required, opened a new log
I20260709 12:20:42.040654 17676 ts_tablet_manager.cc:1434] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.004s
I20260709 12:20:42.040903 17677 ts_tablet_manager.cc:1403] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.019s
I20260709 12:20:42.041678 17676 tablet_bootstrap.cc:492] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e: Bootstrap starting.
I20260709 12:20:42.043834 17677 raft_consensus.cc:359] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.044440 17678 tablet_bootstrap.cc:492] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3: No bootstrap required, opened a new log
I20260709 12:20:42.044602 17677 raft_consensus.cc:385] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:42.045107 17678 ts_tablet_manager.cc:1403] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3: Time spent bootstrapping tablet: real 0.108s	user 0.018s	sys 0.000s
I20260709 12:20:42.045023 17677 raft_consensus.cc:740] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:42.046069 17677 consensus_queue.cc:260] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.048434 17677 ts_tablet_manager.cc:1434] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.003s
I20260709 12:20:42.048898 17676 tablet_bootstrap.cc:654] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:42.049636 17677 tablet_bootstrap.cc:492] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3: Bootstrap starting.
I20260709 12:20:42.058313 17677 tablet_bootstrap.cc:654] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:42.062700 17676 tablet_bootstrap.cc:492] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e: No bootstrap required, opened a new log
I20260709 12:20:42.063402 17676 ts_tablet_manager.cc:1403] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.001s
I20260709 12:20:42.067268 17676 raft_consensus.cc:359] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.068321 17676 raft_consensus.cc:385] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:42.068709 17676 raft_consensus.cc:740] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Initialized, Role: FOLLOWER
I20260709 12:20:42.069698 17676 consensus_queue.cc:260] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.073354 17676 ts_tablet_manager.cc:1434] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 12:20:42.074715 17676 tablet_bootstrap.cc:492] T 497230b8fcb8404297bb61cf04549f78 P d63a012a36464bb282cc473364dcbc1e: Bootstrap starting.
W20260709 12:20:42.077627 17659 tablet.cc:2406] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:20:42.074820 17678 raft_consensus.cc:359] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } }
I20260709 12:20:42.081478 17678 raft_consensus.cc:385] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:42.081799 17678 raft_consensus.cc:740] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Initialized, Role: FOLLOWER
I20260709 12:20:42.082608 17678 consensus_queue.cc:260] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } }
I20260709 12:20:42.083707 17683 raft_consensus.cc:493] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.084230 17683 raft_consensus.cc:515] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.091333 17676 tablet_bootstrap.cc:654] T 497230b8fcb8404297bb61cf04549f78 P d63a012a36464bb282cc473364dcbc1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:42.092005 17683 leader_election.cc:290] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:42.092229 17677 tablet_bootstrap.cc:492] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3: No bootstrap required, opened a new log
I20260709 12:20:42.094676 17677 ts_tablet_manager.cc:1403] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.008s
I20260709 12:20:42.097941 17678 ts_tablet_manager.cc:1434] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.000s
I20260709 12:20:42.098984 17678 tablet_bootstrap.cc:492] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3: Bootstrap starting.
I20260709 12:20:42.098981 17582 heartbeater.cc:499] Master 127.16.240.190:44201 was elected leader, sending a full tablet report...
I20260709 12:20:42.101980 17677 raft_consensus.cc:359] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } }
I20260709 12:20:42.102921 17677 raft_consensus.cc:385] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:42.103225 17677 raft_consensus.cc:740] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:42.104038 17677 consensus_queue.cc:260] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } }
I20260709 12:20:42.106693 17678 tablet_bootstrap.cc:654] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:42.110901 17677 ts_tablet_manager.cc:1434] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:20:42.112260 17677 tablet_bootstrap.cc:492] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3: Bootstrap starting.
I20260709 12:20:42.132030 17689 raft_consensus.cc:493] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.134421 17689 raft_consensus.cc:515] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } }
I20260709 12:20:42.144289 17683 raft_consensus.cc:493] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.145300 17683 raft_consensus.cc:515] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.149158 17683 leader_election.cc:290] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:42.150317 17689 leader_election.cc:290] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511), fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849)
I20260709 12:20:42.160346 17678 tablet_bootstrap.cc:492] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3: No bootstrap required, opened a new log
I20260709 12:20:42.160893 17678 ts_tablet_manager.cc:1403] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3: Time spent bootstrapping tablet: real 0.062s	user 0.022s	sys 0.010s
I20260709 12:20:42.167032 17678 raft_consensus.cc:359] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.168205 17678 raft_consensus.cc:385] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:42.168519 17678 raft_consensus.cc:740] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Initialized, Role: FOLLOWER
I20260709 12:20:42.176358 17677 tablet_bootstrap.cc:654] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:42.183043 17678 consensus_queue.cc:260] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.188800 17681 raft_consensus.cc:493] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.189339 17681 raft_consensus.cc:515] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.216905 17681 leader_election.cc:290] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035)
I20260709 12:20:42.225978 17677 tablet_bootstrap.cc:492] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3: No bootstrap required, opened a new log
I20260709 12:20:42.228422 17678 ts_tablet_manager.cc:1434] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.004s
I20260709 12:20:42.233628 17676 tablet_bootstrap.cc:492] T 497230b8fcb8404297bb61cf04549f78 P d63a012a36464bb282cc473364dcbc1e: No bootstrap required, opened a new log
I20260709 12:20:42.236959 17678 tablet_bootstrap.cc:492] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3: Bootstrap starting.
I20260709 12:20:42.237457 17677 ts_tablet_manager.cc:1403] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3: Time spent bootstrapping tablet: real 0.125s	user 0.009s	sys 0.013s
I20260709 12:20:42.238175 17676 ts_tablet_manager.cc:1403] T 497230b8fcb8404297bb61cf04549f78 P d63a012a36464bb282cc473364dcbc1e: Time spent bootstrapping tablet: real 0.164s	user 0.025s	sys 0.032s
I20260709 12:20:42.265185 17676 raft_consensus.cc:359] T 497230b8fcb8404297bb61cf04549f78 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.273588 17676 raft_consensus.cc:385] T 497230b8fcb8404297bb61cf04549f78 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:42.274057 17676 raft_consensus.cc:740] T 497230b8fcb8404297bb61cf04549f78 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Initialized, Role: FOLLOWER
I20260709 12:20:42.275074 17676 consensus_queue.cc:260] T 497230b8fcb8404297bb61cf04549f78 P d63a012a36464bb282cc473364dcbc1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.293742 17676 ts_tablet_manager.cc:1434] T 497230b8fcb8404297bb61cf04549f78 P d63a012a36464bb282cc473364dcbc1e: Time spent starting tablet: real 0.050s	user 0.018s	sys 0.000s
I20260709 12:20:42.294831 17676 tablet_bootstrap.cc:492] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e: Bootstrap starting.
I20260709 12:20:42.296098 17677 raft_consensus.cc:359] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.296931 17677 raft_consensus.cc:385] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:42.297263 17677 raft_consensus.cc:740] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:42.297650 17678 tablet_bootstrap.cc:654] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:42.303329 17677 consensus_queue.cc:260] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.302145 17557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8250d6ce783641dbb54f3075c37c2594" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3" is_pre_election: true
I20260709 12:20:42.311542 17683 raft_consensus.cc:493] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.312065 17683 raft_consensus.cc:515] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.314105 17683 leader_election.cc:290] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:42.315060 17681 raft_consensus.cc:493] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.315544 17681 raft_consensus.cc:515] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } }
I20260709 12:20:42.318492 17632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8250d6ce783641dbb54f3075c37c2594" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d63a012a36464bb282cc473364dcbc1e" is_pre_election: true
I20260709 12:20:42.315644 17556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497230b8fcb8404297bb61cf04549f78" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3" is_pre_election: true
I20260709 12:20:42.320269 17632 raft_consensus.cc:2468] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc50b7531b474e48adb0838c110df3c3 in term 0.
W20260709 12:20:42.325915 17447 leader_election.cc:343] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:42.326967 17681 leader_election.cc:290] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035), fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849)
I20260709 12:20:42.327158 17677 ts_tablet_manager.cc:1434] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.004s
I20260709 12:20:42.328657 17677 tablet_bootstrap.cc:492] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3: Bootstrap starting.
I20260709 12:20:42.329012 17556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df95c0de53cc45e7bf9338f523ec21d6" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3" is_pre_election: true
I20260709 12:20:42.329282 17676 tablet_bootstrap.cc:654] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:42.330857 17632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497230b8fcb8404297bb61cf04549f78" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d63a012a36464bb282cc473364dcbc1e" is_pre_election: true
I20260709 12:20:42.332020 17632 raft_consensus.cc:2468] T 497230b8fcb8404297bb61cf04549f78 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc50b7531b474e48adb0838c110df3c3 in term 0.
W20260709 12:20:42.333218 17447 leader_election.cc:343] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:42.335395 17447 leader_election.cc:343] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:42.338171 17632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df95c0de53cc45e7bf9338f523ec21d6" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d63a012a36464bb282cc473364dcbc1e" is_pre_election: true
I20260709 12:20:42.339025 17448 leader_election.cc:304] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d63a012a36464bb282cc473364dcbc1e, fc50b7531b474e48adb0838c110df3c3; no voters: 63b3cdaff6e940b197c26c7eea9889f3
I20260709 12:20:42.341894 17482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2de3e7d05e947efa97e42a696f6360b" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc50b7531b474e48adb0838c110df3c3" is_pre_election: true
I20260709 12:20:42.344470 17557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2de3e7d05e947efa97e42a696f6360b" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3" is_pre_election: true
I20260709 12:20:42.344235 17631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2de3e7d05e947efa97e42a696f6360b" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d63a012a36464bb282cc473364dcbc1e" is_pre_election: true
I20260709 12:20:42.343814 17683 raft_consensus.cc:2804] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:42.345894 17683 raft_consensus.cc:493] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.345516 17557 raft_consensus.cc:2468] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d63a012a36464bb282cc473364dcbc1e in term 0.
I20260709 12:20:42.346211 17631 raft_consensus.cc:2468] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 0.
I20260709 12:20:42.346895 17683 raft_consensus.cc:3060] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:42.343184 17632 raft_consensus.cc:2468] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc50b7531b474e48adb0838c110df3c3 in term 0.
I20260709 12:20:42.348891 17596 leader_election.cc:304] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, d63a012a36464bb282cc473364dcbc1e; no voters: 
I20260709 12:20:42.349515 17523 leader_election.cc:304] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, d63a012a36464bb282cc473364dcbc1e; no voters: 
I20260709 12:20:42.350571 17681 raft_consensus.cc:2804] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:42.350940 17681 raft_consensus.cc:493] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.351002 17689 raft_consensus.cc:2804] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:42.348162 17678 tablet_bootstrap.cc:492] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3: No bootstrap required, opened a new log
I20260709 12:20:42.351424 17689 raft_consensus.cc:493] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.345937 17482 raft_consensus.cc:2468] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 0.
I20260709 12:20:42.351826 17689 raft_consensus.cc:3060] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:42.352720 17681 raft_consensus.cc:3060] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:42.345621 17448 leader_election.cc:304] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d63a012a36464bb282cc473364dcbc1e, fc50b7531b474e48adb0838c110df3c3; no voters: 63b3cdaff6e940b197c26c7eea9889f3
I20260709 12:20:42.351807 17678 ts_tablet_manager.cc:1403] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3: Time spent bootstrapping tablet: real 0.121s	user 0.033s	sys 0.016s
I20260709 12:20:42.353380 17556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8250d6ce783641dbb54f3075c37c2594" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3" is_pre_election: true
W20260709 12:20:42.358554 17596 leader_election.cc:343] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:42.363633 17448 leader_election.cc:304] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d63a012a36464bb282cc473364dcbc1e, fc50b7531b474e48adb0838c110df3c3; no voters: 63b3cdaff6e940b197c26c7eea9889f3
I20260709 12:20:42.370724 17689 raft_consensus.cc:515] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } }
I20260709 12:20:42.373015 17689 leader_election.cc:290] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 1 election: Requested vote from peers d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511), fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849)
I20260709 12:20:42.372355 17681 raft_consensus.cc:515] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } }
I20260709 12:20:42.367120 17707 raft_consensus.cc:2804] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:42.377097 17632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2de3e7d05e947efa97e42a696f6360b" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
I20260709 12:20:42.377986 17707 raft_consensus.cc:493] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.378698 17632 raft_consensus.cc:2393] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 63b3cdaff6e940b197c26c7eea9889f3 in current term 1: Already voted for candidate d63a012a36464bb282cc473364dcbc1e in this term.
I20260709 12:20:42.380546 17482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8250d6ce783641dbb54f3075c37c2594" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc50b7531b474e48adb0838c110df3c3" is_pre_election: true
I20260709 12:20:42.382889 17481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2de3e7d05e947efa97e42a696f6360b" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc50b7531b474e48adb0838c110df3c3" is_pre_election: true
I20260709 12:20:42.383330 17556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2de3e7d05e947efa97e42a696f6360b" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
I20260709 12:20:42.384228 17481 raft_consensus.cc:2468] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d63a012a36464bb282cc473364dcbc1e in term 0.
I20260709 12:20:42.384449 17556 raft_consensus.cc:2393] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d63a012a36464bb282cc473364dcbc1e in current term 1: Already voted for candidate 63b3cdaff6e940b197c26c7eea9889f3 in this term.
I20260709 12:20:42.385524 17681 leader_election.cc:290] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 election: Requested vote from peers 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035), fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849)
I20260709 12:20:42.386287 17707 raft_consensus.cc:3060] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:42.389953 17481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2de3e7d05e947efa97e42a696f6360b" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
I20260709 12:20:42.390820 17481 raft_consensus.cc:3060] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:42.386523 17681 raft_consensus.cc:493] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.394052 17678 raft_consensus.cc:359] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.395383 17678 raft_consensus.cc:385] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:42.395864 17678 raft_consensus.cc:740] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Initialized, Role: FOLLOWER
I20260709 12:20:42.410915 17707 raft_consensus.cc:515] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.400666 17681 raft_consensus.cc:515] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.391057 17683 raft_consensus.cc:515] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.396697 17678 consensus_queue.cc:260] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.417729 17681 leader_election.cc:290] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035)
I20260709 12:20:42.419322 17556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7bde90819e4906a5388c608a5b7a07" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3" is_pre_election: true
I20260709 12:20:42.420769 17480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7bde90819e4906a5388c608a5b7a07" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc50b7531b474e48adb0838c110df3c3" is_pre_election: true
I20260709 12:20:42.421121 17481 raft_consensus.cc:2468] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d63a012a36464bb282cc473364dcbc1e in term 1.
I20260709 12:20:42.423007 17482 raft_consensus.cc:2393] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d63a012a36464bb282cc473364dcbc1e in current term 1: Already voted for candidate fc50b7531b474e48adb0838c110df3c3 in this term.
I20260709 12:20:42.423439 17678 ts_tablet_manager.cc:1434] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.004s
I20260709 12:20:42.424525 17678 tablet_bootstrap.cc:492] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3: Bootstrap starting.
I20260709 12:20:42.424788 17677 tablet_bootstrap.cc:654] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:42.414204 17448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:41511, user_credentials={real_user=slave}} blocked reactor thread for 50663.6us
I20260709 12:20:42.420923 17556 raft_consensus.cc:2468] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d63a012a36464bb282cc473364dcbc1e in term 0.
I20260709 12:20:42.427448 17683 leader_election.cc:290] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 election: Requested vote from peers 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:42.427840 17556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8250d6ce783641dbb54f3075c37c2594" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
I20260709 12:20:42.427958 17596 leader_election.cc:304] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, d63a012a36464bb282cc473364dcbc1e; no voters: 
I20260709 12:20:42.429294 17710 raft_consensus.cc:2804] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:42.430527 17710 raft_consensus.cc:493] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:42.430534 17447 leader_election.cc:343] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:42.431061 17710 raft_consensus.cc:3060] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:42.434243 17482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2de3e7d05e947efa97e42a696f6360b" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
I20260709 12:20:42.435215 17482 raft_consensus.cc:2393] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 63b3cdaff6e940b197c26c7eea9889f3 in current term 1: Already voted for candidate d63a012a36464bb282cc473364dcbc1e in this term.
I20260709 12:20:42.436668 17676 tablet_bootstrap.cc:492] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e: No bootstrap required, opened a new log
I20260709 12:20:42.436591 17632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8250d6ce783641dbb54f3075c37c2594" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
I20260709 12:20:42.437414 17520 leader_election.cc:304] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3; no voters: d63a012a36464bb282cc473364dcbc1e, fc50b7531b474e48adb0838c110df3c3
I20260709 12:20:42.437764 17632 raft_consensus.cc:3060] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:42.438709 17689 raft_consensus.cc:2749] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:42.439209 17631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497230b8fcb8404297bb61cf04549f78" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
I20260709 12:20:42.440892 17631 raft_consensus.cc:3060] T 497230b8fcb8404297bb61cf04549f78 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:42.440747 17676 ts_tablet_manager.cc:1403] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e: Time spent bootstrapping tablet: real 0.146s	user 0.018s	sys 0.011s
I20260709 12:20:42.436599 17707 leader_election.cc:290] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 election: Requested vote from peers 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:42.445645 17556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497230b8fcb8404297bb61cf04549f78" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
W20260709 12:20:42.447103 17447 leader_election.cc:343] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:42.447695 17708 raft_consensus.cc:2804] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:42.450690 17708 raft_consensus.cc:493] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.451143 17708 raft_consensus.cc:3060] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:42.453608 17631 raft_consensus.cc:2468] T 497230b8fcb8404297bb61cf04549f78 P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc50b7531b474e48adb0838c110df3c3 in term 1.
I20260709 12:20:42.453704 17632 raft_consensus.cc:2468] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc50b7531b474e48adb0838c110df3c3 in term 1.
I20260709 12:20:42.448105 17594 leader_election.cc:304] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d63a012a36464bb282cc473364dcbc1e, fc50b7531b474e48adb0838c110df3c3; no voters: 63b3cdaff6e940b197c26c7eea9889f3
I20260709 12:20:42.454594 17681 raft_consensus.cc:2804] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:20:42.455016 17594 leader_election.cc:343] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:42.456053 17677 tablet_bootstrap.cc:492] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3: No bootstrap required, opened a new log
I20260709 12:20:42.456171 17594 leader_election.cc:304] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d63a012a36464bb282cc473364dcbc1e; no voters: 63b3cdaff6e940b197c26c7eea9889f3, fc50b7531b474e48adb0838c110df3c3
I20260709 12:20:42.447551 17676 raft_consensus.cc:359] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.457226 17676 raft_consensus.cc:385] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:42.457579 17676 raft_consensus.cc:740] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Initialized, Role: FOLLOWER
I20260709 12:20:42.458421 17676 consensus_queue.cc:260] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.456621 17677 ts_tablet_manager.cc:1403] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3: Time spent bootstrapping tablet: real 0.128s	user 0.009s	sys 0.008s
I20260709 12:20:42.460968 17708 raft_consensus.cc:515] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.462030 17678 tablet_bootstrap.cc:654] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:42.449882 17710 raft_consensus.cc:515] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.464345 17677 raft_consensus.cc:359] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.464113 17448 leader_election.cc:304] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d63a012a36464bb282cc473364dcbc1e, fc50b7531b474e48adb0838c110df3c3; no voters: 63b3cdaff6e940b197c26c7eea9889f3
I20260709 12:20:42.465158 17677 raft_consensus.cc:385] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:42.465736 17677 raft_consensus.cc:740] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:42.467425 17707 raft_consensus.cc:2804] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:42.465912 17713 raft_consensus.cc:2749] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:42.468658 17556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df95c0de53cc45e7bf9338f523ec21d6" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
I20260709 12:20:42.469197 17707 raft_consensus.cc:697] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [term 1 LEADER]: Becoming Leader. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Running, Role: LEADER
I20260709 12:20:42.467746 17708 leader_election.cc:290] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 election: Requested vote from peers 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
W20260709 12:20:42.470309 17447 leader_election.cc:343] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:42.470389 17707 consensus_queue.cc:237] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.472659 17676 ts_tablet_manager.cc:1434] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.004s
I20260709 12:20:42.473472 17676 tablet_bootstrap.cc:492] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e: Bootstrap starting.
I20260709 12:20:42.466094 17448 leader_election.cc:304] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d63a012a36464bb282cc473364dcbc1e, fc50b7531b474e48adb0838c110df3c3; no voters: 63b3cdaff6e940b197c26c7eea9889f3
I20260709 12:20:42.474282 17708 raft_consensus.cc:2804] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:42.475024 17708 raft_consensus.cc:697] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 1 LEADER]: Becoming Leader. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Running, Role: LEADER
I20260709 12:20:42.475852 17681 raft_consensus.cc:697] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 1 LEADER]: Becoming Leader. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Running, Role: LEADER
I20260709 12:20:42.476123 17708 consensus_queue.cc:237] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.476759 17681 consensus_queue.cc:237] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } }
I20260709 12:20:42.475713 17632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df95c0de53cc45e7bf9338f523ec21d6" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
I20260709 12:20:42.478125 17632 raft_consensus.cc:3060] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:42.478483 17481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7bde90819e4906a5388c608a5b7a07" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
W20260709 12:20:42.480013 17594 leader_election.cc:343] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:42.481292 17677 consensus_queue.cc:260] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.487107 17677 ts_tablet_manager.cc:1434] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3: Time spent starting tablet: real 0.026s	user 0.000s	sys 0.007s
I20260709 12:20:42.488399 17710 leader_election.cc:290] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 election: Requested vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035)
I20260709 12:20:42.488507 17677 tablet_bootstrap.cc:492] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3: Bootstrap starting.
I20260709 12:20:42.491446 17707 raft_consensus.cc:493] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.492184 17707 raft_consensus.cc:515] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.494081 17632 raft_consensus.cc:2468] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc50b7531b474e48adb0838c110df3c3 in term 1.
I20260709 12:20:42.497664 17556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7bde90819e4906a5388c608a5b7a07" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
I20260709 12:20:42.493090 17378 catalog_manager.cc:5697] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc50b7531b474e48adb0838c110df3c3 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "fc50b7531b474e48adb0838c110df3c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:42.498867 17556 raft_consensus.cc:3060] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:42.497879 17557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e7f42e0bcb4903912c56beb592ce5a" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3" is_pre_election: true
I20260709 12:20:42.559414 17689 raft_consensus.cc:493] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.565834 17448 leader_election.cc:304] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d63a012a36464bb282cc473364dcbc1e, fc50b7531b474e48adb0838c110df3c3; no voters: 63b3cdaff6e940b197c26c7eea9889f3
I20260709 12:20:42.595646 17708 raft_consensus.cc:2804] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:42.596344 17708 raft_consensus.cc:697] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 1 LEADER]: Becoming Leader. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Running, Role: LEADER
I20260709 12:20:42.596657 17689 raft_consensus.cc:515] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.597174 17708 consensus_queue.cc:237] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.631343 17681 raft_consensus.cc:493] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.632098 17681 raft_consensus.cc:515] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.625569 17689 leader_election.cc:290] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:42.649085 17632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23fdbee0aed64eb7944d541434bc2eca" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d63a012a36464bb282cc473364dcbc1e" is_pre_election: true
I20260709 12:20:42.647353 17676 tablet_bootstrap.cc:700] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e: Time spent opening tablet: real 0.149s	user 0.002s	sys 0.000s
I20260709 12:20:42.651418 17678 tablet_bootstrap.cc:492] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3: No bootstrap required, opened a new log
I20260709 12:20:42.648914 17377 catalog_manager.cc:5697] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e reported cstate change: term changed from 0 to 1, leader changed from <none> to d63a012a36464bb282cc473364dcbc1e (127.16.240.131). New cstate: current_term: 1 leader_uuid: "d63a012a36464bb282cc473364dcbc1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:42.651789 17482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e4d65e63294f1bb0cba6e869adc91b" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc50b7531b474e48adb0838c110df3c3" is_pre_election: true
W20260709 12:20:42.652055 17523 leader_election.cc:343] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:42.651270 17481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23fdbee0aed64eb7944d541434bc2eca" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc50b7531b474e48adb0838c110df3c3" is_pre_election: true
I20260709 12:20:42.647503 17707 leader_election.cc:290] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:42.653203 17678 ts_tablet_manager.cc:1403] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3: Time spent bootstrapping tablet: real 0.229s	user 0.022s	sys 0.074s
W20260709 12:20:42.660732 17447 leader_election.cc:343] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:42.662354 17632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e7f42e0bcb4903912c56beb592ce5a" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d63a012a36464bb282cc473364dcbc1e" is_pre_election: true
I20260709 12:20:42.662791 17676 tablet_bootstrap.cc:654] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:42.652037 17681 leader_election.cc:290] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035)
W20260709 12:20:42.665143 17594 leader_election.cc:343] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:42.665030 17557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e4d65e63294f1bb0cba6e869adc91b" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3" is_pre_election: true
W20260709 12:20:42.669314 17448 leader_election.cc:343] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:42.670099 17448 leader_election.cc:304] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc50b7531b474e48adb0838c110df3c3; no voters: 63b3cdaff6e940b197c26c7eea9889f3, d63a012a36464bb282cc473364dcbc1e
I20260709 12:20:42.671633 17707 raft_consensus.cc:2749] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:42.672350 17677 tablet_bootstrap.cc:654] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:42.671453 17678 raft_consensus.cc:359] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.674328 17678 raft_consensus.cc:385] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:20:42.673321 17520 leader_election.cc:343] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:42.674821 17678 raft_consensus.cc:740] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Initialized, Role: FOLLOWER
I20260709 12:20:42.674994 17520 leader_election.cc:304] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3; no voters: d63a012a36464bb282cc473364dcbc1e, fc50b7531b474e48adb0838c110df3c3
I20260709 12:20:42.675769 17678 consensus_queue.cc:260] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.668802 17556 raft_consensus.cc:2468] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d63a012a36464bb282cc473364dcbc1e in term 1.
W20260709 12:20:42.677687 17596 leader_election.cc:343] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:42.678498 17596 leader_election.cc:304] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d63a012a36464bb282cc473364dcbc1e; no voters: 63b3cdaff6e940b197c26c7eea9889f3, fc50b7531b474e48adb0838c110df3c3
I20260709 12:20:42.677505 17689 raft_consensus.cc:2749] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:42.680150 17681 raft_consensus.cc:2749] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:42.682157 17596 leader_election.cc:304] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, d63a012a36464bb282cc473364dcbc1e; no voters: fc50b7531b474e48adb0838c110df3c3
I20260709 12:20:42.683632 17681 raft_consensus.cc:2804] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:42.684198 17681 raft_consensus.cc:697] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 1 LEADER]: Becoming Leader. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Running, Role: LEADER
I20260709 12:20:42.685021 17681 consensus_queue.cc:237] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.688551 17676 tablet_bootstrap.cc:492] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e: No bootstrap required, opened a new log
I20260709 12:20:42.689208 17676 ts_tablet_manager.cc:1403] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e: Time spent bootstrapping tablet: real 0.216s	user 0.013s	sys 0.002s
I20260709 12:20:42.694159 17676 raft_consensus.cc:359] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
W20260709 12:20:42.694480 17426 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:42.694752 17676 raft_consensus.cc:385] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:42.695075 17676 raft_consensus.cc:740] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Initialized, Role: FOLLOWER
I20260709 12:20:42.691907 17678 ts_tablet_manager.cc:1434] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3: Time spent starting tablet: real 0.032s	user 0.012s	sys 0.000s
I20260709 12:20:42.695250 17677 tablet_bootstrap.cc:492] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3: No bootstrap required, opened a new log
I20260709 12:20:42.696718 17677 ts_tablet_manager.cc:1403] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3: Time spent bootstrapping tablet: real 0.208s	user 0.011s	sys 0.007s
I20260709 12:20:42.698619 17678 tablet_bootstrap.cc:492] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3: Bootstrap starting.
I20260709 12:20:42.696939 17676 consensus_queue.cc:260] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.709918 17723 raft_consensus.cc:493] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.711910 17676 ts_tablet_manager.cc:1434] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.001s
I20260709 12:20:42.711344 17723 raft_consensus.cc:515] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.713833 17677 raft_consensus.cc:359] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.715389 17676 tablet_bootstrap.cc:492] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e: Bootstrap starting.
I20260709 12:20:42.716017 17677 raft_consensus.cc:385] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:42.716957 17677 raft_consensus.cc:740] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:42.724951 17677 consensus_queue.cc:260] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.727618 17677 ts_tablet_manager.cc:1434] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.004s
I20260709 12:20:42.728780 17677 tablet_bootstrap.cc:492] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3: Bootstrap starting.
I20260709 12:20:42.728842 17676 tablet_bootstrap.cc:654] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:42.729728 17723 leader_election.cc:290] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:42.731931 17482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497230b8fcb8404297bb61cf04549f78" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc50b7531b474e48adb0838c110df3c3" is_pre_election: true
I20260709 12:20:42.732528 17632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497230b8fcb8404297bb61cf04549f78" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d63a012a36464bb282cc473364dcbc1e" is_pre_election: true
I20260709 12:20:42.733443 17632 raft_consensus.cc:2393] T 497230b8fcb8404297bb61cf04549f78 P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63b3cdaff6e940b197c26c7eea9889f3 in current term 1: Already voted for candidate fc50b7531b474e48adb0838c110df3c3 in this term.
I20260709 12:20:42.734732 17523 leader_election.cc:304] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3; no voters: d63a012a36464bb282cc473364dcbc1e, fc50b7531b474e48adb0838c110df3c3
I20260709 12:20:42.735908 17723 raft_consensus.cc:3060] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:42.728791 17678 tablet_bootstrap.cc:654] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:42.743351 17723 raft_consensus.cc:2749] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:42.749485 17677 tablet_bootstrap.cc:654] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:42.750452 17678 tablet_bootstrap.cc:492] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3: No bootstrap required, opened a new log
I20260709 12:20:42.751376 17678 ts_tablet_manager.cc:1403] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.005s
I20260709 12:20:42.757781 17678 raft_consensus.cc:359] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.758752 17678 raft_consensus.cc:385] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:42.759073 17678 raft_consensus.cc:740] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Initialized, Role: FOLLOWER
I20260709 12:20:42.759950 17678 consensus_queue.cc:260] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.762471 17678 ts_tablet_manager.cc:1434] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.004s
I20260709 12:20:42.763438 17678 tablet_bootstrap.cc:492] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3: Bootstrap starting.
I20260709 12:20:42.770143 17678 tablet_bootstrap.cc:654] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:42.775023 17376 catalog_manager.cc:5697] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e reported cstate change: term changed from 0 to 1, leader changed from <none> to d63a012a36464bb282cc473364dcbc1e (127.16.240.131). New cstate: current_term: 1 leader_uuid: "d63a012a36464bb282cc473364dcbc1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:42.792379 17676 tablet_bootstrap.cc:492] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e: No bootstrap required, opened a new log
I20260709 12:20:42.796331 17676 ts_tablet_manager.cc:1403] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.010s
I20260709 12:20:42.802251 17676 raft_consensus.cc:359] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.808477 17676 raft_consensus.cc:385] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:42.809070 17676 raft_consensus.cc:740] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Initialized, Role: FOLLOWER
I20260709 12:20:42.810163 17676 consensus_queue.cc:260] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.817255 17377 catalog_manager.cc:5697] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc50b7531b474e48adb0838c110df3c3 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "fc50b7531b474e48adb0838c110df3c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:42.820266 17377 catalog_manager.cc:5697] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc50b7531b474e48adb0838c110df3c3 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "fc50b7531b474e48adb0838c110df3c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:42.828578 17676 ts_tablet_manager.cc:1434] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.002s
I20260709 12:20:42.831952 17677 tablet_bootstrap.cc:492] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3: No bootstrap required, opened a new log
I20260709 12:20:42.834506 17676 tablet_bootstrap.cc:492] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e: Bootstrap starting.
I20260709 12:20:42.832742 17678 tablet_bootstrap.cc:492] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3: No bootstrap required, opened a new log
I20260709 12:20:42.835620 17678 ts_tablet_manager.cc:1403] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3: Time spent bootstrapping tablet: real 0.072s	user 0.020s	sys 0.042s
I20260709 12:20:42.836127 17677 ts_tablet_manager.cc:1403] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3: Time spent bootstrapping tablet: real 0.108s	user 0.042s	sys 0.043s
I20260709 12:20:42.838747 17678 raft_consensus.cc:359] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.839545 17678 raft_consensus.cc:385] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:42.839854 17678 raft_consensus.cc:740] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Initialized, Role: FOLLOWER
I20260709 12:20:42.840132 17677 raft_consensus.cc:359] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.840660 17678 consensus_queue.cc:260] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.840948 17677 raft_consensus.cc:385] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:42.841532 17677 raft_consensus.cc:740] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:42.842746 17677 consensus_queue.cc:260] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.853017 17676 tablet_bootstrap.cc:654] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:42.862355 17678 ts_tablet_manager.cc:1434] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:20:42.862988 17677 ts_tablet_manager.cc:1434] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3: Time spent starting tablet: real 0.026s	user 0.016s	sys 0.007s
I20260709 12:20:42.863476 17678 tablet_bootstrap.cc:492] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3: Bootstrap starting.
I20260709 12:20:42.864231 17677 tablet_bootstrap.cc:492] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3: Bootstrap starting.
I20260709 12:20:42.871033 17678 tablet_bootstrap.cc:654] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:42.871416 17677 tablet_bootstrap.cc:654] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:42.876575 17681 consensus_queue.cc:1048] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:42.877619 17678 tablet_bootstrap.cc:492] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3: No bootstrap required, opened a new log
I20260709 12:20:42.878101 17678 ts_tablet_manager.cc:1403] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 12:20:42.881532 17678 raft_consensus.cc:359] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.882535 17678 raft_consensus.cc:385] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:42.882889 17678 raft_consensus.cc:740] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Initialized, Role: FOLLOWER
I20260709 12:20:42.883924 17678 consensus_queue.cc:260] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.885040 17708 raft_consensus.cc:493] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.885690 17708 raft_consensus.cc:515] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.886749 17678 ts_tablet_manager.cc:1434] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:20:42.888433 17678 tablet_bootstrap.cc:492] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3: Bootstrap starting.
I20260709 12:20:42.890049 17557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23fdbee0aed64eb7944d541434bc2eca" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3" is_pre_election: true
I20260709 12:20:42.890745 17557 raft_consensus.cc:2468] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc50b7531b474e48adb0838c110df3c3 in term 0.
I20260709 12:20:42.892066 17632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23fdbee0aed64eb7944d541434bc2eca" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d63a012a36464bb282cc473364dcbc1e" is_pre_election: true
I20260709 12:20:42.893677 17447 leader_election.cc:304] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, fc50b7531b474e48adb0838c110df3c3; no voters: 
I20260709 12:20:42.892079 17708 leader_election.cc:290] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
W20260709 12:20:42.894429 17448 leader_election.cc:343] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:42.894593 17707 raft_consensus.cc:2804] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:42.895010 17681 raft_consensus.cc:493] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.897362 17678 tablet_bootstrap.cc:654] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:42.895509 17707 raft_consensus.cc:493] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.899299 17707 raft_consensus.cc:3060] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:42.896003 17681 raft_consensus.cc:515] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
W20260709 12:20:42.902477 17447 consensus_peers.cc:597] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 -> Peer 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035): Couldn't send request to peer 63b3cdaff6e940b197c26c7eea9889f3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:42.903513 17681 leader_election.cc:290] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035)
I20260709 12:20:42.904306 17482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b59956b80d41dd899e6b77cbdbdd89" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc50b7531b474e48adb0838c110df3c3" is_pre_election: true
I20260709 12:20:42.905230 17557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b59956b80d41dd899e6b77cbdbdd89" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3" is_pre_election: true
W20260709 12:20:42.905748 17594 leader_election.cc:343] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:42.905856 17557 raft_consensus.cc:2468] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d63a012a36464bb282cc473364dcbc1e in term 0.
I20260709 12:20:42.907069 17596 leader_election.cc:304] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, d63a012a36464bb282cc473364dcbc1e; no voters: fc50b7531b474e48adb0838c110df3c3
I20260709 12:20:42.908560 17681 raft_consensus.cc:2804] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:42.909071 17681 raft_consensus.cc:493] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.912580 17681 raft_consensus.cc:3060] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:42.914117 17707 raft_consensus.cc:515] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.920774 17677 tablet_bootstrap.cc:492] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3: No bootstrap required, opened a new log
I20260709 12:20:42.921502 17677 ts_tablet_manager.cc:1403] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3: Time spent bootstrapping tablet: real 0.057s	user 0.016s	sys 0.022s
I20260709 12:20:42.916958 17708 consensus_queue.cc:1048] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:20:42.927644 17556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23fdbee0aed64eb7944d541434bc2eca" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
I20260709 12:20:42.928331 17556 raft_consensus.cc:3060] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:42.932415 17677 raft_consensus.cc:359] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.935907 17677 raft_consensus.cc:385] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:42.936050 17556 raft_consensus.cc:2468] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc50b7531b474e48adb0838c110df3c3 in term 1.
I20260709 12:20:42.924129 17681 raft_consensus.cc:515] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.937814 17447 leader_election.cc:304] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, fc50b7531b474e48adb0838c110df3c3; no voters: 
I20260709 12:20:42.939177 17681 leader_election.cc:290] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 election: Requested vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035)
I20260709 12:20:42.939951 17708 raft_consensus.cc:2804] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:42.936352 17677 raft_consensus.cc:740] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:42.940771 17708 raft_consensus.cc:697] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 1 LEADER]: Becoming Leader. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Running, Role: LEADER
I20260709 12:20:42.940996 17677 consensus_queue.cc:260] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.941622 17708 consensus_queue.cc:237] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.942332 17714 consensus_queue.cc:1048] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:20:42.943424 17677 ts_tablet_manager.cc:1434] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.005s
I20260709 12:20:42.944422 17677 tablet_bootstrap.cc:492] T 80e4d65e63294f1bb0cba6e869adc91b P fc50b7531b474e48adb0838c110df3c3: Bootstrap starting.
I20260709 12:20:42.948808 17482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b59956b80d41dd899e6b77cbdbdd89" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
I20260709 12:20:42.949370 17707 leader_election.cc:290] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 election: Requested vote from peers 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:42.949465 17482 raft_consensus.cc:3060] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:42.949769 17632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23fdbee0aed64eb7944d541434bc2eca" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
W20260709 12:20:42.951869 17448 leader_election.cc:343] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:42.965270 17482 raft_consensus.cc:2468] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d63a012a36464bb282cc473364dcbc1e in term 1.
I20260709 12:20:42.965976 17556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b59956b80d41dd899e6b77cbdbdd89" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
I20260709 12:20:42.966387 17594 leader_election.cc:304] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d63a012a36464bb282cc473364dcbc1e, fc50b7531b474e48adb0838c110df3c3; no voters: 
I20260709 12:20:42.966641 17556 raft_consensus.cc:3060] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:42.967229 17714 raft_consensus.cc:2804] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:42.967762 17714 raft_consensus.cc:697] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 1 LEADER]: Becoming Leader. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Running, Role: LEADER
I20260709 12:20:42.969715 17676 tablet_bootstrap.cc:492] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e: No bootstrap required, opened a new log
I20260709 12:20:42.970360 17676 ts_tablet_manager.cc:1403] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e: Time spent bootstrapping tablet: real 0.136s	user 0.021s	sys 0.000s
I20260709 12:20:42.968621 17714 consensus_queue.cc:237] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.992274 17556 raft_consensus.cc:2468] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d63a012a36464bb282cc473364dcbc1e in term 1.
I20260709 12:20:42.995289 17676 raft_consensus.cc:359] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.996038 17676 raft_consensus.cc:385] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:42.996317 17676 raft_consensus.cc:740] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Initialized, Role: FOLLOWER
I20260709 12:20:42.997107 17676 consensus_queue.cc:260] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:42.998045 17378 catalog_manager.cc:5697] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc50b7531b474e48adb0838c110df3c3 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "fc50b7531b474e48adb0838c110df3c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:42.999838 17676 ts_tablet_manager.cc:1434] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:20:43.005414 17677 tablet_bootstrap.cc:654] T 80e4d65e63294f1bb0cba6e869adc91b P fc50b7531b474e48adb0838c110df3c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:43.015868 17678 tablet_bootstrap.cc:492] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3: No bootstrap required, opened a new log
I20260709 12:20:43.028388 17683 consensus_queue.cc:1048] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:20:43.031282 17708 consensus_queue.cc:1048] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:43.034862 17376 catalog_manager.cc:5697] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e reported cstate change: term changed from 0 to 1, leader changed from <none> to d63a012a36464bb282cc473364dcbc1e (127.16.240.131). New cstate: current_term: 1 leader_uuid: "d63a012a36464bb282cc473364dcbc1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:43.030944 17678 ts_tablet_manager.cc:1403] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3: Time spent bootstrapping tablet: real 0.143s	user 0.011s	sys 0.022s
I20260709 12:20:43.052067 17678 raft_consensus.cc:359] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.052771 17678 raft_consensus.cc:385] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:43.053042 17678 raft_consensus.cc:740] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Initialized, Role: FOLLOWER
I20260709 12:20:43.054831 17678 consensus_queue.cc:260] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.057873 17678 ts_tablet_manager.cc:1434] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:20:43.060433 17678 tablet_bootstrap.cc:492] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3: Bootstrap starting.
I20260709 12:20:43.061105 17677 tablet_bootstrap.cc:492] T 80e4d65e63294f1bb0cba6e869adc91b P fc50b7531b474e48adb0838c110df3c3: No bootstrap required, opened a new log
I20260709 12:20:43.061570 17677 ts_tablet_manager.cc:1403] T 80e4d65e63294f1bb0cba6e869adc91b P fc50b7531b474e48adb0838c110df3c3: Time spent bootstrapping tablet: real 0.117s	user 0.020s	sys 0.000s
I20260709 12:20:43.064137 17677 raft_consensus.cc:359] T 80e4d65e63294f1bb0cba6e869adc91b P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.064885 17677 raft_consensus.cc:385] T 80e4d65e63294f1bb0cba6e869adc91b P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:43.065150 17677 raft_consensus.cc:740] T 80e4d65e63294f1bb0cba6e869adc91b P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:43.065776 17677 consensus_queue.cc:260] T 80e4d65e63294f1bb0cba6e869adc91b P fc50b7531b474e48adb0838c110df3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.067687 17678 tablet_bootstrap.cc:654] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:43.069036 17677 ts_tablet_manager.cc:1434] T 80e4d65e63294f1bb0cba6e869adc91b P fc50b7531b474e48adb0838c110df3c3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:43.080405 17678 tablet_bootstrap.cc:492] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3: No bootstrap required, opened a new log
I20260709 12:20:43.080899 17678 ts_tablet_manager.cc:1403] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 12:20:43.083541 17678 raft_consensus.cc:359] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.084272 17678 raft_consensus.cc:385] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:43.084545 17678 raft_consensus.cc:740] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Initialized, Role: FOLLOWER
I20260709 12:20:43.085436 17678 consensus_queue.cc:260] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.087786 17678 ts_tablet_manager.cc:1434] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:43.094602 17714 raft_consensus.cc:493] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.095139 17714 raft_consensus.cc:515] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.097267 17714 leader_election.cc:290] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035)
I20260709 12:20:43.097956 17481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23fdbee0aed64eb7944d541434bc2eca" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc50b7531b474e48adb0838c110df3c3" is_pre_election: true
I20260709 12:20:43.099905 17555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23fdbee0aed64eb7944d541434bc2eca" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3" is_pre_election: true
I20260709 12:20:43.101053 17555 raft_consensus.cc:2393] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d63a012a36464bb282cc473364dcbc1e in current term 1: Already voted for candidate fc50b7531b474e48adb0838c110df3c3 in this term.
I20260709 12:20:43.102280 17596 leader_election.cc:304] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d63a012a36464bb282cc473364dcbc1e; no voters: 63b3cdaff6e940b197c26c7eea9889f3, fc50b7531b474e48adb0838c110df3c3
I20260709 12:20:43.103170 17714 raft_consensus.cc:3060] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:43.109087 17714 raft_consensus.cc:2749] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:43.117610 17714 consensus_queue.cc:1048] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:43.118569 17681 raft_consensus.cc:493] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.119067 17681 raft_consensus.cc:515] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.121061 17681 leader_election.cc:290] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035)
I20260709 12:20:43.122252 17481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e7f42e0bcb4903912c56beb592ce5a" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc50b7531b474e48adb0838c110df3c3" is_pre_election: true
I20260709 12:20:43.122954 17481 raft_consensus.cc:2468] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d63a012a36464bb282cc473364dcbc1e in term 0.
I20260709 12:20:43.123878 17750 raft_consensus.cc:493] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.125073 17556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e7f42e0bcb4903912c56beb592ce5a" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3" is_pre_election: true
I20260709 12:20:43.126463 17556 raft_consensus.cc:2468] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d63a012a36464bb282cc473364dcbc1e in term 0.
I20260709 12:20:43.126266 17750 raft_consensus.cc:515] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.127460 17594 leader_election.cc:304] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d63a012a36464bb282cc473364dcbc1e, fc50b7531b474e48adb0838c110df3c3; no voters: 
I20260709 12:20:43.129870 17556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7bde90819e4906a5388c608a5b7a07" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3" is_pre_election: true
I20260709 12:20:43.130223 17681 raft_consensus.cc:2804] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:43.130755 17681 raft_consensus.cc:493] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.131132 17681 raft_consensus.cc:3060] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:43.133090 17632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7bde90819e4906a5388c608a5b7a07" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d63a012a36464bb282cc473364dcbc1e" is_pre_election: true
I20260709 12:20:43.135011 17448 leader_election.cc:304] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc50b7531b474e48adb0838c110df3c3; no voters: 63b3cdaff6e940b197c26c7eea9889f3, d63a012a36464bb282cc473364dcbc1e
I20260709 12:20:43.135591 17750 leader_election.cc:290] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:43.135833 17481 raft_consensus.cc:3060] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:43.140615 17681 raft_consensus.cc:515] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.143908 17482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e7f42e0bcb4903912c56beb592ce5a" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
I20260709 12:20:43.144829 17482 raft_consensus.cc:3060] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:43.150348 17681 leader_election.cc:290] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 election: Requested vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035)
I20260709 12:20:43.151993 17556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e7f42e0bcb4903912c56beb592ce5a" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
I20260709 12:20:43.152822 17556 raft_consensus.cc:3060] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:43.160203 17556 raft_consensus.cc:2468] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d63a012a36464bb282cc473364dcbc1e in term 1.
I20260709 12:20:43.154925 17681 consensus_queue.cc:1048] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:20:43.153389 17708 raft_consensus.cc:2749] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:43.161880 17596 leader_election.cc:304] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, d63a012a36464bb282cc473364dcbc1e; no voters: 
I20260709 12:20:43.162828 17714 raft_consensus.cc:2804] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:43.153260 17482 raft_consensus.cc:2468] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d63a012a36464bb282cc473364dcbc1e in term 1.
I20260709 12:20:43.164093 17714 raft_consensus.cc:697] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [term 1 LEADER]: Becoming Leader. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Running, Role: LEADER
I20260709 12:20:43.165654 17714 consensus_queue.cc:237] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.179597 17708 consensus_queue.cc:1048] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:43.188309 17378 catalog_manager.cc:5697] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e reported cstate change: term changed from 0 to 1, leader changed from <none> to d63a012a36464bb282cc473364dcbc1e (127.16.240.131). New cstate: current_term: 1 leader_uuid: "d63a012a36464bb282cc473364dcbc1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:43.190685 17556 raft_consensus.cc:3060] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:43.206106 17708 consensus_queue.cc:1048] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:43.233172 17723 raft_consensus.cc:493] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.234009 17723 raft_consensus.cc:515] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.237104 17723 leader_election.cc:290] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:43.237166 17481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e4d65e63294f1bb0cba6e869adc91b" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc50b7531b474e48adb0838c110df3c3" is_pre_election: true
I20260709 12:20:43.237937 17481 raft_consensus.cc:2468] T 80e4d65e63294f1bb0cba6e869adc91b P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 0.
I20260709 12:20:43.237799 17632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e4d65e63294f1bb0cba6e869adc91b" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d63a012a36464bb282cc473364dcbc1e" is_pre_election: true
I20260709 12:20:43.238584 17632 raft_consensus.cc:2468] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 0.
I20260709 12:20:43.239054 17520 leader_election.cc:304] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, fc50b7531b474e48adb0838c110df3c3; no voters: 
I20260709 12:20:43.239979 17723 raft_consensus.cc:2804] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:43.240406 17723 raft_consensus.cc:493] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.240732 17723 raft_consensus.cc:3060] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:43.247665 17723 raft_consensus.cc:515] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.249892 17723 leader_election.cc:290] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 1 election: Requested vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:43.250713 17481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e4d65e63294f1bb0cba6e869adc91b" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
I20260709 12:20:43.250962 17632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e4d65e63294f1bb0cba6e869adc91b" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
I20260709 12:20:43.251250 17481 raft_consensus.cc:3060] T 80e4d65e63294f1bb0cba6e869adc91b P fc50b7531b474e48adb0838c110df3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:43.251550 17632 raft_consensus.cc:3060] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:43.256211 17481 raft_consensus.cc:2468] T 80e4d65e63294f1bb0cba6e869adc91b P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 1.
I20260709 12:20:43.257287 17520 leader_election.cc:304] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, fc50b7531b474e48adb0838c110df3c3; no voters: 
I20260709 12:20:43.257985 17723 raft_consensus.cc:2804] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:43.257969 17632 raft_consensus.cc:2468] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 1.
I20260709 12:20:43.259682 17723 raft_consensus.cc:697] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 LEADER]: Becoming Leader. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Running, Role: LEADER
I20260709 12:20:43.260542 17723 consensus_queue.cc:237] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.269711 17376 catalog_manager.cc:5697] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "63b3cdaff6e940b197c26c7eea9889f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:43.382303 17714 consensus_queue.cc:1048] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:43.394138 17714 consensus_queue.cc:1048] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:43.422027 17556 raft_consensus.cc:3060] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:43.453661 17632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2de3e7d05e947efa97e42a696f6360b"
dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
mode: GRACEFUL
new_leader_uuid: "fc50b7531b474e48adb0838c110df3c3"
 from {username='slave'} at 127.0.0.1:56864
I20260709 12:20:43.454296 17632 raft_consensus.cc:606] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 1 LEADER]: Received request to transfer leadership to TS fc50b7531b474e48adb0838c110df3c3
I20260709 12:20:43.460160 17632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d7bde90819e4906a5388c608a5b7a07"
dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
mode: GRACEFUL
new_leader_uuid: "fc50b7531b474e48adb0838c110df3c3"
 from {username='slave'} at 127.0.0.1:56864
I20260709 12:20:43.461069 17632 raft_consensus.cc:606] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 1 LEADER]: Received request to transfer leadership to TS fc50b7531b474e48adb0838c110df3c3
I20260709 12:20:43.472196 17632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5e7f42e0bcb4903912c56beb592ce5a"
dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
mode: GRACEFUL
new_leader_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
 from {username='slave'} at 127.0.0.1:56864
I20260709 12:20:43.472738 17632 raft_consensus.cc:606] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [term 1 LEADER]: Received request to transfer leadership to TS 63b3cdaff6e940b197c26c7eea9889f3
I20260709 12:20:43.488111 17481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df95c0de53cc45e7bf9338f523ec21d6"
dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
mode: GRACEFUL
new_leader_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
 from {username='slave'} at 127.0.0.1:38308
I20260709 12:20:43.488749 17481 raft_consensus.cc:606] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 1 LEADER]: Received request to transfer leadership to TS 63b3cdaff6e940b197c26c7eea9889f3
I20260709 12:20:43.494812 17708 consensus_queue.cc:1048] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:43.495067 17481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8250d6ce783641dbb54f3075c37c2594"
dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
mode: GRACEFUL
new_leader_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
 from {username='slave'} at 127.0.0.1:38308
I20260709 12:20:43.495602 17481 raft_consensus.cc:606] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 1 LEADER]: Received request to transfer leadership to TS 63b3cdaff6e940b197c26c7eea9889f3
I20260709 12:20:43.503235 17631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3b59956b80d41dd899e6b77cbdbdd89"
dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
mode: GRACEFUL
new_leader_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
 from {username='slave'} at 127.0.0.1:56864
I20260709 12:20:43.503875 17631 raft_consensus.cc:606] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 1 LEADER]: Received request to transfer leadership to TS 63b3cdaff6e940b197c26c7eea9889f3
I20260709 12:20:43.510668 17708 consensus_queue.cc:1048] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:43.527953 17556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80e4d65e63294f1bb0cba6e869adc91b"
dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
mode: GRACEFUL
new_leader_uuid: "d63a012a36464bb282cc473364dcbc1e"
 from {username='slave'} at 127.0.0.1:55340
I20260709 12:20:43.528580 17556 raft_consensus.cc:606] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 LEADER]: Received request to transfer leadership to TS d63a012a36464bb282cc473364dcbc1e
I20260709 12:20:43.563889 17681 raft_consensus.cc:993] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e: : Instructing follower fc50b7531b474e48adb0838c110df3c3 to start an election
I20260709 12:20:43.564417 17681 raft_consensus.cc:1081] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 1 LEADER]: Signalling peer fc50b7531b474e48adb0838c110df3c3 to start an election
I20260709 12:20:43.566332 17481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2de3e7d05e947efa97e42a696f6360b"
dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
 from {username='slave'} at 127.0.0.1:38298
I20260709 12:20:43.566941 17481 raft_consensus.cc:493] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:43.567333 17481 raft_consensus.cc:3060] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.574538 17481 raft_consensus.cc:515] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } }
I20260709 12:20:43.576781 17481 leader_election.cc:290] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 2 election: Requested vote from peers d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511), 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035)
I20260709 12:20:43.577903 17631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2de3e7d05e947efa97e42a696f6360b" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
I20260709 12:20:43.579063 17631 raft_consensus.cc:3055] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:43.578063 17556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2de3e7d05e947efa97e42a696f6360b" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
I20260709 12:20:43.579473 17631 raft_consensus.cc:740] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Running, Role: LEADER
I20260709 12:20:43.579685 17556 raft_consensus.cc:3060] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.580415 17631 consensus_queue.cc:260] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } }
I20260709 12:20:43.581852 17631 raft_consensus.cc:3060] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.586839 17556 raft_consensus.cc:2468] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc50b7531b474e48adb0838c110df3c3 in term 2.
I20260709 12:20:43.588305 17447 leader_election.cc:304] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, fc50b7531b474e48adb0838c110df3c3; no voters: 
I20260709 12:20:43.588622 17631 raft_consensus.cc:2468] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc50b7531b474e48adb0838c110df3c3 in term 2.
I20260709 12:20:43.589246 17708 raft_consensus.cc:2804] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:43.589751 17708 raft_consensus.cc:697] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 2 LEADER]: Becoming Leader. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Running, Role: LEADER
I20260709 12:20:43.590556 17708 consensus_queue.cc:237] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } }
I20260709 12:20:43.597728 17378 catalog_manager.cc:5697] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 reported cstate change: term changed from 1 to 2, leader changed from d63a012a36464bb282cc473364dcbc1e (127.16.240.131) to fc50b7531b474e48adb0838c110df3c3 (127.16.240.129). New cstate: current_term: 2 leader_uuid: "fc50b7531b474e48adb0838c110df3c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:43.664386 17708 raft_consensus.cc:993] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3: : Instructing follower 63b3cdaff6e940b197c26c7eea9889f3 to start an election
I20260709 12:20:43.664853 17707 raft_consensus.cc:1081] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 1 LEADER]: Signalling peer 63b3cdaff6e940b197c26c7eea9889f3 to start an election
I20260709 12:20:43.666276 17556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df95c0de53cc45e7bf9338f523ec21d6"
dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
 from {username='slave'} at 127.0.0.1:55320
I20260709 12:20:43.666752 17556 raft_consensus.cc:493] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:43.667064 17556 raft_consensus.cc:3060] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.672473 17556 raft_consensus.cc:515] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.674593 17556 leader_election.cc:290] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 2 election: Requested vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:43.675065 17481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df95c0de53cc45e7bf9338f523ec21d6" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
I20260709 12:20:43.675246 17631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df95c0de53cc45e7bf9338f523ec21d6" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
I20260709 12:20:43.675721 17481 raft_consensus.cc:3055] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:43.675937 17631 raft_consensus.cc:3060] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.676128 17481 raft_consensus.cc:740] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Running, Role: LEADER
I20260709 12:20:43.676987 17481 consensus_queue.cc:260] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.678200 17481 raft_consensus.cc:3060] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.682251 17631 raft_consensus.cc:2468] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 2.
I20260709 12:20:43.683430 17523 leader_election.cc:304] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, d63a012a36464bb282cc473364dcbc1e; no voters: 
I20260709 12:20:43.684162 17723 raft_consensus.cc:2804] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:43.684635 17723 raft_consensus.cc:697] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Becoming Leader. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Running, Role: LEADER
I20260709 12:20:43.684625 17481 raft_consensus.cc:2468] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 2.
I20260709 12:20:43.685518 17723 consensus_queue.cc:237] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.692981 17378 catalog_manager.cc:5697] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 reported cstate change: term changed from 1 to 2, leader changed from fc50b7531b474e48adb0838c110df3c3 (127.16.240.129) to 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "63b3cdaff6e940b197c26c7eea9889f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:43.694986 17714 consensus_queue.cc:1048] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:43.717471 17681 consensus_queue.cc:1048] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:43.726037 17681 raft_consensus.cc:993] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e: : Instructing follower fc50b7531b474e48adb0838c110df3c3 to start an election
I20260709 12:20:43.726521 17710 raft_consensus.cc:1081] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 1 LEADER]: Signalling peer fc50b7531b474e48adb0838c110df3c3 to start an election
I20260709 12:20:43.728561 17481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d7bde90819e4906a5388c608a5b7a07"
dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
 from {username='slave'} at 127.0.0.1:38298
I20260709 12:20:43.729122 17481 raft_consensus.cc:493] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:43.729504 17481 raft_consensus.cc:3060] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.730674 17710 raft_consensus.cc:993] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e: : Instructing follower 63b3cdaff6e940b197c26c7eea9889f3 to start an election
I20260709 12:20:43.731127 17710 raft_consensus.cc:1081] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [term 1 LEADER]: Signalling peer 63b3cdaff6e940b197c26c7eea9889f3 to start an election
I20260709 12:20:43.732980 17555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5e7f42e0bcb4903912c56beb592ce5a"
dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
 from {username='slave'} at 127.0.0.1:55336
I20260709 12:20:43.733560 17555 raft_consensus.cc:493] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:43.733911 17555 raft_consensus.cc:3060] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.737185 17723 consensus_queue.cc:1048] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:43.738969 17481 raft_consensus.cc:515] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.740859 17555 raft_consensus.cc:515] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.741915 17481 leader_election.cc:290] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 2 election: Requested vote from peers 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:43.742937 17631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7bde90819e4906a5388c608a5b7a07" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
I20260709 12:20:43.744534 17631 raft_consensus.cc:3055] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:43.744864 17631 raft_consensus.cc:740] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Running, Role: LEADER
I20260709 12:20:43.745314 17555 leader_election.cc:290] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 2 election: Requested vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:43.746165 17631 consensus_queue.cc:260] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.748054 17632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e7f42e0bcb4903912c56beb592ce5a" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
I20260709 12:20:43.748894 17632 raft_consensus.cc:3055] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:43.749238 17631 raft_consensus.cc:3060] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.749310 17632 raft_consensus.cc:740] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Running, Role: LEADER
I20260709 12:20:43.750464 17481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e7f42e0bcb4903912c56beb592ce5a" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
I20260709 12:20:43.750373 17632 consensus_queue.cc:260] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.751072 17481 raft_consensus.cc:3060] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.751775 17632 raft_consensus.cc:3060] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.758993 17632 raft_consensus.cc:2468] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 2.
I20260709 12:20:43.760787 17523 leader_election.cc:304] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, d63a012a36464bb282cc473364dcbc1e; no voters: 
I20260709 12:20:43.761093 17555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7bde90819e4906a5388c608a5b7a07" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
I20260709 12:20:43.761760 17555 raft_consensus.cc:3060] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.762120 17723 raft_consensus.cc:2804] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:43.777132 17723 raft_consensus.cc:697] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Becoming Leader. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Running, Role: LEADER
I20260709 12:20:43.780364 17631 raft_consensus.cc:2468] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc50b7531b474e48adb0838c110df3c3 in term 2.
I20260709 12:20:43.781883 17448 leader_election.cc:304] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d63a012a36464bb282cc473364dcbc1e, fc50b7531b474e48adb0838c110df3c3; no voters: 
I20260709 12:20:43.780794 17723 consensus_queue.cc:237] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.783299 17707 raft_consensus.cc:2804] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:43.782393 17481 raft_consensus.cc:2468] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 2.
I20260709 12:20:43.783861 17707 raft_consensus.cc:697] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 2 LEADER]: Becoming Leader. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Running, Role: LEADER
I20260709 12:20:43.784861 17555 raft_consensus.cc:2468] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc50b7531b474e48adb0838c110df3c3 in term 2.
I20260709 12:20:43.784731 17707 consensus_queue.cc:237] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.789543 17771 consensus_queue.cc:1048] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:43.792706 17378 catalog_manager.cc:5697] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 reported cstate change: term changed from 1 to 2, leader changed from d63a012a36464bb282cc473364dcbc1e (127.16.240.131) to fc50b7531b474e48adb0838c110df3c3 (127.16.240.129). New cstate: current_term: 2 leader_uuid: "fc50b7531b474e48adb0838c110df3c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:43.801303 17376 catalog_manager.cc:5697] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3 reported cstate change: term changed from 1 to 2, leader changed from d63a012a36464bb282cc473364dcbc1e (127.16.240.131) to 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "63b3cdaff6e940b197c26c7eea9889f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:43.810103 17723 raft_consensus.cc:993] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3: : Instructing follower d63a012a36464bb282cc473364dcbc1e to start an election
I20260709 12:20:43.810560 17723 raft_consensus.cc:1081] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 LEADER]: Signalling peer d63a012a36464bb282cc473364dcbc1e to start an election
I20260709 12:20:43.812254 17631 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80e4d65e63294f1bb0cba6e869adc91b"
dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
 from {username='slave'} at 127.0.0.1:56856
I20260709 12:20:43.812839 17631 raft_consensus.cc:493] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:43.813207 17631 raft_consensus.cc:3060] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.822094 17631 raft_consensus.cc:515] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.826133 17555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e4d65e63294f1bb0cba6e869adc91b" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
I20260709 12:20:43.825974 17481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e4d65e63294f1bb0cba6e869adc91b" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
I20260709 12:20:43.826773 17555 raft_consensus.cc:3055] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:43.827128 17555 raft_consensus.cc:740] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Running, Role: LEADER
I20260709 12:20:43.827214 17481 raft_consensus.cc:3060] T 80e4d65e63294f1bb0cba6e869adc91b P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.827978 17555 consensus_queue.cc:260] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.829066 17555 raft_consensus.cc:3060] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.831799 17631 leader_election.cc:290] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 2 election: Requested vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035)
I20260709 12:20:43.834483 17481 raft_consensus.cc:2468] T 80e4d65e63294f1bb0cba6e869adc91b P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d63a012a36464bb282cc473364dcbc1e in term 2.
I20260709 12:20:43.835621 17594 leader_election.cc:304] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d63a012a36464bb282cc473364dcbc1e, fc50b7531b474e48adb0838c110df3c3; no voters: 
I20260709 12:20:43.835738 17555 raft_consensus.cc:2468] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d63a012a36464bb282cc473364dcbc1e in term 2.
I20260709 12:20:43.836500 17710 raft_consensus.cc:2804] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:43.837039 17710 raft_consensus.cc:697] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [term 2 LEADER]: Becoming Leader. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Running, Role: LEADER
I20260709 12:20:43.837857 17710 consensus_queue.cc:237] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.844666 17376 catalog_manager.cc:5697] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e reported cstate change: term changed from 1 to 2, leader changed from 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130) to d63a012a36464bb282cc473364dcbc1e (127.16.240.131). New cstate: current_term: 2 leader_uuid: "d63a012a36464bb282cc473364dcbc1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:43.875559 17707 raft_consensus.cc:993] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3: : Instructing follower 63b3cdaff6e940b197c26c7eea9889f3 to start an election
I20260709 12:20:43.876063 17708 raft_consensus.cc:1081] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 1 LEADER]: Signalling peer 63b3cdaff6e940b197c26c7eea9889f3 to start an election
I20260709 12:20:43.877913 17555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8250d6ce783641dbb54f3075c37c2594"
dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
 from {username='slave'} at 127.0.0.1:55320
I20260709 12:20:43.878583 17555 raft_consensus.cc:493] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:43.878978 17555 raft_consensus.cc:3060] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.886401 17555 raft_consensus.cc:515] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.889612 17555 leader_election.cc:290] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 2 election: Requested vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:43.890377 17631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8250d6ce783641dbb54f3075c37c2594" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
I20260709 12:20:43.889729 17481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8250d6ce783641dbb54f3075c37c2594" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
I20260709 12:20:43.890969 17631 raft_consensus.cc:3060] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.891307 17481 raft_consensus.cc:3055] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:43.891781 17481 raft_consensus.cc:740] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Running, Role: LEADER
I20260709 12:20:43.892825 17481 consensus_queue.cc:260] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.893814 17481 raft_consensus.cc:3060] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.898155 17631 raft_consensus.cc:2468] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 2.
I20260709 12:20:43.899729 17523 leader_election.cc:304] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, d63a012a36464bb282cc473364dcbc1e; no voters: 
I20260709 12:20:43.900585 17771 raft_consensus.cc:2804] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:43.900631 17481 raft_consensus.cc:2468] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 2.
I20260709 12:20:43.901178 17771 raft_consensus.cc:697] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Becoming Leader. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Running, Role: LEADER
I20260709 12:20:43.902570 17771 consensus_queue.cc:237] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.909838 17376 catalog_manager.cc:5697] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 reported cstate change: term changed from 1 to 2, leader changed from fc50b7531b474e48adb0838c110df3c3 (127.16.240.129) to 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "63b3cdaff6e940b197c26c7eea9889f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:43.928565 17681 raft_consensus.cc:993] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e: : Instructing follower 63b3cdaff6e940b197c26c7eea9889f3 to start an election
I20260709 12:20:43.929059 17710 raft_consensus.cc:1081] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 1 LEADER]: Signalling peer 63b3cdaff6e940b197c26c7eea9889f3 to start an election
I20260709 12:20:43.930800 17555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3b59956b80d41dd899e6b77cbdbdd89"
dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
 from {username='slave'} at 127.0.0.1:55336
I20260709 12:20:43.931360 17555 raft_consensus.cc:493] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:43.931798 17555 raft_consensus.cc:3060] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.937566 17555 raft_consensus.cc:515] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.940343 17555 leader_election.cc:290] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 2 election: Requested vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:43.940737 17481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b59956b80d41dd899e6b77cbdbdd89" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
I20260709 12:20:43.941062 17631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b59956b80d41dd899e6b77cbdbdd89" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
I20260709 12:20:43.941569 17481 raft_consensus.cc:3060] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.942059 17631 raft_consensus.cc:3055] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:43.942445 17631 raft_consensus.cc:740] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Running, Role: LEADER
I20260709 12:20:43.947971 17481 raft_consensus.cc:2468] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 2.
I20260709 12:20:43.947659 17631 consensus_queue.cc:260] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.949165 17631 raft_consensus.cc:3060] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.949373 17520 leader_election.cc:304] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, fc50b7531b474e48adb0838c110df3c3; no voters: 
I20260709 12:20:43.950232 17771 raft_consensus.cc:2804] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:43.950707 17771 raft_consensus.cc:697] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Becoming Leader. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Running, Role: LEADER
I20260709 12:20:43.952693 17771 consensus_queue.cc:237] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:43.955678 17631 raft_consensus.cc:2468] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 2.
I20260709 12:20:43.961238 17376 catalog_manager.cc:5697] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 reported cstate change: term changed from 1 to 2, leader changed from d63a012a36464bb282cc473364dcbc1e (127.16.240.131) to 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "63b3cdaff6e940b197c26c7eea9889f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:43.986577 17631 raft_consensus.cc:1275] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Refusing update from remote peer fc50b7531b474e48adb0838c110df3c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:43.991173 17707 consensus_queue.cc:1048] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:44.012033 17555 raft_consensus.cc:1275] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Refusing update from remote peer fc50b7531b474e48adb0838c110df3c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:44.014212 17708 consensus_queue.cc:1048] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:44.164781 17481 raft_consensus.cc:1275] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Refusing update from remote peer 63b3cdaff6e940b197c26c7eea9889f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:44.166179 17771 consensus_queue.cc:1048] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:44.173933 17631 raft_consensus.cc:1275] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Refusing update from remote peer 63b3cdaff6e940b197c26c7eea9889f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:44.175519 17772 consensus_queue.cc:1048] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:44.218308 17631 raft_consensus.cc:1275] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Refusing update from remote peer fc50b7531b474e48adb0838c110df3c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:44.219702 17708 consensus_queue.cc:1048] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:44.229722 17555 raft_consensus.cc:1275] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Refusing update from remote peer fc50b7531b474e48adb0838c110df3c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:44.231200 17750 consensus_queue.cc:1048] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:44.317313 17631 raft_consensus.cc:1275] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Refusing update from remote peer 63b3cdaff6e940b197c26c7eea9889f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:44.318586 17772 consensus_queue.cc:1048] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:44.327104 17481 raft_consensus.cc:1275] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Refusing update from remote peer 63b3cdaff6e940b197c26c7eea9889f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:44.328621 17772 consensus_queue.cc:1048] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:44.384310 17631 raft_consensus.cc:1275] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Refusing update from remote peer 63b3cdaff6e940b197c26c7eea9889f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:44.385670 17772 consensus_queue.cc:1048] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:44.394797 17481 raft_consensus.cc:1275] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Refusing update from remote peer 63b3cdaff6e940b197c26c7eea9889f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:44.397071 17723 consensus_queue.cc:1048] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:44.440225 17481 raft_consensus.cc:1275] T 80e4d65e63294f1bb0cba6e869adc91b P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Refusing update from remote peer d63a012a36464bb282cc473364dcbc1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:44.441556 17710 consensus_queue.cc:1048] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:44.452507 17555 raft_consensus.cc:1275] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Refusing update from remote peer d63a012a36464bb282cc473364dcbc1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:44.454524 17783 consensus_queue.cc:1048] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:44.486791 17481 raft_consensus.cc:1275] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Refusing update from remote peer 63b3cdaff6e940b197c26c7eea9889f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:44.488868 17723 consensus_queue.cc:1048] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:44.498014 17631 raft_consensus.cc:1275] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Refusing update from remote peer 63b3cdaff6e940b197c26c7eea9889f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:44.499696 17779 consensus_queue.cc:1048] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:46.565126 17346 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:20:46.566036 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:46.589636 17482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d7bde90819e4906a5388c608a5b7a07"
dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
mode: GRACEFUL
new_leader_uuid: "d63a012a36464bb282cc473364dcbc1e"
 from {username='slave'} at 127.0.0.1:38318
I20260709 12:20:46.590241 17482 raft_consensus.cc:606] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 2 LEADER]: Received request to transfer leadership to TS d63a012a36464bb282cc473364dcbc1e
I20260709 12:20:46.602095 17556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df95c0de53cc45e7bf9338f523ec21d6"
dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
mode: GRACEFUL
new_leader_uuid: "d63a012a36464bb282cc473364dcbc1e"
 from {username='slave'} at 127.0.0.1:55352
I20260709 12:20:46.602732 17556 raft_consensus.cc:606] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Received request to transfer leadership to TS d63a012a36464bb282cc473364dcbc1e
I20260709 12:20:46.603963 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:20:46.604437 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:46.813580 17787 raft_consensus.cc:993] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3: : Instructing follower d63a012a36464bb282cc473364dcbc1e to start an election
I20260709 12:20:46.814057 17723 raft_consensus.cc:1081] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Signalling peer d63a012a36464bb282cc473364dcbc1e to start an election
I20260709 12:20:46.816042 17631 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df95c0de53cc45e7bf9338f523ec21d6"
dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
 from {username='slave'} at 127.0.0.1:56856
I20260709 12:20:46.816565 17631 raft_consensus.cc:493] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:46.817061 17631 raft_consensus.cc:3060] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:46.823073 17631 raft_consensus.cc:515] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:46.824503 17631 leader_election.cc:290] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 3 election: Requested vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035)
I20260709 12:20:46.825680 17482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df95c0de53cc45e7bf9338f523ec21d6" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
I20260709 12:20:46.825842 17556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df95c0de53cc45e7bf9338f523ec21d6" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
I20260709 12:20:46.826439 17482 raft_consensus.cc:3060] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:46.826520 17556 raft_consensus.cc:3055] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:46.826876 17556 raft_consensus.cc:740] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Running, Role: LEADER
I20260709 12:20:46.827509 17556 consensus_queue.cc:260] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:46.828485 17556 raft_consensus.cc:3060] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:46.831929 17482 raft_consensus.cc:2468] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d63a012a36464bb282cc473364dcbc1e in term 3.
I20260709 12:20:46.833349 17556 raft_consensus.cc:2468] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d63a012a36464bb282cc473364dcbc1e in term 3.
I20260709 12:20:46.833820 17594 leader_election.cc:304] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d63a012a36464bb282cc473364dcbc1e, fc50b7531b474e48adb0838c110df3c3; no voters: 
I20260709 12:20:46.834673 17710 raft_consensus.cc:2804] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:46.835705 17710 raft_consensus.cc:697] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 3 LEADER]: Becoming Leader. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Running, Role: LEADER
I20260709 12:20:46.836474 17710 consensus_queue.cc:237] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:46.844900 17378 catalog_manager.cc:5697] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e reported cstate change: term changed from 2 to 3, leader changed from 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130) to d63a012a36464bb282cc473364dcbc1e (127.16.240.131). New cstate: current_term: 3 leader_uuid: "d63a012a36464bb282cc473364dcbc1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:46.956877 17788 raft_consensus.cc:993] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3: : Instructing follower d63a012a36464bb282cc473364dcbc1e to start an election
I20260709 12:20:46.957365 17799 raft_consensus.cc:1081] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 2 LEADER]: Signalling peer d63a012a36464bb282cc473364dcbc1e to start an election
I20260709 12:20:46.959015 17631 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d7bde90819e4906a5388c608a5b7a07"
dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
 from {username='slave'} at 127.0.0.1:56854
I20260709 12:20:46.959475 17631 raft_consensus.cc:493] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:46.959755 17631 raft_consensus.cc:3060] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:46.963855 17631 raft_consensus.cc:515] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:46.965598 17631 leader_election.cc:290] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 3 election: Requested vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035)
I20260709 12:20:46.966528 17482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7bde90819e4906a5388c608a5b7a07" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
I20260709 12:20:46.966821 17556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7bde90819e4906a5388c608a5b7a07" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
I20260709 12:20:46.967200 17482 raft_consensus.cc:3055] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:46.967350 17556 raft_consensus.cc:3060] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:46.967572 17482 raft_consensus.cc:740] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Running, Role: LEADER
I20260709 12:20:46.968453 17482 consensus_queue.cc:260] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:46.969687 17482 raft_consensus.cc:3060] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:46.974571 17556 raft_consensus.cc:2468] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d63a012a36464bb282cc473364dcbc1e in term 3.
I20260709 12:20:46.975893 17596 leader_election.cc:304] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, d63a012a36464bb282cc473364dcbc1e; no voters: 
I20260709 12:20:46.976708 17482 raft_consensus.cc:2468] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d63a012a36464bb282cc473364dcbc1e in term 3.
I20260709 12:20:46.976794 17710 raft_consensus.cc:2804] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:46.977388 17710 raft_consensus.cc:697] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 3 LEADER]: Becoming Leader. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Running, Role: LEADER
I20260709 12:20:46.978143 17710 consensus_queue.cc:237] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:46.985850 17378 catalog_manager.cc:5697] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e reported cstate change: term changed from 2 to 3, leader changed from fc50b7531b474e48adb0838c110df3c3 (127.16.240.129) to d63a012a36464bb282cc473364dcbc1e (127.16.240.131). New cstate: current_term: 3 leader_uuid: "d63a012a36464bb282cc473364dcbc1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:47.332563 17556 raft_consensus.cc:1275] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Refusing update from remote peer d63a012a36464bb282cc473364dcbc1e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:47.333947 17710 consensus_queue.cc:1048] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:47.345482 17482 raft_consensus.cc:1275] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 3 FOLLOWER]: Refusing update from remote peer d63a012a36464bb282cc473364dcbc1e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:47.346840 17792 consensus_queue.cc:1048] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:47.462076 17556 raft_consensus.cc:1275] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Refusing update from remote peer d63a012a36464bb282cc473364dcbc1e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:47.463436 17792 consensus_queue.cc:1048] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:47.474448 17482 raft_consensus.cc:1275] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 3 FOLLOWER]: Refusing update from remote peer d63a012a36464bb282cc473364dcbc1e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:47.477301 17807 consensus_queue.cc:1048] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:47.605381 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:47.611557 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:47.611950 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:48.612897 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:48.619114 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:48.619601 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:49.621042 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:49.626703 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:49.627084 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:50.628340 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:50.633350 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:50.634016 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:51.635149 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:51.641638 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:51.642014 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:52.642976 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:52.648599 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:52.649056 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:53.650121 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:53.656041 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:53.656649 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:54.657862 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:54.664309 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:54.664795 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:55.665930 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:55.671049 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:55.671514 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:56.703605 17346 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:20:56.708877 17482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2de3e7d05e947efa97e42a696f6360b"
dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
mode: GRACEFUL
new_leader_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
 from {username='slave'} at 127.0.0.1:38308
I20260709 12:20:56.709625 17482 raft_consensus.cc:606] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 2 LEADER]: Received request to transfer leadership to TS 63b3cdaff6e940b197c26c7eea9889f3
I20260709 12:20:56.715234 17631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d7bde90819e4906a5388c608a5b7a07"
dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
mode: GRACEFUL
new_leader_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
 from {username='slave'} at 127.0.0.1:56864
I20260709 12:20:56.715682 17631 raft_consensus.cc:606] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 3 LEADER]: Received request to transfer leadership to TS 63b3cdaff6e940b197c26c7eea9889f3
I20260709 12:20:56.720988 17482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23fdbee0aed64eb7944d541434bc2eca"
dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
mode: GRACEFUL
new_leader_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
 from {username='slave'} at 127.0.0.1:38308
I20260709 12:20:56.721418 17482 raft_consensus.cc:606] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 1 LEADER]: Received request to transfer leadership to TS 63b3cdaff6e940b197c26c7eea9889f3
I20260709 12:20:56.726506 17482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "497230b8fcb8404297bb61cf04549f78"
dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
mode: GRACEFUL
new_leader_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
 from {username='slave'} at 127.0.0.1:38308
I20260709 12:20:56.726986 17482 raft_consensus.cc:606] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [term 1 LEADER]: Received request to transfer leadership to TS 63b3cdaff6e940b197c26c7eea9889f3
I20260709 12:20:56.735020 17631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df95c0de53cc45e7bf9338f523ec21d6"
dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
mode: GRACEFUL
new_leader_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
 from {username='slave'} at 127.0.0.1:56864
I20260709 12:20:56.735530 17631 raft_consensus.cc:606] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 3 LEADER]: Received request to transfer leadership to TS 63b3cdaff6e940b197c26c7eea9889f3
I20260709 12:20:56.838491 17815 raft_consensus.cc:993] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e: : Instructing follower 63b3cdaff6e940b197c26c7eea9889f3 to start an election
I20260709 12:20:56.839005 17816 raft_consensus.cc:1081] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 3 LEADER]: Signalling peer 63b3cdaff6e940b197c26c7eea9889f3 to start an election
I20260709 12:20:56.840556 17555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df95c0de53cc45e7bf9338f523ec21d6"
dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
 from {username='slave'} at 127.0.0.1:55336
I20260709 12:20:56.840984 17555 raft_consensus.cc:493] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:56.841253 17555 raft_consensus.cc:3060] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:56.846014 17555 raft_consensus.cc:515] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:56.847827 17555 leader_election.cc:290] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 4 election: Requested vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:56.849205 17631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df95c0de53cc45e7bf9338f523ec21d6" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
I20260709 12:20:56.849169 17482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df95c0de53cc45e7bf9338f523ec21d6" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
I20260709 12:20:56.850116 17631 raft_consensus.cc:3055] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:56.850179 17482 raft_consensus.cc:3060] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:56.850526 17631 raft_consensus.cc:740] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Running, Role: LEADER
I20260709 12:20:56.851398 17631 consensus_queue.cc:260] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:56.853080 17631 raft_consensus.cc:3060] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:56.857215 17482 raft_consensus.cc:2468] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 4.
I20260709 12:20:56.858728 17520 leader_election.cc:304] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, fc50b7531b474e48adb0838c110df3c3; no voters: 
I20260709 12:20:56.859661 17631 raft_consensus.cc:2468] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 4.
I20260709 12:20:56.859688 17810 raft_consensus.cc:2804] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:56.861511 17810 raft_consensus.cc:697] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 4 LEADER]: Becoming Leader. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Running, Role: LEADER
I20260709 12:20:56.863013 17810 consensus_queue.cc:237] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:56.870951 17378 catalog_manager.cc:5697] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 reported cstate change: term changed from 3 to 4, leader changed from d63a012a36464bb282cc473364dcbc1e (127.16.240.131) to 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130). New cstate: current_term: 4 leader_uuid: "63b3cdaff6e940b197c26c7eea9889f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:56.897020 17813 raft_consensus.cc:993] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3: : Instructing follower 63b3cdaff6e940b197c26c7eea9889f3 to start an election
I20260709 12:20:56.897612 17823 raft_consensus.cc:1081] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [term 1 LEADER]: Signalling peer 63b3cdaff6e940b197c26c7eea9889f3 to start an election
I20260709 12:20:56.899211 17555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "497230b8fcb8404297bb61cf04549f78"
dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
 from {username='slave'} at 127.0.0.1:55320
I20260709 12:20:56.899698 17555 raft_consensus.cc:493] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:56.900051 17555 raft_consensus.cc:3060] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:56.904683 17555 raft_consensus.cc:515] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:56.906483 17555 leader_election.cc:290] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 2 election: Requested vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:56.907274 17482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497230b8fcb8404297bb61cf04549f78" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
I20260709 12:20:56.907369 17631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497230b8fcb8404297bb61cf04549f78" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
I20260709 12:20:56.907883 17482 raft_consensus.cc:3055] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:56.907925 17631 raft_consensus.cc:3060] T 497230b8fcb8404297bb61cf04549f78 P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:56.908322 17482 raft_consensus.cc:740] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Running, Role: LEADER
I20260709 12:20:56.909053 17482 consensus_queue.cc:260] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:56.910454 17482 raft_consensus.cc:3060] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:56.910990 17813 raft_consensus.cc:993] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3: : Instructing follower 63b3cdaff6e940b197c26c7eea9889f3 to start an election
I20260709 12:20:56.911445 17823 raft_consensus.cc:1081] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 1 LEADER]: Signalling peer 63b3cdaff6e940b197c26c7eea9889f3 to start an election
I20260709 12:20:56.913085 17555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23fdbee0aed64eb7944d541434bc2eca"
dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
 from {username='slave'} at 127.0.0.1:55320
I20260709 12:20:56.913594 17555 raft_consensus.cc:493] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:56.913908 17555 raft_consensus.cc:3060] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:56.914335 17631 raft_consensus.cc:2468] T 497230b8fcb8404297bb61cf04549f78 P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 2.
I20260709 12:20:56.915496 17523 leader_election.cc:304] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, d63a012a36464bb282cc473364dcbc1e; no voters: 
I20260709 12:20:56.916282 17810 raft_consensus.cc:2804] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:56.916684 17482 raft_consensus.cc:2468] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 2.
I20260709 12:20:56.916725 17810 raft_consensus.cc:697] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Becoming Leader. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Running, Role: LEADER
I20260709 12:20:56.917964 17810 consensus_queue.cc:237] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:56.919400 17555 raft_consensus.cc:515] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:56.921406 17555 leader_election.cc:290] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 2 election: Requested vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:56.922029 17631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23fdbee0aed64eb7944d541434bc2eca" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
I20260709 12:20:56.921747 17482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23fdbee0aed64eb7944d541434bc2eca" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
I20260709 12:20:56.922976 17631 raft_consensus.cc:3060] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:56.923110 17482 raft_consensus.cc:3055] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:56.923883 17482 raft_consensus.cc:740] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Running, Role: LEADER
I20260709 12:20:56.924676 17482 consensus_queue.cc:260] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:56.925570 17482 raft_consensus.cc:3060] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:56.928089 17631 raft_consensus.cc:2468] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 2.
I20260709 12:20:56.929078 17523 leader_election.cc:304] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, d63a012a36464bb282cc473364dcbc1e; no voters: 
I20260709 12:20:56.929885 17810 raft_consensus.cc:2804] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:56.930181 17482 raft_consensus.cc:2468] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 2.
I20260709 12:20:56.930343 17810 raft_consensus.cc:697] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Becoming Leader. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Running, Role: LEADER
I20260709 12:20:56.931304 17810 consensus_queue.cc:237] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:56.932722 17378 catalog_manager.cc:5697] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 reported cstate change: term changed from 1 to 2, leader changed from fc50b7531b474e48adb0838c110df3c3 (127.16.240.129) to 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "63b3cdaff6e940b197c26c7eea9889f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:56.945473 17378 catalog_manager.cc:5697] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 reported cstate change: term changed from 1 to 2, leader changed from fc50b7531b474e48adb0838c110df3c3 (127.16.240.129) to 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "63b3cdaff6e940b197c26c7eea9889f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:56.985787 17815 raft_consensus.cc:993] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e: : Instructing follower 63b3cdaff6e940b197c26c7eea9889f3 to start an election
I20260709 12:20:56.986253 17816 raft_consensus.cc:1081] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 3 LEADER]: Signalling peer 63b3cdaff6e940b197c26c7eea9889f3 to start an election
I20260709 12:20:56.987731 17555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d7bde90819e4906a5388c608a5b7a07"
dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
 from {username='slave'} at 127.0.0.1:55336
I20260709 12:20:56.988219 17555 raft_consensus.cc:493] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:56.988502 17555 raft_consensus.cc:3060] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:56.993834 17555 raft_consensus.cc:515] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:56.995313 17555 leader_election.cc:290] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 4 election: Requested vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:56.996191 17482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7bde90819e4906a5388c608a5b7a07" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
I20260709 12:20:56.996346 17631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7bde90819e4906a5388c608a5b7a07" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
I20260709 12:20:56.996721 17482 raft_consensus.cc:3060] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:56.996901 17631 raft_consensus.cc:3055] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:56.997269 17631 raft_consensus.cc:740] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Running, Role: LEADER
I20260709 12:20:56.998004 17631 consensus_queue.cc:260] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:56.998917 17631 raft_consensus.cc:3060] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:57.001322 17482 raft_consensus.cc:2468] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 4.
I20260709 12:20:57.002266 17520 leader_election.cc:304] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, fc50b7531b474e48adb0838c110df3c3; no voters: 
I20260709 12:20:57.002959 17810 raft_consensus.cc:2804] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:57.003413 17631 raft_consensus.cc:2468] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 4.
I20260709 12:20:57.003684 17810 raft_consensus.cc:697] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 4 LEADER]: Becoming Leader. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Running, Role: LEADER
I20260709 12:20:57.004734 17810 consensus_queue.cc:237] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:57.011602 17378 catalog_manager.cc:5697] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 reported cstate change: term changed from 3 to 4, leader changed from d63a012a36464bb282cc473364dcbc1e (127.16.240.131) to 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130). New cstate: current_term: 4 leader_uuid: "63b3cdaff6e940b197c26c7eea9889f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:57.201570 17813 raft_consensus.cc:993] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3: : Instructing follower 63b3cdaff6e940b197c26c7eea9889f3 to start an election
I20260709 12:20:57.202037 17823 raft_consensus.cc:1081] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 2 LEADER]: Signalling peer 63b3cdaff6e940b197c26c7eea9889f3 to start an election
I20260709 12:20:57.203508 17555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2de3e7d05e947efa97e42a696f6360b"
dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
 from {username='slave'} at 127.0.0.1:55320
I20260709 12:20:57.204064 17555 raft_consensus.cc:493] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:57.204322 17555 raft_consensus.cc:3060] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:57.210345 17555 raft_consensus.cc:515] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } }
I20260709 12:20:57.212957 17555 leader_election.cc:290] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 3 election: Requested vote from peers d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511), fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849)
I20260709 12:20:57.213944 17631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2de3e7d05e947efa97e42a696f6360b" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
I20260709 12:20:57.213966 17482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2de3e7d05e947efa97e42a696f6360b" candidate_uuid: "63b3cdaff6e940b197c26c7eea9889f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
I20260709 12:20:57.214564 17631 raft_consensus.cc:3060] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:57.214640 17482 raft_consensus.cc:3055] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:57.214985 17482 raft_consensus.cc:740] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Running, Role: LEADER
I20260709 12:20:57.215564 17482 consensus_queue.cc:260] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } }
I20260709 12:20:57.216516 17482 raft_consensus.cc:3060] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:57.219352 17631 raft_consensus.cc:2468] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 3.
I20260709 12:20:57.220522 17523 leader_election.cc:304] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, d63a012a36464bb282cc473364dcbc1e; no voters: 
I20260709 12:20:57.220634 17482 raft_consensus.cc:2468] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63b3cdaff6e940b197c26c7eea9889f3 in term 3.
I20260709 12:20:57.221506 17810 raft_consensus.cc:2804] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:57.222227 17810 raft_consensus.cc:697] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 LEADER]: Becoming Leader. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Running, Role: LEADER
I20260709 12:20:57.223169 17810 consensus_queue.cc:237] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } }
I20260709 12:20:57.231150 17378 catalog_manager.cc:5697] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 reported cstate change: term changed from 2 to 3, leader changed from fc50b7531b474e48adb0838c110df3c3 (127.16.240.129) to 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130). New cstate: current_term: 3 leader_uuid: "63b3cdaff6e940b197c26c7eea9889f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:57.298832 17482 raft_consensus.cc:1275] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 4 FOLLOWER]: Refusing update from remote peer 63b3cdaff6e940b197c26c7eea9889f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:57.300088 17810 consensus_queue.cc:1048] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:57.310882 17631 raft_consensus.cc:1275] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 4 FOLLOWER]: Refusing update from remote peer 63b3cdaff6e940b197c26c7eea9889f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:57.312451 17810 consensus_queue.cc:1048] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:57.384145 17631 raft_consensus.cc:1275] T 497230b8fcb8404297bb61cf04549f78 P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Refusing update from remote peer 63b3cdaff6e940b197c26c7eea9889f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:57.385828 17810 consensus_queue.cc:1048] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:57.395429 17482 raft_consensus.cc:1275] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Refusing update from remote peer 63b3cdaff6e940b197c26c7eea9889f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:57.397879 17831 consensus_queue.cc:1048] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:57.492309 17482 raft_consensus.cc:1275] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 4 FOLLOWER]: Refusing update from remote peer 63b3cdaff6e940b197c26c7eea9889f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:57.493616 17831 consensus_queue.cc:1048] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:57.498585 17481 raft_consensus.cc:1275] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Refusing update from remote peer 63b3cdaff6e940b197c26c7eea9889f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:57.500569 17817 consensus_queue.cc:1048] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:57.505733 17631 raft_consensus.cc:1275] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 4 FOLLOWER]: Refusing update from remote peer 63b3cdaff6e940b197c26c7eea9889f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:57.507800 17810 consensus_queue.cc:1048] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:57.517541 17632 raft_consensus.cc:1275] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Refusing update from remote peer 63b3cdaff6e940b197c26c7eea9889f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:57.519251 17817 consensus_queue.cc:1048] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:57.771838 17481 raft_consensus.cc:1275] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 3 FOLLOWER]: Refusing update from remote peer 63b3cdaff6e940b197c26c7eea9889f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:57.773232 17838 consensus_queue.cc:1048] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:57.782460 17631 raft_consensus.cc:1275] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 3 FOLLOWER]: Refusing update from remote peer 63b3cdaff6e940b197c26c7eea9889f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:57.784883 17838 consensus_queue.cc:1048] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:59.780072 17346 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:20:59.780988 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:59.788211 17555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23fdbee0aed64eb7944d541434bc2eca"
dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
mode: GRACEFUL
new_leader_uuid: "fc50b7531b474e48adb0838c110df3c3"
 from {username='slave'} at 127.0.0.1:55352
I20260709 12:20:59.788932 17555 raft_consensus.cc:606] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Received request to transfer leadership to TS fc50b7531b474e48adb0838c110df3c3
I20260709 12:20:59.792586 17555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d7bde90819e4906a5388c608a5b7a07"
dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
mode: GRACEFUL
new_leader_uuid: "d63a012a36464bb282cc473364dcbc1e"
 from {username='slave'} at 127.0.0.1:55352
I20260709 12:20:59.793139 17555 raft_consensus.cc:606] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 4 LEADER]: Received request to transfer leadership to TS d63a012a36464bb282cc473364dcbc1e
I20260709 12:20:59.796427 17555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8250d6ce783641dbb54f3075c37c2594"
dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
mode: GRACEFUL
new_leader_uuid: "fc50b7531b474e48adb0838c110df3c3"
 from {username='slave'} at 127.0.0.1:55352
I20260709 12:20:59.797019 17555 raft_consensus.cc:606] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Received request to transfer leadership to TS fc50b7531b474e48adb0838c110df3c3
I20260709 12:20:59.799896 17838 raft_consensus.cc:993] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3: : Instructing follower d63a012a36464bb282cc473364dcbc1e to start an election
I20260709 12:20:59.800326 17555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2de3e7d05e947efa97e42a696f6360b"
dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
mode: GRACEFUL
new_leader_uuid: "d63a012a36464bb282cc473364dcbc1e"
 from {username='slave'} at 127.0.0.1:55352
I20260709 12:20:59.800868 17831 raft_consensus.cc:1081] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 4 LEADER]: Signalling peer d63a012a36464bb282cc473364dcbc1e to start an election
I20260709 12:20:59.801129 17555 raft_consensus.cc:606] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 LEADER]: Received request to transfer leadership to TS d63a012a36464bb282cc473364dcbc1e
I20260709 12:20:59.802973 17631 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d7bde90819e4906a5388c608a5b7a07"
dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
 from {username='slave'} at 127.0.0.1:56856
I20260709 12:20:59.803506 17631 raft_consensus.cc:493] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:59.803874 17631 raft_consensus.cc:3060] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:59.804073 17555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3b59956b80d41dd899e6b77cbdbdd89"
dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
mode: GRACEFUL
new_leader_uuid: "fc50b7531b474e48adb0838c110df3c3"
 from {username='slave'} at 127.0.0.1:55352
I20260709 12:20:59.804682 17555 raft_consensus.cc:606] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Received request to transfer leadership to TS fc50b7531b474e48adb0838c110df3c3
I20260709 12:20:59.805835 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:59.806442 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:59.811436 17631 raft_consensus.cc:515] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:59.812778 17838 raft_consensus.cc:993] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3: : Instructing follower d63a012a36464bb282cc473364dcbc1e to start an election
I20260709 12:20:59.813522 17844 raft_consensus.cc:1081] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 LEADER]: Signalling peer d63a012a36464bb282cc473364dcbc1e to start an election
I20260709 12:20:59.815440 17631 leader_election.cc:290] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 5 election: Requested vote from peers fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849), 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035)
I20260709 12:20:59.815840 17632 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2de3e7d05e947efa97e42a696f6360b"
dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
 from {username='slave'} at 127.0.0.1:56856
I20260709 12:20:59.815969 17482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7bde90819e4906a5388c608a5b7a07" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
I20260709 12:20:59.816578 17632 raft_consensus.cc:493] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:59.816723 17482 raft_consensus.cc:3060] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:59.816699 17555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7bde90819e4906a5388c608a5b7a07" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
I20260709 12:20:59.817091 17632 raft_consensus.cc:3060] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:59.817462 17555 raft_consensus.cc:3055] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:59.817756 17555 raft_consensus.cc:740] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Running, Role: LEADER
I20260709 12:20:59.818522 17555 consensus_queue.cc:260] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:59.819564 17555 raft_consensus.cc:3060] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:59.824503 17555 raft_consensus.cc:2468] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d63a012a36464bb282cc473364dcbc1e in term 5.
I20260709 12:20:59.824786 17482 raft_consensus.cc:2468] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d63a012a36464bb282cc473364dcbc1e in term 5.
I20260709 12:20:59.825065 17632 raft_consensus.cc:515] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } }
I20260709 12:20:59.825893 17596 leader_election.cc:304] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, d63a012a36464bb282cc473364dcbc1e; no voters: 
I20260709 12:20:59.826839 17816 raft_consensus.cc:2804] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:59.827850 17632 leader_election.cc:290] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 4 election: Requested vote from peers 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035), fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849)
I20260709 12:20:59.828213 17816 raft_consensus.cc:697] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 5 LEADER]: Becoming Leader. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Running, Role: LEADER
I20260709 12:20:59.828912 17555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2de3e7d05e947efa97e42a696f6360b" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
I20260709 12:20:59.829000 17482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2de3e7d05e947efa97e42a696f6360b" candidate_uuid: "d63a012a36464bb282cc473364dcbc1e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
I20260709 12:20:59.829497 17555 raft_consensus.cc:3055] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:59.829540 17482 raft_consensus.cc:3060] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:59.829232 17816 consensus_queue.cc:237] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:59.829901 17555 raft_consensus.cc:740] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Running, Role: LEADER
I20260709 12:20:59.830682 17555 consensus_queue.cc:260] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } }
I20260709 12:20:59.831997 17555 raft_consensus.cc:3060] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:59.836937 17482 raft_consensus.cc:2468] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d63a012a36464bb282cc473364dcbc1e in term 4.
I20260709 12:20:59.838203 17594 leader_election.cc:304] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d63a012a36464bb282cc473364dcbc1e, fc50b7531b474e48adb0838c110df3c3; no voters: 
I20260709 12:20:59.838923 17816 raft_consensus.cc:2804] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:59.840178 17816 raft_consensus.cc:697] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 4 LEADER]: Becoming Leader. State: Replica: d63a012a36464bb282cc473364dcbc1e, State: Running, Role: LEADER
I20260709 12:20:59.840649 17555 raft_consensus.cc:2468] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d63a012a36464bb282cc473364dcbc1e in term 4.
I20260709 12:20:59.840251 17378 catalog_manager.cc:5697] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e reported cstate change: term changed from 4 to 5, leader changed from 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130) to d63a012a36464bb282cc473364dcbc1e (127.16.240.131). New cstate: current_term: 5 leader_uuid: "d63a012a36464bb282cc473364dcbc1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:59.841701 17816 consensus_queue.cc:237] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } }
I20260709 12:20:59.865165 17378 catalog_manager.cc:5697] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e reported cstate change: term changed from 3 to 4, leader changed from 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130) to d63a012a36464bb282cc473364dcbc1e (127.16.240.131). New cstate: current_term: 4 leader_uuid: "d63a012a36464bb282cc473364dcbc1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:59.940416 17838 raft_consensus.cc:993] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3: : Instructing follower fc50b7531b474e48adb0838c110df3c3 to start an election
I20260709 12:20:59.940864 17844 raft_consensus.cc:1081] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Signalling peer fc50b7531b474e48adb0838c110df3c3 to start an election
I20260709 12:20:59.942476 17482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3b59956b80d41dd899e6b77cbdbdd89"
dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
 from {username='slave'} at 127.0.0.1:38284
I20260709 12:20:59.943095 17482 raft_consensus.cc:493] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:59.943464 17482 raft_consensus.cc:3060] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:59.947981 17482 raft_consensus.cc:515] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:59.949998 17482 leader_election.cc:290] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 3 election: Requested vote from peers 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:20:59.951135 17632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b59956b80d41dd899e6b77cbdbdd89" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
I20260709 12:20:59.951222 17555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b59956b80d41dd899e6b77cbdbdd89" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
I20260709 12:20:59.951730 17632 raft_consensus.cc:3060] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:59.951877 17555 raft_consensus.cc:3055] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:59.952240 17555 raft_consensus.cc:740] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Running, Role: LEADER
I20260709 12:20:59.952988 17555 consensus_queue.cc:260] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:59.953913 17555 raft_consensus.cc:3060] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:59.957548 17632 raft_consensus.cc:2468] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc50b7531b474e48adb0838c110df3c3 in term 3.
I20260709 12:20:59.959182 17555 raft_consensus.cc:2468] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc50b7531b474e48adb0838c110df3c3 in term 3.
I20260709 12:20:59.959497 17448 leader_election.cc:304] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d63a012a36464bb282cc473364dcbc1e, fc50b7531b474e48adb0838c110df3c3; no voters: 
I20260709 12:20:59.961875 17852 raft_consensus.cc:2804] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:59.963152 17852 raft_consensus.cc:697] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3 [term 3 LEADER]: Becoming Leader. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Running, Role: LEADER
I20260709 12:20:59.964255 17852 consensus_queue.cc:237] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:20:59.971697 17378 catalog_manager.cc:5697] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3 reported cstate change: term changed from 2 to 3, leader changed from 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130) to fc50b7531b474e48adb0838c110df3c3 (127.16.240.129). New cstate: current_term: 3 leader_uuid: "fc50b7531b474e48adb0838c110df3c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:00.096686 17838 raft_consensus.cc:993] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3: : Instructing follower fc50b7531b474e48adb0838c110df3c3 to start an election
I20260709 12:21:00.097232 17844 raft_consensus.cc:1081] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Signalling peer fc50b7531b474e48adb0838c110df3c3 to start an election
I20260709 12:21:00.099308 17482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23fdbee0aed64eb7944d541434bc2eca"
dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
 from {username='slave'} at 127.0.0.1:38284
I20260709 12:21:00.099852 17482 raft_consensus.cc:493] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:00.100185 17482 raft_consensus.cc:3060] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:00.104467 17482 raft_consensus.cc:515] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:21:00.105979 17482 leader_election.cc:290] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 3 election: Requested vote from peers 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:21:00.106909 17555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23fdbee0aed64eb7944d541434bc2eca" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
I20260709 12:21:00.107013 17632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23fdbee0aed64eb7944d541434bc2eca" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
I20260709 12:21:00.107481 17555 raft_consensus.cc:3055] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:00.107646 17632 raft_consensus.cc:3060] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:00.107846 17555 raft_consensus.cc:740] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Running, Role: LEADER
I20260709 12:21:00.108664 17555 consensus_queue.cc:260] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:21:00.109779 17555 raft_consensus.cc:3060] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:00.115592 17632 raft_consensus.cc:2468] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc50b7531b474e48adb0838c110df3c3 in term 3.
I20260709 12:21:00.117110 17448 leader_election.cc:304] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d63a012a36464bb282cc473364dcbc1e, fc50b7531b474e48adb0838c110df3c3; no voters: 
I20260709 12:21:00.117872 17852 raft_consensus.cc:2804] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:00.118314 17852 raft_consensus.cc:697] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 3 LEADER]: Becoming Leader. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Running, Role: LEADER
I20260709 12:21:00.119092 17852 consensus_queue.cc:237] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:21:00.119867 17555 raft_consensus.cc:2468] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc50b7531b474e48adb0838c110df3c3 in term 3.
I20260709 12:21:00.126899 17378 catalog_manager.cc:5697] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 reported cstate change: term changed from 2 to 3, leader changed from 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130) to fc50b7531b474e48adb0838c110df3c3 (127.16.240.129). New cstate: current_term: 3 leader_uuid: "fc50b7531b474e48adb0838c110df3c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:00.223369 17838 raft_consensus.cc:993] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3: : Instructing follower fc50b7531b474e48adb0838c110df3c3 to start an election
I20260709 12:21:00.224117 17838 raft_consensus.cc:1081] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Signalling peer fc50b7531b474e48adb0838c110df3c3 to start an election
I20260709 12:21:00.225713 17482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8250d6ce783641dbb54f3075c37c2594"
dest_uuid: "fc50b7531b474e48adb0838c110df3c3"
 from {username='slave'} at 127.0.0.1:38284
I20260709 12:21:00.226219 17482 raft_consensus.cc:493] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:00.226536 17482 raft_consensus.cc:3060] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:00.231978 17482 raft_consensus.cc:515] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:21:00.234100 17482 leader_election.cc:290] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 3 election: Requested vote from peers 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035), d63a012a36464bb282cc473364dcbc1e (127.16.240.131:41511)
I20260709 12:21:00.235158 17555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8250d6ce783641dbb54f3075c37c2594" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63b3cdaff6e940b197c26c7eea9889f3"
I20260709 12:21:00.235484 17632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8250d6ce783641dbb54f3075c37c2594" candidate_uuid: "fc50b7531b474e48adb0838c110df3c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d63a012a36464bb282cc473364dcbc1e"
I20260709 12:21:00.235677 17555 raft_consensus.cc:3055] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:00.236114 17555 raft_consensus.cc:740] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63b3cdaff6e940b197c26c7eea9889f3, State: Running, Role: LEADER
I20260709 12:21:00.236236 17632 raft_consensus.cc:3060] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:00.236867 17555 consensus_queue.cc:260] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:21:00.237802 17555 raft_consensus.cc:3060] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:00.242203 17555 raft_consensus.cc:2468] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc50b7531b474e48adb0838c110df3c3 in term 3.
I20260709 12:21:00.242311 17632 raft_consensus.cc:2468] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc50b7531b474e48adb0838c110df3c3 in term 3.
I20260709 12:21:00.243505 17447 leader_election.cc:304] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b3cdaff6e940b197c26c7eea9889f3, fc50b7531b474e48adb0838c110df3c3; no voters: 
I20260709 12:21:00.244351 17852 raft_consensus.cc:2804] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:00.244813 17852 raft_consensus.cc:697] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 3 LEADER]: Becoming Leader. State: Replica: fc50b7531b474e48adb0838c110df3c3, State: Running, Role: LEADER
I20260709 12:21:00.245667 17852 consensus_queue.cc:237] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } }
I20260709 12:21:00.254666 17378 catalog_manager.cc:5697] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 reported cstate change: term changed from 2 to 3, leader changed from 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130) to fc50b7531b474e48adb0838c110df3c3 (127.16.240.129). New cstate: current_term: 3 leader_uuid: "fc50b7531b474e48adb0838c110df3c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:00.275300 17482 raft_consensus.cc:1275] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 5 FOLLOWER]: Refusing update from remote peer d63a012a36464bb282cc473364dcbc1e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:00.276577 17816 consensus_queue.cc:1048] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:00.286435 17555 raft_consensus.cc:1275] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 4 FOLLOWER]: Refusing update from remote peer d63a012a36464bb282cc473364dcbc1e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:00.289345 17555 raft_consensus.cc:1275] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 5 FOLLOWER]: Refusing update from remote peer d63a012a36464bb282cc473364dcbc1e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:00.291210 17858 consensus_queue.cc:1048] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:00.289875 17845 consensus_queue.cc:1048] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:00.304488 17482 raft_consensus.cc:1275] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 4 FOLLOWER]: Refusing update from remote peer d63a012a36464bb282cc473364dcbc1e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:00.306766 17816 consensus_queue.cc:1048] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc50b7531b474e48adb0838c110df3c3" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:00.398710 17556 raft_consensus.cc:1275] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Refusing update from remote peer fc50b7531b474e48adb0838c110df3c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:00.399935 17852 consensus_queue.cc:1048] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:00.409034 17632 raft_consensus.cc:1275] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 3 FOLLOWER]: Refusing update from remote peer fc50b7531b474e48adb0838c110df3c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:00.410780 17866 consensus_queue.cc:1048] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:00.631894 17556 raft_consensus.cc:1275] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Refusing update from remote peer fc50b7531b474e48adb0838c110df3c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:00.633100 17866 consensus_queue.cc:1048] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:00.643500 17632 raft_consensus.cc:1275] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e [term 3 FOLLOWER]: Refusing update from remote peer fc50b7531b474e48adb0838c110df3c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:00.645440 17869 consensus_queue.cc:1048] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:00.674226 17632 raft_consensus.cc:1275] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e [term 3 FOLLOWER]: Refusing update from remote peer fc50b7531b474e48adb0838c110df3c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:00.675673 17869 consensus_queue.cc:1048] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d63a012a36464bb282cc473364dcbc1e" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:00.685577 17556 raft_consensus.cc:1275] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Refusing update from remote peer fc50b7531b474e48adb0838c110df3c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:00.687091 17869 consensus_queue.cc:1048] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63b3cdaff6e940b197c26c7eea9889f3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:00.808375 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:00.816344 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:00.816937 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:01.818209 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:01.825034 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:01.825604 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:02.826910 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:02.832545 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:02.832954 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:03.834178 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:03.840014 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:03.840451 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:04.841473 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:04.846531 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:04.846920 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:05.848289 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:05.853624 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:05.854154 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:06.855121 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:06.860795 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:06.861310 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:07.862764 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:07.868467 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:07.868865 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:08.869946 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:08.875013 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:08.875407 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:09.913650 17346 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:21:09.914305 17346 tablet_server.cc:179] TabletServer@127.16.240.129:0 shutting down...
I20260709 12:21:09.950855 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:09.951645 17346 tablet_replica.cc:333] T 80e4d65e63294f1bb0cba6e869adc91b P fc50b7531b474e48adb0838c110df3c3: stopping tablet replica
I20260709 12:21:09.952463 17346 raft_consensus.cc:2243] T 80e4d65e63294f1bb0cba6e869adc91b P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.953265 17346 raft_consensus.cc:2272] T 80e4d65e63294f1bb0cba6e869adc91b P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.956019 17346 tablet_replica.cc:333] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3: stopping tablet replica
I20260709 12:21:09.956604 17346 raft_consensus.cc:2243] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.957077 17346 raft_consensus.cc:2272] T a5e7f42e0bcb4903912c56beb592ce5a P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.958806 17346 tablet_replica.cc:333] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3: stopping tablet replica
I20260709 12:21:09.959331 17346 raft_consensus.cc:2243] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:09.960255 17346 raft_consensus.cc:2272] T d3b59956b80d41dd899e6b77cbdbdd89 P fc50b7531b474e48adb0838c110df3c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.962133 17346 tablet_replica.cc:333] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3: stopping tablet replica
I20260709 12:21:09.962947 17346 raft_consensus.cc:2243] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:09.964110 17346 raft_consensus.cc:2272] T 23fdbee0aed64eb7944d541434bc2eca P fc50b7531b474e48adb0838c110df3c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.966430 17346 tablet_replica.cc:333] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3: stopping tablet replica
I20260709 12:21:09.967106 17346 raft_consensus.cc:2243] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.967664 17346 raft_consensus.cc:2272] T df95c0de53cc45e7bf9338f523ec21d6 P fc50b7531b474e48adb0838c110df3c3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.969600 17346 tablet_replica.cc:333] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3: stopping tablet replica
I20260709 12:21:09.970155 17346 raft_consensus.cc:2243] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:09.970985 17346 raft_consensus.cc:2272] T 8250d6ce783641dbb54f3075c37c2594 P fc50b7531b474e48adb0838c110df3c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.972935 17346 tablet_replica.cc:333] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3: stopping tablet replica
I20260709 12:21:09.973470 17346 raft_consensus.cc:2243] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.973937 17346 raft_consensus.cc:2272] T 6d7bde90819e4906a5388c608a5b7a07 P fc50b7531b474e48adb0838c110df3c3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.975638 17346 tablet_replica.cc:333] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3: stopping tablet replica
I20260709 12:21:09.976212 17346 raft_consensus.cc:2243] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.976688 17346 raft_consensus.cc:2272] T a2de3e7d05e947efa97e42a696f6360b P fc50b7531b474e48adb0838c110df3c3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.978417 17346 tablet_replica.cc:333] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3: stopping tablet replica
I20260709 12:21:09.979054 17346 raft_consensus.cc:2243] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.979557 17346 raft_consensus.cc:2272] T 497230b8fcb8404297bb61cf04549f78 P fc50b7531b474e48adb0838c110df3c3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:10.105858 17594 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45849: connect: Connection refused (error 111)
I20260709 12:21:10.137253 17346 tablet_server.cc:196] TabletServer@127.16.240.129:0 shutdown complete.
W20260709 12:21:10.138376 17594 consensus_peers.cc:597] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e -> Peer fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849): Couldn't send request to peer fc50b7531b474e48adb0838c110df3c3. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45849: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:10.139068 17520 consensus_peers.cc:597] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3 -> Peer fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849): Couldn't send request to peer fc50b7531b474e48adb0838c110df3c3. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45849: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:10.139542 17520 consensus_peers.cc:597] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 -> Peer fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849): Couldn't send request to peer fc50b7531b474e48adb0838c110df3c3. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45849: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:10.160322 17346 tablet_server.cc:179] TabletServer@127.16.240.130:0 shutting down...
W20260709 12:21:10.170565 17594 consensus_peers.cc:597] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e -> Peer fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849): Couldn't send request to peer fc50b7531b474e48adb0838c110df3c3. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45849: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:10.192481 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:10.193276 17346 tablet_replica.cc:333] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3: stopping tablet replica
I20260709 12:21:10.194199 17346 raft_consensus.cc:2243] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:10.194831 17346 raft_consensus.cc:2272] T 8250d6ce783641dbb54f3075c37c2594 P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.196695 17346 tablet_replica.cc:333] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3: stopping tablet replica
I20260709 12:21:10.197165 17346 raft_consensus.cc:2243] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:10.197551 17346 raft_consensus.cc:2272] T 80e4d65e63294f1bb0cba6e869adc91b P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.199153 17346 tablet_replica.cc:333] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3: stopping tablet replica
I20260709 12:21:10.199630 17346 raft_consensus.cc:2243] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:10.200465 17346 raft_consensus.cc:2272] T a5e7f42e0bcb4903912c56beb592ce5a P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.202128 17346 tablet_replica.cc:333] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3: stopping tablet replica
I20260709 12:21:10.202616 17346 raft_consensus.cc:2243] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:10.203027 17346 raft_consensus.cc:2272] T a2de3e7d05e947efa97e42a696f6360b P 63b3cdaff6e940b197c26c7eea9889f3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.204748 17346 tablet_replica.cc:333] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3: stopping tablet replica
I20260709 12:21:10.205206 17346 raft_consensus.cc:2243] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:10.205565 17346 raft_consensus.cc:2272] T 6d7bde90819e4906a5388c608a5b7a07 P 63b3cdaff6e940b197c26c7eea9889f3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.208339 17346 tablet_replica.cc:333] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3: stopping tablet replica
I20260709 12:21:10.208823 17346 raft_consensus.cc:2243] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:21:10.209627 17346 raft_consensus.cc:2272] T df95c0de53cc45e7bf9338f523ec21d6 P 63b3cdaff6e940b197c26c7eea9889f3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.211395 17346 tablet_replica.cc:333] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3: stopping tablet replica
I20260709 12:21:10.211958 17346 raft_consensus.cc:2243] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:10.212387 17346 raft_consensus.cc:2272] T 23fdbee0aed64eb7944d541434bc2eca P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.214078 17346 tablet_replica.cc:333] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3: stopping tablet replica
I20260709 12:21:10.214571 17346 raft_consensus.cc:2243] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:10.214988 17346 raft_consensus.cc:2272] T d3b59956b80d41dd899e6b77cbdbdd89 P 63b3cdaff6e940b197c26c7eea9889f3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.216638 17346 tablet_replica.cc:333] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3: stopping tablet replica
I20260709 12:21:10.217125 17346 raft_consensus.cc:2243] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:10.217901 17346 raft_consensus.cc:2272] T 497230b8fcb8404297bb61cf04549f78 P 63b3cdaff6e940b197c26c7eea9889f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.247424 17346 tablet_server.cc:196] TabletServer@127.16.240.130:0 shutdown complete.
W20260709 12:21:10.263031 17594 consensus_peers.cc:597] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e -> Peer fc50b7531b474e48adb0838c110df3c3 (127.16.240.129:45849): Couldn't send request to peer fc50b7531b474e48adb0838c110df3c3. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45849: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:10.268893 17346 tablet_server.cc:179] TabletServer@127.16.240.131:0 shutting down...
W20260709 12:21:10.282472 17596 consensus_peers.cc:597] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e -> Peer 63b3cdaff6e940b197c26c7eea9889f3 (127.16.240.130:37035): Couldn't send request to peer 63b3cdaff6e940b197c26c7eea9889f3. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:10.300171 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:10.301015 17346 tablet_replica.cc:333] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e: stopping tablet replica
I20260709 12:21:10.301708 17346 raft_consensus.cc:2243] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:10.302533 17346 raft_consensus.cc:2272] T a5e7f42e0bcb4903912c56beb592ce5a P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.305032 17346 tablet_replica.cc:333] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e: stopping tablet replica
I20260709 12:21:10.305733 17346 raft_consensus.cc:2243] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:10.306699 17346 raft_consensus.cc:2272] T 80e4d65e63294f1bb0cba6e869adc91b P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.308586 17346 tablet_replica.cc:333] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e: stopping tablet replica
I20260709 12:21:10.309092 17346 raft_consensus.cc:2243] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:21:10.309899 17346 raft_consensus.cc:2272] T a2de3e7d05e947efa97e42a696f6360b P d63a012a36464bb282cc473364dcbc1e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.311980 17346 tablet_replica.cc:333] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e: stopping tablet replica
I20260709 12:21:10.312604 17346 raft_consensus.cc:2243] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:21:10.313464 17346 raft_consensus.cc:2272] T 6d7bde90819e4906a5388c608a5b7a07 P d63a012a36464bb282cc473364dcbc1e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.315675 17346 tablet_replica.cc:333] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e: stopping tablet replica
I20260709 12:21:10.316306 17346 raft_consensus.cc:2243] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:10.316840 17346 raft_consensus.cc:2272] T 23fdbee0aed64eb7944d541434bc2eca P d63a012a36464bb282cc473364dcbc1e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.318711 17346 tablet_replica.cc:333] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e: stopping tablet replica
I20260709 12:21:10.319265 17346 raft_consensus.cc:2243] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:10.319802 17346 raft_consensus.cc:2272] T d3b59956b80d41dd899e6b77cbdbdd89 P d63a012a36464bb282cc473364dcbc1e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.321614 17346 tablet_replica.cc:333] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e: stopping tablet replica
I20260709 12:21:10.322181 17346 raft_consensus.cc:2243] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:10.322664 17346 raft_consensus.cc:2272] T df95c0de53cc45e7bf9338f523ec21d6 P d63a012a36464bb282cc473364dcbc1e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.324611 17346 tablet_replica.cc:333] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e: stopping tablet replica
I20260709 12:21:10.325124 17346 raft_consensus.cc:2243] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:10.325737 17346 raft_consensus.cc:2272] T 8250d6ce783641dbb54f3075c37c2594 P d63a012a36464bb282cc473364dcbc1e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.327561 17346 tablet_replica.cc:333] T 497230b8fcb8404297bb61cf04549f78 P d63a012a36464bb282cc473364dcbc1e: stopping tablet replica
I20260709 12:21:10.328097 17346 raft_consensus.cc:2243] T 497230b8fcb8404297bb61cf04549f78 P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:10.328580 17346 raft_consensus.cc:2272] T 497230b8fcb8404297bb61cf04549f78 P d63a012a36464bb282cc473364dcbc1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.357659 17346 tablet_server.cc:196] TabletServer@127.16.240.131:0 shutdown complete.
I20260709 12:21:10.377507 17346 master.cc:562] Master@127.16.240.190:44201 shutting down...
I20260709 12:21:10.532936 17346 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:10.533527 17346 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:10.533815 17346 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9c700316e26b40428f6f129754f63657: stopping tablet replica
I20260709 12:21:10.555441 17346 master.cc:584] Master@127.16.240.190:44201 shutdown complete.
63b3cdaff6e940b197c26c7eea9889f3  4
d63a012a36464bb282cc473364dcbc1e  1
fc50b7531b474e48adb0838c110df3c3  4
63b3cdaff6e940b197c26c7eea9889f3  3
d63a012a36464bb282cc473364dcbc1e  3
fc50b7531b474e48adb0838c110df3c3  3
63b3cdaff6e940b197c26c7eea9889f3  8
d63a012a36464bb282cc473364dcbc1e  1
fc50b7531b474e48adb0838c110df3c3  0
63b3cdaff6e940b197c26c7eea9889f3  3
d63a012a36464bb282cc473364dcbc1e  3
fc50b7531b474e48adb0838c110df3c3  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (31535 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:21:10.600872 17346 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.240.190:42675
I20260709 12:21:10.602042 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:10.608810 17887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:10.609124 17886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:10.609175 17889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:10.610018 17346 server_base.cc:1061] running on GCE node
I20260709 12:21:10.610939 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:10.611133 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:10.611310 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599670611296 us; error 0 us; skew 500 ppm
I20260709 12:21:10.611963 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:10.614589 17346 webserver.cc:533] Webserver started at http://127.16.240.190:38763/ using document root <none> and password file <none>
I20260709 12:21:10.615134 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:10.615295 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:10.615614 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:10.617141 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599638884573-17346-0/minicluster-data/master-0-root/instance:
uuid: "6abc2d4c9e544f29a7c92c45b69bdafd"
format_stamp: "Formatted at 2026-07-09 12:21:10 on dist-test-slave-7xpw"
I20260709 12:21:10.621798 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:21:10.625453 17894 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:10.626360 17346 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:21:10.626753 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599638884573-17346-0/minicluster-data/master-0-root
uuid: "6abc2d4c9e544f29a7c92c45b69bdafd"
format_stamp: "Formatted at 2026-07-09 12:21:10 on dist-test-slave-7xpw"
I20260709 12:21:10.627283 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599638884573-17346-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599638884573-17346-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599638884573-17346-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:10.641448 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:10.642750 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:10.686532 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.190:42675
I20260709 12:21:10.686652 17946 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.190:42675 every 8 connection(s)
I20260709 12:21:10.690655 17947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:10.700551 17947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd: Bootstrap starting.
I20260709 12:21:10.705286 17947 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:10.709744 17947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd: No bootstrap required, opened a new log
I20260709 12:21:10.712329 17947 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6abc2d4c9e544f29a7c92c45b69bdafd" member_type: VOTER }
I20260709 12:21:10.712792 17947 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:10.713035 17947 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6abc2d4c9e544f29a7c92c45b69bdafd, State: Initialized, Role: FOLLOWER
I20260709 12:21:10.713644 17947 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6abc2d4c9e544f29a7c92c45b69bdafd" member_type: VOTER }
I20260709 12:21:10.714118 17947 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:21:10.714339 17947 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:21:10.714612 17947 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:10.718591 17947 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6abc2d4c9e544f29a7c92c45b69bdafd" member_type: VOTER }
I20260709 12:21:10.719147 17947 leader_election.cc:304] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6abc2d4c9e544f29a7c92c45b69bdafd; no voters: 
I20260709 12:21:10.720360 17947 leader_election.cc:290] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:21:10.720695 17950 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:10.722157 17950 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd [term 1 LEADER]: Becoming Leader. State: Replica: 6abc2d4c9e544f29a7c92c45b69bdafd, State: Running, Role: LEADER
I20260709 12:21:10.722940 17950 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6abc2d4c9e544f29a7c92c45b69bdafd" member_type: VOTER }
I20260709 12:21:10.723402 17947 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:21:10.728193 17951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6abc2d4c9e544f29a7c92c45b69bdafd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6abc2d4c9e544f29a7c92c45b69bdafd" member_type: VOTER } }
I20260709 12:21:10.729094 17951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:10.729333 17952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6abc2d4c9e544f29a7c92c45b69bdafd. Latest consensus state: current_term: 1 leader_uuid: "6abc2d4c9e544f29a7c92c45b69bdafd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6abc2d4c9e544f29a7c92c45b69bdafd" member_type: VOTER } }
I20260709 12:21:10.733103 17952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:10.734571 17959 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:21:10.743026 17959 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:21:10.744462 17346 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:21:10.753620 17959 catalog_manager.cc:1383] Generated new cluster ID: 4eddffb2926f439c858771c2a20cc638
I20260709 12:21:10.754133 17959 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:21:10.784065 17959 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:21:10.785384 17959 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:21:10.803862 17959 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd: Generated new TSK 0
I20260709 12:21:10.804656 17959 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:21:10.811659 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:10.818635 17968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:10.820289 17969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:10.822093 17971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:10.822685 17346 server_base.cc:1061] running on GCE node
I20260709 12:21:10.823917 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:10.824108 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:10.824486 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599670824441 us; error 0 us; skew 500 ppm
I20260709 12:21:10.825100 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:10.827877 17346 webserver.cc:533] Webserver started at http://127.16.240.129:42299/ using document root <none> and password file <none>
I20260709 12:21:10.828408 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:10.828603 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:10.828912 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:10.830191 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599638884573-17346-0/minicluster-data/ts-0-root/instance:
uuid: "ba6e65ec56284f449dde8c8a931eacfe"
format_stamp: "Formatted at 2026-07-09 12:21:10 on dist-test-slave-7xpw"
I20260709 12:21:10.836079 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.003s
I20260709 12:21:10.839674 17976 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:10.840615 17346 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:21:10.840989 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599638884573-17346-0/minicluster-data/ts-0-root
uuid: "ba6e65ec56284f449dde8c8a931eacfe"
format_stamp: "Formatted at 2026-07-09 12:21:10 on dist-test-slave-7xpw"
I20260709 12:21:10.841291 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599638884573-17346-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599638884573-17346-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599638884573-17346-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:10.857862 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:10.859193 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:10.860747 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:10.863070 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:10.863301 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:10.863541 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:10.863734 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:10.910175 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.129:36543
I20260709 12:21:10.910404 18038 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.129:36543 every 8 connection(s)
I20260709 12:21:10.916069 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:10.924353 18043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:10.926067 18044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:10.927614 18046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:10.928853 17346 server_base.cc:1061] running on GCE node
I20260709 12:21:10.930147 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:10.930337 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:10.930542 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599670930522 us; error 0 us; skew 500 ppm
I20260709 12:21:10.931075 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:10.933626 17346 webserver.cc:533] Webserver started at http://127.16.240.130:45731/ using document root <none> and password file <none>
I20260709 12:21:10.934156 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:10.934352 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:10.934670 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:10.936266 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599638884573-17346-0/minicluster-data/ts-1-root/instance:
uuid: "4446ad69b93d4a62a3861fb1923713d5"
format_stamp: "Formatted at 2026-07-09 12:21:10 on dist-test-slave-7xpw"
I20260709 12:21:10.937320 18039 heartbeater.cc:344] Connected to a master server at 127.16.240.190:42675
I20260709 12:21:10.937765 18039 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:10.938675 18039 heartbeater.cc:507] Master 127.16.240.190:42675 requested a full tablet report, sending...
I20260709 12:21:10.941208 17911 ts_manager.cc:194] Registered new tserver with Master: ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543)
I20260709 12:21:10.942557 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:21:10.943492 17911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44096
I20260709 12:21:10.947088 18051 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:10.948108 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:21:10.948493 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599638884573-17346-0/minicluster-data/ts-1-root
uuid: "4446ad69b93d4a62a3861fb1923713d5"
format_stamp: "Formatted at 2026-07-09 12:21:10 on dist-test-slave-7xpw"
I20260709 12:21:10.948967 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599638884573-17346-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599638884573-17346-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599638884573-17346-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:10.960258 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:10.961509 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:10.962998 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:10.965590 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:10.965844 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:10.966106 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:10.966277 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:11.010288 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.130:43875
I20260709 12:21:11.010424 18114 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.130:43875 every 8 connection(s)
I20260709 12:21:11.015296 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:11.023350 18118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:11.025305 18119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:11.028841 17346 server_base.cc:1061] running on GCE node
W20260709 12:21:11.028914 18121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:11.030155 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:11.030476 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:11.030695 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599671030670 us; error 0 us; skew 500 ppm
I20260709 12:21:11.031073 18115 heartbeater.cc:344] Connected to a master server at 127.16.240.190:42675
I20260709 12:21:11.031474 18115 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:11.031666 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:11.032315 18115 heartbeater.cc:507] Master 127.16.240.190:42675 requested a full tablet report, sending...
I20260709 12:21:11.034838 17346 webserver.cc:533] Webserver started at http://127.16.240.131:38227/ using document root <none> and password file <none>
I20260709 12:21:11.034843 17911 ts_manager.cc:194] Registered new tserver with Master: 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875)
I20260709 12:21:11.035671 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:11.035981 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:11.036326 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:11.036902 17911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44100
I20260709 12:21:11.037899 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599638884573-17346-0/minicluster-data/ts-2-root/instance:
uuid: "917383ee650a411288b86b4895768002"
format_stamp: "Formatted at 2026-07-09 12:21:11 on dist-test-slave-7xpw"
I20260709 12:21:11.043151 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:21:11.047434 18126 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:11.048312 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:21:11.048630 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599638884573-17346-0/minicluster-data/ts-2-root
uuid: "917383ee650a411288b86b4895768002"
format_stamp: "Formatted at 2026-07-09 12:21:11 on dist-test-slave-7xpw"
I20260709 12:21:11.048941 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599638884573-17346-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599638884573-17346-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599638884573-17346-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:11.074167 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:11.075448 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:11.076987 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:11.079234 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:11.079468 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:11.079703 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:11.079949 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:21:11.124019 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.131:40621
I20260709 12:21:11.124110 18188 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.131:40621 every 8 connection(s)
I20260709 12:21:11.140491 18189 heartbeater.cc:344] Connected to a master server at 127.16.240.190:42675
I20260709 12:21:11.140903 18189 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:11.141748 18189 heartbeater.cc:507] Master 127.16.240.190:42675 requested a full tablet report, sending...
I20260709 12:21:11.144196 17911 ts_manager.cc:194] Registered new tserver with Master: 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:11.145175 17346 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017146678s
I20260709 12:21:11.145581 17911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44102
I20260709 12:21:11.174343 17911 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44110:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:21:11.177335 17911 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:21:11.259351 18003 tablet_service.cc:1511] Processing CreateTablet for tablet 72fbb32a196a4161a14790e1827e73ec (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:21:11.260502 18004 tablet_service.cc:1511] Processing CreateTablet for tablet b473ce7f315b414e9dcc16f27ee42bfc (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:21:11.263348 18000 tablet_service.cc:1511] Processing CreateTablet for tablet 08454883e9dc40e58a5e1c61624e2126 (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:21:11.264150 18001 tablet_service.cc:1511] Processing CreateTablet for tablet d246e0caab544fd8b721745d6aa518ba (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:21:11.268929 18002 tablet_service.cc:1511] Processing CreateTablet for tablet b797090c2ec247bfb432e56d7c913d05 (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:21:11.267050 17999 tablet_service.cc:1511] Processing CreateTablet for tablet f1a420cbdc52422aab49dc58e04e7b1e (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:21:11.261035 18003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72fbb32a196a4161a14790e1827e73ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.272781 18004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b473ce7f315b414e9dcc16f27ee42bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.272855 17998 tablet_service.cc:1511] Processing CreateTablet for tablet c4318035ed794a5e83625cc731fda175 (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:21:11.273638 18001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d246e0caab544fd8b721745d6aa518ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.274267 18000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08454883e9dc40e58a5e1c61624e2126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.274855 17998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4318035ed794a5e83625cc731fda175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.276160 17999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a420cbdc52422aab49dc58e04e7b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.277537 18002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b797090c2ec247bfb432e56d7c913d05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.278198 17997 tablet_service.cc:1511] Processing CreateTablet for tablet 7a77f52af1814deab6b5fc9d724ed9e2 (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:21:11.279614 17997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a77f52af1814deab6b5fc9d724ed9e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.296141 18154 tablet_service.cc:1511] Processing CreateTablet for tablet b473ce7f315b414e9dcc16f27ee42bfc (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:21:11.297649 18154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b473ce7f315b414e9dcc16f27ee42bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.298841 18152 tablet_service.cc:1511] Processing CreateTablet for tablet b797090c2ec247bfb432e56d7c913d05 (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:21:11.300436 18152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b797090c2ec247bfb432e56d7c913d05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.305970 18151 tablet_service.cc:1511] Processing CreateTablet for tablet d246e0caab544fd8b721745d6aa518ba (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:21:11.307415 18151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d246e0caab544fd8b721745d6aa518ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.297641 18153 tablet_service.cc:1511] Processing CreateTablet for tablet 72fbb32a196a4161a14790e1827e73ec (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:21:11.310070 18080 tablet_service.cc:1511] Processing CreateTablet for tablet b473ce7f315b414e9dcc16f27ee42bfc (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:21:11.310140 18150 tablet_service.cc:1511] Processing CreateTablet for tablet 08454883e9dc40e58a5e1c61624e2126 (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:21:11.310542 18078 tablet_service.cc:1511] Processing CreateTablet for tablet 72fbb32a196a4161a14790e1827e73ec (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:21:11.311540 18080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b473ce7f315b414e9dcc16f27ee42bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.312516 18078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72fbb32a196a4161a14790e1827e73ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.312634 18149 tablet_service.cc:1511] Processing CreateTablet for tablet f1a420cbdc52422aab49dc58e04e7b1e (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:21:11.315106 18148 tablet_service.cc:1511] Processing CreateTablet for tablet c4318035ed794a5e83625cc731fda175 (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:21:11.317514 18147 tablet_service.cc:1511] Processing CreateTablet for tablet 7a77f52af1814deab6b5fc9d724ed9e2 (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:21:11.319324 18153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72fbb32a196a4161a14790e1827e73ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.320000 18150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08454883e9dc40e58a5e1c61624e2126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.321449 18077 tablet_service.cc:1511] Processing CreateTablet for tablet b797090c2ec247bfb432e56d7c913d05 (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:21:11.322862 18077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b797090c2ec247bfb432e56d7c913d05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.324505 18148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4318035ed794a5e83625cc731fda175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.328131 18147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a77f52af1814deab6b5fc9d724ed9e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.332146 18149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a420cbdc52422aab49dc58e04e7b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.333755 18076 tablet_service.cc:1511] Processing CreateTablet for tablet d246e0caab544fd8b721745d6aa518ba (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:21:11.335287 18076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d246e0caab544fd8b721745d6aa518ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.337119 18075 tablet_service.cc:1511] Processing CreateTablet for tablet 08454883e9dc40e58a5e1c61624e2126 (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:21:11.338574 18075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08454883e9dc40e58a5e1c61624e2126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.341010 18073 tablet_service.cc:1511] Processing CreateTablet for tablet c4318035ed794a5e83625cc731fda175 (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:21:11.342293 18205 tablet_bootstrap.cc:492] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002: Bootstrap starting.
I20260709 12:21:11.342502 18073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4318035ed794a5e83625cc731fda175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.341005 18074 tablet_service.cc:1511] Processing CreateTablet for tablet f1a420cbdc52422aab49dc58e04e7b1e (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:21:11.344817 18074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a420cbdc52422aab49dc58e04e7b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.350924 18205 tablet_bootstrap.cc:654] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.363051 18072 tablet_service.cc:1511] Processing CreateTablet for tablet 7a77f52af1814deab6b5fc9d724ed9e2 (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:21:11.365489 18072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a77f52af1814deab6b5fc9d724ed9e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.376861 18205 tablet_bootstrap.cc:492] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002: No bootstrap required, opened a new log
I20260709 12:21:11.377765 18205 ts_tablet_manager.cc:1403] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002: Time spent bootstrapping tablet: real 0.036s	user 0.000s	sys 0.026s
I20260709 12:21:11.382383 18205 raft_consensus.cc:359] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } }
I20260709 12:21:11.383390 18205 raft_consensus.cc:385] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.384056 18205 raft_consensus.cc:740] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 917383ee650a411288b86b4895768002, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.391654 18153 tablet_service.cc:1511] Processing CreateTablet for tablet 2d7fc6d43ca44313b5454b047cb20056 (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:21:11.396301 18153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d7fc6d43ca44313b5454b047cb20056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.393898 17996 tablet_service.cc:1511] Processing CreateTablet for tablet 2d7fc6d43ca44313b5454b047cb20056 (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:21:11.401316 17996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d7fc6d43ca44313b5454b047cb20056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.393965 17995 tablet_service.cc:1511] Processing CreateTablet for tablet 8210f9521a824b97addc9f8d5a7864fb (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:21:11.405893 17995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8210f9521a824b97addc9f8d5a7864fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.389289 18071 tablet_service.cc:1511] Processing CreateTablet for tablet 2d7fc6d43ca44313b5454b047cb20056 (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:21:11.410233 18071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d7fc6d43ca44313b5454b047cb20056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.414163 18207 tablet_bootstrap.cc:492] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5: Bootstrap starting.
I20260709 12:21:11.421146 18207 tablet_bootstrap.cc:654] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.385380 18205 consensus_queue.cc:260] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } }
I20260709 12:21:11.432080 18074 tablet_service.cc:1511] Processing CreateTablet for tablet 8210f9521a824b97addc9f8d5a7864fb (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:21:11.433650 18149 tablet_service.cc:1511] Processing CreateTablet for tablet 8210f9521a824b97addc9f8d5a7864fb (DEFAULT_TABLE table=test-workload [id=4e7abbc0d44345519eee11502cdc1898]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:21:11.434870 18074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8210f9521a824b97addc9f8d5a7864fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.435187 18149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8210f9521a824b97addc9f8d5a7864fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.472332 18204 tablet_bootstrap.cc:492] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe: Bootstrap starting.
I20260709 12:21:11.480587 18207 tablet_bootstrap.cc:492] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5: No bootstrap required, opened a new log
I20260709 12:21:11.481125 18207 ts_tablet_manager.cc:1403] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5: Time spent bootstrapping tablet: real 0.067s	user 0.008s	sys 0.005s
I20260709 12:21:11.484261 18207 raft_consensus.cc:359] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.485023 18207 raft_consensus.cc:385] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.485172 18204 tablet_bootstrap.cc:654] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.485363 18207 raft_consensus.cc:740] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4446ad69b93d4a62a3861fb1923713d5, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.486186 18207 consensus_queue.cc:260] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.487135 18189 heartbeater.cc:499] Master 127.16.240.190:42675 was elected leader, sending a full tablet report...
I20260709 12:21:11.490604 18205 ts_tablet_manager.cc:1434] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002: Time spent starting tablet: real 0.112s	user 0.004s	sys 0.020s
I20260709 12:21:11.491714 18205 tablet_bootstrap.cc:492] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002: Bootstrap starting.
I20260709 12:21:11.493925 18207 ts_tablet_manager.cc:1434] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.002s
I20260709 12:21:11.493965 18115 heartbeater.cc:499] Master 127.16.240.190:42675 was elected leader, sending a full tablet report...
I20260709 12:21:11.497866 18204 tablet_bootstrap.cc:492] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe: No bootstrap required, opened a new log
I20260709 12:21:11.498371 18204 ts_tablet_manager.cc:1403] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.003s
I20260709 12:21:11.498847 18205 tablet_bootstrap.cc:654] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.501477 18207 tablet_bootstrap.cc:492] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5: Bootstrap starting.
I20260709 12:21:11.501528 18204 raft_consensus.cc:359] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.502352 18204 raft_consensus.cc:385] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.502661 18204 raft_consensus.cc:740] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.503413 18204 consensus_queue.cc:260] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.509737 18207 tablet_bootstrap.cc:654] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.531236 18039 heartbeater.cc:499] Master 127.16.240.190:42675 was elected leader, sending a full tablet report...
I20260709 12:21:11.532409 18204 ts_tablet_manager.cc:1434] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe: Time spent starting tablet: real 0.034s	user 0.015s	sys 0.017s
I20260709 12:21:11.532622 18205 tablet_bootstrap.cc:492] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002: No bootstrap required, opened a new log
I20260709 12:21:11.533149 18205 ts_tablet_manager.cc:1403] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002: Time spent bootstrapping tablet: real 0.042s	user 0.032s	sys 0.007s
I20260709 12:21:11.533484 18204 tablet_bootstrap.cc:492] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe: Bootstrap starting.
I20260709 12:21:11.533962 18207 tablet_bootstrap.cc:492] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5: No bootstrap required, opened a new log
I20260709 12:21:11.534541 18207 ts_tablet_manager.cc:1403] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.018s
I20260709 12:21:11.537755 18207 raft_consensus.cc:359] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.538729 18207 raft_consensus.cc:385] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.539098 18207 raft_consensus.cc:740] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4446ad69b93d4a62a3861fb1923713d5, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.540207 18204 tablet_bootstrap.cc:654] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.540061 18207 consensus_queue.cc:260] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.542721 18207 ts_tablet_manager.cc:1434] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:21:11.543911 18207 tablet_bootstrap.cc:492] T 72fbb32a196a4161a14790e1827e73ec P 4446ad69b93d4a62a3861fb1923713d5: Bootstrap starting.
I20260709 12:21:11.549440 18205 raft_consensus.cc:359] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.550282 18205 raft_consensus.cc:385] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.550518 18207 tablet_bootstrap.cc:654] T 72fbb32a196a4161a14790e1827e73ec P 4446ad69b93d4a62a3861fb1923713d5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.550700 18205 raft_consensus.cc:740] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 917383ee650a411288b86b4895768002, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.551697 18205 consensus_queue.cc:260] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.555467 18204 tablet_bootstrap.cc:492] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe: No bootstrap required, opened a new log
I20260709 12:21:11.556017 18204 ts_tablet_manager.cc:1403] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.003s
I20260709 12:21:11.557674 18205 ts_tablet_manager.cc:1434] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.002s
I20260709 12:21:11.558923 18205 tablet_bootstrap.cc:492] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002: Bootstrap starting.
I20260709 12:21:11.559123 18204 raft_consensus.cc:359] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.559890 18204 raft_consensus.cc:385] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.560199 18204 raft_consensus.cc:740] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.560899 18204 consensus_queue.cc:260] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.563179 18204 ts_tablet_manager.cc:1434] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:21:11.564152 18204 tablet_bootstrap.cc:492] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe: Bootstrap starting.
I20260709 12:21:11.565766 18209 raft_consensus.cc:493] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.566464 18209 raft_consensus.cc:515] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } }
I20260709 12:21:11.570339 18205 tablet_bootstrap.cc:654] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.574944 18209 leader_election.cc:290] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875)
I20260709 12:21:11.596215 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b473ce7f315b414e9dcc16f27ee42bfc" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe" is_pre_election: true
W20260709 12:21:11.599056 18129 leader_election.cc:343] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:11.600263 18207 tablet_bootstrap.cc:492] T 72fbb32a196a4161a14790e1827e73ec P 4446ad69b93d4a62a3861fb1923713d5: No bootstrap required, opened a new log
I20260709 12:21:11.600975 18207 ts_tablet_manager.cc:1403] T 72fbb32a196a4161a14790e1827e73ec P 4446ad69b93d4a62a3861fb1923713d5: Time spent bootstrapping tablet: real 0.057s	user 0.021s	sys 0.028s
I20260709 12:21:11.602451 18204 tablet_bootstrap.cc:654] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.603412 18205 tablet_bootstrap.cc:492] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002: No bootstrap required, opened a new log
I20260709 12:21:11.603988 18205 ts_tablet_manager.cc:1403] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002: Time spent bootstrapping tablet: real 0.045s	user 0.030s	sys 0.010s
I20260709 12:21:11.604059 18207 raft_consensus.cc:359] T 72fbb32a196a4161a14790e1827e73ec P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.604862 18207 raft_consensus.cc:385] T 72fbb32a196a4161a14790e1827e73ec P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.605250 18207 raft_consensus.cc:740] T 72fbb32a196a4161a14790e1827e73ec P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4446ad69b93d4a62a3861fb1923713d5, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.606482 18207 consensus_queue.cc:260] T 72fbb32a196a4161a14790e1827e73ec P 4446ad69b93d4a62a3861fb1923713d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.608381 18205 raft_consensus.cc:359] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.609421 18205 raft_consensus.cc:385] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.609838 18205 raft_consensus.cc:740] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 917383ee650a411288b86b4895768002, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.610978 18205 consensus_queue.cc:260] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.612243 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b473ce7f315b414e9dcc16f27ee42bfc" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4446ad69b93d4a62a3861fb1923713d5" is_pre_election: true
I20260709 12:21:11.613569 18205 ts_tablet_manager.cc:1434] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:21:11.614635 18205 tablet_bootstrap.cc:492] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002: Bootstrap starting.
W20260709 12:21:11.617411 18130 leader_election.cc:343] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:11.617882 18207 ts_tablet_manager.cc:1434] T 72fbb32a196a4161a14790e1827e73ec P 4446ad69b93d4a62a3861fb1923713d5: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:21:11.617920 18130 leader_election.cc:304] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 917383ee650a411288b86b4895768002; no voters: 4446ad69b93d4a62a3861fb1923713d5, ba6e65ec56284f449dde8c8a931eacfe
I20260709 12:21:11.619225 18207 tablet_bootstrap.cc:492] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5: Bootstrap starting.
I20260709 12:21:11.620725 18209 raft_consensus.cc:2749] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:11.621668 18205 tablet_bootstrap.cc:654] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.626272 18204 tablet_bootstrap.cc:492] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe: No bootstrap required, opened a new log
I20260709 12:21:11.626703 18207 tablet_bootstrap.cc:654] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.626787 18204 ts_tablet_manager.cc:1403] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe: Time spent bootstrapping tablet: real 0.063s	user 0.016s	sys 0.007s
I20260709 12:21:11.630177 18204 raft_consensus.cc:359] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.630928 18204 raft_consensus.cc:385] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.631230 18204 raft_consensus.cc:740] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.632174 18204 consensus_queue.cc:260] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.637531 18204 ts_tablet_manager.cc:1434] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:21:11.638590 18204 tablet_bootstrap.cc:492] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe: Bootstrap starting.
I20260709 12:21:11.645208 18204 tablet_bootstrap.cc:654] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.648654 18210 raft_consensus.cc:493] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.649200 18210 raft_consensus.cc:515] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.655844 18210 leader_election.cc:290] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:11.663089 18204 tablet_bootstrap.cc:492] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe: No bootstrap required, opened a new log
I20260709 12:21:11.663496 18207 tablet_bootstrap.cc:492] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5: No bootstrap required, opened a new log
I20260709 12:21:11.663496 18205 tablet_bootstrap.cc:492] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002: No bootstrap required, opened a new log
I20260709 12:21:11.664229 18207 ts_tablet_manager.cc:1403] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.019s
I20260709 12:21:11.664361 18205 ts_tablet_manager.cc:1403] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002: Time spent bootstrapping tablet: real 0.050s	user 0.023s	sys 0.022s
I20260709 12:21:11.663594 18204 ts_tablet_manager.cc:1403] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.004s
I20260709 12:21:11.668047 18205 raft_consensus.cc:359] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.668869 18205 raft_consensus.cc:385] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.669205 18205 raft_consensus.cc:740] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 917383ee650a411288b86b4895768002, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.670061 18204 raft_consensus.cc:359] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.670162 18205 consensus_queue.cc:260] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.670851 18204 raft_consensus.cc:385] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.671186 18204 raft_consensus.cc:740] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.671862 18207 raft_consensus.cc:359] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.672649 18207 raft_consensus.cc:385] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.672953 18207 raft_consensus.cc:740] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4446ad69b93d4a62a3861fb1923713d5, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.673945 18207 consensus_queue.cc:260] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.674281 18204 consensus_queue.cc:260] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.677239 18207 ts_tablet_manager.cc:1434] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:21:11.677304 18164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4318035ed794a5e83625cc731fda175" candidate_uuid: "4446ad69b93d4a62a3861fb1923713d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "917383ee650a411288b86b4895768002" is_pre_election: true
I20260709 12:21:11.678347 18207 tablet_bootstrap.cc:492] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5: Bootstrap starting.
W20260709 12:21:11.678992 18054 leader_election.cc:343] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 917383ee650a411288b86b4895768002 (127.16.240.131:40621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:11.680217 18205 ts_tablet_manager.cc:1434] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:21:11.684526 18204 ts_tablet_manager.cc:1434] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.004s
I20260709 12:21:11.685597 18204 tablet_bootstrap.cc:492] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe: Bootstrap starting.
I20260709 12:21:11.685923 18207 tablet_bootstrap.cc:654] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.691176 18209 raft_consensus.cc:493] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.691721 18209 raft_consensus.cc:515] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.694492 18209 leader_election.cc:290] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875)
I20260709 12:21:11.692325 18204 tablet_bootstrap.cc:654] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.694974 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4318035ed794a5e83625cc731fda175" candidate_uuid: "4446ad69b93d4a62a3861fb1923713d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe" is_pre_election: true
I20260709 12:21:11.695914 18014 raft_consensus.cc:2468] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4446ad69b93d4a62a3861fb1923713d5 in term 0.
I20260709 12:21:11.696601 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a77f52af1814deab6b5fc9d724ed9e2" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe" is_pre_election: true
I20260709 12:21:11.697012 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a77f52af1814deab6b5fc9d724ed9e2" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4446ad69b93d4a62a3861fb1923713d5" is_pre_election: true
I20260709 12:21:11.699242 18054 leader_election.cc:304] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, ba6e65ec56284f449dde8c8a931eacfe; no voters: 917383ee650a411288b86b4895768002
I20260709 12:21:11.700971 18210 raft_consensus.cc:2804] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:11.701964 18210 raft_consensus.cc:493] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.702729 18210 raft_consensus.cc:3060] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.703732 18205 tablet_bootstrap.cc:492] T c4318035ed794a5e83625cc731fda175 P 917383ee650a411288b86b4895768002: Bootstrap starting.
W20260709 12:21:11.704186 18129 leader_election.cc:343] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:11.705713 18130 leader_election.cc:343] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:11.706319 18130 leader_election.cc:304] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 917383ee650a411288b86b4895768002; no voters: 4446ad69b93d4a62a3861fb1923713d5, ba6e65ec56284f449dde8c8a931eacfe
I20260709 12:21:11.707357 18209 raft_consensus.cc:2749] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:11.714730 18205 tablet_bootstrap.cc:654] T c4318035ed794a5e83625cc731fda175 P 917383ee650a411288b86b4895768002: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.718101 18204 tablet_bootstrap.cc:492] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe: No bootstrap required, opened a new log
I20260709 12:21:11.718782 18204 ts_tablet_manager.cc:1403] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.016s
I20260709 12:21:11.721923 18210 raft_consensus.cc:515] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.722997 18204 raft_consensus.cc:359] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.724109 18204 raft_consensus.cc:385] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.724577 18204 raft_consensus.cc:740] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.725780 18204 consensus_queue.cc:260] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.726884 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4318035ed794a5e83625cc731fda175" candidate_uuid: "4446ad69b93d4a62a3861fb1923713d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
I20260709 12:21:11.727762 18013 raft_consensus.cc:3060] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.734750 18204 ts_tablet_manager.cc:1434] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.004s
I20260709 12:21:11.736577 18204 tablet_bootstrap.cc:492] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe: Bootstrap starting.
I20260709 12:21:11.747108 18204 tablet_bootstrap.cc:654] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:11.750383 17960 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:11.759336 18209 raft_consensus.cc:493] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.759887 18209 raft_consensus.cc:515] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.760373 18204 tablet_bootstrap.cc:492] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe: No bootstrap required, opened a new log
I20260709 12:21:11.760998 18204 ts_tablet_manager.cc:1403] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.012s
I20260709 12:21:11.762091 18209 leader_election.cc:290] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875)
I20260709 12:21:11.762953 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fbb32a196a4161a14790e1827e73ec" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe" is_pre_election: true
I20260709 12:21:11.763589 18014 raft_consensus.cc:2468] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 0.
I20260709 12:21:11.763649 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fbb32a196a4161a14790e1827e73ec" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4446ad69b93d4a62a3861fb1923713d5" is_pre_election: true
I20260709 12:21:11.765050 18090 raft_consensus.cc:2468] T 72fbb32a196a4161a14790e1827e73ec P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 0.
I20260709 12:21:11.765056 18210 leader_election.cc:290] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [CANDIDATE]: Term 1 election: Requested vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:11.766876 18130 leader_election.cc:304] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, 917383ee650a411288b86b4895768002; no voters: 
I20260709 12:21:11.767127 18210 raft_consensus.cc:493] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.767829 18210 raft_consensus.cc:515] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.769264 18209 raft_consensus.cc:2804] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:11.769810 18209 raft_consensus.cc:493] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.770219 18209 raft_consensus.cc:3060] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.770406 18210 leader_election.cc:290] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:11.774843 18207 tablet_bootstrap.cc:492] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5: No bootstrap required, opened a new log
I20260709 12:21:11.774971 18205 tablet_bootstrap.cc:492] T c4318035ed794a5e83625cc731fda175 P 917383ee650a411288b86b4895768002: No bootstrap required, opened a new log
I20260709 12:21:11.775434 18205 ts_tablet_manager.cc:1403] T c4318035ed794a5e83625cc731fda175 P 917383ee650a411288b86b4895768002: Time spent bootstrapping tablet: real 0.072s	user 0.020s	sys 0.039s
I20260709 12:21:11.775785 18204 raft_consensus.cc:359] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.776592 18204 raft_consensus.cc:385] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.776952 18204 raft_consensus.cc:740] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.763476 18013 raft_consensus.cc:2468] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4446ad69b93d4a62a3861fb1923713d5 in term 1.
I20260709 12:21:11.777844 18204 consensus_queue.cc:260] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.778374 18164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4318035ed794a5e83625cc731fda175" candidate_uuid: "4446ad69b93d4a62a3861fb1923713d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "917383ee650a411288b86b4895768002"
I20260709 12:21:11.775437 18207 ts_tablet_manager.cc:1403] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5: Time spent bootstrapping tablet: real 0.097s	user 0.026s	sys 0.068s
I20260709 12:21:11.778595 18205 raft_consensus.cc:359] T c4318035ed794a5e83625cc731fda175 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.779350 18205 raft_consensus.cc:385] T c4318035ed794a5e83625cc731fda175 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.779677 18205 raft_consensus.cc:740] T c4318035ed794a5e83625cc731fda175 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 917383ee650a411288b86b4895768002, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.780387 18204 ts_tablet_manager.cc:1434] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 12:21:11.780490 18205 consensus_queue.cc:260] T c4318035ed794a5e83625cc731fda175 P 917383ee650a411288b86b4895768002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.781539 18204 tablet_bootstrap.cc:492] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe: Bootstrap starting.
I20260709 12:21:11.782187 18207 raft_consensus.cc:359] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } }
I20260709 12:21:11.783221 18207 raft_consensus.cc:385] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.783619 18207 raft_consensus.cc:740] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4446ad69b93d4a62a3861fb1923713d5, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.784837 18207 consensus_queue.cc:260] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } }
I20260709 12:21:11.786084 18213 raft_consensus.cc:493] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.786641 18213 raft_consensus.cc:515] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.788811 18204 tablet_bootstrap.cc:654] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.791942 18207 ts_tablet_manager.cc:1434] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:21:11.793042 18207 tablet_bootstrap.cc:492] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5: Bootstrap starting.
I20260709 12:21:11.793089 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797090c2ec247bfb432e56d7c913d05" candidate_uuid: "4446ad69b93d4a62a3861fb1923713d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "917383ee650a411288b86b4895768002" is_pre_election: true
I20260709 12:21:11.794226 18164 raft_consensus.cc:3060] T c4318035ed794a5e83625cc731fda175 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:11.800273 18054 leader_election.cc:343] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 917383ee650a411288b86b4895768002 (127.16.240.131:40621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:11.801345 18054 leader_election.cc:304] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:11.801733 18164 raft_consensus.cc:2468] T c4318035ed794a5e83625cc731fda175 P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4446ad69b93d4a62a3861fb1923713d5 in term 1.
I20260709 12:21:11.802832 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797090c2ec247bfb432e56d7c913d05" candidate_uuid: "4446ad69b93d4a62a3861fb1923713d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe" is_pre_election: true
I20260709 12:21:11.804422 18229 raft_consensus.cc:2804] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:11.805133 18229 raft_consensus.cc:697] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [term 1 LEADER]: Becoming Leader. State: Replica: 4446ad69b93d4a62a3861fb1923713d5, State: Running, Role: LEADER
I20260709 12:21:11.805428 18213 leader_election.cc:290] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:11.805953 18213 raft_consensus.cc:493] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.806135 18229 consensus_queue.cc:237] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.806541 18213 raft_consensus.cc:515] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
W20260709 12:21:11.810045 18054 leader_election.cc:343] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:11.810670 18054 leader_election.cc:304] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5; no voters: 917383ee650a411288b86b4895768002, ba6e65ec56284f449dde8c8a931eacfe
I20260709 12:21:11.813476 18210 raft_consensus.cc:2749] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:11.816555 18213 leader_election.cc:290] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:11.819353 18207 tablet_bootstrap.cc:654] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.819408 18209 raft_consensus.cc:515] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.822613 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fbb32a196a4161a14790e1827e73ec" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
I20260709 12:21:11.823231 18013 raft_consensus.cc:3060] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.831257 18013 raft_consensus.cc:2468] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 1.
I20260709 12:21:11.793432 18205 ts_tablet_manager.cc:1434] T c4318035ed794a5e83625cc731fda175 P 917383ee650a411288b86b4895768002: Time spent starting tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:21:11.835774 18205 tablet_bootstrap.cc:492] T d246e0caab544fd8b721745d6aa518ba P 917383ee650a411288b86b4895768002: Bootstrap starting.
I20260709 12:21:11.836719 18213 raft_consensus.cc:493] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.835268 17910 catalog_manager.cc:5697] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "4446ad69b93d4a62a3861fb1923713d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:11.837234 18213 raft_consensus.cc:515] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.843190 18213 leader_election.cc:290] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:11.843999 18164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a77f52af1814deab6b5fc9d724ed9e2" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "917383ee650a411288b86b4895768002" is_pre_election: true
I20260709 12:21:11.844825 18164 raft_consensus.cc:2468] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 0.
I20260709 12:21:11.846556 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a420cbdc52422aab49dc58e04e7b1e" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "917383ee650a411288b86b4895768002" is_pre_election: true
I20260709 12:21:11.847381 18163 raft_consensus.cc:2468] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 0.
I20260709 12:21:11.857234 18209 leader_election.cc:290] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 election: Requested vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875)
I20260709 12:21:11.858624 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a77f52af1814deab6b5fc9d724ed9e2" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4446ad69b93d4a62a3861fb1923713d5" is_pre_election: true
I20260709 12:21:11.858783 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fbb32a196a4161a14790e1827e73ec" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
I20260709 12:21:11.859437 18089 raft_consensus.cc:3060] T 72fbb32a196a4161a14790e1827e73ec P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.860702 17979 leader_election.cc:304] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 917383ee650a411288b86b4895768002, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:11.863088 18205 tablet_bootstrap.cc:654] T d246e0caab544fd8b721745d6aa518ba P 917383ee650a411288b86b4895768002: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.865206 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a420cbdc52422aab49dc58e04e7b1e" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4446ad69b93d4a62a3861fb1923713d5" is_pre_election: true
I20260709 12:21:11.865919 18090 raft_consensus.cc:2468] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 0.
I20260709 12:21:11.861929 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08454883e9dc40e58a5e1c61624e2126" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "917383ee650a411288b86b4895768002" is_pre_election: true
I20260709 12:21:11.867857 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08454883e9dc40e58a5e1c61624e2126" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4446ad69b93d4a62a3861fb1923713d5" is_pre_election: true
W20260709 12:21:11.869489 17980 leader_election.cc:343] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:11.870467 18089 raft_consensus.cc:2468] T 72fbb32a196a4161a14790e1827e73ec P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 1.
I20260709 12:21:11.870520 17980 leader_election.cc:304] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:11.873317 18234 raft_consensus.cc:2804] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:11.873347 18129 leader_election.cc:304] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 917383ee650a411288b86b4895768002, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:11.873875 18207 tablet_bootstrap.cc:492] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5: No bootstrap required, opened a new log
I20260709 12:21:11.873845 18234 raft_consensus.cc:493] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.874336 18234 raft_consensus.cc:3060] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.874506 18207 ts_tablet_manager.cc:1403] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.015s
I20260709 12:21:11.874578 18209 raft_consensus.cc:2804] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:21:11.875721 17979 leader_election.cc:343] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 917383ee650a411288b86b4895768002 (127.16.240.131:40621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:11.877470 18209 raft_consensus.cc:697] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [term 1 LEADER]: Becoming Leader. State: Replica: 917383ee650a411288b86b4895768002, State: Running, Role: LEADER
I20260709 12:21:11.878403 18209 consensus_queue.cc:237] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
W20260709 12:21:11.880259 17980 leader_election.cc:343] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:11.880872 17980 leader_election.cc:304] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba6e65ec56284f449dde8c8a931eacfe; no voters: 4446ad69b93d4a62a3861fb1923713d5, 917383ee650a411288b86b4895768002
I20260709 12:21:11.872388 18213 raft_consensus.cc:2804] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:11.883569 18207 raft_consensus.cc:359] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.884389 18207 raft_consensus.cc:385] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.885138 18207 raft_consensus.cc:740] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4446ad69b93d4a62a3861fb1923713d5, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.884994 18234 raft_consensus.cc:515] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.886140 18207 consensus_queue.cc:260] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.890313 18204 tablet_bootstrap.cc:492] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe: No bootstrap required, opened a new log
I20260709 12:21:11.890854 18204 ts_tablet_manager.cc:1403] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe: Time spent bootstrapping tablet: real 0.110s	user 0.031s	sys 0.038s
I20260709 12:21:11.891633 18207 ts_tablet_manager.cc:1434] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:21:11.893002 18213 raft_consensus.cc:493] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.894268 18234 leader_election.cc:290] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 election: Requested vote from peers 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:11.894465 18207 tablet_bootstrap.cc:492] T d246e0caab544fd8b721745d6aa518ba P 4446ad69b93d4a62a3861fb1923713d5: Bootstrap starting.
I20260709 12:21:11.894891 18234 raft_consensus.cc:2749] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:11.895803 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a420cbdc52422aab49dc58e04e7b1e" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "917383ee650a411288b86b4895768002"
I20260709 12:21:11.896579 18163 raft_consensus.cc:3060] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.896631 18204 raft_consensus.cc:359] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } }
I20260709 12:21:11.897534 18204 raft_consensus.cc:385] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.897878 18204 raft_consensus.cc:740] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.898715 18204 consensus_queue.cc:260] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } }
I20260709 12:21:11.902307 18204 ts_tablet_manager.cc:1434] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:21:11.903390 18204 tablet_bootstrap.cc:492] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe: Bootstrap starting.
I20260709 12:21:11.904651 18207 tablet_bootstrap.cc:654] T d246e0caab544fd8b721745d6aa518ba P 4446ad69b93d4a62a3861fb1923713d5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.915225 18204 tablet_bootstrap.cc:654] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.916919 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a420cbdc52422aab49dc58e04e7b1e" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
I20260709 12:21:11.917580 18089 raft_consensus.cc:3060] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.919929 18205 tablet_bootstrap.cc:492] T d246e0caab544fd8b721745d6aa518ba P 917383ee650a411288b86b4895768002: No bootstrap required, opened a new log
I20260709 12:21:11.920620 18205 ts_tablet_manager.cc:1403] T d246e0caab544fd8b721745d6aa518ba P 917383ee650a411288b86b4895768002: Time spent bootstrapping tablet: real 0.085s	user 0.014s	sys 0.011s
I20260709 12:21:11.907342 18213 raft_consensus.cc:3060] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.917073 18242 raft_consensus.cc:493] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.924635 18242 raft_consensus.cc:515] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.927901 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d246e0caab544fd8b721745d6aa518ba" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4446ad69b93d4a62a3861fb1923713d5" is_pre_election: true
I20260709 12:21:11.928512 18205 raft_consensus.cc:359] T d246e0caab544fd8b721745d6aa518ba P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.929225 18205 raft_consensus.cc:385] T d246e0caab544fd8b721745d6aa518ba P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:21:11.929478 17980 leader_election.cc:343] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:11.929557 18205 raft_consensus.cc:740] T d246e0caab544fd8b721745d6aa518ba P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 917383ee650a411288b86b4895768002, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.931231 18205 consensus_queue.cc:260] T d246e0caab544fd8b721745d6aa518ba P 917383ee650a411288b86b4895768002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.934089 18205 ts_tablet_manager.cc:1434] T d246e0caab544fd8b721745d6aa518ba P 917383ee650a411288b86b4895768002: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:21:11.935676 18205 tablet_bootstrap.cc:492] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002: Bootstrap starting.
I20260709 12:21:11.936221 18213 raft_consensus.cc:515] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.939193 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a77f52af1814deab6b5fc9d724ed9e2" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
W20260709 12:21:11.940707 17980 leader_election.cc:343] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:11.941174 18164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d246e0caab544fd8b721745d6aa518ba" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "917383ee650a411288b86b4895768002" is_pre_election: true
I20260709 12:21:11.944759 18164 raft_consensus.cc:2468] T d246e0caab544fd8b721745d6aa518ba P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 0.
I20260709 12:21:11.946218 17979 leader_election.cc:304] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 917383ee650a411288b86b4895768002, ba6e65ec56284f449dde8c8a931eacfe; no voters: 4446ad69b93d4a62a3861fb1923713d5
I20260709 12:21:11.947254 18205 tablet_bootstrap.cc:654] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.947466 18234 raft_consensus.cc:2804] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:11.948143 18234 raft_consensus.cc:493] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.948598 18234 raft_consensus.cc:3060] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.951592 18242 leader_election.cc:290] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:11.954671 18163 raft_consensus.cc:2468] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 1.
I20260709 12:21:11.956033 17979 leader_election.cc:304] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 917383ee650a411288b86b4895768002, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:11.958130 18213 leader_election.cc:290] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 election: Requested vote from peers 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:11.958388 18164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a77f52af1814deab6b5fc9d724ed9e2" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "917383ee650a411288b86b4895768002"
I20260709 12:21:11.958738 18213 raft_consensus.cc:2804] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:11.959075 18164 raft_consensus.cc:3060] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.959250 18213 raft_consensus.cc:697] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 1 LEADER]: Becoming Leader. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Running, Role: LEADER
I20260709 12:21:11.960342 18089 raft_consensus.cc:2468] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 1.
I20260709 12:21:11.960232 18213 consensus_queue.cc:237] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.958824 18234 raft_consensus.cc:515] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.960619 17910 catalog_manager.cc:5697] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 917383ee650a411288b86b4895768002 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "917383ee650a411288b86b4895768002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:11.968351 18207 tablet_bootstrap.cc:492] T d246e0caab544fd8b721745d6aa518ba P 4446ad69b93d4a62a3861fb1923713d5: No bootstrap required, opened a new log
I20260709 12:21:11.972429 18207 ts_tablet_manager.cc:1403] T d246e0caab544fd8b721745d6aa518ba P 4446ad69b93d4a62a3861fb1923713d5: Time spent bootstrapping tablet: real 0.078s	user 0.027s	sys 0.019s
I20260709 12:21:11.973688 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d246e0caab544fd8b721745d6aa518ba" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "917383ee650a411288b86b4895768002"
I20260709 12:21:11.974505 18163 raft_consensus.cc:3060] T d246e0caab544fd8b721745d6aa518ba P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.975682 18207 raft_consensus.cc:359] T d246e0caab544fd8b721745d6aa518ba P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.976572 18207 raft_consensus.cc:385] T d246e0caab544fd8b721745d6aa518ba P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.976975 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d246e0caab544fd8b721745d6aa518ba" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
I20260709 12:21:11.976922 18207 raft_consensus.cc:740] T d246e0caab544fd8b721745d6aa518ba P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4446ad69b93d4a62a3861fb1923713d5, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.970769 18204 tablet_bootstrap.cc:492] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe: No bootstrap required, opened a new log
I20260709 12:21:11.978048 18207 consensus_queue.cc:260] T d246e0caab544fd8b721745d6aa518ba P 4446ad69b93d4a62a3861fb1923713d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.970906 18205 tablet_bootstrap.cc:492] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002: No bootstrap required, opened a new log
I20260709 12:21:11.979123 18089 raft_consensus.cc:3060] T d246e0caab544fd8b721745d6aa518ba P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:11.980122 18205 ts_tablet_manager.cc:1403] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.006s
I20260709 12:21:11.981047 18207 ts_tablet_manager.cc:1434] T d246e0caab544fd8b721745d6aa518ba P 4446ad69b93d4a62a3861fb1923713d5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:21:11.982133 18207 tablet_bootstrap.cc:492] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5: Bootstrap starting.
I20260709 12:21:11.984460 17908 catalog_manager.cc:5697] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe reported cstate change: term changed from 0 to 1, leader changed from <none> to ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129). New cstate: current_term: 1 leader_uuid: "ba6e65ec56284f449dde8c8a931eacfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:11.987073 18089 raft_consensus.cc:2468] T d246e0caab544fd8b721745d6aa518ba P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 1.
I20260709 12:21:11.978647 18204 ts_tablet_manager.cc:1403] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.008s
I20260709 12:21:11.987195 18234 leader_election.cc:290] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 election: Requested vote from peers 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:11.983597 18205 raft_consensus.cc:359] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.993649 18205 raft_consensus.cc:385] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.993736 18204 raft_consensus.cc:359] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.994105 18205 raft_consensus.cc:740] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 917383ee650a411288b86b4895768002, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.994424 18204 raft_consensus.cc:385] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:11.994732 18204 raft_consensus.cc:740] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Initialized, Role: FOLLOWER
I20260709 12:21:11.995169 18205 consensus_queue.cc:260] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.995553 18204 consensus_queue.cc:260] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:11.993327 18207 tablet_bootstrap.cc:654] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:11.998005 18204 ts_tablet_manager.cc:1434] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 12:21:11.998162 18164 raft_consensus.cc:2468] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 1.
I20260709 12:21:11.998986 18204 tablet_bootstrap.cc:492] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe: Bootstrap starting.
I20260709 12:21:11.999451 17979 leader_election.cc:304] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 917383ee650a411288b86b4895768002, ba6e65ec56284f449dde8c8a931eacfe; no voters: 4446ad69b93d4a62a3861fb1923713d5
I20260709 12:21:12.000351 18234 raft_consensus.cc:2804] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:11.987078 18163 raft_consensus.cc:2468] T d246e0caab544fd8b721745d6aa518ba P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 1.
I20260709 12:21:12.000805 18205 ts_tablet_manager.cc:1434] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.004s
I20260709 12:21:12.000866 18234 raft_consensus.cc:697] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 1 LEADER]: Becoming Leader. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Running, Role: LEADER
I20260709 12:21:12.007371 18205 tablet_bootstrap.cc:492] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002: Bootstrap starting.
I20260709 12:21:12.006989 18234 consensus_queue.cc:237] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.003952 17980 leader_election.cc:304] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:12.011077 18242 raft_consensus.cc:2804] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:12.011310 18209 raft_consensus.cc:493] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.011869 18242 raft_consensus.cc:697] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe [term 1 LEADER]: Becoming Leader. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Running, Role: LEADER
I20260709 12:21:12.011904 18209 raft_consensus.cc:515] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.013155 18242 consensus_queue.cc:237] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.014393 18209 leader_election.cc:290] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875)
I20260709 12:21:12.015384 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797090c2ec247bfb432e56d7c913d05" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe" is_pre_election: true
I20260709 12:21:12.016045 18013 raft_consensus.cc:2468] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 0.
I20260709 12:21:12.017072 18205 tablet_bootstrap.cc:654] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:12.016858 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797090c2ec247bfb432e56d7c913d05" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4446ad69b93d4a62a3861fb1923713d5" is_pre_election: true
I20260709 12:21:12.018450 18089 raft_consensus.cc:2468] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 0.
I20260709 12:21:12.017467 18129 leader_election.cc:304] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 917383ee650a411288b86b4895768002, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:12.020321 18209 raft_consensus.cc:2804] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:12.020720 18209 raft_consensus.cc:493] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.021080 18209 raft_consensus.cc:3060] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:12.030618 18205 tablet_bootstrap.cc:492] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002: No bootstrap required, opened a new log
I20260709 12:21:12.031898 18205 ts_tablet_manager.cc:1403] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.006s
I20260709 12:21:12.033231 18207 tablet_bootstrap.cc:492] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5: No bootstrap required, opened a new log
I20260709 12:21:12.032979 18209 raft_consensus.cc:515] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.033756 18207 ts_tablet_manager.cc:1403] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.008s
I20260709 12:21:12.034663 18205 raft_consensus.cc:359] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.035364 18205 raft_consensus.cc:385] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:12.035615 18205 raft_consensus.cc:740] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 917383ee650a411288b86b4895768002, State: Initialized, Role: FOLLOWER
I20260709 12:21:12.036317 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797090c2ec247bfb432e56d7c913d05" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
I20260709 12:21:12.036656 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797090c2ec247bfb432e56d7c913d05" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
I20260709 12:21:12.036329 18205 consensus_queue.cc:260] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.036319 18207 raft_consensus.cc:359] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.037213 18089 raft_consensus.cc:3060] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:12.037253 18207 raft_consensus.cc:385] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:12.037806 18207 raft_consensus.cc:740] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4446ad69b93d4a62a3861fb1923713d5, State: Initialized, Role: FOLLOWER
I20260709 12:21:12.038509 18205 ts_tablet_manager.cc:1434] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:21:12.038501 18207 consensus_queue.cc:260] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.037187 18013 raft_consensus.cc:3060] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:12.042096 18205 tablet_bootstrap.cc:492] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002: Bootstrap starting.
I20260709 12:21:12.049798 18207 ts_tablet_manager.cc:1434] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 12:21:12.050009 18204 tablet_bootstrap.cc:654] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:12.049468 18013 raft_consensus.cc:2468] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 1.
I20260709 12:21:12.052196 18129 leader_election.cc:304] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 917383ee650a411288b86b4895768002, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:12.052588 18209 leader_election.cc:290] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 election: Requested vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875)
I20260709 12:21:12.053038 18089 raft_consensus.cc:2468] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 1.
I20260709 12:21:12.053293 18231 raft_consensus.cc:2804] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:12.054471 18205 tablet_bootstrap.cc:654] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:12.054996 18207 tablet_bootstrap.cc:492] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5: Bootstrap starting.
I20260709 12:21:12.062240 18204 tablet_bootstrap.cc:492] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe: No bootstrap required, opened a new log
I20260709 12:21:12.062750 18204 ts_tablet_manager.cc:1403] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.000s
I20260709 12:21:12.062804 18207 tablet_bootstrap.cc:654] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:12.066427 18204 raft_consensus.cc:359] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.063565 17910 catalog_manager.cc:5697] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe reported cstate change: term changed from 0 to 1, leader changed from <none> to ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129). New cstate: current_term: 1 leader_uuid: "ba6e65ec56284f449dde8c8a931eacfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:12.067302 18204 raft_consensus.cc:385] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:12.067821 18204 raft_consensus.cc:740] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Initialized, Role: FOLLOWER
I20260709 12:21:12.068830 18204 consensus_queue.cc:260] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.072788 18205 tablet_bootstrap.cc:492] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002: No bootstrap required, opened a new log
I20260709 12:21:12.073565 18205 ts_tablet_manager.cc:1403] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.000s
I20260709 12:21:12.075821 18231 raft_consensus.cc:697] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 1 LEADER]: Becoming Leader. State: Replica: 917383ee650a411288b86b4895768002, State: Running, Role: LEADER
I20260709 12:21:12.076319 18229 raft_consensus.cc:493] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.076594 18205 raft_consensus.cc:359] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.076844 18229 raft_consensus.cc:515] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.077391 18205 raft_consensus.cc:385] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:12.077026 18231 consensus_queue.cc:237] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.077692 18205 raft_consensus.cc:740] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 917383ee650a411288b86b4895768002, State: Initialized, Role: FOLLOWER
I20260709 12:21:12.078429 18205 consensus_queue.cc:260] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.079172 18229 leader_election.cc:290] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:12.080442 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a77f52af1814deab6b5fc9d724ed9e2" candidate_uuid: "4446ad69b93d4a62a3861fb1923713d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe" is_pre_election: true
I20260709 12:21:12.080935 18204 ts_tablet_manager.cc:1434] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.001s
I20260709 12:21:12.081140 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a77f52af1814deab6b5fc9d724ed9e2" candidate_uuid: "4446ad69b93d4a62a3861fb1923713d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "917383ee650a411288b86b4895768002" is_pre_election: true
I20260709 12:21:12.081892 18204 tablet_bootstrap.cc:492] T 2d7fc6d43ca44313b5454b047cb20056 P ba6e65ec56284f449dde8c8a931eacfe: Bootstrap starting.
I20260709 12:21:12.079990 18207 tablet_bootstrap.cc:492] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5: No bootstrap required, opened a new log
I20260709 12:21:12.082201 18163 raft_consensus.cc:2393] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4446ad69b93d4a62a3861fb1923713d5 in current term 1: Already voted for candidate ba6e65ec56284f449dde8c8a931eacfe in this term.
I20260709 12:21:12.082564 18207 ts_tablet_manager.cc:1403] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.003s
I20260709 12:21:12.084120 18054 leader_election.cc:304] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5; no voters: 917383ee650a411288b86b4895768002, ba6e65ec56284f449dde8c8a931eacfe
I20260709 12:21:12.085301 18207 raft_consensus.cc:359] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.085995 18207 raft_consensus.cc:385] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:12.086284 18207 raft_consensus.cc:740] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4446ad69b93d4a62a3861fb1923713d5, State: Initialized, Role: FOLLOWER
I20260709 12:21:12.086305 18229 raft_consensus.cc:3060] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:12.087459 18209 raft_consensus.cc:493] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.087363 18207 consensus_queue.cc:260] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.088604 18205 ts_tablet_manager.cc:1434] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:21:12.088191 18209 raft_consensus.cc:515] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.090561 18209 leader_election.cc:290] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875)
I20260709 12:21:12.092109 18205 tablet_bootstrap.cc:492] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002: Bootstrap starting.
I20260709 12:21:12.092157 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7fc6d43ca44313b5454b047cb20056" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe" is_pre_election: true
W20260709 12:21:12.093696 18129 leader_election.cc:343] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:12.094570 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7fc6d43ca44313b5454b047cb20056" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4446ad69b93d4a62a3861fb1923713d5" is_pre_election: true
I20260709 12:21:12.095261 18089 raft_consensus.cc:2468] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 0.
I20260709 12:21:12.095404 18229 raft_consensus.cc:2749] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:12.095477 18207 ts_tablet_manager.cc:1434] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:21:12.096200 18204 tablet_bootstrap.cc:654] T 2d7fc6d43ca44313b5454b047cb20056 P ba6e65ec56284f449dde8c8a931eacfe: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:12.096570 18207 tablet_bootstrap.cc:492] T 8210f9521a824b97addc9f8d5a7864fb P 4446ad69b93d4a62a3861fb1923713d5: Bootstrap starting.
I20260709 12:21:12.096990 18130 leader_election.cc:304] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, 917383ee650a411288b86b4895768002; no voters: ba6e65ec56284f449dde8c8a931eacfe
I20260709 12:21:12.098078 18209 raft_consensus.cc:2804] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:12.098599 18209 raft_consensus.cc:493] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.098932 18209 raft_consensus.cc:3060] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:12.101881 18205 tablet_bootstrap.cc:654] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:12.101583 17908 catalog_manager.cc:5697] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe reported cstate change: term changed from 0 to 1, leader changed from <none> to ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129). New cstate: current_term: 1 leader_uuid: "ba6e65ec56284f449dde8c8a931eacfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:12.106336 18209 raft_consensus.cc:515] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.109916 18234 raft_consensus.cc:493] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.110435 18234 raft_consensus.cc:515] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } }
I20260709 12:21:12.112747 18234 leader_election.cc:290] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 917383ee650a411288b86b4895768002 (127.16.240.131:40621), 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875)
I20260709 12:21:12.115167 18209 leader_election.cc:290] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 election: Requested vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875)
I20260709 12:21:12.115278 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b473ce7f315b414e9dcc16f27ee42bfc" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4446ad69b93d4a62a3861fb1923713d5" is_pre_election: true
I20260709 12:21:12.115995 18089 raft_consensus.cc:2468] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 0.
I20260709 12:21:12.117789 17980 leader_election.cc:304] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:12.117851 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b473ce7f315b414e9dcc16f27ee42bfc" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "917383ee650a411288b86b4895768002" is_pre_election: true
I20260709 12:21:12.118237 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7fc6d43ca44313b5454b047cb20056" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
I20260709 12:21:12.118898 18163 raft_consensus.cc:2468] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 0.
W20260709 12:21:12.120393 18129 leader_election.cc:343] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:12.117048 18207 tablet_bootstrap.cc:654] T 8210f9521a824b97addc9f8d5a7864fb P 4446ad69b93d4a62a3861fb1923713d5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:12.120975 18234 raft_consensus.cc:2804] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:12.121541 18234 raft_consensus.cc:493] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.122340 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7fc6d43ca44313b5454b047cb20056" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
I20260709 12:21:12.123234 18089 raft_consensus.cc:3060] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:12.121882 18234 raft_consensus.cc:3060] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:12.124675 17908 catalog_manager.cc:5697] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 917383ee650a411288b86b4895768002 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "917383ee650a411288b86b4895768002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:12.137691 18205 tablet_bootstrap.cc:492] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002: No bootstrap required, opened a new log
I20260709 12:21:12.138355 18205 ts_tablet_manager.cc:1403] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.009s
W20260709 12:21:12.141993 18190 tablet.cc:2406] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:21:12.142403 18205 raft_consensus.cc:359] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.143010 18089 raft_consensus.cc:2468] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 1.
I20260709 12:21:12.143306 18205 raft_consensus.cc:385] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:12.143690 18205 raft_consensus.cc:740] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 917383ee650a411288b86b4895768002, State: Initialized, Role: FOLLOWER
I20260709 12:21:12.144531 18130 leader_election.cc:304] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, 917383ee650a411288b86b4895768002; no voters: ba6e65ec56284f449dde8c8a931eacfe
I20260709 12:21:12.144599 18205 consensus_queue.cc:260] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.146005 18234 raft_consensus.cc:515] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } }
I20260709 12:21:12.149914 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b473ce7f315b414e9dcc16f27ee42bfc" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "917383ee650a411288b86b4895768002"
I20260709 12:21:12.150429 18204 tablet_bootstrap.cc:492] T 2d7fc6d43ca44313b5454b047cb20056 P ba6e65ec56284f449dde8c8a931eacfe: No bootstrap required, opened a new log
I20260709 12:21:12.150931 18163 raft_consensus.cc:3060] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:12.151070 18204 ts_tablet_manager.cc:1403] T 2d7fc6d43ca44313b5454b047cb20056 P ba6e65ec56284f449dde8c8a931eacfe: Time spent bootstrapping tablet: real 0.069s	user 0.020s	sys 0.011s
I20260709 12:21:12.155077 18204 raft_consensus.cc:359] T 2d7fc6d43ca44313b5454b047cb20056 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.156070 18204 raft_consensus.cc:385] T 2d7fc6d43ca44313b5454b047cb20056 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:12.156435 18204 raft_consensus.cc:740] T 2d7fc6d43ca44313b5454b047cb20056 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Initialized, Role: FOLLOWER
I20260709 12:21:12.157456 18209 raft_consensus.cc:2804] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:12.157953 18209 raft_consensus.cc:697] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [term 1 LEADER]: Becoming Leader. State: Replica: 917383ee650a411288b86b4895768002, State: Running, Role: LEADER
I20260709 12:21:12.158877 18205 ts_tablet_manager.cc:1434] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:21:12.158808 18209 consensus_queue.cc:237] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.160104 18204 consensus_queue.cc:260] T 2d7fc6d43ca44313b5454b047cb20056 P ba6e65ec56284f449dde8c8a931eacfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.162358 18163 raft_consensus.cc:2468] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 1.
I20260709 12:21:12.162528 18204 ts_tablet_manager.cc:1434] T 2d7fc6d43ca44313b5454b047cb20056 P ba6e65ec56284f449dde8c8a931eacfe: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:21:12.163554 18234 leader_election.cc:290] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 election: Requested vote from peers 917383ee650a411288b86b4895768002 (127.16.240.131:40621), 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875)
I20260709 12:21:12.163645 17979 leader_election.cc:304] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 917383ee650a411288b86b4895768002, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:12.165967 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b473ce7f315b414e9dcc16f27ee42bfc" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
I20260709 12:21:12.166734 18089 raft_consensus.cc:3060] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:12.168251 18234 raft_consensus.cc:2804] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:12.168787 18234 raft_consensus.cc:697] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [term 1 LEADER]: Becoming Leader. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Running, Role: LEADER
I20260709 12:21:12.169631 18234 consensus_queue.cc:237] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } }
I20260709 12:21:12.171908 18207 tablet_bootstrap.cc:492] T 8210f9521a824b97addc9f8d5a7864fb P 4446ad69b93d4a62a3861fb1923713d5: No bootstrap required, opened a new log
I20260709 12:21:12.172484 18207 ts_tablet_manager.cc:1403] T 8210f9521a824b97addc9f8d5a7864fb P 4446ad69b93d4a62a3861fb1923713d5: Time spent bootstrapping tablet: real 0.076s	user 0.025s	sys 0.022s
I20260709 12:21:12.172896 18231 raft_consensus.cc:493] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.173401 18231 raft_consensus.cc:515] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.175576 18231 leader_election.cc:290] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875)
I20260709 12:21:12.177353 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08454883e9dc40e58a5e1c61624e2126" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4446ad69b93d4a62a3861fb1923713d5" is_pre_election: true
I20260709 12:21:12.177109 18207 raft_consensus.cc:359] T 8210f9521a824b97addc9f8d5a7864fb P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.178066 18090 raft_consensus.cc:2468] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 0.
I20260709 12:21:12.178138 18207 raft_consensus.cc:385] T 8210f9521a824b97addc9f8d5a7864fb P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:12.178685 18207 raft_consensus.cc:740] T 8210f9521a824b97addc9f8d5a7864fb P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4446ad69b93d4a62a3861fb1923713d5, State: Initialized, Role: FOLLOWER
I20260709 12:21:12.179612 18207 consensus_queue.cc:260] T 8210f9521a824b97addc9f8d5a7864fb P 4446ad69b93d4a62a3861fb1923713d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.182819 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08454883e9dc40e58a5e1c61624e2126" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe" is_pre_election: true
I20260709 12:21:12.183873 18013 raft_consensus.cc:2468] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 0.
I20260709 12:21:12.185415 18130 leader_election.cc:304] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, 917383ee650a411288b86b4895768002; no voters: 
I20260709 12:21:12.187412 18231 raft_consensus.cc:2804] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:12.186894 18207 ts_tablet_manager.cc:1434] T 8210f9521a824b97addc9f8d5a7864fb P 4446ad69b93d4a62a3861fb1923713d5: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:21:12.188010 18231 raft_consensus.cc:493] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.188581 18231 raft_consensus.cc:3060] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:12.191447 18089 raft_consensus.cc:2468] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 1.
I20260709 12:21:12.200177 18231 raft_consensus.cc:515] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.203727 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08454883e9dc40e58a5e1c61624e2126" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
I20260709 12:21:12.203809 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08454883e9dc40e58a5e1c61624e2126" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
I20260709 12:21:12.204569 18089 raft_consensus.cc:3060] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:12.204829 18013 raft_consensus.cc:3060] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:12.205407 18231 leader_election.cc:290] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 election: Requested vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875)
I20260709 12:21:12.203876 17910 catalog_manager.cc:5697] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 917383ee650a411288b86b4895768002 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "917383ee650a411288b86b4895768002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:12.213791 18013 raft_consensus.cc:2468] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 1.
I20260709 12:21:12.214409 18089 raft_consensus.cc:2468] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 1.
I20260709 12:21:12.215133 18129 leader_election.cc:304] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 917383ee650a411288b86b4895768002, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:12.216032 18231 raft_consensus.cc:2804] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:12.216972 18231 raft_consensus.cc:697] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 1 LEADER]: Becoming Leader. State: Replica: 917383ee650a411288b86b4895768002, State: Running, Role: LEADER
I20260709 12:21:12.218420 18231 consensus_queue.cc:237] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.219373 17909 catalog_manager.cc:5697] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe reported cstate change: term changed from 0 to 1, leader changed from <none> to ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129). New cstate: current_term: 1 leader_uuid: "ba6e65ec56284f449dde8c8a931eacfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:12.226387 17910 catalog_manager.cc:5697] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 917383ee650a411288b86b4895768002 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "917383ee650a411288b86b4895768002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:12.248070 18229 consensus_queue.cc:1048] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:12.261308 18265 consensus_queue.cc:1048] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:12.348232 18234 raft_consensus.cc:493] T 2d7fc6d43ca44313b5454b047cb20056 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.348914 18234 raft_consensus.cc:515] T 2d7fc6d43ca44313b5454b047cb20056 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.351594 18234 leader_election.cc:290] T 2d7fc6d43ca44313b5454b047cb20056 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:12.351511 18231 consensus_queue.cc:1048] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:12.351927 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7fc6d43ca44313b5454b047cb20056" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4446ad69b93d4a62a3861fb1923713d5" is_pre_election: true
I20260709 12:21:12.352389 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7fc6d43ca44313b5454b047cb20056" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "917383ee650a411288b86b4895768002" is_pre_election: true
I20260709 12:21:12.352644 18089 raft_consensus.cc:2393] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba6e65ec56284f449dde8c8a931eacfe in current term 1: Already voted for candidate 917383ee650a411288b86b4895768002 in this term.
I20260709 12:21:12.354115 17979 leader_election.cc:304] T 2d7fc6d43ca44313b5454b047cb20056 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba6e65ec56284f449dde8c8a931eacfe; no voters: 4446ad69b93d4a62a3861fb1923713d5, 917383ee650a411288b86b4895768002
I20260709 12:21:12.354923 18234 raft_consensus.cc:3060] T 2d7fc6d43ca44313b5454b047cb20056 P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:12.365821 18209 consensus_queue.cc:1048] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:12.366381 18234 raft_consensus.cc:2749] T 2d7fc6d43ca44313b5454b047cb20056 P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:12.379796 18234 consensus_queue.cc:1048] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:12.392099 18242 consensus_queue.cc:1048] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:12.399789 18242 raft_consensus.cc:493] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.400290 18242 raft_consensus.cc:515] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.402630 18242 leader_election.cc:290] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:12.403425 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8210f9521a824b97addc9f8d5a7864fb" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4446ad69b93d4a62a3861fb1923713d5" is_pre_election: true
I20260709 12:21:12.404260 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8210f9521a824b97addc9f8d5a7864fb" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "917383ee650a411288b86b4895768002" is_pre_election: true
I20260709 12:21:12.404101 18090 raft_consensus.cc:2468] T 8210f9521a824b97addc9f8d5a7864fb P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 0.
I20260709 12:21:12.405403 18163 raft_consensus.cc:2468] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 0.
I20260709 12:21:12.406296 17980 leader_election.cc:304] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:12.407572 18242 raft_consensus.cc:2804] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:12.407985 18242 raft_consensus.cc:493] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.408478 18242 raft_consensus.cc:3060] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:12.415472 18242 raft_consensus.cc:515] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.417827 18242 leader_election.cc:290] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 election: Requested vote from peers 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:12.418648 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8210f9521a824b97addc9f8d5a7864fb" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
I20260709 12:21:12.418792 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8210f9521a824b97addc9f8d5a7864fb" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "917383ee650a411288b86b4895768002"
I20260709 12:21:12.419183 18090 raft_consensus.cc:3060] T 8210f9521a824b97addc9f8d5a7864fb P 4446ad69b93d4a62a3861fb1923713d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:12.419349 18163 raft_consensus.cc:3060] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:12.424260 18163 raft_consensus.cc:2468] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 1.
I20260709 12:21:12.425434 17979 leader_election.cc:304] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 917383ee650a411288b86b4895768002, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:12.426352 18242 raft_consensus.cc:2804] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:12.426620 18090 raft_consensus.cc:2468] T 8210f9521a824b97addc9f8d5a7864fb P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 1.
I20260709 12:21:12.426878 18242 raft_consensus.cc:697] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [term 1 LEADER]: Becoming Leader. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Running, Role: LEADER
I20260709 12:21:12.427804 18242 consensus_queue.cc:237] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.436312 17909 catalog_manager.cc:5697] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe reported cstate change: term changed from 0 to 1, leader changed from <none> to ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129). New cstate: current_term: 1 leader_uuid: "ba6e65ec56284f449dde8c8a931eacfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:12.443394 18242 consensus_queue.cc:1048] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:12.457543 18213 consensus_queue.cc:1048] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:12.480561 18163 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72fbb32a196a4161a14790e1827e73ec"
dest_uuid: "917383ee650a411288b86b4895768002"
mode: GRACEFUL
new_leader_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
 from {username='slave'} at 127.0.0.1:51414
I20260709 12:21:12.481276 18163 raft_consensus.cc:606] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [term 1 LEADER]: Received request to transfer leadership to TS ba6e65ec56284f449dde8c8a931eacfe
I20260709 12:21:12.487653 18163 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b797090c2ec247bfb432e56d7c913d05"
dest_uuid: "917383ee650a411288b86b4895768002"
mode: GRACEFUL
new_leader_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
 from {username='slave'} at 127.0.0.1:51414
I20260709 12:21:12.488224 18163 raft_consensus.cc:606] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 1 LEADER]: Received request to transfer leadership to TS ba6e65ec56284f449dde8c8a931eacfe
I20260709 12:21:12.496168 18163 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08454883e9dc40e58a5e1c61624e2126"
dest_uuid: "917383ee650a411288b86b4895768002"
mode: GRACEFUL
new_leader_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
 from {username='slave'} at 127.0.0.1:51414
I20260709 12:21:12.496645 18163 raft_consensus.cc:606] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 1 LEADER]: Received request to transfer leadership to TS ba6e65ec56284f449dde8c8a931eacfe
I20260709 12:21:12.517019 18013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1a420cbdc52422aab49dc58e04e7b1e"
dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
mode: GRACEFUL
new_leader_uuid: "4446ad69b93d4a62a3861fb1923713d5"
 from {username='slave'} at 127.0.0.1:57432
I20260709 12:21:12.517762 18013 raft_consensus.cc:606] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 1 LEADER]: Received request to transfer leadership to TS 4446ad69b93d4a62a3861fb1923713d5
I20260709 12:21:12.527127 18013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a77f52af1814deab6b5fc9d724ed9e2"
dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
mode: GRACEFUL
new_leader_uuid: "4446ad69b93d4a62a3861fb1923713d5"
 from {username='slave'} at 127.0.0.1:57432
I20260709 12:21:12.527695 18013 raft_consensus.cc:606] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 1 LEADER]: Received request to transfer leadership to TS 4446ad69b93d4a62a3861fb1923713d5
I20260709 12:21:12.534075 18163 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d7fc6d43ca44313b5454b047cb20056"
dest_uuid: "917383ee650a411288b86b4895768002"
mode: GRACEFUL
new_leader_uuid: "4446ad69b93d4a62a3861fb1923713d5"
 from {username='slave'} at 127.0.0.1:51414
I20260709 12:21:12.534703 18163 raft_consensus.cc:606] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [term 1 LEADER]: Received request to transfer leadership to TS 4446ad69b93d4a62a3861fb1923713d5
I20260709 12:21:12.540271 18013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8210f9521a824b97addc9f8d5a7864fb"
dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
mode: GRACEFUL
new_leader_uuid: "917383ee650a411288b86b4895768002"
 from {username='slave'} at 127.0.0.1:57432
I20260709 12:21:12.540800 18013 raft_consensus.cc:606] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [term 1 LEADER]: Received request to transfer leadership to TS 917383ee650a411288b86b4895768002
I20260709 12:21:12.563740 18213 consensus_queue.cc:1048] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:12.576690 18275 consensus_queue.cc:1048] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:12.604112 18209 consensus_queue.cc:1048] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:12.610729 18275 consensus_queue.cc:1048] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:12.616894 18209 consensus_queue.cc:1048] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:12.629397 18209 raft_consensus.cc:993] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002: : Instructing follower 4446ad69b93d4a62a3861fb1923713d5 to start an election
I20260709 12:21:12.629859 18209 raft_consensus.cc:1081] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [term 1 LEADER]: Signalling peer 4446ad69b93d4a62a3861fb1923713d5 to start an election
I20260709 12:21:12.632529 18089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d7fc6d43ca44313b5454b047cb20056"
dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
 from {username='slave'} at 127.0.0.1:49076
I20260709 12:21:12.633282 18089 raft_consensus.cc:493] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:12.633740 18089 raft_consensus.cc:3060] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.634436 18275 consensus_queue.cc:1048] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:12.642186 18089 raft_consensus.cc:515] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.644675 18089 leader_election.cc:290] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5 [CANDIDATE]: Term 2 election: Requested vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:12.645572 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7fc6d43ca44313b5454b047cb20056" candidate_uuid: "4446ad69b93d4a62a3861fb1923713d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
I20260709 12:21:12.646015 18164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7fc6d43ca44313b5454b047cb20056" candidate_uuid: "4446ad69b93d4a62a3861fb1923713d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "917383ee650a411288b86b4895768002"
I20260709 12:21:12.646173 18013 raft_consensus.cc:3060] T 2d7fc6d43ca44313b5454b047cb20056 P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.646603 18164 raft_consensus.cc:3055] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:12.646943 18164 raft_consensus.cc:740] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 917383ee650a411288b86b4895768002, State: Running, Role: LEADER
I20260709 12:21:12.647794 18164 consensus_queue.cc:260] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.651208 18164 raft_consensus.cc:3060] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.655154 18013 raft_consensus.cc:2468] T 2d7fc6d43ca44313b5454b047cb20056 P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4446ad69b93d4a62a3861fb1923713d5 in term 2.
I20260709 12:21:12.656304 18054 leader_election.cc:304] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:12.656607 18253 consensus_queue.cc:1048] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:12.657171 18210 raft_consensus.cc:2804] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:12.657636 18210 raft_consensus.cc:697] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 LEADER]: Becoming Leader. State: Replica: 4446ad69b93d4a62a3861fb1923713d5, State: Running, Role: LEADER
I20260709 12:21:12.658360 18210 consensus_queue.cc:237] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.664331 18164 raft_consensus.cc:2468] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4446ad69b93d4a62a3861fb1923713d5 in term 2.
I20260709 12:21:12.668608 18253 consensus_queue.cc:1048] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:12.674078 17909 catalog_manager.cc:5697] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5 reported cstate change: term changed from 1 to 2, leader changed from 917383ee650a411288b86b4895768002 (127.16.240.131) to 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "4446ad69b93d4a62a3861fb1923713d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:12.695525 18231 raft_consensus.cc:993] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002: : Instructing follower ba6e65ec56284f449dde8c8a931eacfe to start an election
I20260709 12:21:12.696082 18287 raft_consensus.cc:1081] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 1 LEADER]: Signalling peer ba6e65ec56284f449dde8c8a931eacfe to start an election
I20260709 12:21:12.698460 18013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b797090c2ec247bfb432e56d7c913d05"
dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
 from {username='slave'} at 127.0.0.1:57426
I20260709 12:21:12.698985 18013 raft_consensus.cc:493] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:12.699322 18013 raft_consensus.cc:3060] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.706058 18013 raft_consensus.cc:515] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.708432 18013 leader_election.cc:290] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 2 election: Requested vote from peers 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:12.709154 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797090c2ec247bfb432e56d7c913d05" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
I20260709 12:21:12.709463 18164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797090c2ec247bfb432e56d7c913d05" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "917383ee650a411288b86b4895768002"
I20260709 12:21:12.709735 18089 raft_consensus.cc:3060] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.710062 18164 raft_consensus.cc:3055] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:12.710325 18164 raft_consensus.cc:740] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 917383ee650a411288b86b4895768002, State: Running, Role: LEADER
I20260709 12:21:12.711043 18164 consensus_queue.cc:260] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.712085 18164 raft_consensus.cc:3060] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.716174 18089 raft_consensus.cc:2468] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 2.
I20260709 12:21:12.717308 18164 raft_consensus.cc:2468] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 2.
I20260709 12:21:12.717487 17980 leader_election.cc:304] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:12.718328 18275 raft_consensus.cc:2804] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:12.718789 18275 raft_consensus.cc:697] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 2 LEADER]: Becoming Leader. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Running, Role: LEADER
I20260709 12:21:12.719591 18275 consensus_queue.cc:237] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.726867 17908 catalog_manager.cc:5697] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe reported cstate change: term changed from 1 to 2, leader changed from 917383ee650a411288b86b4895768002 (127.16.240.131) to ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129). New cstate: current_term: 2 leader_uuid: "ba6e65ec56284f449dde8c8a931eacfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:12.732182 18287 consensus_queue.cc:1048] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:12.743793 18287 consensus_queue.cc:1048] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:12.751803 18231 raft_consensus.cc:993] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002: : Instructing follower ba6e65ec56284f449dde8c8a931eacfe to start an election
I20260709 12:21:12.752261 18231 raft_consensus.cc:1081] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 1 LEADER]: Signalling peer ba6e65ec56284f449dde8c8a931eacfe to start an election
I20260709 12:21:12.754066 18014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08454883e9dc40e58a5e1c61624e2126"
dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
 from {username='slave'} at 127.0.0.1:57426
I20260709 12:21:12.754666 18014 raft_consensus.cc:493] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:12.755066 18014 raft_consensus.cc:3060] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.760100 18014 raft_consensus.cc:515] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.763831 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08454883e9dc40e58a5e1c61624e2126" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
I20260709 12:21:12.764880 18089 raft_consensus.cc:3060] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.763831 18164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08454883e9dc40e58a5e1c61624e2126" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "917383ee650a411288b86b4895768002"
I20260709 12:21:12.769409 18164 raft_consensus.cc:3055] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:12.769826 18164 raft_consensus.cc:740] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 917383ee650a411288b86b4895768002, State: Running, Role: LEADER
I20260709 12:21:12.770605 18164 consensus_queue.cc:260] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.771625 18164 raft_consensus.cc:3060] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.772583 18089 raft_consensus.cc:2468] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 2.
I20260709 12:21:12.773581 18014 leader_election.cc:290] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 2 election: Requested vote from peers 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:12.774101 17980 leader_election.cc:304] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:12.775573 18275 raft_consensus.cc:2804] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:12.776214 18275 raft_consensus.cc:697] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 2 LEADER]: Becoming Leader. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Running, Role: LEADER
I20260709 12:21:12.777456 18275 consensus_queue.cc:237] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.782444 18164 raft_consensus.cc:2468] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 2.
I20260709 12:21:12.785861 18275 raft_consensus.cc:993] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe: : Instructing follower 4446ad69b93d4a62a3861fb1923713d5 to start an election
I20260709 12:21:12.786343 18275 raft_consensus.cc:1081] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 1 LEADER]: Signalling peer 4446ad69b93d4a62a3861fb1923713d5 to start an election
I20260709 12:21:12.788350 18089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1a420cbdc52422aab49dc58e04e7b1e"
dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
 from {username='slave'} at 127.0.0.1:49086
I20260709 12:21:12.788553 17908 catalog_manager.cc:5697] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe reported cstate change: term changed from 1 to 2, leader changed from 917383ee650a411288b86b4895768002 (127.16.240.131) to ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129). New cstate: current_term: 2 leader_uuid: "ba6e65ec56284f449dde8c8a931eacfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:12.789486 18089 raft_consensus.cc:493] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:12.790086 18089 raft_consensus.cc:3060] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.798023 18089 raft_consensus.cc:515] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.801308 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a420cbdc52422aab49dc58e04e7b1e" candidate_uuid: "4446ad69b93d4a62a3861fb1923713d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
I20260709 12:21:12.801623 18089 leader_election.cc:290] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [CANDIDATE]: Term 2 election: Requested vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:12.801967 18014 raft_consensus.cc:3055] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:12.802239 18164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a420cbdc52422aab49dc58e04e7b1e" candidate_uuid: "4446ad69b93d4a62a3861fb1923713d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "917383ee650a411288b86b4895768002"
I20260709 12:21:12.802378 18014 raft_consensus.cc:740] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Running, Role: LEADER
I20260709 12:21:12.802824 18164 raft_consensus.cc:3060] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.803285 18014 consensus_queue.cc:260] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.804617 18014 raft_consensus.cc:3060] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.812072 18014 raft_consensus.cc:2468] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4446ad69b93d4a62a3861fb1923713d5 in term 2.
I20260709 12:21:12.812072 18164 raft_consensus.cc:2468] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4446ad69b93d4a62a3861fb1923713d5 in term 2.
I20260709 12:21:12.816188 18054 leader_election.cc:304] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:12.816983 18229 raft_consensus.cc:2804] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:12.817471 18229 raft_consensus.cc:697] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 2 LEADER]: Becoming Leader. State: Replica: 4446ad69b93d4a62a3861fb1923713d5, State: Running, Role: LEADER
I20260709 12:21:12.818463 18229 consensus_queue.cc:237] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.828660 17908 catalog_manager.cc:5697] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 reported cstate change: term changed from 1 to 2, leader changed from ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129) to 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "4446ad69b93d4a62a3861fb1923713d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:12.888247 18275 consensus_queue.cc:1048] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:12.900297 18242 consensus_queue.cc:1048] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:12.902405 18213 raft_consensus.cc:993] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe: : Instructing follower 4446ad69b93d4a62a3861fb1923713d5 to start an election
I20260709 12:21:12.902952 18242 raft_consensus.cc:1081] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 1 LEADER]: Signalling peer 4446ad69b93d4a62a3861fb1923713d5 to start an election
I20260709 12:21:12.909678 18089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a77f52af1814deab6b5fc9d724ed9e2"
dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
 from {username='slave'} at 127.0.0.1:49086
I20260709 12:21:12.910651 18089 raft_consensus.cc:493] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:12.911553 18089 raft_consensus.cc:3060] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.913336 18275 raft_consensus.cc:993] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe: : Instructing follower 917383ee650a411288b86b4895768002 to start an election
I20260709 12:21:12.913817 18275 raft_consensus.cc:1081] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [term 1 LEADER]: Signalling peer 917383ee650a411288b86b4895768002 to start an election
I20260709 12:21:12.915472 18164 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8210f9521a824b97addc9f8d5a7864fb"
dest_uuid: "917383ee650a411288b86b4895768002"
 from {username='slave'} at 127.0.0.1:51402
I20260709 12:21:12.915999 18164 raft_consensus.cc:493] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:12.916333 18164 raft_consensus.cc:3060] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.919862 18089 raft_consensus.cc:515] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.922040 18089 leader_election.cc:290] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [CANDIDATE]: Term 2 election: Requested vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:12.922786 18164 raft_consensus.cc:515] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.924185 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a77f52af1814deab6b5fc9d724ed9e2" candidate_uuid: "4446ad69b93d4a62a3861fb1923713d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "917383ee650a411288b86b4895768002"
I20260709 12:21:12.924865 18163 raft_consensus.cc:3060] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.925554 18164 leader_election.cc:290] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 2 election: Requested vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875)
I20260709 12:21:12.926855 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a77f52af1814deab6b5fc9d724ed9e2" candidate_uuid: "4446ad69b93d4a62a3861fb1923713d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
I20260709 12:21:12.927492 18014 raft_consensus.cc:3055] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:12.927841 18014 raft_consensus.cc:740] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Running, Role: LEADER
I20260709 12:21:12.928678 18014 consensus_queue.cc:260] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.929349 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8210f9521a824b97addc9f8d5a7864fb" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
I20260709 12:21:12.929972 18013 raft_consensus.cc:3055] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:12.930553 18013 raft_consensus.cc:740] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Running, Role: LEADER
I20260709 12:21:12.930197 18014 raft_consensus.cc:3060] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.931424 18231 raft_consensus.cc:993] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002: : Instructing follower ba6e65ec56284f449dde8c8a931eacfe to start an election
I20260709 12:21:12.931396 18013 consensus_queue.cc:260] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.932010 18231 raft_consensus.cc:1081] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [term 1 LEADER]: Signalling peer ba6e65ec56284f449dde8c8a931eacfe to start an election
I20260709 12:21:12.932775 18013 raft_consensus.cc:3060] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.935417 18012 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72fbb32a196a4161a14790e1827e73ec"
dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
 from {username='slave'} at 127.0.0.1:57426
I20260709 12:21:12.936121 18012 raft_consensus.cc:493] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:12.936508 18012 raft_consensus.cc:3060] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.936832 18163 raft_consensus.cc:2468] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4446ad69b93d4a62a3861fb1923713d5 in term 2.
I20260709 12:21:12.938373 18054 leader_election.cc:304] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, 917383ee650a411288b86b4895768002; no voters: 
I20260709 12:21:12.939253 18229 raft_consensus.cc:2804] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:12.939788 18229 raft_consensus.cc:697] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 LEADER]: Becoming Leader. State: Replica: 4446ad69b93d4a62a3861fb1923713d5, State: Running, Role: LEADER
I20260709 12:21:12.940655 18229 consensus_queue.cc:237] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.931872 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8210f9521a824b97addc9f8d5a7864fb" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
I20260709 12:21:12.941732 18089 raft_consensus.cc:3060] T 8210f9521a824b97addc9f8d5a7864fb P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.945498 18012 raft_consensus.cc:515] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.946401 18014 raft_consensus.cc:2468] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4446ad69b93d4a62a3861fb1923713d5 in term 2.
I20260709 12:21:12.948140 18012 leader_election.cc:290] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 2 election: Requested vote from peers 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:12.947814 18013 raft_consensus.cc:2468] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 2.
I20260709 12:21:12.949606 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fbb32a196a4161a14790e1827e73ec" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
I20260709 12:21:12.950212 18090 raft_consensus.cc:3060] T 72fbb32a196a4161a14790e1827e73ec P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.950285 18129 leader_election.cc:304] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 917383ee650a411288b86b4895768002, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:12.951161 18287 raft_consensus.cc:2804] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:12.951673 18287 raft_consensus.cc:697] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002 [term 2 LEADER]: Becoming Leader. State: Replica: 917383ee650a411288b86b4895768002, State: Running, Role: LEADER
I20260709 12:21:12.951669 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fbb32a196a4161a14790e1827e73ec" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "917383ee650a411288b86b4895768002"
I20260709 12:21:12.952783 18163 raft_consensus.cc:3055] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:12.951432 17911 catalog_manager.cc:5697] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 reported cstate change: term changed from 1 to 2, leader changed from ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129) to 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "4446ad69b93d4a62a3861fb1923713d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:12.953150 18163 raft_consensus.cc:740] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 917383ee650a411288b86b4895768002, State: Running, Role: LEADER
I20260709 12:21:12.952961 18287 consensus_queue.cc:237] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.953893 18089 raft_consensus.cc:2468] T 8210f9521a824b97addc9f8d5a7864fb P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 2.
I20260709 12:21:12.954305 18163 consensus_queue.cc:260] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.956053 18163 raft_consensus.cc:3060] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.957894 18090 raft_consensus.cc:2468] T 72fbb32a196a4161a14790e1827e73ec P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 2.
I20260709 12:21:12.959170 17980 leader_election.cc:304] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:12.960357 18275 raft_consensus.cc:2804] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:12.960824 18275 raft_consensus.cc:697] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe [term 2 LEADER]: Becoming Leader. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Running, Role: LEADER
I20260709 12:21:12.961649 18275 consensus_queue.cc:237] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:12.962395 17910 catalog_manager.cc:5697] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002 reported cstate change: term changed from 1 to 2, leader changed from ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129) to 917383ee650a411288b86b4895768002 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "917383ee650a411288b86b4895768002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:12.965162 18163 raft_consensus.cc:2468] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 2.
I20260709 12:21:12.969905 17911 catalog_manager.cc:5697] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe reported cstate change: term changed from 1 to 2, leader changed from 917383ee650a411288b86b4895768002 (127.16.240.131) to ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129). New cstate: current_term: 2 leader_uuid: "ba6e65ec56284f449dde8c8a931eacfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:13.053098 18163 raft_consensus.cc:1275] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Refusing update from remote peer 4446ad69b93d4a62a3861fb1923713d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:13.054530 18229 consensus_queue.cc:1048] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:13.062498 18013 raft_consensus.cc:1275] T 2d7fc6d43ca44313b5454b047cb20056 P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Refusing update from remote peer 4446ad69b93d4a62a3861fb1923713d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:13.064251 18265 consensus_queue.cc:1048] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:13.205251 18163 raft_consensus.cc:1275] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Refusing update from remote peer ba6e65ec56284f449dde8c8a931eacfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:13.206612 18213 consensus_queue.cc:1048] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:13.210999 18013 raft_consensus.cc:1275] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Refusing update from remote peer 4446ad69b93d4a62a3861fb1923713d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:13.212359 18265 consensus_queue.cc:1048] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:13.214617 18090 raft_consensus.cc:1275] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Refusing update from remote peer ba6e65ec56284f449dde8c8a931eacfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:13.216349 18275 consensus_queue.cc:1048] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:13.226292 18163 raft_consensus.cc:1275] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Refusing update from remote peer 4446ad69b93d4a62a3861fb1923713d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:13.227977 18265 consensus_queue.cc:1048] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:13.320223 18090 raft_consensus.cc:1275] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Refusing update from remote peer ba6e65ec56284f449dde8c8a931eacfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:13.321615 18213 consensus_queue.cc:1048] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:13.330487 18163 raft_consensus.cc:1275] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Refusing update from remote peer ba6e65ec56284f449dde8c8a931eacfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:13.332466 18275 consensus_queue.cc:1048] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:13.340834 18163 raft_consensus.cc:1275] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Refusing update from remote peer 4446ad69b93d4a62a3861fb1923713d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:13.342432 18265 consensus_queue.cc:1048] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:13.353237 18013 raft_consensus.cc:1275] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Refusing update from remote peer 4446ad69b93d4a62a3861fb1923713d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:13.354750 18265 consensus_queue.cc:1048] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:13.356770 18090 raft_consensus.cc:1275] T 8210f9521a824b97addc9f8d5a7864fb P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Refusing update from remote peer 917383ee650a411288b86b4895768002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:13.358356 18287 consensus_queue.cc:1048] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:13.367255 18013 raft_consensus.cc:1275] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Refusing update from remote peer 917383ee650a411288b86b4895768002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:13.369066 18253 consensus_queue.cc:1048] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:13.475024 18163 raft_consensus.cc:1275] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Refusing update from remote peer ba6e65ec56284f449dde8c8a931eacfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:13.476627 18275 consensus_queue.cc:1048] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:13.485881 18090 raft_consensus.cc:1275] T 72fbb32a196a4161a14790e1827e73ec P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Refusing update from remote peer ba6e65ec56284f449dde8c8a931eacfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:13.487370 18234 consensus_queue.cc:1048] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:15.576735 17346 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:21:15.577416 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:15.595947 18013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08454883e9dc40e58a5e1c61624e2126"
dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
mode: GRACEFUL
new_leader_uuid: "917383ee650a411288b86b4895768002"
 from {username='slave'} at 127.0.0.1:57448
I20260709 12:21:15.596560 18013 raft_consensus.cc:606] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 2 LEADER]: Received request to transfer leadership to TS 917383ee650a411288b86b4895768002
I20260709 12:21:15.599341 18013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b797090c2ec247bfb432e56d7c913d05"
dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
mode: GRACEFUL
new_leader_uuid: "917383ee650a411288b86b4895768002"
 from {username='slave'} at 127.0.0.1:57448
I20260709 12:21:15.599928 18013 raft_consensus.cc:606] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 2 LEADER]: Received request to transfer leadership to TS 917383ee650a411288b86b4895768002
I20260709 12:21:15.600147 18298 raft_consensus.cc:993] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe: : Instructing follower 917383ee650a411288b86b4895768002 to start an election
I20260709 12:21:15.600596 18213 raft_consensus.cc:1081] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 2 LEADER]: Signalling peer 917383ee650a411288b86b4895768002 to start an election
I20260709 12:21:15.601111 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:21:15.601636 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:15.602214 18162 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08454883e9dc40e58a5e1c61624e2126"
dest_uuid: "917383ee650a411288b86b4895768002"
 from {username='slave'} at 127.0.0.1:51402
I20260709 12:21:15.602622 18162 raft_consensus.cc:493] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:15.602859 18162 raft_consensus.cc:3060] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:15.607380 18162 raft_consensus.cc:515] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:15.609047 18162 leader_election.cc:290] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 3 election: Requested vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875)
I20260709 12:21:15.610155 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08454883e9dc40e58a5e1c61624e2126" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
I20260709 12:21:15.610278 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08454883e9dc40e58a5e1c61624e2126" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
I20260709 12:21:15.610711 18013 raft_consensus.cc:3055] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:15.610918 18090 raft_consensus.cc:3060] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:15.611045 18013 raft_consensus.cc:740] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Running, Role: LEADER
I20260709 12:21:15.611944 18013 consensus_queue.cc:260] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:15.612905 18013 raft_consensus.cc:3060] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:15.616029 18090 raft_consensus.cc:2468] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 3.
I20260709 12:21:15.617187 18130 leader_election.cc:304] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, 917383ee650a411288b86b4895768002; no voters: 
I20260709 12:21:15.617926 18297 raft_consensus.cc:2804] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:15.617879 18013 raft_consensus.cc:2468] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 3.
I20260709 12:21:15.619160 18297 raft_consensus.cc:697] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 3 LEADER]: Becoming Leader. State: Replica: 917383ee650a411288b86b4895768002, State: Running, Role: LEADER
I20260709 12:21:15.620028 18297 consensus_queue.cc:237] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:15.627390 17908 catalog_manager.cc:5697] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 reported cstate change: term changed from 2 to 3, leader changed from ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129) to 917383ee650a411288b86b4895768002 (127.16.240.131). New cstate: current_term: 3 leader_uuid: "917383ee650a411288b86b4895768002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:15.638883 18298 raft_consensus.cc:993] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe: : Instructing follower 917383ee650a411288b86b4895768002 to start an election
I20260709 12:21:15.639348 18213 raft_consensus.cc:1081] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 2 LEADER]: Signalling peer 917383ee650a411288b86b4895768002 to start an election
I20260709 12:21:15.640967 18162 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b797090c2ec247bfb432e56d7c913d05"
dest_uuid: "917383ee650a411288b86b4895768002"
 from {username='slave'} at 127.0.0.1:51402
I20260709 12:21:15.641547 18162 raft_consensus.cc:493] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:15.641897 18162 raft_consensus.cc:3060] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:15.647856 18162 raft_consensus.cc:515] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:15.649583 18162 leader_election.cc:290] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 3 election: Requested vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875)
I20260709 12:21:15.651463 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797090c2ec247bfb432e56d7c913d05" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
I20260709 12:21:15.652124 18090 raft_consensus.cc:3060] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:15.653417 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797090c2ec247bfb432e56d7c913d05" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
I20260709 12:21:15.654016 18013 raft_consensus.cc:3055] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:15.654349 18013 raft_consensus.cc:740] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Running, Role: LEADER
I20260709 12:21:15.655171 18013 consensus_queue.cc:260] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:15.656499 18013 raft_consensus.cc:3060] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:15.658839 18090 raft_consensus.cc:2468] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 3.
I20260709 12:21:15.660092 18130 leader_election.cc:304] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, 917383ee650a411288b86b4895768002; no voters: 
I20260709 12:21:15.660892 18297 raft_consensus.cc:2804] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:15.661422 18297 raft_consensus.cc:697] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 3 LEADER]: Becoming Leader. State: Replica: 917383ee650a411288b86b4895768002, State: Running, Role: LEADER
I20260709 12:21:15.662343 18013 raft_consensus.cc:2468] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 3.
I20260709 12:21:15.662225 18297 consensus_queue.cc:237] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:15.669418 17908 catalog_manager.cc:5697] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 reported cstate change: term changed from 2 to 3, leader changed from ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129) to 917383ee650a411288b86b4895768002 (127.16.240.131). New cstate: current_term: 3 leader_uuid: "917383ee650a411288b86b4895768002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:16.146036 18090 raft_consensus.cc:1275] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5 [term 3 FOLLOWER]: Refusing update from remote peer 917383ee650a411288b86b4895768002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:16.147627 18297 consensus_queue.cc:1048] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:16.159106 18013 raft_consensus.cc:1275] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 3 FOLLOWER]: Refusing update from remote peer 917383ee650a411288b86b4895768002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:16.164659 18311 consensus_queue.cc:1048] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:16.238678 18090 raft_consensus.cc:1275] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [term 3 FOLLOWER]: Refusing update from remote peer 917383ee650a411288b86b4895768002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:16.240391 18311 consensus_queue.cc:1048] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:16.249862 18013 raft_consensus.cc:1275] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 3 FOLLOWER]: Refusing update from remote peer 917383ee650a411288b86b4895768002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:16.252641 18297 consensus_queue.cc:1048] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:16.602840 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:16.608649 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:16.609119 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:17.610220 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:17.616094 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:17.616778 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:18.618239 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:18.623791 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:18.624284 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:19.625545 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:19.633469 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:19.633957 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:20.635174 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:20.640456 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:20.640956 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:21.641973 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:21.647521 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:21.648001 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:22.648985 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:22.657354 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:22.658061 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:23.659430 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:23.665688 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:23.666190 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:24.667234 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:24.674667 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:24.675132 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:25.710708 17346 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:21:25.722049 18164 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b797090c2ec247bfb432e56d7c913d05"
dest_uuid: "917383ee650a411288b86b4895768002"
mode: GRACEFUL
new_leader_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
 from {username='slave'} at 127.0.0.1:51414
I20260709 12:21:25.722772 18164 raft_consensus.cc:606] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 3 LEADER]: Received request to transfer leadership to TS ba6e65ec56284f449dde8c8a931eacfe
I20260709 12:21:25.731920 18164 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08454883e9dc40e58a5e1c61624e2126"
dest_uuid: "917383ee650a411288b86b4895768002"
mode: GRACEFUL
new_leader_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
 from {username='slave'} at 127.0.0.1:51414
I20260709 12:21:25.732455 18164 raft_consensus.cc:606] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 3 LEADER]: Received request to transfer leadership to TS ba6e65ec56284f449dde8c8a931eacfe
I20260709 12:21:25.748399 18089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1a420cbdc52422aab49dc58e04e7b1e"
dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
mode: GRACEFUL
new_leader_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
 from {username='slave'} at 127.0.0.1:47628
I20260709 12:21:25.748849 18089 raft_consensus.cc:606] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 2 LEADER]: Received request to transfer leadership to TS ba6e65ec56284f449dde8c8a931eacfe
I20260709 12:21:25.754119 18089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4318035ed794a5e83625cc731fda175"
dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
mode: GRACEFUL
new_leader_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
 from {username='slave'} at 127.0.0.1:47628
I20260709 12:21:25.754571 18089 raft_consensus.cc:606] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [term 1 LEADER]: Received request to transfer leadership to TS ba6e65ec56284f449dde8c8a931eacfe
I20260709 12:21:25.759826 18089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a77f52af1814deab6b5fc9d724ed9e2"
dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
mode: GRACEFUL
new_leader_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
 from {username='slave'} at 127.0.0.1:47628
I20260709 12:21:25.760279 18089 raft_consensus.cc:606] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 LEADER]: Received request to transfer leadership to TS ba6e65ec56284f449dde8c8a931eacfe
I20260709 12:21:25.905001 18330 raft_consensus.cc:993] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002: : Instructing follower ba6e65ec56284f449dde8c8a931eacfe to start an election
I20260709 12:21:25.905365 18327 raft_consensus.cc:993] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5: : Instructing follower ba6e65ec56284f449dde8c8a931eacfe to start an election
I20260709 12:21:25.905875 18326 raft_consensus.cc:1081] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 3 LEADER]: Signalling peer ba6e65ec56284f449dde8c8a931eacfe to start an election
I20260709 12:21:25.906272 18322 raft_consensus.cc:1081] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 LEADER]: Signalling peer ba6e65ec56284f449dde8c8a931eacfe to start an election
I20260709 12:21:25.908341 18013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b797090c2ec247bfb432e56d7c913d05"
dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
 from {username='slave'} at 127.0.0.1:57426
I20260709 12:21:25.908776 18014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a77f52af1814deab6b5fc9d724ed9e2"
dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
 from {username='slave'} at 127.0.0.1:57428
I20260709 12:21:25.908919 18013 raft_consensus.cc:493] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:25.909343 18014 raft_consensus.cc:493] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:25.909355 18013 raft_consensus.cc:3060] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:25.909797 18014 raft_consensus.cc:3060] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:25.915251 18013 raft_consensus.cc:515] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:25.915385 18014 raft_consensus.cc:515] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:25.917506 18014 leader_election.cc:290] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 3 election: Requested vote from peers 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:25.918582 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797090c2ec247bfb432e56d7c913d05" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
I20260709 12:21:25.918550 18164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b797090c2ec247bfb432e56d7c913d05" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "917383ee650a411288b86b4895768002"
I20260709 12:21:25.919107 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a77f52af1814deab6b5fc9d724ed9e2" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
I20260709 12:21:25.918932 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a77f52af1814deab6b5fc9d724ed9e2" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "917383ee650a411288b86b4895768002"
I20260709 12:21:25.917356 18013 leader_election.cc:290] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 4 election: Requested vote from peers 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:25.919617 18090 raft_consensus.cc:3055] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:25.919862 18162 raft_consensus.cc:3060] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:25.919528 18089 raft_consensus.cc:3060] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:25.920063 18090 raft_consensus.cc:740] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4446ad69b93d4a62a3861fb1923713d5, State: Running, Role: LEADER
I20260709 12:21:25.919625 18164 raft_consensus.cc:3055] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:25.921412 18164 raft_consensus.cc:740] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 917383ee650a411288b86b4895768002, State: Running, Role: LEADER
I20260709 12:21:25.921074 18090 consensus_queue.cc:260] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:25.922576 18164 consensus_queue.cc:260] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:25.935106 18090 raft_consensus.cc:3060] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:25.935132 18164 raft_consensus.cc:3060] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:25.940436 18162 raft_consensus.cc:2468] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 3.
I20260709 12:21:25.940752 18089 raft_consensus.cc:2468] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 4.
I20260709 12:21:25.941994 17979 leader_election.cc:304] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 917383ee650a411288b86b4895768002, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:25.942821 18090 raft_consensus.cc:2468] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 3.
I20260709 12:21:25.943807 18164 raft_consensus.cc:2468] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 4.
I20260709 12:21:25.944000 18325 raft_consensus.cc:2804] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:25.944525 17980 leader_election.cc:304] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:25.948890 18331 raft_consensus.cc:2804] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:25.948885 18325 raft_consensus.cc:697] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 3 LEADER]: Becoming Leader. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Running, Role: LEADER
I20260709 12:21:25.949856 18331 raft_consensus.cc:697] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 4 LEADER]: Becoming Leader. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Running, Role: LEADER
I20260709 12:21:25.950428 18325 consensus_queue.cc:237] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:25.951251 18331 consensus_queue.cc:237] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:25.958333 18327 raft_consensus.cc:993] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5: : Instructing follower ba6e65ec56284f449dde8c8a931eacfe to start an election
I20260709 12:21:25.958873 18322 raft_consensus.cc:1081] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [term 1 LEADER]: Signalling peer ba6e65ec56284f449dde8c8a931eacfe to start an election
I20260709 12:21:25.960435 18013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4318035ed794a5e83625cc731fda175"
dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
 from {username='slave'} at 127.0.0.1:57428
I20260709 12:21:25.960965 18013 raft_consensus.cc:493] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:25.961277 18013 raft_consensus.cc:3060] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:25.961434 17911 catalog_manager.cc:5697] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe reported cstate change: term changed from 2 to 3, leader changed from 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130) to ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129). New cstate: current_term: 3 leader_uuid: "ba6e65ec56284f449dde8c8a931eacfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:25.966982 18013 raft_consensus.cc:515] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:25.970160 18013 leader_election.cc:290] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 2 election: Requested vote from peers 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:25.970232 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4318035ed794a5e83625cc731fda175" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
I20260709 12:21:25.970815 18089 raft_consensus.cc:3055] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:25.970815 18164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4318035ed794a5e83625cc731fda175" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "917383ee650a411288b86b4895768002"
I20260709 12:21:25.971190 18089 raft_consensus.cc:740] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4446ad69b93d4a62a3861fb1923713d5, State: Running, Role: LEADER
I20260709 12:21:25.971976 18164 raft_consensus.cc:3060] T c4318035ed794a5e83625cc731fda175 P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:25.972193 18089 consensus_queue.cc:260] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:25.973640 18089 raft_consensus.cc:3060] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:25.980144 18164 raft_consensus.cc:2468] T c4318035ed794a5e83625cc731fda175 P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 2.
I20260709 12:21:25.980515 18089 raft_consensus.cc:2468] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 2.
I20260709 12:21:25.981537 17980 leader_election.cc:304] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:25.982345 18325 raft_consensus.cc:2804] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:25.982849 18325 raft_consensus.cc:697] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe [term 2 LEADER]: Becoming Leader. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Running, Role: LEADER
I20260709 12:21:25.983847 18325 consensus_queue.cc:237] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:25.985244 17911 catalog_manager.cc:5697] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe reported cstate change: term changed from 3 to 4, leader changed from 917383ee650a411288b86b4895768002 (127.16.240.131) to ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129). New cstate: current_term: 4 leader_uuid: "ba6e65ec56284f449dde8c8a931eacfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:25.998452 17911 catalog_manager.cc:5697] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe reported cstate change: term changed from 1 to 2, leader changed from 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130) to ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129). New cstate: current_term: 2 leader_uuid: "ba6e65ec56284f449dde8c8a931eacfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:26.091050 18330 raft_consensus.cc:993] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002: : Instructing follower ba6e65ec56284f449dde8c8a931eacfe to start an election
I20260709 12:21:26.091925 18326 raft_consensus.cc:1081] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 3 LEADER]: Signalling peer ba6e65ec56284f449dde8c8a931eacfe to start an election
I20260709 12:21:26.093957 18327 raft_consensus.cc:993] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5: : Instructing follower ba6e65ec56284f449dde8c8a931eacfe to start an election
I20260709 12:21:26.094218 18013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08454883e9dc40e58a5e1c61624e2126"
dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
 from {username='slave'} at 127.0.0.1:57426
I20260709 12:21:26.094492 18322 raft_consensus.cc:1081] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 2 LEADER]: Signalling peer ba6e65ec56284f449dde8c8a931eacfe to start an election
I20260709 12:21:26.094813 18013 raft_consensus.cc:493] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:26.095158 18013 raft_consensus.cc:3060] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:26.096222 18014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1a420cbdc52422aab49dc58e04e7b1e"
dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
 from {username='slave'} at 127.0.0.1:57428
I20260709 12:21:26.096761 18014 raft_consensus.cc:493] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:26.097128 18014 raft_consensus.cc:3060] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:26.099939 18013 raft_consensus.cc:515] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:26.101604 18013 leader_election.cc:290] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 4 election: Requested vote from peers 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:26.102429 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08454883e9dc40e58a5e1c61624e2126" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
I20260709 12:21:26.102641 18164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08454883e9dc40e58a5e1c61624e2126" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "917383ee650a411288b86b4895768002"
I20260709 12:21:26.103040 18089 raft_consensus.cc:3060] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:26.102778 18014 raft_consensus.cc:515] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:26.103312 18164 raft_consensus.cc:3055] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:26.103749 18164 raft_consensus.cc:740] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 917383ee650a411288b86b4895768002, State: Running, Role: LEADER
I20260709 12:21:26.104673 18164 consensus_queue.cc:260] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:26.105448 18014 leader_election.cc:290] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 3 election: Requested vote from peers 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:26.106186 18164 raft_consensus.cc:3060] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:26.106591 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a420cbdc52422aab49dc58e04e7b1e" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
I20260709 12:21:26.107151 18090 raft_consensus.cc:3055] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:26.107398 18090 raft_consensus.cc:740] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4446ad69b93d4a62a3861fb1923713d5, State: Running, Role: LEADER
I20260709 12:21:26.108136 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a420cbdc52422aab49dc58e04e7b1e" candidate_uuid: "ba6e65ec56284f449dde8c8a931eacfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "917383ee650a411288b86b4895768002"
I20260709 12:21:26.108155 18090 consensus_queue.cc:260] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:26.108891 18162 raft_consensus.cc:3060] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:26.109567 18090 raft_consensus.cc:3060] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:26.113658 18164 raft_consensus.cc:2468] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 4.
I20260709 12:21:26.114779 17979 leader_election.cc:304] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 917383ee650a411288b86b4895768002, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:26.115715 18331 raft_consensus.cc:2804] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:26.116212 18331 raft_consensus.cc:697] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 4 LEADER]: Becoming Leader. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Running, Role: LEADER
I20260709 12:21:26.116535 18162 raft_consensus.cc:2468] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 3.
I20260709 12:21:26.117102 18331 consensus_queue.cc:237] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:26.117741 18090 raft_consensus.cc:2468] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 3.
I20260709 12:21:26.118901 17980 leader_election.cc:304] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, ba6e65ec56284f449dde8c8a931eacfe; no voters: 
I20260709 12:21:26.114205 18089 raft_consensus.cc:2468] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6e65ec56284f449dde8c8a931eacfe in term 4.
I20260709 12:21:26.120217 18325 raft_consensus.cc:2804] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:26.121871 18325 raft_consensus.cc:697] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 3 LEADER]: Becoming Leader. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Running, Role: LEADER
I20260709 12:21:26.122869 18325 consensus_queue.cc:237] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:26.124979 17911 catalog_manager.cc:5697] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe reported cstate change: term changed from 3 to 4, leader changed from 917383ee650a411288b86b4895768002 (127.16.240.131) to ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129). New cstate: current_term: 4 leader_uuid: "ba6e65ec56284f449dde8c8a931eacfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:26.138267 17911 catalog_manager.cc:5697] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe reported cstate change: term changed from 2 to 3, leader changed from 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130) to ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129). New cstate: current_term: 3 leader_uuid: "ba6e65ec56284f449dde8c8a931eacfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:26.335389 18162 raft_consensus.cc:1275] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 4 FOLLOWER]: Refusing update from remote peer ba6e65ec56284f449dde8c8a931eacfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:26.336647 18325 consensus_queue.cc:1048] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:26.347784 18089 raft_consensus.cc:1275] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [term 4 FOLLOWER]: Refusing update from remote peer ba6e65ec56284f449dde8c8a931eacfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:26.349397 18325 consensus_queue.cc:1048] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:26.377260 18089 raft_consensus.cc:1275] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 3 FOLLOWER]: Refusing update from remote peer ba6e65ec56284f449dde8c8a931eacfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:26.378459 18325 consensus_queue.cc:1048] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:26.388588 18162 raft_consensus.cc:1275] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 3 FOLLOWER]: Refusing update from remote peer ba6e65ec56284f449dde8c8a931eacfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:26.390002 18331 consensus_queue.cc:1048] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:26.471626 18162 raft_consensus.cc:1275] T c4318035ed794a5e83625cc731fda175 P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Refusing update from remote peer ba6e65ec56284f449dde8c8a931eacfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:26.473016 18331 consensus_queue.cc:1048] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:26.482522 18089 raft_consensus.cc:1275] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Refusing update from remote peer ba6e65ec56284f449dde8c8a931eacfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:26.484395 18325 consensus_queue.cc:1048] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:26.607429 18089 raft_consensus.cc:1275] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 3 FOLLOWER]: Refusing update from remote peer ba6e65ec56284f449dde8c8a931eacfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:26.608731 18325 consensus_queue.cc:1048] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:26.618119 18162 raft_consensus.cc:1275] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002 [term 3 FOLLOWER]: Refusing update from remote peer ba6e65ec56284f449dde8c8a931eacfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:26.619582 18332 consensus_queue.cc:1048] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:26.634232 18162 raft_consensus.cc:1275] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 4 FOLLOWER]: Refusing update from remote peer ba6e65ec56284f449dde8c8a931eacfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:26.635633 18332 consensus_queue.cc:1048] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:26.645081 18089 raft_consensus.cc:1275] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5 [term 4 FOLLOWER]: Refusing update from remote peer ba6e65ec56284f449dde8c8a931eacfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:26.648448 18325 consensus_queue.cc:1048] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:28.800180 17346 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:21:28.800860 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:28.808302 18014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08454883e9dc40e58a5e1c61624e2126"
dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
mode: GRACEFUL
new_leader_uuid: "917383ee650a411288b86b4895768002"
 from {username='slave'} at 127.0.0.1:57448
I20260709 12:21:28.808801 18014 raft_consensus.cc:606] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 4 LEADER]: Received request to transfer leadership to TS 917383ee650a411288b86b4895768002
I20260709 12:21:28.811415 18014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a77f52af1814deab6b5fc9d724ed9e2"
dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
mode: GRACEFUL
new_leader_uuid: "917383ee650a411288b86b4895768002"
 from {username='slave'} at 127.0.0.1:57448
I20260709 12:21:28.811965 18014 raft_consensus.cc:606] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 3 LEADER]: Received request to transfer leadership to TS 917383ee650a411288b86b4895768002
I20260709 12:21:28.814328 18014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b473ce7f315b414e9dcc16f27ee42bfc"
dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
mode: GRACEFUL
new_leader_uuid: "4446ad69b93d4a62a3861fb1923713d5"
 from {username='slave'} at 127.0.0.1:57448
I20260709 12:21:28.814862 18014 raft_consensus.cc:606] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [term 1 LEADER]: Received request to transfer leadership to TS 4446ad69b93d4a62a3861fb1923713d5
I20260709 12:21:28.817220 18014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1a420cbdc52422aab49dc58e04e7b1e"
dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
mode: GRACEFUL
new_leader_uuid: "4446ad69b93d4a62a3861fb1923713d5"
 from {username='slave'} at 127.0.0.1:57448
I20260709 12:21:28.817656 18014 raft_consensus.cc:606] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 3 LEADER]: Received request to transfer leadership to TS 4446ad69b93d4a62a3861fb1923713d5
I20260709 12:21:28.818686 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:21:28.819164 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:28.930601 18331 raft_consensus.cc:993] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe: : Instructing follower 4446ad69b93d4a62a3861fb1923713d5 to start an election
I20260709 12:21:28.931154 18358 raft_consensus.cc:1081] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 3 LEADER]: Signalling peer 4446ad69b93d4a62a3861fb1923713d5 to start an election
I20260709 12:21:28.932688 18090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1a420cbdc52422aab49dc58e04e7b1e"
dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
 from {username='slave'} at 127.0.0.1:49086
I20260709 12:21:28.933177 18090 raft_consensus.cc:493] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:28.933463 18090 raft_consensus.cc:3060] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:28.937846 18090 raft_consensus.cc:515] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:28.939765 18090 leader_election.cc:290] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [CANDIDATE]: Term 4 election: Requested vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:28.940747 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a420cbdc52422aab49dc58e04e7b1e" candidate_uuid: "4446ad69b93d4a62a3861fb1923713d5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
I20260709 12:21:28.940927 18164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a420cbdc52422aab49dc58e04e7b1e" candidate_uuid: "4446ad69b93d4a62a3861fb1923713d5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "917383ee650a411288b86b4895768002"
I20260709 12:21:28.941402 18164 raft_consensus.cc:3060] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:28.941375 18014 raft_consensus.cc:3055] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:28.941964 18014 raft_consensus.cc:740] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Running, Role: LEADER
I20260709 12:21:28.942857 18014 consensus_queue.cc:260] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:28.944535 18014 raft_consensus.cc:3060] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:28.950407 18164 raft_consensus.cc:2468] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4446ad69b93d4a62a3861fb1923713d5 in term 4.
I20260709 12:21:28.951923 18014 raft_consensus.cc:2468] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4446ad69b93d4a62a3861fb1923713d5 in term 4.
I20260709 12:21:28.951872 18054 leader_election.cc:304] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, 917383ee650a411288b86b4895768002; no voters: 
I20260709 12:21:28.952870 18355 raft_consensus.cc:2804] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:28.954038 18355 raft_consensus.cc:697] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 4 LEADER]: Becoming Leader. State: Replica: 4446ad69b93d4a62a3861fb1923713d5, State: Running, Role: LEADER
I20260709 12:21:28.955003 18355 consensus_queue.cc:237] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:28.965461 17910 catalog_manager.cc:5697] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 reported cstate change: term changed from 3 to 4, leader changed from ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129) to 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130). New cstate: current_term: 4 leader_uuid: "4446ad69b93d4a62a3861fb1923713d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:29.093051 18331 raft_consensus.cc:993] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe: : Instructing follower 917383ee650a411288b86b4895768002 to start an election
I20260709 12:21:29.093710 18358 raft_consensus.cc:1081] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 4 LEADER]: Signalling peer 917383ee650a411288b86b4895768002 to start an election
I20260709 12:21:29.095252 18164 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08454883e9dc40e58a5e1c61624e2126"
dest_uuid: "917383ee650a411288b86b4895768002"
 from {username='slave'} at 127.0.0.1:51402
I20260709 12:21:29.095693 18164 raft_consensus.cc:493] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:29.095978 18164 raft_consensus.cc:3060] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:29.100528 18164 raft_consensus.cc:515] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:29.102792 18164 leader_election.cc:290] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 5 election: Requested vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875)
I20260709 12:21:29.103507 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08454883e9dc40e58a5e1c61624e2126" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
I20260709 12:21:29.104104 18013 raft_consensus.cc:3055] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:29.104393 18013 raft_consensus.cc:740] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Running, Role: LEADER
I20260709 12:21:29.104839 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08454883e9dc40e58a5e1c61624e2126" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
I20260709 12:21:29.105389 18090 raft_consensus.cc:3060] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:29.105136 18013 consensus_queue.cc:260] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:29.106156 18013 raft_consensus.cc:3060] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:29.109764 18090 raft_consensus.cc:2468] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 5.
I20260709 12:21:29.110395 18013 raft_consensus.cc:2468] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 5.
I20260709 12:21:29.111078 18130 leader_election.cc:304] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, 917383ee650a411288b86b4895768002; no voters: 
I20260709 12:21:29.111982 18356 raft_consensus.cc:2804] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:29.112327 18356 raft_consensus.cc:697] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 5 LEADER]: Becoming Leader. State: Replica: 917383ee650a411288b86b4895768002, State: Running, Role: LEADER
I20260709 12:21:29.113071 18356 consensus_queue.cc:237] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:29.120407 17910 catalog_manager.cc:5697] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 reported cstate change: term changed from 4 to 5, leader changed from ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129) to 917383ee650a411288b86b4895768002 (127.16.240.131). New cstate: current_term: 5 leader_uuid: "917383ee650a411288b86b4895768002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:29.133792 18331 raft_consensus.cc:993] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe: : Instructing follower 4446ad69b93d4a62a3861fb1923713d5 to start an election
I20260709 12:21:29.134351 18358 raft_consensus.cc:1081] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [term 1 LEADER]: Signalling peer 4446ad69b93d4a62a3861fb1923713d5 to start an election
I20260709 12:21:29.135740 18090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b473ce7f315b414e9dcc16f27ee42bfc"
dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
 from {username='slave'} at 127.0.0.1:49086
I20260709 12:21:29.136227 18090 raft_consensus.cc:493] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:29.136507 18090 raft_consensus.cc:3060] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.140650 18090 raft_consensus.cc:515] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } }
I20260709 12:21:29.142282 18090 leader_election.cc:290] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5 [CANDIDATE]: Term 2 election: Requested vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 917383ee650a411288b86b4895768002 (127.16.240.131:40621)
I20260709 12:21:29.143095 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b473ce7f315b414e9dcc16f27ee42bfc" candidate_uuid: "4446ad69b93d4a62a3861fb1923713d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
I20260709 12:21:29.143301 18164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b473ce7f315b414e9dcc16f27ee42bfc" candidate_uuid: "4446ad69b93d4a62a3861fb1923713d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "917383ee650a411288b86b4895768002"
I20260709 12:21:29.143677 18013 raft_consensus.cc:3055] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:29.143791 18164 raft_consensus.cc:3060] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.144096 18013 raft_consensus.cc:740] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Running, Role: LEADER
I20260709 12:21:29.144784 18013 consensus_queue.cc:260] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } }
I20260709 12:21:29.145867 18013 raft_consensus.cc:3060] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.150322 18164 raft_consensus.cc:2468] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4446ad69b93d4a62a3861fb1923713d5 in term 2.
I20260709 12:21:29.152760 18054 leader_election.cc:304] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, 917383ee650a411288b86b4895768002; no voters: 
I20260709 12:21:29.153021 18013 raft_consensus.cc:2468] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4446ad69b93d4a62a3861fb1923713d5 in term 2.
I20260709 12:21:29.153508 18355 raft_consensus.cc:2804] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:29.153970 18355 raft_consensus.cc:697] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5 [term 2 LEADER]: Becoming Leader. State: Replica: 4446ad69b93d4a62a3861fb1923713d5, State: Running, Role: LEADER
I20260709 12:21:29.154772 18355 consensus_queue.cc:237] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } }
I20260709 12:21:29.161469 17910 catalog_manager.cc:5697] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5 reported cstate change: term changed from 1 to 2, leader changed from ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129) to 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "4446ad69b93d4a62a3861fb1923713d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:29.347484 18164 raft_consensus.cc:1275] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002 [term 4 FOLLOWER]: Refusing update from remote peer 4446ad69b93d4a62a3861fb1923713d5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:29.349601 18355 consensus_queue.cc:1048] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:29.370666 18013 raft_consensus.cc:1275] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 4 FOLLOWER]: Refusing update from remote peer 4446ad69b93d4a62a3861fb1923713d5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:29.372411 18355 consensus_queue.cc:1048] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:29.391001 18358 raft_consensus.cc:993] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe: : Instructing follower 917383ee650a411288b86b4895768002 to start an election
I20260709 12:21:29.391767 18331 raft_consensus.cc:1081] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 3 LEADER]: Signalling peer 917383ee650a411288b86b4895768002 to start an election
I20260709 12:21:29.393440 18164 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a77f52af1814deab6b5fc9d724ed9e2"
dest_uuid: "917383ee650a411288b86b4895768002"
 from {username='slave'} at 127.0.0.1:51402
I20260709 12:21:29.394032 18164 raft_consensus.cc:493] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:29.394321 18164 raft_consensus.cc:3060] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:29.400635 18164 raft_consensus.cc:515] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:29.402387 18164 leader_election.cc:290] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 4 election: Requested vote from peers ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543), 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875)
I20260709 12:21:29.403609 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a77f52af1814deab6b5fc9d724ed9e2" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ba6e65ec56284f449dde8c8a931eacfe"
I20260709 12:21:29.404091 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a77f52af1814deab6b5fc9d724ed9e2" candidate_uuid: "917383ee650a411288b86b4895768002" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4446ad69b93d4a62a3861fb1923713d5"
I20260709 12:21:29.404244 18013 raft_consensus.cc:3055] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:29.404637 18013 raft_consensus.cc:740] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ba6e65ec56284f449dde8c8a931eacfe, State: Running, Role: LEADER
I20260709 12:21:29.404723 18090 raft_consensus.cc:3060] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:29.405532 18013 consensus_queue.cc:260] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:29.406678 18013 raft_consensus.cc:3060] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:29.411011 18090 raft_consensus.cc:2468] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 4.
I20260709 12:21:29.411688 18013 raft_consensus.cc:2468] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 917383ee650a411288b86b4895768002 in term 4.
I20260709 12:21:29.412372 18130 leader_election.cc:304] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4446ad69b93d4a62a3861fb1923713d5, 917383ee650a411288b86b4895768002; no voters: 
I20260709 12:21:29.413292 18356 raft_consensus.cc:2804] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:29.413677 18356 raft_consensus.cc:697] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 4 LEADER]: Becoming Leader. State: Replica: 917383ee650a411288b86b4895768002, State: Running, Role: LEADER
I20260709 12:21:29.414534 18356 consensus_queue.cc:237] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } }
I20260709 12:21:29.421854 17911 catalog_manager.cc:5697] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 reported cstate change: term changed from 3 to 4, leader changed from ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129) to 917383ee650a411288b86b4895768002 (127.16.240.131). New cstate: current_term: 4 leader_uuid: "917383ee650a411288b86b4895768002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:29.568634 18013 raft_consensus.cc:1275] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Refusing update from remote peer 4446ad69b93d4a62a3861fb1923713d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:29.569895 18355 consensus_queue.cc:1048] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:29.580981 18164 raft_consensus.cc:1275] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Refusing update from remote peer 4446ad69b93d4a62a3861fb1923713d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:29.583300 18359 consensus_queue.cc:1048] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "917383ee650a411288b86b4895768002" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:29.670472 18090 raft_consensus.cc:1275] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5 [term 5 FOLLOWER]: Refusing update from remote peer 917383ee650a411288b86b4895768002: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:29.671729 18356 consensus_queue.cc:1048] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:29.682384 18013 raft_consensus.cc:1275] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 5 FOLLOWER]: Refusing update from remote peer 917383ee650a411288b86b4895768002: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:29.684201 18356 consensus_queue.cc:1048] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:29.820451 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:29.826393 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:29.826872 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:29.863993 18090 raft_consensus.cc:1275] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 4 FOLLOWER]: Refusing update from remote peer 917383ee650a411288b86b4895768002: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:29.865379 18356 consensus_queue.cc:1048] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4446ad69b93d4a62a3861fb1923713d5" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:29.875553 18013 raft_consensus.cc:1275] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 4 FOLLOWER]: Refusing update from remote peer 917383ee650a411288b86b4895768002: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:29.877213 18378 consensus_queue.cc:1048] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6e65ec56284f449dde8c8a931eacfe" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:30.828014 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:30.834100 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:30.834656 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:31.835662 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:31.841581 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:31.842044 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:32.843268 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:32.849449 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:32.850216 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:33.851343 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:33.857523 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:33.858042 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:34.859053 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:34.864852 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:34.865389 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:35.866371 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:35.872026 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:35.872524 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:36.873579 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:36.879297 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:36.879841 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:37.881207 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:37.887589 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:37.888304 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:38.922456 17346 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:21:38.923026 17346 tablet_server.cc:179] TabletServer@127.16.240.129:0 shutting down...
W20260709 12:21:38.961700 18054 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 12:21:38.965829 18054 consensus_peers.cc:597] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 -> Peer ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543): Couldn't send request to peer ba6e65ec56284f449dde8c8a931eacfe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:38.972088 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:38.973011 17346 tablet_replica.cc:333] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe: stopping tablet replica
I20260709 12:21:38.973817 17346 raft_consensus.cc:2243] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:38.974362 17346 raft_consensus.cc:2272] T 8210f9521a824b97addc9f8d5a7864fb P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:38.976501 17346 tablet_replica.cc:333] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe: stopping tablet replica
I20260709 12:21:38.977051 17346 raft_consensus.cc:2243] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:38.977490 17346 raft_consensus.cc:2272] T b473ce7f315b414e9dcc16f27ee42bfc P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:38.979146 17346 tablet_replica.cc:333] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe: stopping tablet replica
I20260709 12:21:38.979701 17346 raft_consensus.cc:2243] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:38.980213 17346 raft_consensus.cc:2272] T f1a420cbdc52422aab49dc58e04e7b1e P ba6e65ec56284f449dde8c8a931eacfe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:38.981891 17346 tablet_replica.cc:333] T 2d7fc6d43ca44313b5454b047cb20056 P ba6e65ec56284f449dde8c8a931eacfe: stopping tablet replica
I20260709 12:21:38.982477 17346 raft_consensus.cc:2243] T 2d7fc6d43ca44313b5454b047cb20056 P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:38.982949 17346 raft_consensus.cc:2272] T 2d7fc6d43ca44313b5454b047cb20056 P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:38.984839 17346 tablet_replica.cc:333] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe: stopping tablet replica
I20260709 12:21:38.985363 17346 raft_consensus.cc:2243] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:38.985802 17346 raft_consensus.cc:2272] T 08454883e9dc40e58a5e1c61624e2126 P ba6e65ec56284f449dde8c8a931eacfe [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:38.987507 17346 tablet_replica.cc:333] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe: stopping tablet replica
I20260709 12:21:38.988116 17346 raft_consensus.cc:2243] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:38.988535 17346 raft_consensus.cc:2272] T 7a77f52af1814deab6b5fc9d724ed9e2 P ba6e65ec56284f449dde8c8a931eacfe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:38.990276 17346 tablet_replica.cc:333] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe: stopping tablet replica
I20260709 12:21:38.990876 17346 raft_consensus.cc:2243] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:21:38.991704 17346 raft_consensus.cc:2272] T b797090c2ec247bfb432e56d7c913d05 P ba6e65ec56284f449dde8c8a931eacfe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:38.993925 17346 tablet_replica.cc:333] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe: stopping tablet replica
I20260709 12:21:38.994675 17346 raft_consensus.cc:2243] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:21:38.995182 18054 consensus_peers.cc:597] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5 -> Peer ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543): Couldn't send request to peer ba6e65ec56284f449dde8c8a931eacfe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:38.995641 17346 raft_consensus.cc:2272] T 72fbb32a196a4161a14790e1827e73ec P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:38.997696 17346 tablet_replica.cc:333] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe: stopping tablet replica
I20260709 12:21:38.998247 17346 raft_consensus.cc:2243] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:38.999050 17346 raft_consensus.cc:2272] T c4318035ed794a5e83625cc731fda175 P ba6e65ec56284f449dde8c8a931eacfe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:39.000941 17346 tablet_replica.cc:333] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe: stopping tablet replica
I20260709 12:21:39.001461 17346 raft_consensus.cc:2243] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:39.002271 17346 raft_consensus.cc:2272] T d246e0caab544fd8b721745d6aa518ba P ba6e65ec56284f449dde8c8a931eacfe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:39.034438 17346 tablet_server.cc:196] TabletServer@127.16.240.129:0 shutdown complete.
W20260709 12:21:39.046507 18129 consensus_peers.cc:597] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 -> Peer ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543): Couldn't send request to peer ba6e65ec56284f449dde8c8a931eacfe. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:36543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:39.058182 18054 consensus_peers.cc:597] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5 -> Peer ba6e65ec56284f449dde8c8a931eacfe (127.16.240.129:36543): Couldn't send request to peer ba6e65ec56284f449dde8c8a931eacfe. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:36543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:39.061070 17346 tablet_server.cc:179] TabletServer@127.16.240.130:0 shutting down...
I20260709 12:21:39.092077 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:39.092767 17346 tablet_replica.cc:333] T 8210f9521a824b97addc9f8d5a7864fb P 4446ad69b93d4a62a3861fb1923713d5: stopping tablet replica
I20260709 12:21:39.093485 17346 raft_consensus.cc:2243] T 8210f9521a824b97addc9f8d5a7864fb P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:39.093982 17346 raft_consensus.cc:2272] T 8210f9521a824b97addc9f8d5a7864fb P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:39.096067 17346 tablet_replica.cc:333] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5: stopping tablet replica
I20260709 12:21:39.096619 17346 raft_consensus.cc:2243] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:39.097071 17346 raft_consensus.cc:2272] T 7a77f52af1814deab6b5fc9d724ed9e2 P 4446ad69b93d4a62a3861fb1923713d5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:39.098737 17346 tablet_replica.cc:333] T d246e0caab544fd8b721745d6aa518ba P 4446ad69b93d4a62a3861fb1923713d5: stopping tablet replica
I20260709 12:21:39.099292 17346 raft_consensus.cc:2243] T d246e0caab544fd8b721745d6aa518ba P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:39.099684 17346 raft_consensus.cc:2272] T d246e0caab544fd8b721745d6aa518ba P 4446ad69b93d4a62a3861fb1923713d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:39.101366 17346 tablet_replica.cc:333] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5: stopping tablet replica
I20260709 12:21:39.101876 17346 raft_consensus.cc:2243] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:39.102681 17346 raft_consensus.cc:2272] T 2d7fc6d43ca44313b5454b047cb20056 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:39.104413 17346 tablet_replica.cc:333] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5: stopping tablet replica
I20260709 12:21:39.104933 17346 raft_consensus.cc:2243] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:39.105402 17346 raft_consensus.cc:2272] T 08454883e9dc40e58a5e1c61624e2126 P 4446ad69b93d4a62a3861fb1923713d5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:39.106956 17346 tablet_replica.cc:333] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5: stopping tablet replica
I20260709 12:21:39.107470 17346 raft_consensus.cc:2243] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:39.108235 17346 raft_consensus.cc:2272] T b473ce7f315b414e9dcc16f27ee42bfc P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:39.110023 17346 tablet_replica.cc:333] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5: stopping tablet replica
I20260709 12:21:39.110532 17346 raft_consensus.cc:2243] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:21:39.111299 17346 raft_consensus.cc:2272] T f1a420cbdc52422aab49dc58e04e7b1e P 4446ad69b93d4a62a3861fb1923713d5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:39.113055 17346 tablet_replica.cc:333] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5: stopping tablet replica
I20260709 12:21:39.113598 17346 raft_consensus.cc:2243] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:39.113999 17346 raft_consensus.cc:2272] T b797090c2ec247bfb432e56d7c913d05 P 4446ad69b93d4a62a3861fb1923713d5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:39.115700 17346 tablet_replica.cc:333] T 72fbb32a196a4161a14790e1827e73ec P 4446ad69b93d4a62a3861fb1923713d5: stopping tablet replica
I20260709 12:21:39.116206 17346 raft_consensus.cc:2243] T 72fbb32a196a4161a14790e1827e73ec P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:39.116628 17346 raft_consensus.cc:2272] T 72fbb32a196a4161a14790e1827e73ec P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:39.118314 17346 tablet_replica.cc:333] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5: stopping tablet replica
I20260709 12:21:39.118777 17346 raft_consensus.cc:2243] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:39.119191 17346 raft_consensus.cc:2272] T c4318035ed794a5e83625cc731fda175 P 4446ad69b93d4a62a3861fb1923713d5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:39.123874 18130 consensus_peers.cc:597] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 -> Peer 4446ad69b93d4a62a3861fb1923713d5 (127.16.240.130:43875): Couldn't send request to peer 4446ad69b93d4a62a3861fb1923713d5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:39.150466 17346 tablet_server.cc:196] TabletServer@127.16.240.130:0 shutdown complete.
I20260709 12:21:39.172178 17346 tablet_server.cc:179] TabletServer@127.16.240.131:0 shutting down...
I20260709 12:21:39.200084 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:39.200688 17346 tablet_replica.cc:333] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002: stopping tablet replica
I20260709 12:21:39.201313 17346 raft_consensus.cc:2243] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:39.202217 17346 raft_consensus.cc:2272] T 8210f9521a824b97addc9f8d5a7864fb P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:39.204113 17346 tablet_replica.cc:333] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002: stopping tablet replica
I20260709 12:21:39.204687 17346 raft_consensus.cc:2243] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:21:39.205456 17346 raft_consensus.cc:2272] T 08454883e9dc40e58a5e1c61624e2126 P 917383ee650a411288b86b4895768002 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:39.207175 17346 tablet_replica.cc:333] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002: stopping tablet replica
I20260709 12:21:39.207700 17346 raft_consensus.cc:2243] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:39.208230 17346 raft_consensus.cc:2272] T 2d7fc6d43ca44313b5454b047cb20056 P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:39.210052 17346 tablet_replica.cc:333] T d246e0caab544fd8b721745d6aa518ba P 917383ee650a411288b86b4895768002: stopping tablet replica
I20260709 12:21:39.210579 17346 raft_consensus.cc:2243] T d246e0caab544fd8b721745d6aa518ba P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:39.210984 17346 raft_consensus.cc:2272] T d246e0caab544fd8b721745d6aa518ba P 917383ee650a411288b86b4895768002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:39.212762 17346 tablet_replica.cc:333] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002: stopping tablet replica
I20260709 12:21:39.213284 17346 raft_consensus.cc:2243] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:39.213727 17346 raft_consensus.cc:2272] T f1a420cbdc52422aab49dc58e04e7b1e P 917383ee650a411288b86b4895768002 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:39.215339 17346 tablet_replica.cc:333] T c4318035ed794a5e83625cc731fda175 P 917383ee650a411288b86b4895768002: stopping tablet replica
I20260709 12:21:39.215927 17346 raft_consensus.cc:2243] T c4318035ed794a5e83625cc731fda175 P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:39.216349 17346 raft_consensus.cc:2272] T c4318035ed794a5e83625cc731fda175 P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:39.217933 17346 tablet_replica.cc:333] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002: stopping tablet replica
I20260709 12:21:39.218432 17346 raft_consensus.cc:2243] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:21:39.219183 17346 raft_consensus.cc:2272] T 7a77f52af1814deab6b5fc9d724ed9e2 P 917383ee650a411288b86b4895768002 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:39.220916 17346 tablet_replica.cc:333] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002: stopping tablet replica
I20260709 12:21:39.221426 17346 raft_consensus.cc:2243] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:39.221854 17346 raft_consensus.cc:2272] T b797090c2ec247bfb432e56d7c913d05 P 917383ee650a411288b86b4895768002 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:39.223516 17346 tablet_replica.cc:333] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002: stopping tablet replica
I20260709 12:21:39.224010 17346 raft_consensus.cc:2243] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:39.224464 17346 raft_consensus.cc:2272] T 72fbb32a196a4161a14790e1827e73ec P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:39.226178 17346 tablet_replica.cc:333] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002: stopping tablet replica
I20260709 12:21:39.226650 17346 raft_consensus.cc:2243] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:39.227047 17346 raft_consensus.cc:2272] T b473ce7f315b414e9dcc16f27ee42bfc P 917383ee650a411288b86b4895768002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:39.257040 17346 tablet_server.cc:196] TabletServer@127.16.240.131:0 shutdown complete.
I20260709 12:21:39.277079 17346 master.cc:562] Master@127.16.240.190:42675 shutting down...
I20260709 12:21:39.314507 17346 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:39.315507 17346 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:39.315936 17346 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6abc2d4c9e544f29a7c92c45b69bdafd: stopping tablet replica
I20260709 12:21:39.337550 17346 master.cc:584] Master@127.16.240.190:42675 shutdown complete.
4446ad69b93d4a62a3861fb1923713d5  4
917383ee650a411288b86b4895768002  1
ba6e65ec56284f449dde8c8a931eacfe  5
4446ad69b93d4a62a3861fb1923713d5  4
917383ee650a411288b86b4895768002  3
ba6e65ec56284f449dde8c8a931eacfe  3
4446ad69b93d4a62a3861fb1923713d5  1
917383ee650a411288b86b4895768002  1
ba6e65ec56284f449dde8c8a931eacfe  8
4446ad69b93d4a62a3861fb1923713d5  3
917383ee650a411288b86b4895768002  3
ba6e65ec56284f449dde8c8a931eacfe  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28789 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:21:39.390818 17346 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.240.190:43515
I20260709 12:21:39.392175 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:39.398352 18401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:39.398835 18402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:39.399278 18404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:39.399888 17346 server_base.cc:1061] running on GCE node
I20260709 12:21:39.400843 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:39.401080 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:39.401283 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599699401245 us; error 0 us; skew 500 ppm
I20260709 12:21:39.401865 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:39.404973 17346 webserver.cc:533] Webserver started at http://127.16.240.190:33061/ using document root <none> and password file <none>
I20260709 12:21:39.405665 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:39.405844 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:39.406209 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:39.407562 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/master-0-root/instance:
uuid: "01c309cccd034172a8532c59d6c80638"
format_stamp: "Formatted at 2026-07-09 12:21:39 on dist-test-slave-7xpw"
I20260709 12:21:39.412431 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:21:39.416013 18409 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:39.416772 17346 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:21:39.417091 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/master-0-root
uuid: "01c309cccd034172a8532c59d6c80638"
format_stamp: "Formatted at 2026-07-09 12:21:39 on dist-test-slave-7xpw"
I20260709 12:21:39.417630 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:39.441056 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:39.442386 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:39.485795 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.190:43515
I20260709 12:21:39.485922 18461 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.190:43515 every 8 connection(s)
I20260709 12:21:39.490216 18462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.500699 18462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638: Bootstrap starting.
I20260709 12:21:39.506484 18462 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.511797 18462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638: No bootstrap required, opened a new log
I20260709 12:21:39.514449 18462 raft_consensus.cc:359] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01c309cccd034172a8532c59d6c80638" member_type: VOTER }
I20260709 12:21:39.514943 18462 raft_consensus.cc:385] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.515239 18462 raft_consensus.cc:740] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c309cccd034172a8532c59d6c80638, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.515965 18462 consensus_queue.cc:260] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01c309cccd034172a8532c59d6c80638" member_type: VOTER }
I20260709 12:21:39.516443 18462 raft_consensus.cc:399] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:21:39.516675 18462 raft_consensus.cc:493] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:21:39.516971 18462 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.521663 18462 raft_consensus.cc:515] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01c309cccd034172a8532c59d6c80638" member_type: VOTER }
I20260709 12:21:39.522269 18462 leader_election.cc:304] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 01c309cccd034172a8532c59d6c80638; no voters: 
I20260709 12:21:39.523442 18462 leader_election.cc:290] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:21:39.523957 18465 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:39.525362 18465 raft_consensus.cc:697] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638 [term 1 LEADER]: Becoming Leader. State: Replica: 01c309cccd034172a8532c59d6c80638, State: Running, Role: LEADER
I20260709 12:21:39.526124 18465 consensus_queue.cc:237] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01c309cccd034172a8532c59d6c80638" member_type: VOTER }
I20260709 12:21:39.527237 18462 sys_catalog.cc:565] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:21:39.532931 18467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 01c309cccd034172a8532c59d6c80638. Latest consensus state: current_term: 1 leader_uuid: "01c309cccd034172a8532c59d6c80638" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01c309cccd034172a8532c59d6c80638" member_type: VOTER } }
I20260709 12:21:39.533083 18466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "01c309cccd034172a8532c59d6c80638" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01c309cccd034172a8532c59d6c80638" member_type: VOTER } }
I20260709 12:21:39.533813 18467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638 [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:39.533908 18466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638 [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:39.536213 18474 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:21:39.541175 18474 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:21:39.543267 17346 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:21:39.551790 18474 catalog_manager.cc:1383] Generated new cluster ID: 63a20f3776044ccbb53383c6221f4488
I20260709 12:21:39.552243 18474 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:21:39.574213 18474 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:21:39.575517 18474 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:21:39.593991 18474 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638: Generated new TSK 0
I20260709 12:21:39.594601 18474 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:21:39.610769 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:39.618280 18483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:39.619119 18484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:39.620775 18486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:39.621218 17346 server_base.cc:1061] running on GCE node
I20260709 12:21:39.622241 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:39.622447 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:39.622638 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599699622623 us; error 0 us; skew 500 ppm
I20260709 12:21:39.623231 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:39.625849 17346 webserver.cc:533] Webserver started at http://127.16.240.129:36459/ using document root <none> and password file <none>
I20260709 12:21:39.626362 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:39.626545 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:39.626868 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:39.628180 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-0-root/instance:
uuid: "2f9872512f1646bc835906bd0e98c6a7"
format_stamp: "Formatted at 2026-07-09 12:21:39 on dist-test-slave-7xpw"
I20260709 12:21:39.633268 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:21:39.636852 18492 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:39.637888 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:21:39.638231 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-0-root
uuid: "2f9872512f1646bc835906bd0e98c6a7"
format_stamp: "Formatted at 2026-07-09 12:21:39 on dist-test-slave-7xpw"
I20260709 12:21:39.638513 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:39.649942 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:39.651338 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:39.652968 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:39.656155 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:39.656355 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:39.656560 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:39.656702 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:39.703421 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.129:45155
I20260709 12:21:39.703524 18554 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.129:45155 every 8 connection(s)
I20260709 12:21:39.708931 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:39.717804 18559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:39.718262 18560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:39.722199 18562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:39.722657 17346 server_base.cc:1061] running on GCE node
I20260709 12:21:39.723910 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:39.724129 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:39.724296 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599699724278 us; error 0 us; skew 500 ppm
I20260709 12:21:39.725229 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:39.728619 17346 webserver.cc:533] Webserver started at http://127.16.240.130:39733/ using document root <none> and password file <none>
I20260709 12:21:39.729259 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:39.729396 18555 heartbeater.cc:344] Connected to a master server at 127.16.240.190:43515
I20260709 12:21:39.729558 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:39.729836 18555 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:39.729905 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:39.730850 18555 heartbeater.cc:507] Master 127.16.240.190:43515 requested a full tablet report, sending...
I20260709 12:21:39.731669 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-1-root/instance:
uuid: "c7bd71f1f37c45f28b52c154e59356b9"
format_stamp: "Formatted at 2026-07-09 12:21:39 on dist-test-slave-7xpw"
I20260709 12:21:39.733697 18427 ts_manager.cc:194] Registered new tserver with Master: 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:21:39.735667 18427 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47708
I20260709 12:21:39.736975 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:21:39.740892 18568 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:39.741741 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:21:39.742089 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-1-root
uuid: "c7bd71f1f37c45f28b52c154e59356b9"
format_stamp: "Formatted at 2026-07-09 12:21:39 on dist-test-slave-7xpw"
I20260709 12:21:39.742398 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:39.756080 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:39.757362 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:39.758948 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:39.761377 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:39.761622 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:39.761878 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:39.762056 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:39.810726 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.130:37079
I20260709 12:21:39.811014 18630 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.130:37079 every 8 connection(s)
I20260709 12:21:39.816155 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:39.823905 18634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:39.826190 18635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:39.828024 18637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:39.829409 17346 server_base.cc:1061] running on GCE node
I20260709 12:21:39.829608 18631 heartbeater.cc:344] Connected to a master server at 127.16.240.190:43515
I20260709 12:21:39.830081 18631 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:39.830474 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:39.830701 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:39.830889 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599699830858 us; error 0 us; skew 500 ppm
I20260709 12:21:39.830914 18631 heartbeater.cc:507] Master 127.16.240.190:43515 requested a full tablet report, sending...
I20260709 12:21:39.831580 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:39.833264 18427 ts_manager.cc:194] Registered new tserver with Master: c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:39.834319 17346 webserver.cc:533] Webserver started at http://127.16.240.131:35903/ using document root <none> and password file <none>
I20260709 12:21:39.834836 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:39.834844 18427 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47714
I20260709 12:21:39.835090 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:39.835475 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:39.836871 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-2-root/instance:
uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
format_stamp: "Formatted at 2026-07-09 12:21:39 on dist-test-slave-7xpw"
I20260709 12:21:39.841643 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:21:39.845788 18642 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:39.847028 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:21:39.847395 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-2-root
uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
format_stamp: "Formatted at 2026-07-09 12:21:39 on dist-test-slave-7xpw"
I20260709 12:21:39.847708 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:39.860376 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:39.861810 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:39.863497 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:39.866361 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:39.866578 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:39.866900 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:39.867058 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:39.913031 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.131:36757
I20260709 12:21:39.913141 18705 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.131:36757 every 8 connection(s)
I20260709 12:21:39.928049 18706 heartbeater.cc:344] Connected to a master server at 127.16.240.190:43515
I20260709 12:21:39.928491 18706 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:39.929396 18706 heartbeater.cc:507] Master 127.16.240.190:43515 requested a full tablet report, sending...
I20260709 12:21:39.931627 18427 ts_manager.cc:194] Registered new tserver with Master: a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:39.932130 17346 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01594091s
I20260709 12:21:39.933686 18427 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47728
I20260709 12:21:39.964058 18427 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47744:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:21:39.970283 18427 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:21:40.192757 18520 tablet_service.cc:1511] Processing CreateTablet for tablet 2cbe068cca5f4e01bf21b7df39ac7d89 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:21:40.194293 18520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cbe068cca5f4e01bf21b7df39ac7d89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.196853 18519 tablet_service.cc:1511] Processing CreateTablet for tablet 6874b99e69744371a73c71762816db62 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:21:40.198366 18519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6874b99e69744371a73c71762816db62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.200379 18514 tablet_service.cc:1511] Processing CreateTablet for tablet 6e95bb922f31462b9debb1f2a9ff7e19 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:21:40.201823 18514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e95bb922f31462b9debb1f2a9ff7e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.205302 18518 tablet_service.cc:1511] Processing CreateTablet for tablet f8f93d163b9441dd9c044b6224aff070 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:21:40.206812 18518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f93d163b9441dd9c044b6224aff070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.209025 18517 tablet_service.cc:1511] Processing CreateTablet for tablet 10f0fd04dea343f1a51febdac9b97f7b (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:21:40.211401 18516 tablet_service.cc:1511] Processing CreateTablet for tablet c30a47c4d7e24c07809e11073578b22c (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:21:40.213315 18515 tablet_service.cc:1511] Processing CreateTablet for tablet 06c92947c3174627a5618c85f17edeb3 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:21:40.214437 18517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10f0fd04dea343f1a51febdac9b97f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.217190 18512 tablet_service.cc:1511] Processing CreateTablet for tablet 400ea90be13249389635103ccb1dfee6 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:21:40.218336 18516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c30a47c4d7e24c07809e11073578b22c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.220101 18515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c92947c3174627a5618c85f17edeb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.219916 18513 tablet_service.cc:1511] Processing CreateTablet for tablet c2c31f23053e4804b0fb872f29fde999 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:21:40.221480 18513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c31f23053e4804b0fb872f29fde999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.215333 18511 tablet_service.cc:1511] Processing CreateTablet for tablet 30ca83d13be54a41b9c5aaebfc89de05 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:21:40.225010 18511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30ca83d13be54a41b9c5aaebfc89de05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.227779 18512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400ea90be13249389635103ccb1dfee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.238197 18670 tablet_service.cc:1511] Processing CreateTablet for tablet 2cbe068cca5f4e01bf21b7df39ac7d89 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:21:40.239710 18670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cbe068cca5f4e01bf21b7df39ac7d89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.250943 18669 tablet_service.cc:1511] Processing CreateTablet for tablet 6874b99e69744371a73c71762816db62 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:21:40.252321 18669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6874b99e69744371a73c71762816db62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.254668 18596 tablet_service.cc:1511] Processing CreateTablet for tablet 2cbe068cca5f4e01bf21b7df39ac7d89 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:21:40.256115 18596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cbe068cca5f4e01bf21b7df39ac7d89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.257289 18595 tablet_service.cc:1511] Processing CreateTablet for tablet 6874b99e69744371a73c71762816db62 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:21:40.258731 18595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6874b99e69744371a73c71762816db62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.261005 18594 tablet_service.cc:1511] Processing CreateTablet for tablet f8f93d163b9441dd9c044b6224aff070 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:21:40.262403 18666 tablet_service.cc:1511] Processing CreateTablet for tablet c30a47c4d7e24c07809e11073578b22c (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:21:40.263432 18593 tablet_service.cc:1511] Processing CreateTablet for tablet 10f0fd04dea343f1a51febdac9b97f7b (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:21:40.263710 18668 tablet_service.cc:1511] Processing CreateTablet for tablet f8f93d163b9441dd9c044b6224aff070 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:21:40.265897 18592 tablet_service.cc:1511] Processing CreateTablet for tablet c30a47c4d7e24c07809e11073578b22c (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:21:40.266122 18667 tablet_service.cc:1511] Processing CreateTablet for tablet 10f0fd04dea343f1a51febdac9b97f7b (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:21:40.265892 18587 tablet_service.cc:1511] Processing CreateTablet for tablet 30ca83d13be54a41b9c5aaebfc89de05 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:21:40.268117 18666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c30a47c4d7e24c07809e11073578b22c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.269114 18511 tablet_service.cc:1511] Processing CreateTablet for tablet 6bcb0137def74cb3b0f0590e5e746d02 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:21:40.269289 18590 tablet_service.cc:1511] Processing CreateTablet for tablet 6e95bb922f31462b9debb1f2a9ff7e19 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:21:40.276230 18661 tablet_service.cc:1511] Processing CreateTablet for tablet 30ca83d13be54a41b9c5aaebfc89de05 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:21:40.277711 18661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30ca83d13be54a41b9c5aaebfc89de05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.270610 18663 tablet_service.cc:1511] Processing CreateTablet for tablet c2c31f23053e4804b0fb872f29fde999 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:21:40.280145 18594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f93d163b9441dd9c044b6224aff070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.280804 18593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10f0fd04dea343f1a51febdac9b97f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.280901 18663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c31f23053e4804b0fb872f29fde999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.284127 18590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e95bb922f31462b9debb1f2a9ff7e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.269191 18664 tablet_service.cc:1511] Processing CreateTablet for tablet 6e95bb922f31462b9debb1f2a9ff7e19 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:21:40.285526 18664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e95bb922f31462b9debb1f2a9ff7e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.271191 18589 tablet_service.cc:1511] Processing CreateTablet for tablet c2c31f23053e4804b0fb872f29fde999 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:21:40.288148 18592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c30a47c4d7e24c07809e11073578b22c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.272555 18662 tablet_service.cc:1511] Processing CreateTablet for tablet 400ea90be13249389635103ccb1dfee6 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:21:40.273018 18588 tablet_service.cc:1511] Processing CreateTablet for tablet 400ea90be13249389635103ccb1dfee6 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:21:40.274224 18591 tablet_service.cc:1511] Processing CreateTablet for tablet 06c92947c3174627a5618c85f17edeb3 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:21:40.274362 18665 tablet_service.cc:1511] Processing CreateTablet for tablet 06c92947c3174627a5618c85f17edeb3 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:21:40.294870 18511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bcb0137def74cb3b0f0590e5e746d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.296106 18587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30ca83d13be54a41b9c5aaebfc89de05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.296936 18591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c92947c3174627a5618c85f17edeb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.298369 18667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10f0fd04dea343f1a51febdac9b97f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.299216 18662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400ea90be13249389635103ccb1dfee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.300307 18589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c31f23053e4804b0fb872f29fde999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.300647 18665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c92947c3174627a5618c85f17edeb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.301853 18588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400ea90be13249389635103ccb1dfee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.302040 18668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f93d163b9441dd9c044b6224aff070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.326977 18669 tablet_service.cc:1511] Processing CreateTablet for tablet 6bcb0137def74cb3b0f0590e5e746d02 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:21:40.340991 18517 tablet_service.cc:1511] Processing CreateTablet for tablet 298b8c963d93464e999fee75e74e9781 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:21:40.342429 18517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298b8c963d93464e999fee75e74e9781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.343219 18514 tablet_service.cc:1511] Processing CreateTablet for tablet a0ba9bae3e1f4f9a97bb68834d01038c (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:21:40.350757 18514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0ba9bae3e1f4f9a97bb68834d01038c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.351104 18669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bcb0137def74cb3b0f0590e5e746d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.343487 18512 tablet_service.cc:1511] Processing CreateTablet for tablet e9507595fc484ec1b5cf1d1b2482debf (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:21:40.353605 18512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9507595fc484ec1b5cf1d1b2482debf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.361373 18722 tablet_bootstrap.cc:492] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:40.372918 18670 tablet_service.cc:1511] Processing CreateTablet for tablet 298b8c963d93464e999fee75e74e9781 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:21:40.374693 18670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298b8c963d93464e999fee75e74e9781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.383769 18667 tablet_service.cc:1511] Processing CreateTablet for tablet e9507595fc484ec1b5cf1d1b2482debf (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:21:40.385129 18667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9507595fc484ec1b5cf1d1b2482debf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.390533 18520 tablet_service.cc:1511] Processing CreateTablet for tablet 91ba7e5c69124062865d447b2968bc2e (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:21:40.397591 18514 tablet_service.cc:1511] Processing CreateTablet for tablet 9786988480ef4569bc65f17fa6b60fd2 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:21:40.383524 18515 tablet_service.cc:1511] Processing CreateTablet for tablet 13a2490fb6904f8ca5c4cab03767d419 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:21:40.400205 18520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91ba7e5c69124062865d447b2968bc2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.401571 18514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9786988480ef4569bc65f17fa6b60fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.412151 18515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13a2490fb6904f8ca5c4cab03767d419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.415738 18667 tablet_service.cc:1511] Processing CreateTablet for tablet a0ba9bae3e1f4f9a97bb68834d01038c (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:21:40.417580 18512 tablet_service.cc:1511] Processing CreateTablet for tablet 222ae469827d4570aa1d61844f01eae9 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:21:40.418237 18667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0ba9bae3e1f4f9a97bb68834d01038c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.418802 18512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222ae469827d4570aa1d61844f01eae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.416854 18670 tablet_service.cc:1511] Processing CreateTablet for tablet 13a2490fb6904f8ca5c4cab03767d419 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:21:40.419556 18518 tablet_service.cc:1511] Processing CreateTablet for tablet 59141dbba91a4f249871144353b43d37 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:21:40.420723 18670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13a2490fb6904f8ca5c4cab03767d419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.421029 18518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59141dbba91a4f249871144353b43d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.429847 18722 tablet_bootstrap.cc:654] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.431000 18721 tablet_bootstrap.cc:492] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:40.460620 18519 tablet_service.cc:1511] Processing CreateTablet for tablet d337bc5c46924f42af3a8e39c86bfa17 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:21:40.464807 18594 tablet_service.cc:1511] Processing CreateTablet for tablet 13a2490fb6904f8ca5c4cab03767d419 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:21:40.469255 18514 tablet_service.cc:1511] Processing CreateTablet for tablet 171eb098d126492b96266e36d8a6ba81 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:21:40.484633 18514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 171eb098d126492b96266e36d8a6ba81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.485494 18519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d337bc5c46924f42af3a8e39c86bfa17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.487980 18721 tablet_bootstrap.cc:654] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.491072 18594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13a2490fb6904f8ca5c4cab03767d419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.497025 18669 tablet_service.cc:1511] Processing CreateTablet for tablet 91ba7e5c69124062865d447b2968bc2e (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:21:40.477974 18518 tablet_service.cc:1511] Processing CreateTablet for tablet d92b776ce9bf460fbd0c74b31953276d (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:21:40.511113 18518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d92b776ce9bf460fbd0c74b31953276d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.477974 18590 tablet_service.cc:1511] Processing CreateTablet for tablet 6bcb0137def74cb3b0f0590e5e746d02 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:21:40.508586 18513 tablet_service.cc:1511] Processing CreateTablet for tablet 406a6f5175ee42239ec8464ef19d6f14 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:21:40.515552 18513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 406a6f5175ee42239ec8464ef19d6f14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.524632 18590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bcb0137def74cb3b0f0590e5e746d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.534274 18724 tablet_bootstrap.cc:492] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:40.535521 18721 tablet_bootstrap.cc:492] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:40.586091 18721 ts_tablet_manager.cc:1403] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.156s	user 0.013s	sys 0.004s
I20260709 12:21:40.525156 18593 tablet_service.cc:1511] Processing CreateTablet for tablet e9507595fc484ec1b5cf1d1b2482debf (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:21:40.482925 18516 tablet_service.cc:1511] Processing CreateTablet for tablet e5079e43d75f41f9b2acb31e4798ce95 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:21:40.588300 18516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5079e43d75f41f9b2acb31e4798ce95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.584822 18594 tablet_service.cc:1511] Processing CreateTablet for tablet 171eb098d126492b96266e36d8a6ba81 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:21:40.591254 18594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 171eb098d126492b96266e36d8a6ba81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.595461 18593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9507595fc484ec1b5cf1d1b2482debf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.537948 18666 tablet_service.cc:1511] Processing CreateTablet for tablet 9786988480ef4569bc65f17fa6b60fd2 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:21:40.539597 18595 tablet_service.cc:1511] Processing CreateTablet for tablet a0ba9bae3e1f4f9a97bb68834d01038c (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:21:40.544075 18722 tablet_bootstrap.cc:492] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:40.549980 18592 tablet_service.cc:1511] Processing CreateTablet for tablet d337bc5c46924f42af3a8e39c86bfa17 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:21:40.552722 18669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91ba7e5c69124062865d447b2968bc2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.555817 18590 tablet_service.cc:1511] Processing CreateTablet for tablet 91ba7e5c69124062865d447b2968bc2e (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
W20260709 12:21:40.556562 18475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:40.561841 18512 tablet_service.cc:1511] Processing CreateTablet for tablet 845d4cff87f249e1ab9060dd308d4b22 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:21:40.562079 18661 tablet_service.cc:1511] Processing CreateTablet for tablet 222ae469827d4570aa1d61844f01eae9 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:21:40.564404 18667 tablet_service.cc:1511] Processing CreateTablet for tablet 59141dbba91a4f249871144353b43d37 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:21:40.567689 18665 tablet_service.cc:1511] Processing CreateTablet for tablet 171eb098d126492b96266e36d8a6ba81 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:21:40.568940 18668 tablet_service.cc:1511] Processing CreateTablet for tablet d92b776ce9bf460fbd0c74b31953276d (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:21:40.570811 18662 tablet_service.cc:1511] Processing CreateTablet for tablet e5079e43d75f41f9b2acb31e4798ce95 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:21:40.570868 18596 tablet_service.cc:1511] Processing CreateTablet for tablet 9786988480ef4569bc65f17fa6b60fd2 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:21:40.572176 18520 tablet_service.cc:1511] Processing CreateTablet for tablet b52424a465944d0ba861991c593bdc17 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:21:40.573858 18588 tablet_service.cc:1511] Processing CreateTablet for tablet 222ae469827d4570aa1d61844f01eae9 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:21:40.576577 18670 tablet_service.cc:1511] Processing CreateTablet for tablet d337bc5c46924f42af3a8e39c86bfa17 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:21:40.579540 18591 tablet_service.cc:1511] Processing CreateTablet for tablet 298b8c963d93464e999fee75e74e9781 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:21:40.584822 18589 tablet_service.cc:1511] Processing CreateTablet for tablet 59141dbba91a4f249871144353b43d37 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:21:40.595563 18587 tablet_service.cc:1511] Processing CreateTablet for tablet d92b776ce9bf460fbd0c74b31953276d (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:21:40.653110 18591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298b8c963d93464e999fee75e74e9781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.653250 18512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 845d4cff87f249e1ab9060dd308d4b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.653847 18722 ts_tablet_manager.cc:1403] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.293s	user 0.009s	sys 0.011s
I20260709 12:21:40.654017 18596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9786988480ef4569bc65f17fa6b60fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.654986 18589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59141dbba91a4f249871144353b43d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.629367 18513 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6a528af94f43f980dcff59f8ba646e (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:21:40.656551 18513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6a528af94f43f980dcff59f8ba646e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.656651 18590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91ba7e5c69124062865d447b2968bc2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.658839 18592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d337bc5c46924f42af3a8e39c86bfa17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.659848 18595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0ba9bae3e1f4f9a97bb68834d01038c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.660451 18520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b52424a465944d0ba861991c593bdc17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.613857 18519 tablet_service.cc:1511] Processing CreateTablet for tablet 60d3f1fac491465fb48a6000ace325f2 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:21:40.639866 18663 tablet_service.cc:1511] Processing CreateTablet for tablet 406a6f5175ee42239ec8464ef19d6f14 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:21:40.661378 18519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d3f1fac491465fb48a6000ace325f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.611505 18721 raft_consensus.cc:359] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:40.662686 18721 raft_consensus.cc:385] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.663072 18721 raft_consensus.cc:740] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.639086 18664 tablet_service.cc:1511] Processing CreateTablet for tablet 845d4cff87f249e1ab9060dd308d4b22 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:21:40.664088 18721 consensus_queue.cc:260] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:40.666316 18670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d337bc5c46924f42af3a8e39c86bfa17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.626274 18518 tablet_service.cc:1511] Processing CreateTablet for tablet 15e3196fc974445e967d05514226ac45 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:21:40.668507 18518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e3196fc974445e967d05514226ac45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.670559 18666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9786988480ef4569bc65f17fa6b60fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.672556 18587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d92b776ce9bf460fbd0c74b31953276d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.672981 18661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222ae469827d4570aa1d61844f01eae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.666359 18724 tablet_bootstrap.cc:654] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.678887 18588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222ae469827d4570aa1d61844f01eae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.688522 18722 raft_consensus.cc:359] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:40.689342 18722 raft_consensus.cc:385] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.689639 18722 raft_consensus.cc:740] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.690446 18722 consensus_queue.cc:260] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:40.709192 18663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 406a6f5175ee42239ec8464ef19d6f14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.712040 18667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59141dbba91a4f249871144353b43d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.714761 18665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 171eb098d126492b96266e36d8a6ba81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.715693 18662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5079e43d75f41f9b2acb31e4798ce95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.717536 18668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d92b776ce9bf460fbd0c74b31953276d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.720279 18664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 845d4cff87f249e1ab9060dd308d4b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.726310 18511 tablet_service.cc:1511] Processing CreateTablet for tablet a2586476710143e281df940fcb3d3238 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:21:40.727906 18511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2586476710143e281df940fcb3d3238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.742904 18555 heartbeater.cc:499] Master 127.16.240.190:43515 was elected leader, sending a full tablet report...
I20260709 12:21:40.748543 18517 tablet_service.cc:1511] Processing CreateTablet for tablet 5ab652408d034870b0f276a90a6132d7 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:21:40.750224 18517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ab652408d034870b0f276a90a6132d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.759646 18722 ts_tablet_manager.cc:1434] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.105s	user 0.010s	sys 0.006s
I20260709 12:21:40.760496 18706 heartbeater.cc:499] Master 127.16.240.190:43515 was elected leader, sending a full tablet report...
I20260709 12:21:40.766677 18724 tablet_bootstrap.cc:492] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:40.767299 18724 ts_tablet_manager.cc:1403] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.233s	user 0.014s	sys 0.003s
I20260709 12:21:40.769841 18514 tablet_service.cc:1511] Processing CreateTablet for tablet 6840b12ab24d4f62b563a6d5d868d0c4 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:21:40.771162 18514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6840b12ab24d4f62b563a6d5d868d0c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.801064 18721 ts_tablet_manager.cc:1434] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.215s	user 0.007s	sys 0.014s
I20260709 12:21:40.802459 18721 tablet_bootstrap.cc:492] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:40.813970 18589 tablet_service.cc:1511] Processing CreateTablet for tablet 406a6f5175ee42239ec8464ef19d6f14 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:21:40.814288 18724 raft_consensus.cc:359] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:40.815099 18724 raft_consensus.cc:385] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.815383 18589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 406a6f5175ee42239ec8464ef19d6f14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.818022 18591 tablet_service.cc:1511] Processing CreateTablet for tablet e5079e43d75f41f9b2acb31e4798ce95 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:21:40.818742 18663 tablet_service.cc:1511] Processing CreateTablet for tablet b52424a465944d0ba861991c593bdc17 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:21:40.820091 18663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b52424a465944d0ba861991c593bdc17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.823976 18512 tablet_service.cc:1511] Processing CreateTablet for tablet f0dcb322f11f4eb39aa973579cafa317 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:21:40.825364 18512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0dcb322f11f4eb39aa973579cafa317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.815436 18724 raft_consensus.cc:740] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.828310 18591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5079e43d75f41f9b2acb31e4798ce95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.833233 18724 consensus_queue.cc:260] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:40.838727 18721 tablet_bootstrap.cc:654] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.846572 18631 heartbeater.cc:499] Master 127.16.240.190:43515 was elected leader, sending a full tablet report...
I20260709 12:21:40.848090 18722 tablet_bootstrap.cc:492] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:40.861002 18595 tablet_service.cc:1511] Processing CreateTablet for tablet 60d3f1fac491465fb48a6000ace325f2 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:21:40.864112 18721 tablet_bootstrap.cc:492] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:40.891217 18721 ts_tablet_manager.cc:1403] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.000s
I20260709 12:21:40.892066 18724 ts_tablet_manager.cc:1434] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.124s	user 0.010s	sys 0.012s
I20260709 12:21:40.893261 18724 tablet_bootstrap.cc:492] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:40.894876 18721 raft_consensus.cc:359] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:40.864398 18593 tablet_service.cc:1511] Processing CreateTablet for tablet b52424a465944d0ba861991c593bdc17 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:21:40.867336 18514 tablet_service.cc:1511] Processing CreateTablet for tablet 678726cf80464d89802570ca4d73600f (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:21:40.872159 18596 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6a528af94f43f980dcff59f8ba646e (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:21:40.872459 18670 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6a528af94f43f980dcff59f8ba646e (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:21:40.873028 18520 tablet_service.cc:1511] Processing CreateTablet for tablet 49c1709156f048cd8184a38476ebfe0d (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:21:40.895682 18721 raft_consensus.cc:385] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.896802 18721 raft_consensus.cc:740] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.897240 18520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c1709156f048cd8184a38476ebfe0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.873687 18587 tablet_service.cc:1511] Processing CreateTablet for tablet 845d4cff87f249e1ab9060dd308d4b22 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:21:40.898128 18721 consensus_queue.cc:260] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:40.885164 18667 tablet_service.cc:1511] Processing CreateTablet for tablet 60d3f1fac491465fb48a6000ace325f2 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:21:40.900714 18667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d3f1fac491465fb48a6000ace325f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.899339 18514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 678726cf80464d89802570ca4d73600f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.899266 18727 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.897434 18593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b52424a465944d0ba861991c593bdc17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.881320 18594 tablet_service.cc:1511] Processing CreateTablet for tablet 15e3196fc974445e967d05514226ac45 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:21:40.905261 18727 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:40.913281 18664 tablet_service.cc:1511] Processing CreateTablet for tablet 6840b12ab24d4f62b563a6d5d868d0c4 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:21:40.913928 18727 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:21:40.910530 18663 tablet_service.cc:1511] Processing CreateTablet for tablet a2586476710143e281df940fcb3d3238 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:21:40.928004 18595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d3f1fac491465fb48a6000ace325f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.929366 18666 tablet_service.cc:1511] Processing CreateTablet for tablet 678726cf80464d89802570ca4d73600f (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:21:40.929562 18665 tablet_service.cc:1511] Processing CreateTablet for tablet f0dcb322f11f4eb39aa973579cafa317 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:21:40.930405 18587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 845d4cff87f249e1ab9060dd308d4b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.941277 18591 tablet_service.cc:1511] Processing CreateTablet for tablet a2586476710143e281df940fcb3d3238 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:21:40.941828 18721 ts_tablet_manager.cc:1434] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.050s	user 0.002s	sys 0.006s
I20260709 12:21:40.942142 18664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6840b12ab24d4f62b563a6d5d868d0c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.943177 18663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2586476710143e281df940fcb3d3238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.944056 18721 tablet_bootstrap.cc:492] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:40.944371 18596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6a528af94f43f980dcff59f8ba646e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.948094 18665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0dcb322f11f4eb39aa973579cafa317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.949489 18591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2586476710143e281df940fcb3d3238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.950613 18670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6a528af94f43f980dcff59f8ba646e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.951942 18666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 678726cf80464d89802570ca4d73600f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.943666 18668 tablet_service.cc:1511] Processing CreateTablet for tablet 49c1709156f048cd8184a38476ebfe0d (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:21:40.964896 18588 tablet_service.cc:1511] Processing CreateTablet for tablet 5ab652408d034870b0f276a90a6132d7 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:21:40.955155 18722 tablet_bootstrap.cc:654] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.966305 18588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ab652408d034870b0f276a90a6132d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.910530 18661 tablet_service.cc:1511] Processing CreateTablet for tablet 15e3196fc974445e967d05514226ac45 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:21:40.952684 18513 tablet_service.cc:1511] Processing CreateTablet for tablet 8e1dfac6f7ba4189ae36a57e87879b22 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:21:40.969895 18513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1dfac6f7ba4189ae36a57e87879b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.978982 18668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c1709156f048cd8184a38476ebfe0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.979282 18726 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.979775 18726 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:40.981472 18517 tablet_service.cc:1511] Processing CreateTablet for tablet b7e559fc600a4308a080243995e9f1e8 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:21:40.982510 18726 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:40.982798 18517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e559fc600a4308a080243995e9f1e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.987912 18590 tablet_service.cc:1511] Processing CreateTablet for tablet 6840b12ab24d4f62b563a6d5d868d0c4 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:21:40.989658 18590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6840b12ab24d4f62b563a6d5d868d0c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.993965 18594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e3196fc974445e967d05514226ac45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.002017 18721 tablet_bootstrap.cc:654] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.015867 18661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e3196fc974445e967d05514226ac45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:40.977461 18669 tablet_service.cc:1511] Processing CreateTablet for tablet 5ab652408d034870b0f276a90a6132d7 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:21:41.039601 18669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ab652408d034870b0f276a90a6132d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.040611 18512 tablet_service.cc:1511] Processing CreateTablet for tablet c3c52474787041b099fe01aa8c862c04 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:21:41.042135 18512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c52474787041b099fe01aa8c862c04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.059412 18724 tablet_bootstrap.cc:654] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.060607 18722 tablet_bootstrap.cc:492] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:41.061169 18722 ts_tablet_manager.cc:1403] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.213s	user 0.023s	sys 0.005s
I20260709 12:21:41.064181 18722 raft_consensus.cc:359] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.065052 18722 raft_consensus.cc:385] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.065459 18722 raft_consensus.cc:740] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.066426 18722 consensus_queue.cc:260] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.068900 18722 ts_tablet_manager.cc:1434] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:21:41.069422 18662 tablet_service.cc:1511] Processing CreateTablet for tablet 8e1dfac6f7ba4189ae36a57e87879b22 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:21:41.069945 18722 tablet_bootstrap.cc:492] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:41.070770 18662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1dfac6f7ba4189ae36a57e87879b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.076596 18722 tablet_bootstrap.cc:654] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.077606 18589 tablet_service.cc:1511] Processing CreateTablet for tablet 678726cf80464d89802570ca4d73600f (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:21:41.079169 18589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 678726cf80464d89802570ca4d73600f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.088210 18520 tablet_service.cc:1511] Processing CreateTablet for tablet f9141b3d8f87474d8f4752290efe5963 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:21:41.089763 18520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9141b3d8f87474d8f4752290efe5963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.100203 18667 tablet_service.cc:1511] Processing CreateTablet for tablet b7e559fc600a4308a080243995e9f1e8 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:21:41.101576 18667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e559fc600a4308a080243995e9f1e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.123721 18663 tablet_service.cc:1511] Processing CreateTablet for tablet c3c52474787041b099fe01aa8c862c04 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:21:41.125715 18663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c52474787041b099fe01aa8c862c04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.132552 18594 tablet_service.cc:1511] Processing CreateTablet for tablet 49c1709156f048cd8184a38476ebfe0d (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:21:41.134006 18594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c1709156f048cd8184a38476ebfe0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.094658 18592 tablet_service.cc:1511] Processing CreateTablet for tablet f0dcb322f11f4eb39aa973579cafa317 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:21:41.145800 18592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0dcb322f11f4eb39aa973579cafa317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.162950 18590 tablet_service.cc:1511] Processing CreateTablet for tablet b7e559fc600a4308a080243995e9f1e8 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:21:41.175320 18594 tablet_service.cc:1511] Processing CreateTablet for tablet c3c52474787041b099fe01aa8c862c04 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:21:41.194232 18594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c52474787041b099fe01aa8c862c04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.195101 18724 tablet_bootstrap.cc:492] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:41.203013 18724 ts_tablet_manager.cc:1403] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.310s	user 0.014s	sys 0.009s
I20260709 12:21:41.228942 18721 tablet_bootstrap.cc:492] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:41.229527 18721 ts_tablet_manager.cc:1403] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.287s	user 0.039s	sys 0.025s
I20260709 12:21:41.229405 18593 tablet_service.cc:1511] Processing CreateTablet for tablet f9141b3d8f87474d8f4752290efe5963 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:21:41.232475 18729 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.232996 18729 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.237250 18514 tablet_service.cc:1511] Processing CreateTablet for tablet ce446d878cef426395147773f6c9a25e (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:21:41.237721 18729 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:41.238623 18514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce446d878cef426395147773f6c9a25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.232962 18593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9141b3d8f87474d8f4752290efe5963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.159413 18596 tablet_service.cc:1511] Processing CreateTablet for tablet 8e1dfac6f7ba4189ae36a57e87879b22 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:21:41.250185 18595 tablet_service.cc:1511] Processing CreateTablet for tablet ce446d878cef426395147773f6c9a25e (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:21:41.251932 18517 tablet_service.cc:1511] Processing CreateTablet for tablet 512f9ba3d0d04063899283c39177bcdf (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:21:41.251796 18721 raft_consensus.cc:359] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.254870 18517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 512f9ba3d0d04063899283c39177bcdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.254544 18721 raft_consensus.cc:385] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.260462 18721 raft_consensus.cc:740] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.238963 18724 raft_consensus.cc:359] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.261008 18724 raft_consensus.cc:385] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.261336 18724 raft_consensus.cc:740] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.261427 18721 consensus_queue.cc:260] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.262140 18724 consensus_queue.cc:260] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.264078 18721 ts_tablet_manager.cc:1434] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.001s
I20260709 12:21:41.265064 18721 tablet_bootstrap.cc:492] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:41.263540 18663 tablet_service.cc:1511] Processing CreateTablet for tablet f9141b3d8f87474d8f4752290efe5963 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:21:41.275653 18726 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.278687 18726 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.277558 18590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e559fc600a4308a080243995e9f1e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.280496 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:41.280974 18726 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:41.281281 18606 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:41.283685 18587 tablet_service.cc:1511] Processing CreateTablet for tablet 512f9ba3d0d04063899283c39177bcdf (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:21:41.289057 18644 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:41.291978 18727 raft_consensus.cc:2804] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.291859 18519 tablet_service.cc:1511] Processing CreateTablet for tablet 4eceb66ae237462f8f0e7e3b03872311 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:21:41.292394 18727 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.292788 18727 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.293239 18519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eceb66ae237462f8f0e7e3b03872311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.296330 18516 tablet_service.cc:1511] Processing CreateTablet for tablet 5e48d46c1f784719adae94c79efd88c8 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:21:41.297633 18516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e48d46c1f784719adae94c79efd88c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.301290 18511 tablet_service.cc:1511] Processing CreateTablet for tablet e3fb557c332c4f69a4267b6505d3f923 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:21:41.302589 18511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3fb557c332c4f69a4267b6505d3f923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.305929 18518 tablet_service.cc:1511] Processing CreateTablet for tablet a5481f6762264d10bd4a98a8b0e678e4 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:21:41.307260 18518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5481f6762264d10bd4a98a8b0e678e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.313673 18515 tablet_service.cc:1511] Processing CreateTablet for tablet cdefe54c01e0436d82e68981b642554b (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:21:41.315178 18515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdefe54c01e0436d82e68981b642554b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.316653 18596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1dfac6f7ba4189ae36a57e87879b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.315783 18724 ts_tablet_manager.cc:1434] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.107s	user 0.007s	sys 0.002s
I20260709 12:21:41.321568 18724 tablet_bootstrap.cc:492] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:41.322649 18513 tablet_service.cc:1511] Processing CreateTablet for tablet f6c6156a485f436881bf4d1fb67194d2 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:21:41.328011 18722 tablet_bootstrap.cc:492] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:41.328536 18722 ts_tablet_manager.cc:1403] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.259s	user 0.032s	sys 0.016s
I20260709 12:21:41.332582 18722 raft_consensus.cc:359] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.333597 18722 raft_consensus.cc:385] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.313614 18589 tablet_service.cc:1511] Processing CreateTablet for tablet 4eceb66ae237462f8f0e7e3b03872311 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:21:41.333961 18722 raft_consensus.cc:740] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.334990 18589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eceb66ae237462f8f0e7e3b03872311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.334961 18722 consensus_queue.cc:260] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.336054 18721 tablet_bootstrap.cc:654] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.336094 18587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 512f9ba3d0d04063899283c39177bcdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.339836 18727 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.342643 18727 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:21:41.342960 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:41.344121 18595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce446d878cef426395147773f6c9a25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.343587 18606 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.365152 18590 tablet_service.cc:1511] Processing CreateTablet for tablet 5e48d46c1f784719adae94c79efd88c8 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:21:41.367556 18667 tablet_service.cc:1511] Processing CreateTablet for tablet ce446d878cef426395147773f6c9a25e (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:21:41.371176 18661 tablet_service.cc:1511] Processing CreateTablet for tablet 512f9ba3d0d04063899283c39177bcdf (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:21:41.380875 18594 tablet_service.cc:1511] Processing CreateTablet for tablet e3fb557c332c4f69a4267b6505d3f923 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:21:41.371263 18513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c6156a485f436881bf4d1fb67194d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.384043 18663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9141b3d8f87474d8f4752290efe5963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.387146 18664 tablet_service.cc:1511] Processing CreateTablet for tablet 4eceb66ae237462f8f0e7e3b03872311 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:21:41.394116 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:41.395027 18664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eceb66ae237462f8f0e7e3b03872311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.395725 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:41.396495 18661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 512f9ba3d0d04063899283c39177bcdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.395777 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:41.397437 18520 tablet_service.cc:1511] Processing CreateTablet for tablet 55f8787198c1435695beded3041a941e (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:21:41.400890 18669 tablet_service.cc:1511] Processing CreateTablet for tablet f6c6156a485f436881bf4d1fb67194d2 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:21:41.401158 18668 tablet_service.cc:1511] Processing CreateTablet for tablet cdefe54c01e0436d82e68981b642554b (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:21:41.402383 18669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c6156a485f436881bf4d1fb67194d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.403246 18670 tablet_service.cc:1511] Processing CreateTablet for tablet 55f8787198c1435695beded3041a941e (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:21:41.404240 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:21:41.404527 18646 leader_election.cc:343] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.405234 18680 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
W20260709 12:21:41.404527 18494 leader_election.cc:343] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.407230 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:21:41.407655 18494 leader_election.cc:343] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.408948 18722 ts_tablet_manager.cc:1434] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.080s	user 0.005s	sys 0.011s
I20260709 12:21:41.410786 18606 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:41.411557 18590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e48d46c1f784719adae94c79efd88c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.390825 18662 tablet_service.cc:1511] Processing CreateTablet for tablet a5481f6762264d10bd4a98a8b0e678e4 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:21:41.389468 18666 tablet_service.cc:1511] Processing CreateTablet for tablet e3fb557c332c4f69a4267b6505d3f923 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:21:41.392762 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:41.412073 18644 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:21:41.389453 18665 tablet_service.cc:1511] Processing CreateTablet for tablet 5e48d46c1f784719adae94c79efd88c8 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:21:41.413257 18727 raft_consensus.cc:2804] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:21:41.413470 18646 leader_election.cc:343] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.413741 18727 raft_consensus.cc:697] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:21:41.414491 18667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce446d878cef426395147773f6c9a25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.414628 18727 consensus_queue.cc:237] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.416505 18494 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:41.417544 18670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55f8787198c1435695beded3041a941e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.418568 18662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5481f6762264d10bd4a98a8b0e678e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.418758 18726 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.419152 18726 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.419495 18726 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.419701 18668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdefe54c01e0436d82e68981b642554b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.428500 18665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e48d46c1f784719adae94c79efd88c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.430106 18722 tablet_bootstrap.cc:492] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:41.433621 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:21:41.435283 18572 leader_election.cc:343] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.437695 18666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3fb557c332c4f69a4267b6505d3f923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.439368 18520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55f8787198c1435695beded3041a941e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.427597 18726 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.446158 18726 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:21:41.447239 18494 leader_election.cc:343] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.447700 18494 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:41.456444 18591 tablet_service.cc:1511] Processing CreateTablet for tablet a5481f6762264d10bd4a98a8b0e678e4 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:21:41.458065 18724 tablet_bootstrap.cc:654] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.458688 18512 tablet_service.cc:1511] Processing CreateTablet for tablet 3be3087e258443e7b525ec57e79f3e2f (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:21:41.460005 18512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be3087e258443e7b525ec57e79f3e2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.459703 18592 tablet_service.cc:1511] Processing CreateTablet for tablet cdefe54c01e0436d82e68981b642554b (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:21:41.462594 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:41.464851 18570 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:41.465720 18729 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:41.467818 18594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3fb557c332c4f69a4267b6505d3f923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.463786 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:41.468560 18591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5481f6762264d10bd4a98a8b0e678e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.468791 18517 tablet_service.cc:1511] Processing CreateTablet for tablet 6ddef1433d2344c9a83050fe07ac225b (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:21:41.470527 18517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ddef1433d2344c9a83050fe07ac225b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.473507 18588 tablet_service.cc:1511] Processing CreateTablet for tablet f6c6156a485f436881bf4d1fb67194d2 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:21:41.474501 18592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdefe54c01e0436d82e68981b642554b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.475817 18588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c6156a485f436881bf4d1fb67194d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.481346 18746 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.481848 18746 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.483022 18722 tablet_bootstrap.cc:654] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:41.492393 18494 leader_election.cc:343] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.479627 18516 tablet_service.cc:1511] Processing CreateTablet for tablet c1f654a3c5be411f92ffc5ed5b6b70a1 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:21:41.496717 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:41.453450 18726 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:41.497345 18680 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.497874 18516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f654a3c5be411f92ffc5ed5b6b70a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.505311 18680 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:41.509526 18587 tablet_service.cc:1511] Processing CreateTablet for tablet 55f8787198c1435695beded3041a941e (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:21:41.510932 18587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55f8787198c1435695beded3041a941e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.510677 18494 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:41.511482 18595 tablet_service.cc:1511] Processing CreateTablet for tablet 6ddef1433d2344c9a83050fe07ac225b (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:21:41.512477 18726 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:41.512761 18595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ddef1433d2344c9a83050fe07ac225b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.508055 18519 tablet_service.cc:1511] Processing CreateTablet for tablet 169aeacb13cc43bb853d44de2d778477 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:21:41.531788 18593 tablet_service.cc:1511] Processing CreateTablet for tablet 3be3087e258443e7b525ec57e79f3e2f (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:21:41.532850 18519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 169aeacb13cc43bb853d44de2d778477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.523102 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:41.536382 18530 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:41.537923 18646 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:21:41.552548 18727 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.575985 18727 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.576381 18727 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.577765 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:21:41.581123 18644 leader_election.cc:343] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.580909 18591 tablet_service.cc:1511] Processing CreateTablet for tablet c1f654a3c5be411f92ffc5ed5b6b70a1 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:21:41.585807 18727 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.590297 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:21:41.592164 18644 leader_election.cc:343] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.592903 18727 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:41.568408 18593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be3087e258443e7b525ec57e79f3e2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.563009 18726 raft_consensus.cc:697] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:41.554157 18514 tablet_service.cc:1511] Processing CreateTablet for tablet 9f9c25fcde974c42918932833eac1523 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:21:41.605995 18515 tablet_service.cc:1511] Processing CreateTablet for tablet 8eebfbd8106141a5903392238ce5a613 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:21:41.618700 18589 tablet_service.cc:1511] Processing CreateTablet for tablet 169aeacb13cc43bb853d44de2d778477 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:21:41.616838 18514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9c25fcde974c42918932833eac1523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.624954 18662 tablet_service.cc:1511] Processing CreateTablet for tablet 6ddef1433d2344c9a83050fe07ac225b (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:21:41.626368 18662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ddef1433d2344c9a83050fe07ac225b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.628119 18591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f654a3c5be411f92ffc5ed5b6b70a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.632115 18515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eebfbd8106141a5903392238ce5a613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.632314 18729 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.632817 18729 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.634902 18729 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:41.637053 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:41.638756 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:21:41.640242 18572 leader_election.cc:343] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:41.641005 18570 leader_election.cc:343] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.641427 18570 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:41.574783 18746 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:41.650785 18721 tablet_bootstrap.cc:492] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:41.652619 18589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 169aeacb13cc43bb853d44de2d778477. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:41.646154 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 108374us
I20260709 12:21:41.664314 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:41.656649 18729 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:41.664427 18663 tablet_service.cc:1511] Processing CreateTablet for tablet 3be3087e258443e7b525ec57e79f3e2f (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:21:41.664983 18530 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.665813 18663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be3087e258443e7b525ec57e79f3e2f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:41.667171 18475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:41.669088 18511 tablet_service.cc:1511] Processing CreateTablet for tablet 75f0f0df600b45d1b1ba9f3a58145915 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:21:41.670450 18511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75f0f0df600b45d1b1ba9f3a58145915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.681722 18530 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:41.683101 18646 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:41.683990 18746 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:41.684468 18746 raft_consensus.cc:697] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:21:41.685268 18746 consensus_queue.cc:237] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.558183 18426 catalog_manager.cc:5697] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:41.696171 18518 tablet_service.cc:1511] Processing CreateTablet for tablet d52124cfb8a140deaab206a18aadc308 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:21:41.697577 18518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d52124cfb8a140deaab206a18aadc308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.697256 18668 tablet_service.cc:1511] Processing CreateTablet for tablet 169aeacb13cc43bb853d44de2d778477 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:21:41.699180 18668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 169aeacb13cc43bb853d44de2d778477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.700886 18666 tablet_service.cc:1511] Processing CreateTablet for tablet 9f9c25fcde974c42918932833eac1523 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:21:41.710887 18590 tablet_service.cc:1511] Processing CreateTablet for tablet 8eebfbd8106141a5903392238ce5a613 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:21:41.711738 18721 ts_tablet_manager.cc:1403] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.447s	user 0.024s	sys 0.038s
I20260709 12:21:41.712333 18590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eebfbd8106141a5903392238ce5a613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.714744 18721 raft_consensus.cc:359] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.715497 18721 raft_consensus.cc:385] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.718849 18664 tablet_service.cc:1511] Processing CreateTablet for tablet 8eebfbd8106141a5903392238ce5a613 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:21:41.702171 18666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9c25fcde974c42918932833eac1523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.724486 18667 tablet_service.cc:1511] Processing CreateTablet for tablet d52124cfb8a140deaab206a18aadc308 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:21:41.726461 18726 consensus_queue.cc:237] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.729245 18519 tablet_service.cc:1511] Processing CreateTablet for tablet bb60480c703d4fb3b06a0d4f669bc90c (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:21:41.730309 18591 tablet_service.cc:1511] Processing CreateTablet for tablet 75f0f0df600b45d1b1ba9f3a58145915 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:21:41.730983 18519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb60480c703d4fb3b06a0d4f669bc90c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.703482 18596 tablet_service.cc:1511] Processing CreateTablet for tablet 9f9c25fcde974c42918932833eac1523 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:21:41.734483 18665 tablet_service.cc:1511] Processing CreateTablet for tablet c1f654a3c5be411f92ffc5ed5b6b70a1 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:21:41.735726 18596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9c25fcde974c42918932833eac1523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.738695 18517 tablet_service.cc:1511] Processing CreateTablet for tablet 172bc8a62f9b4215b7395487dd4afd2b (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:21:41.732376 18721 raft_consensus.cc:740] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.747732 18517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172bc8a62f9b4215b7395487dd4afd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.747790 18670 tablet_service.cc:1511] Processing CreateTablet for tablet 75f0f0df600b45d1b1ba9f3a58145915 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:21:41.764480 18664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eebfbd8106141a5903392238ce5a613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.768147 18591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75f0f0df600b45d1b1ba9f3a58145915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.769477 18670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75f0f0df600b45d1b1ba9f3a58145915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.770388 18724 tablet_bootstrap.cc:492] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:41.770957 18724 ts_tablet_manager.cc:1403] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.450s	user 0.016s	sys 0.012s
W20260709 12:21:41.743083 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 60078.8us
I20260709 12:21:41.781749 18665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f654a3c5be411f92ffc5ed5b6b70a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.793942 18722 tablet_bootstrap.cc:492] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:41.796474 18722 ts_tablet_manager.cc:1403] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.370s	user 0.023s	sys 0.046s
I20260709 12:21:41.799415 18722 raft_consensus.cc:359] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.800207 18722 raft_consensus.cc:385] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.800549 18722 raft_consensus.cc:740] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.801306 18722 consensus_queue.cc:260] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.805552 18722 ts_tablet_manager.cc:1434] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:21:41.817233 18669 tablet_service.cc:1511] Processing CreateTablet for tablet 172bc8a62f9b4215b7395487dd4afd2b (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:21:41.817591 18512 tablet_service.cc:1511] Processing CreateTablet for tablet 08cf98d6828c446ebc2e69eda1b33719 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:21:41.819437 18512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08cf98d6828c446ebc2e69eda1b33719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.780189 18721 consensus_queue.cc:260] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.823248 18666 tablet_service.cc:1511] Processing CreateTablet for tablet 08cf98d6828c446ebc2e69eda1b33719 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:21:41.835312 18588 tablet_service.cc:1511] Processing CreateTablet for tablet 08cf98d6828c446ebc2e69eda1b33719 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:21:41.836899 18588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08cf98d6828c446ebc2e69eda1b33719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.836453 18661 tablet_service.cc:1511] Processing CreateTablet for tablet bb60480c703d4fb3b06a0d4f669bc90c (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:21:41.785916 18724 raft_consensus.cc:359] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.843046 18724 raft_consensus.cc:385] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.843465 18724 raft_consensus.cc:740] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.829787 18592 tablet_service.cc:1511] Processing CreateTablet for tablet bb60480c703d4fb3b06a0d4f669bc90c (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:21:41.837410 18667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d52124cfb8a140deaab206a18aadc308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.846508 18592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb60480c703d4fb3b06a0d4f669bc90c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.848351 18722 tablet_bootstrap.cc:492] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:41.844408 18724 consensus_queue.cc:260] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.859268 18724 ts_tablet_manager.cc:1434] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.088s	user 0.009s	sys 0.001s
I20260709 12:21:41.864675 18661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb60480c703d4fb3b06a0d4f669bc90c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.866029 18595 tablet_service.cc:1511] Processing CreateTablet for tablet 172bc8a62f9b4215b7395487dd4afd2b (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:21:41.868108 18595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172bc8a62f9b4215b7395487dd4afd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.872088 18721 ts_tablet_manager.cc:1434] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.160s	user 0.004s	sys 0.004s
I20260709 12:21:41.872646 18724 tablet_bootstrap.cc:492] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:41.873539 18721 tablet_bootstrap.cc:492] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:41.900300 18587 tablet_service.cc:1511] Processing CreateTablet for tablet d52124cfb8a140deaab206a18aadc308 (DEFAULT_TABLE table=test-workload [id=19f6690326ef4c70903c44294c3fea9c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:21:41.901784 18587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d52124cfb8a140deaab206a18aadc308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.907666 18669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172bc8a62f9b4215b7395487dd4afd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.916834 18729 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.917541 18729 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.919881 18729 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:41.920626 18724 tablet_bootstrap.cc:654] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.921829 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:41.922432 18427 catalog_manager.cc:5697] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:41.924023 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:21:41.925586 18572 leader_election.cc:343] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:41.926704 18570 leader_election.cc:343] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.927124 18570 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:41.928932 18729 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:41.930142 18746 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.930797 18746 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:41.931617 18666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08cf98d6828c446ebc2e69eda1b33719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.944124 18721 tablet_bootstrap.cc:654] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.947111 18722 tablet_bootstrap.cc:654] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.968561 18746 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:21:41.969627 18646 consensus_peers.cc:597] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:41.969774 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:41.970863 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:21:41.971195 18644 leader_election.cc:343] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:41.972529 18646 leader_election.cc:343] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.973131 18646 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:41.974629 18746 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:41.998206 18724 tablet_bootstrap.cc:492] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:41.999028 18724 ts_tablet_manager.cc:1403] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.127s	user 0.021s	sys 0.042s
I20260709 12:21:42.001859 18724 raft_consensus.cc:359] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.002614 18724 raft_consensus.cc:385] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.002925 18724 raft_consensus.cc:740] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.003674 18724 consensus_queue.cc:260] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.015286 18724 ts_tablet_manager.cc:1434] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:21:42.019393 18746 consensus_queue.cc:1048] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:42.015316 18426 catalog_manager.cc:5697] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:42.022044 18724 tablet_bootstrap.cc:492] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:42.024783 18721 tablet_bootstrap.cc:492] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:42.025249 18722 tablet_bootstrap.cc:492] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:42.036850 18721 ts_tablet_manager.cc:1403] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.164s	user 0.013s	sys 0.006s
I20260709 12:21:42.036983 18722 ts_tablet_manager.cc:1403] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.189s	user 0.014s	sys 0.003s
I20260709 12:21:42.040210 18721 raft_consensus.cc:359] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.040401 18722 raft_consensus.cc:359] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.041510 18722 raft_consensus.cc:385] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.042008 18722 raft_consensus.cc:740] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.043998 18724 tablet_bootstrap.cc:654] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.043095 18722 consensus_queue.cc:260] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.051203 18722 ts_tablet_manager.cc:1434] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:21:42.041157 18721 raft_consensus.cc:385] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.052219 18721 raft_consensus.cc:740] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.053457 18721 consensus_queue.cc:260] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.055807 18721 ts_tablet_manager.cc:1434] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 12:21:42.056804 18722 tablet_bootstrap.cc:492] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:42.065568 18722 tablet_bootstrap.cc:654] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.067052 18724 tablet_bootstrap.cc:492] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:42.067608 18724 ts_tablet_manager.cc:1403] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.046s	user 0.006s	sys 0.011s
I20260709 12:21:42.071352 18724 raft_consensus.cc:359] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.072439 18724 raft_consensus.cc:385] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.072835 18724 raft_consensus.cc:740] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.073813 18724 consensus_queue.cc:260] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.074899 18721 tablet_bootstrap.cc:492] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:42.077437 18724 ts_tablet_manager.cc:1434] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:21:42.078269 18722 tablet_bootstrap.cc:492] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:42.078552 18724 tablet_bootstrap.cc:492] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:42.078884 18722 ts_tablet_manager.cc:1403] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.000s
I20260709 12:21:42.081969 18721 tablet_bootstrap.cc:654] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.082366 18722 raft_consensus.cc:359] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.083206 18722 raft_consensus.cc:385] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.083568 18722 raft_consensus.cc:740] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.084578 18722 consensus_queue.cc:260] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.087230 18722 ts_tablet_manager.cc:1434] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:21:42.088092 18724 tablet_bootstrap.cc:654] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.090142 18722 tablet_bootstrap.cc:492] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:42.097406 18722 tablet_bootstrap.cc:654] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.100389 18721 tablet_bootstrap.cc:492] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:42.101006 18721 ts_tablet_manager.cc:1403] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.013s
I20260709 12:21:42.101825 18724 tablet_bootstrap.cc:492] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:42.102325 18724 ts_tablet_manager.cc:1403] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 12:21:42.104743 18721 raft_consensus.cc:359] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.105185 18724 raft_consensus.cc:359] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.105973 18724 raft_consensus.cc:385] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.105871 18721 raft_consensus.cc:385] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.106400 18724 raft_consensus.cc:740] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.106472 18721 raft_consensus.cc:740] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.107136 18724 consensus_queue.cc:260] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.107537 18721 consensus_queue.cc:260] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.109287 18724 ts_tablet_manager.cc:1434] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:21:42.110278 18724 tablet_bootstrap.cc:492] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:42.116972 18724 tablet_bootstrap.cc:654] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.117058 18721 ts_tablet_manager.cc:1434] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:21:42.118788 18721 tablet_bootstrap.cc:492] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:42.129930 18721 tablet_bootstrap.cc:654] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.130712 18722 tablet_bootstrap.cc:492] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:42.131279 18722 ts_tablet_manager.cc:1403] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.020s
I20260709 12:21:42.131676 18724 tablet_bootstrap.cc:492] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:42.132222 18724 ts_tablet_manager.cc:1403] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.008s
I20260709 12:21:42.134626 18722 raft_consensus.cc:359] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.135426 18722 raft_consensus.cc:385] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.135247 18724 raft_consensus.cc:359] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.135779 18722 raft_consensus.cc:740] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.136024 18724 raft_consensus.cc:385] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.136335 18724 raft_consensus.cc:740] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.136749 18722 consensus_queue.cc:260] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.137107 18724 consensus_queue.cc:260] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.139526 18722 ts_tablet_manager.cc:1434] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:21:42.139526 18724 ts_tablet_manager.cc:1434] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:21:42.140825 18722 tablet_bootstrap.cc:492] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:42.141454 18724 tablet_bootstrap.cc:492] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:42.148267 18724 tablet_bootstrap.cc:654] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.149859 18722 tablet_bootstrap.cc:654] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.150403 18746 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.151116 18746 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.152232 18727 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:42.154134 18746 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:42.156297 18721 tablet_bootstrap.cc:492] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:42.156539 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:42.156843 18721 ts_tablet_manager.cc:1403] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.018s
W20260709 12:21:42.158140 18644 leader_election.cc:343] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.159966 18604 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.159894 18721 raft_consensus.cc:359] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.160741 18721 raft_consensus.cc:385] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.161033 18721 raft_consensus.cc:740] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.161746 18721 consensus_queue.cc:260] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.164932 18721 ts_tablet_manager.cc:1434] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:21:42.166615 18724 tablet_bootstrap.cc:492] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:42.166622 18729 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.167068 18721 tablet_bootstrap.cc:492] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:42.167239 18724 ts_tablet_manager.cc:1403] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.009s
I20260709 12:21:42.167198 18729 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.169781 18729 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:42.170296 18724 raft_consensus.cc:359] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.170938 18724 raft_consensus.cc:385] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.171195 18724 raft_consensus.cc:740] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.171599 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:42.171897 18724 consensus_queue.cc:260] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:42.173069 18572 leader_election.cc:343] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.174115 18724 ts_tablet_manager.cc:1434] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:21:42.175033 18724 tablet_bootstrap.cc:492] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:42.175134 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:21:42.176671 18570 leader_election.cc:343] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.177017 18721 tablet_bootstrap.cc:654] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.178504 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:21:42.180191 18646 leader_election.cc:343] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.180619 18646 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:42.181214 18724 tablet_bootstrap.cc:654] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.181748 18746 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:42.183287 18707 tablet.cc:2406] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:21:42.177130 18570 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:42.251688 18779 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.285727 18749 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.274537 18606 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.351773 18749 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.354943 18749 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:42.312963 18780 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:42.303112 18729 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.356307 18729 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.359409 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:21:42.364786 18494 leader_election.cc:343] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.366315 18749 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:42.284499 18746 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.372519 18746 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.381098 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:42.252812 18726 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.382969 18726 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.260076 18776 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.386909 18776 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.392035 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:42.393003 18528 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
W20260709 12:21:42.393707 18646 leader_election.cc:343] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.394783 18572 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:42.376437 18779 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.399293 18779 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.403760 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:21:42.407114 18572 leader_election.cc:343] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.410051 18779 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:42.411641 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:42.482436 18679 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:42.483845 18722 tablet_bootstrap.cc:492] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:42.484014 18570 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:21:42.486094 18779 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.486534 18779 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.429924 18784 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.450264 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:42.452600 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:42.454461 18750 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:42.457835 18776 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:42.459362 18746 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:42.459223 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:42.460031 18785 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.460260 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:42.492740 18606 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:42.492465 18785 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:42.493606 18644 leader_election.cc:343] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:42.493721 18570 leader_election.cc:343] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.494131 18644 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:42.460794 18726 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:42.462786 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:42.494906 18750 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.463323 18729 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:42.476819 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:42.415562 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:42.484336 18722 ts_tablet_manager.cc:1403] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.344s	user 0.070s	sys 0.175s
I20260709 12:21:42.497372 18572 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:42.497762 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:42.428328 18782 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.490594 18721 tablet_bootstrap.cc:492] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
W20260709 12:21:42.499715 18494 leader_election.cc:343] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.499740 18722 raft_consensus.cc:359] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.503165 18722 raft_consensus.cc:385] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.503458 18722 raft_consensus.cc:740] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
W20260709 12:21:42.503543 18494 leader_election.cc:343] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.504035 18494 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:42.500293 18782 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.504789 18784 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.505189 18784 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.494586 18785 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:42.500134 18721 ts_tablet_manager.cc:1403] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.334s	user 0.131s	sys 0.167s
I20260709 12:21:42.490734 18779 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.510236 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:42.510941 18603 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:42.500438 18729 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:42.515583 18782 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:42.516499 18780 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.516530 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:42.516387 18722 consensus_queue.cc:260] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.517218 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:42.518252 18721 raft_consensus.cc:359] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.518891 18722 ts_tablet_manager.cc:1434] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.002s
I20260709 12:21:42.518903 18721 raft_consensus.cc:385] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.519306 18721 raft_consensus.cc:740] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.520040 18721 consensus_queue.cc:260] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.520859 18722 tablet_bootstrap.cc:492] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:42.523319 18721 ts_tablet_manager.cc:1434] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:21:42.524315 18721 tablet_bootstrap.cc:492] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:42.527729 18722 tablet_bootstrap.cc:654] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.531633 18724 tablet_bootstrap.cc:492] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:42.532981 18724 ts_tablet_manager.cc:1403] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.358s	user 0.081s	sys 0.165s
I20260709 12:21:42.533680 18570 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:21:42.533674 18494 leader_election.cc:343] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.536722 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:42.539151 18721 tablet_bootstrap.cc:654] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.537894 18750 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.539463 18780 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.539631 18750 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.540041 18780 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.540709 18780 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.542071 18750 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:42.535557 18729 raft_consensus.cc:2749] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:42.538560 18785 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.544523 18785 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.537884 18494 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:42.549435 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:42.547389 18785 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:42.550985 18783 raft_consensus.cc:2804] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.555174 18783 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.555683 18783 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.556851 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:42.563678 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:42.565016 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:21:42.566696 18494 leader_election.cc:343] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:42.568827 18494 leader_election.cc:343] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.569624 18494 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:42.551988 18724 raft_consensus.cc:359] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:42.552589 18644 leader_election.cc:343] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:42.571307 18646 leader_election.cc:343] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.574546 18646 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:42.576063 18785 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.577247 18750 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.575606 18724 raft_consensus.cc:385] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.578195 18724 raft_consensus.cc:740] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.580358 18724 consensus_queue.cc:260] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.581478 18779 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.582165 18722 tablet_bootstrap.cc:492] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:42.583261 18722 ts_tablet_manager.cc:1403] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.063s	user 0.020s	sys 0.024s
I20260709 12:21:42.567616 18783 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.583280 18780 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.588524 18780 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:42.575086 18784 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.589867 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:42.590723 18605 raft_consensus.cc:2393] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 1: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:21:42.592185 18722 raft_consensus.cc:359] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.592284 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:42.593716 18528 raft_consensus.cc:2393] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 1: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:21:42.592782 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:42.594735 18724 ts_tablet_manager.cc:1434] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 12:21:42.592941 18722 raft_consensus.cc:385] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.595269 18722 raft_consensus.cc:740] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
W20260709 12:21:42.595588 18494 leader_election.cc:343] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.596302 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:42.597102 18784 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:42.598115 18724 tablet_bootstrap.cc:492] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:42.598311 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:42.596292 18722 consensus_queue.cc:260] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:42.600317 18570 leader_election.cc:343] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.601002 18570 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:42.601944 18722 ts_tablet_manager.cc:1434] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:21:42.603044 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:21:42.605448 18572 leader_election.cc:343] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.607929 18724 tablet_bootstrap.cc:654] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.608091 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:42.608685 18676 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.611596 18783 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:42.612424 18783 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.614667 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:42.615517 18605 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.616065 18779 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:42.616773 18779 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.618834 18676 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:42.620177 18570 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:21:42.621492 18779 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:42.622267 18779 raft_consensus.cc:697] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:21:42.623164 18779 consensus_queue.cc:237] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.624533 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:42.625615 18722 tablet_bootstrap.cc:492] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
W20260709 12:21:42.626624 18494 leader_election.cc:343] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.632831 18605 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:42.634652 18494 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:42.635486 18722 tablet_bootstrap.cc:654] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.636806 18780 raft_consensus.cc:2804] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:42.639010 18780 raft_consensus.cc:697] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:42.640233 18780 consensus_queue.cc:237] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.645079 18721 tablet_bootstrap.cc:492] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:42.645581 18721 ts_tablet_manager.cc:1403] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.121s	user 0.029s	sys 0.081s
I20260709 12:21:42.648268 18724 tablet_bootstrap.cc:492] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:42.648772 18724 ts_tablet_manager.cc:1403] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.005s
I20260709 12:21:42.648524 18721 raft_consensus.cc:359] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.649222 18721 raft_consensus.cc:385] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.649616 18721 raft_consensus.cc:740] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.650617 18721 consensus_queue.cc:260] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.652896 18724 raft_consensus.cc:359] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.653636 18724 raft_consensus.cc:385] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.653892 18724 raft_consensus.cc:740] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.653995 18721 ts_tablet_manager.cc:1434] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:21:42.654551 18724 consensus_queue.cc:260] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.655275 18721 tablet_bootstrap.cc:492] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:42.656750 18724 ts_tablet_manager.cc:1434] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:42.662170 18425 catalog_manager.cc:5697] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:42.664131 18721 tablet_bootstrap.cc:654] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.667236 18722 tablet_bootstrap.cc:492] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:42.667939 18722 ts_tablet_manager.cc:1403] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.005s
I20260709 12:21:42.668274 18780 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.668844 18780 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.670082 18427 catalog_manager.cc:5697] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:42.669368 18724 tablet_bootstrap.cc:492] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:42.671934 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:21:42.673260 18475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:42.674324 18722 raft_consensus.cc:359] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.678905 18722 raft_consensus.cc:385] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.679447 18722 raft_consensus.cc:740] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.680294 18722 consensus_queue.cc:260] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.681519 18724 tablet_bootstrap.cc:654] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.681427 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:42.683996 18494 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:42.685134 18783 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.686237 18780 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:42.688956 18750 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.689639 18750 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.690279 18721 tablet_bootstrap.cc:492] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:42.694759 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:42.695708 18605 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:42.690918 18721 ts_tablet_manager.cc:1403] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.017s
I20260709 12:21:42.698321 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:21:42.699962 18646 leader_election.cc:343] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.699827 18721 raft_consensus.cc:359] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.700806 18721 raft_consensus.cc:385] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.701162 18721 raft_consensus.cc:740] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.701326 18644 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:21:42.702278 18722 ts_tablet_manager.cc:1434] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:21:42.702435 18746 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.702656 18727 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.702404 18721 consensus_queue.cc:260] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.702924 18746 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.703227 18722 tablet_bootstrap.cc:492] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:42.703107 18727 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.703297 18746 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.703768 18750 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:42.714560 18721 ts_tablet_manager.cc:1434] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:21:42.714883 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:42.715916 18724 tablet_bootstrap.cc:492] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:42.716383 18724 ts_tablet_manager.cc:1403] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.007s
I20260709 12:21:42.716493 18721 tablet_bootstrap.cc:492] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
W20260709 12:21:42.716507 18644 leader_election.cc:343] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.717267 18722 tablet_bootstrap.cc:654] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.707896 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:42.719079 18528 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:42.722218 18646 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:42.713374 18727 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:42.724308 18721 tablet_bootstrap.cc:654] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.724965 18727 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.725415 18727 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.725831 18727 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.719158 18724 raft_consensus.cc:359] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.732041 18724 raft_consensus.cc:385] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.732426 18724 raft_consensus.cc:740] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.733467 18724 consensus_queue.cc:260] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.744071 18724 ts_tablet_manager.cc:1434] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 12:21:42.745252 18724 tablet_bootstrap.cc:492] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:42.748279 18746 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.751503 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:42.752135 18528 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.753711 18727 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.756747 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:42.757367 18529 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.758826 18746 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:42.760133 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:42.760946 18605 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.762197 18727 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:42.765200 18529 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:42.765640 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:42.766508 18646 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:21:42.767362 18727 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:21:42.767621 18644 leader_election.cc:343] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.767886 18727 raft_consensus.cc:697] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:21:42.768746 18727 consensus_queue.cc:237] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.777056 18724 tablet_bootstrap.cc:654] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.775938 18779 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.779640 18779 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.784899 18722 tablet_bootstrap.cc:492] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:42.785581 18722 ts_tablet_manager.cc:1403] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.083s	user 0.023s	sys 0.006s
I20260709 12:21:42.787828 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:42.787981 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:42.788821 18779 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:21:42.790376 18570 leader_election.cc:343] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:42.794432 18572 leader_election.cc:343] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.794858 18572 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:42.799371 18722 raft_consensus.cc:359] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.800230 18722 raft_consensus.cc:385] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.800598 18722 raft_consensus.cc:740] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.800760 18779 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.801368 18722 consensus_queue.cc:260] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.802309 18528 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:42.802649 18605 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:42.803694 18722 ts_tablet_manager.cc:1434] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:21:42.803642 18646 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:21:42.804561 18746 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:42.804759 18722 tablet_bootstrap.cc:492] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:42.805025 18746 raft_consensus.cc:697] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:21:42.805269 18721 tablet_bootstrap.cc:492] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:42.805681 18721 ts_tablet_manager.cc:1403] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.089s	user 0.035s	sys 0.035s
I20260709 12:21:42.805882 18746 consensus_queue.cc:237] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.808765 18721 raft_consensus.cc:359] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.809489 18721 raft_consensus.cc:385] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.809768 18721 raft_consensus.cc:740] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.810724 18721 consensus_queue.cc:260] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.812279 18722 tablet_bootstrap.cc:654] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.813656 18721 ts_tablet_manager.cc:1434] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:21:42.815315 18721 tablet_bootstrap.cc:492] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:42.821444 18721 tablet_bootstrap.cc:654] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.829425 18424 catalog_manager.cc:5697] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:42.839336 18724 tablet_bootstrap.cc:492] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:42.839879 18724 ts_tablet_manager.cc:1403] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.006s
I20260709 12:21:42.842701 18724 raft_consensus.cc:359] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.843422 18724 raft_consensus.cc:385] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.844624 18724 raft_consensus.cc:740] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.845491 18724 consensus_queue.cc:260] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.852519 18780 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.853289 18780 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.855234 18722 tablet_bootstrap.cc:492] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:42.855700 18722 ts_tablet_manager.cc:1403] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.023s
I20260709 12:21:42.856052 18780 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:42.858620 18722 raft_consensus.cc:359] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.858855 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:42.859333 18722 raft_consensus.cc:385] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.859622 18722 raft_consensus.cc:740] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.860442 18722 consensus_queue.cc:260] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.861340 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:42.862206 18677 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:42.862494 18722 ts_tablet_manager.cc:1434] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:21:42.863515 18722 tablet_bootstrap.cc:492] T 400ea90be13249389635103ccb1dfee6 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:42.864403 18724 ts_tablet_manager.cc:1434] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.003s
I20260709 12:21:42.865299 18494 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:21:42.866688 18494 leader_election.cc:343] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.870812 18722 tablet_bootstrap.cc:654] T 400ea90be13249389635103ccb1dfee6 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.873653 18424 catalog_manager.cc:5697] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:42.879487 18528 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.876058 18780 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.883203 18722 tablet_bootstrap.cc:492] T 400ea90be13249389635103ccb1dfee6 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:42.883790 18722 ts_tablet_manager.cc:1403] T 400ea90be13249389635103ccb1dfee6 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
I20260709 12:21:42.883235 18780 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.887827 18721 tablet_bootstrap.cc:492] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:42.888268 18780 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.888621 18721 ts_tablet_manager.cc:1403] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.074s	user 0.037s	sys 0.035s
I20260709 12:21:42.891564 18721 raft_consensus.cc:359] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.892377 18779 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.892544 18724 tablet_bootstrap.cc:492] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:42.892926 18779 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.894991 18779 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:42.887480 18722 raft_consensus.cc:359] T 400ea90be13249389635103ccb1dfee6 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.892387 18721 raft_consensus.cc:385] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.897169 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:42.897169 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:42.898911 18722 raft_consensus.cc:385] T 400ea90be13249389635103ccb1dfee6 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.899257 18722 raft_consensus.cc:740] T 400ea90be13249389635103ccb1dfee6 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.899546 18529 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:42.899282 18724 tablet_bootstrap.cc:654] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.901007 18572 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:42.902004 18779 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.902446 18779 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.902851 18779 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.903507 18780 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.906740 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:42.908244 18746 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:42.908731 18494 leader_election.cc:343] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.908931 18721 raft_consensus.cc:740] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.912746 18779 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.915917 18780 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:42.914147 18721 consensus_queue.cc:260] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.916977 18750 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.900394 18722 consensus_queue.cc:260] T 400ea90be13249389635103ccb1dfee6 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.917445 18750 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.918197 18721 ts_tablet_manager.cc:1434] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 12:21:42.919165 18721 tablet_bootstrap.cc:492] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:42.919445 18722 ts_tablet_manager.cc:1434] T 400ea90be13249389635103ccb1dfee6 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:21:42.919574 18750 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:42.920857 18677 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:42.921258 18722 tablet_bootstrap.cc:492] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:42.921032 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:42.921907 18528 raft_consensus.cc:2393] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 1: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:21:42.908993 18746 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.928004 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:42.928323 18721 tablet_bootstrap.cc:654] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.928854 18605 raft_consensus.cc:2393] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 1: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:21:42.930182 18746 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:42.930339 18644 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:42.916589 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:42.931171 18676 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.932524 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:42.933199 18605 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:42.934576 18644 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:42.935441 18750 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.936605 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:42.937110 18746 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.937460 18746 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.937810 18746 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:42.937947 18646 leader_election.cc:343] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.946074 18750 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.946266 18784 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.947036 18784 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.947691 18721 tablet_bootstrap.cc:492] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:42.948313 18721 ts_tablet_manager.cc:1403] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.007s
I20260709 12:21:42.951061 18721 raft_consensus.cc:359] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.952065 18784 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:42.952638 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:42.953694 18528 raft_consensus.cc:2393] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 1: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:21:42.953050 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:42.955520 18721 raft_consensus.cc:385] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.955909 18721 raft_consensus.cc:740] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.956121 18570 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:42.958074 18721 consensus_queue.cc:260] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.959203 18676 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:42.960955 18494 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:42.962860 18780 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:42.963992 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:42.964761 18721 ts_tablet_manager.cc:1434] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:21:42.964895 18528 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.965906 18721 tablet_bootstrap.cc:492] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:42.968209 18784 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.968976 18780 raft_consensus.cc:697] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:42.969916 18780 consensus_queue.cc:237] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.973816 18727 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.974352 18727 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.975138 18721 tablet_bootstrap.cc:654] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.976526 18727 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:42.977370 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:42.977782 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:42.978094 18529 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:42.979434 18646 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:21:42.980165 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:21:42.980613 18644 leader_election.cc:343] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.982105 18727 raft_consensus.cc:2804] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.982558 18727 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.982923 18727 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.982947 18528 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:42.984310 18572 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:42.985447 18729 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:42.987623 18729 raft_consensus.cc:697] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:21:42.989893 18729 consensus_queue.cc:237] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:42.980854 18676 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.996161 18424 catalog_manager.cc:5697] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:42.957748 18779 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:42.995466 18727 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.005359 18727 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:43.006650 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:43.007863 18529 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.007983 18746 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.008630 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:21:43.010152 18644 leader_election.cc:343] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.011133 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:43.011795 18530 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.014341 18722 tablet_bootstrap.cc:654] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.010298 18746 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:43.015892 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:43.016532 18605 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.006639 18724 tablet_bootstrap.cc:492] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:43.018282 18724 ts_tablet_manager.cc:1403] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.126s	user 0.028s	sys 0.025s
I20260709 12:21:43.020797 18784 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:43.022490 18530 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:43.023975 18646 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:21:43.025068 18746 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:43.026050 18746 raft_consensus.cc:697] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:21:43.017354 18529 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:43.027617 18721 tablet_bootstrap.cc:492] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:43.027192 18746 consensus_queue.cc:237] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.028270 18721 ts_tablet_manager.cc:1403] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.063s	user 0.022s	sys 0.002s
I20260709 12:21:43.028225 18646 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:43.029139 18750 raft_consensus.cc:2804] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:43.029625 18750 raft_consensus.cc:697] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:21:43.024642 18605 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:43.030454 18750 consensus_queue.cc:237] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.031378 18724 raft_consensus.cc:359] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.032107 18724 raft_consensus.cc:385] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.032378 18724 raft_consensus.cc:740] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.033036 18724 consensus_queue.cc:260] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.035051 18724 ts_tablet_manager.cc:1434] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.016s	user 0.000s	sys 0.004s
I20260709 12:21:43.039023 18424 catalog_manager.cc:5697] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:43.041509 18676 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:43.042654 18724 tablet_bootstrap.cc:492] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:43.038985 18721 raft_consensus.cc:359] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.047266 18780 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.050437 18780 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:43.052032 18572 consensus_peers.cc:597] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:43.053093 18780 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:43.053941 18721 raft_consensus.cc:385] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.054533 18721 raft_consensus.cc:740] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.055464 18721 consensus_queue.cc:260] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.060262 18724 tablet_bootstrap.cc:654] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.063143 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:43.065666 18721 ts_tablet_manager.cc:1434] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.003s
I20260709 12:21:43.067212 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:21:43.067819 18494 leader_election.cc:343] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:43.070147 18494 leader_election.cc:343] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.070442 18494 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:43.071115 18780 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:43.082098 18722 tablet_bootstrap.cc:492] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:43.082643 18722 ts_tablet_manager.cc:1403] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.162s	user 0.019s	sys 0.022s
I20260709 12:21:43.083436 18724 tablet_bootstrap.cc:492] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:43.083979 18724 ts_tablet_manager.cc:1403] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.003s
I20260709 12:21:43.085549 18722 raft_consensus.cc:359] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.086108 18721 tablet_bootstrap.cc:492] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:43.086243 18722 raft_consensus.cc:385] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.086536 18722 raft_consensus.cc:740] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.086927 18724 raft_consensus.cc:359] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.087687 18724 raft_consensus.cc:385] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.088052 18724 raft_consensus.cc:740] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.087481 18722 consensus_queue.cc:260] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.088933 18724 consensus_queue.cc:260] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.090323 18722 ts_tablet_manager.cc:1434] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:21:43.091293 18722 tablet_bootstrap.cc:492] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:43.093616 18721 tablet_bootstrap.cc:654] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.098161 18722 tablet_bootstrap.cc:654] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.099970 18724 ts_tablet_manager.cc:1434] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:21:43.086555 18427 catalog_manager.cc:5697] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:43.101184 18724 tablet_bootstrap.cc:492] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:43.105572 18721 tablet_bootstrap.cc:492] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:43.106496 18721 ts_tablet_manager.cc:1403] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 12:21:43.108048 18724 tablet_bootstrap.cc:654] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.111099 18721 raft_consensus.cc:359] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.112284 18721 raft_consensus.cc:385] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.112651 18721 raft_consensus.cc:740] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.113526 18721 consensus_queue.cc:260] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.117267 18722 tablet_bootstrap.cc:492] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:43.117769 18722 ts_tablet_manager.cc:1403] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.012s
I20260709 12:21:43.120421 18721 ts_tablet_manager.cc:1434] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.002s
I20260709 12:21:43.120536 18722 raft_consensus.cc:359] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.121202 18722 raft_consensus.cc:385] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.121439 18721 tablet_bootstrap.cc:492] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:43.121465 18722 raft_consensus.cc:740] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.122295 18722 consensus_queue.cc:260] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.124712 18722 ts_tablet_manager.cc:1434] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:21:43.125705 18722 tablet_bootstrap.cc:492] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:43.128619 18721 tablet_bootstrap.cc:654] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.131615 18724 tablet_bootstrap.cc:492] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:43.131820 18722 tablet_bootstrap.cc:654] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.132244 18724 ts_tablet_manager.cc:1403] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.010s
I20260709 12:21:43.135159 18724 raft_consensus.cc:359] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.135924 18724 raft_consensus.cc:385] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.136252 18724 raft_consensus.cc:740] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.137321 18724 consensus_queue.cc:260] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.139828 18724 ts_tablet_manager.cc:1434] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:21:43.142637 18780 consensus_queue.cc:1048] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:43.148285 18721 tablet_bootstrap.cc:492] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:43.148979 18721 ts_tablet_manager.cc:1403] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.000s
I20260709 12:21:43.152132 18724 tablet_bootstrap.cc:492] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:43.153461 18721 raft_consensus.cc:359] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.154035 18721 raft_consensus.cc:385] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.154268 18721 raft_consensus.cc:740] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.155133 18721 consensus_queue.cc:260] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.157539 18721 ts_tablet_manager.cc:1434] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:43.158506 18721 tablet_bootstrap.cc:492] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:43.161615 18722 tablet_bootstrap.cc:492] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:43.162034 18722 ts_tablet_manager.cc:1403] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.013s
I20260709 12:21:43.156648 18425 catalog_manager.cc:5697] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:43.167691 18724 tablet_bootstrap.cc:654] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.168401 18721 tablet_bootstrap.cc:654] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.170258 18722 raft_consensus.cc:359] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.171016 18722 raft_consensus.cc:385] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.171379 18722 raft_consensus.cc:740] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.172503 18722 consensus_queue.cc:260] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.174587 18676 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.175614 18722 ts_tablet_manager.cc:1434] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:21:43.176923 18722 tablet_bootstrap.cc:492] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:43.183209 18722 tablet_bootstrap.cc:654] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.193751 18784 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.194378 18784 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.196590 18784 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:43.198287 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:43.198974 18529 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:43.200659 18572 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:43.202831 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:43.203513 18677 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:43.205315 18784 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:43.205731 18784 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.206063 18784 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.209393 18746 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:43.215852 18722 tablet_bootstrap.cc:492] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:43.216109 18746 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:43.216528 18722 ts_tablet_manager.cc:1403] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.040s	user 0.022s	sys 0.015s
I20260709 12:21:43.221442 18729 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:43.221174 18722 raft_consensus.cc:359] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.222343 18722 raft_consensus.cc:385] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.222726 18722 raft_consensus.cc:740] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.223950 18722 consensus_queue.cc:260] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.226980 18783 consensus_queue.cc:1048] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:43.227885 18722 ts_tablet_manager.cc:1434] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:21:43.229326 18722 tablet_bootstrap.cc:492] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:43.237708 18783 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.238476 18783 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.239243 18722 tablet_bootstrap.cc:654] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.241349 18783 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:43.243976 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:21:43.246493 18494 leader_election.cc:343] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.246637 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:21:43.249065 18494 leader_election.cc:343] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.249603 18494 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:43.252100 18722 tablet_bootstrap.cc:492] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:43.252743 18722 ts_tablet_manager.cc:1403] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.001s
I20260709 12:21:43.250519 18783 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:43.257023 18722 raft_consensus.cc:359] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.257975 18722 raft_consensus.cc:385] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.258342 18722 raft_consensus.cc:740] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.259666 18722 consensus_queue.cc:260] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.262732 18722 ts_tablet_manager.cc:1434] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:21:43.264025 18722 tablet_bootstrap.cc:492] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:43.268004 18729 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.268708 18729 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.270915 18729 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:43.271592 18750 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.272316 18750 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.273442 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:43.274133 18680 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:43.274274 18784 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.275451 18570 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:43.275933 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:43.277179 18729 raft_consensus.cc:2804] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:43.277285 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:43.277722 18729 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.278097 18729 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:43.278811 18644 leader_election.cc:343] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.279639 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:43.279817 18722 tablet_bootstrap.cc:654] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:43.280871 18646 leader_election.cc:343] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:43.281005 18572 leader_election.cc:343] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.281358 18646 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:43.282184 18727 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:43.277093 18750 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:43.283543 18783 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.284073 18783 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.287000 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:43.287622 18604 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:43.288938 18494 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:43.289870 18780 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:43.290247 18780 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.290621 18780 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.304812 18727 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:43.309664 18729 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.314687 18721 tablet_bootstrap.cc:492] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:43.315218 18721 ts_tablet_manager.cc:1403] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.157s	user 0.017s	sys 0.015s
I20260709 12:21:43.317592 18722 tablet_bootstrap.cc:492] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:43.317806 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:43.318185 18722 ts_tablet_manager.cc:1403] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.006s
I20260709 12:21:43.318498 18680 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.317662 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:21:43.322678 18572 leader_election.cc:343] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.323030 18722 raft_consensus.cc:359] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.324545 18722 raft_consensus.cc:385] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.324568 18721 raft_consensus.cc:359] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.325606 18721 raft_consensus.cc:385] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.325724 18783 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:43.325924 18721 raft_consensus.cc:740] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.325383 18722 raft_consensus.cc:740] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.326574 18721 consensus_queue.cc:260] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.327159 18722 consensus_queue.cc:260] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.329453 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:43.330163 18679 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:43.331506 18722 ts_tablet_manager.cc:1434] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:21:43.333304 18722 tablet_bootstrap.cc:492] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:43.336025 18721 ts_tablet_manager.cc:1434] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.011s
I20260709 12:21:43.336023 18727 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:43.337283 18721 tablet_bootstrap.cc:492] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:43.339313 18680 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:43.340915 18570 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:21:43.341979 18779 raft_consensus.cc:2804] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:43.342515 18779 raft_consensus.cc:697] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:21:43.343462 18779 consensus_queue.cc:237] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.344507 18721 tablet_bootstrap.cc:654] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:43.345387 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 46993.8us
I20260709 12:21:43.346640 18722 tablet_bootstrap.cc:654] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.358667 18721 tablet_bootstrap.cc:492] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:43.359191 18721 ts_tablet_manager.cc:1403] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.005s
I20260709 12:21:43.361838 18721 raft_consensus.cc:359] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.362567 18721 raft_consensus.cc:385] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.362848 18721 raft_consensus.cc:740] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.363523 18721 consensus_queue.cc:260] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.363328 18729 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:43.364662 18724 tablet_bootstrap.cc:492] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:43.365170 18724 ts_tablet_manager.cc:1403] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.213s	user 0.061s	sys 0.066s
I20260709 12:21:43.369030 18724 raft_consensus.cc:359] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.370038 18724 raft_consensus.cc:385] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.370424 18724 raft_consensus.cc:740] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.371245 18724 consensus_queue.cc:260] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.372228 18721 ts_tablet_manager.cc:1434] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:21:43.373241 18721 tablet_bootstrap.cc:492] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:43.373989 18724 ts_tablet_manager.cc:1434] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:21:43.375140 18724 tablet_bootstrap.cc:492] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:43.376097 18780 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.379521 18721 tablet_bootstrap.cc:654] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.384518 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:43.385463 18605 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.390472 18724 tablet_bootstrap.cc:654] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.391902 18841 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.392541 18841 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.394773 18841 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:43.395694 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:43.396399 18528 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:43.397578 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:43.398298 18528 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.397596 18646 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:21:43.406469 18724 tablet_bootstrap.cc:492] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:43.407335 18724 ts_tablet_manager.cc:1403] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.008s
I20260709 12:21:43.410514 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:43.410732 18842 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:43.411258 18680 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.414072 18724 raft_consensus.cc:359] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.414609 18750 raft_consensus.cc:2804] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:43.415974 18750 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.416342 18750 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.420379 18680 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:43.421271 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:43.421659 18570 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:43.421933 18603 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:43.422564 18782 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:43.423625 18727 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.424121 18727 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.424314 18750 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.426362 18727 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:43.423254 18782 raft_consensus.cc:697] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:21:43.426331 18750 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:43.427412 18782 consensus_queue.cc:237] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.427965 18724 raft_consensus.cc:385] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.428669 18724 raft_consensus.cc:740] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.435593 18724 consensus_queue.cc:260] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.437000 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:43.441735 18724 ts_tablet_manager.cc:1434] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.003s
I20260709 12:21:43.443107 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:43.444204 18603 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.444659 18724 tablet_bootstrap.cc:492] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:43.445060 18527 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:43.442216 18646 leader_election.cc:343] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.456492 18527 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:43.458169 18646 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:21:43.459383 18750 raft_consensus.cc:2804] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:43.460152 18750 raft_consensus.cc:697] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:21:43.461328 18750 consensus_queue.cc:237] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.470013 18427 catalog_manager.cc:5697] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:43.474148 18528 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:43.475572 18780 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:43.478749 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:43.472270 18784 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:21:43.470475 18644 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.16.240.190:43515, user_credentials={real_user=slave}} blocked reactor thread for 44907.6us
I20260709 12:21:43.482311 18680 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.489596 18722 tablet_bootstrap.cc:492] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:43.490444 18722 ts_tablet_manager.cc:1403] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.157s	user 0.037s	sys 0.039s
I20260709 12:21:43.503324 18784 consensus_queue.cc:1048] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:21:43.509239 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:43.509127 18779 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.510478 18606 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.511205 18779 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.514142 18779 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:43.517975 18605 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:43.520797 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:43.532264 18779 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.533293 18779 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.544718 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:21:43.546691 18572 leader_election.cc:343] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.550441 18722 raft_consensus.cc:359] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.551283 18722 raft_consensus.cc:385] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.551589 18722 raft_consensus.cc:740] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.553857 18494 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:43.555068 18842 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:43.555526 18842 raft_consensus.cc:697] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:43.556785 18842 consensus_queue.cc:237] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.559998 18722 consensus_queue.cc:260] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.560849 18427 catalog_manager.cc:5697] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:43.562849 18721 tablet_bootstrap.cc:492] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:43.563323 18721 ts_tablet_manager.cc:1403] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.190s	user 0.062s	sys 0.039s
I20260709 12:21:43.558687 18780 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:21:43.566569 18779 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:43.566808 18721 raft_consensus.cc:359] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.567457 18721 raft_consensus.cc:385] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.567548 18750 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.567879 18721 raft_consensus.cc:740] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.568120 18750 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.568941 18721 consensus_queue.cc:260] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.570456 18750 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:43.551203 18680 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:43.574391 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:43.574627 18722 ts_tablet_manager.cc:1434] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.014s
I20260709 12:21:43.575712 18722 tablet_bootstrap.cc:492] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:43.574596 18721 ts_tablet_manager.cc:1434] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:21:43.576834 18721 tablet_bootstrap.cc:492] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:43.575577 18606 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
W20260709 12:21:43.581717 18644 leader_election.cc:343] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.590654 18780 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.594501 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:43.594365 18780 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.595036 18724 tablet_bootstrap.cc:654] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.596630 18780 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:43.588292 18644 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:43.598136 18750 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:43.598384 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:43.598793 18750 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:43.599375 18779 consensus_queue.cc:1048] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:43.600274 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:21:43.601975 18644 leader_election.cc:343] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.604031 18779 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.604521 18779 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.604065 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:43.606034 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:43.607295 18528 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:43.613653 18646 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:21:43.614634 18570 leader_election.cc:343] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.614869 18746 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:43.615235 18746 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.615130 18570 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:43.615604 18746 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.616987 18782 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:43.618892 18644 consensus_peers.cc:597] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:43.624926 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:43.626088 18677 raft_consensus.cc:2393] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 1: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:21:43.628123 18570 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:43.630036 18782 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:43.631341 18841 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:43.634207 18494 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:43.635535 18780 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.638604 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:43.639321 18528 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:43.640837 18572 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:43.642050 18782 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:43.642519 18782 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.642972 18782 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.664165 18746 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.665787 18782 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.666797 18722 tablet_bootstrap.cc:654] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.669312 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:43.670419 18528 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.674782 18779 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:43.686091 18783 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.686625 18783 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.686901 18424 catalog_manager.cc:5697] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:43.688824 18783 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:43.690369 18746 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:21:43.690896 18475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:43.691561 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:43.696322 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:43.696985 18680 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:43.697311 18724 tablet_bootstrap.cc:492] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:43.697911 18724 ts_tablet_manager.cc:1403] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.254s	user 0.014s	sys 0.018s
I20260709 12:21:43.698055 18721 tablet_bootstrap.cc:654] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.681763 18780 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:43.700157 18644 leader_election.cc:343] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.694479 18782 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:43.710055 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:43.711694 18746 consensus_queue.cc:1048] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:43.709896 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:43.713209 18527 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.716995 18528 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:43.720573 18427 catalog_manager.cc:5697] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:43.724310 18494 leader_election.cc:343] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.728835 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:43.728735 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:43.729835 18680 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.735618 18572 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:43.737296 18527 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:43.738801 18646 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:43.736858 18850 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:43.740232 18841 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:43.740855 18841 raft_consensus.cc:697] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:21:43.741034 18721 tablet_bootstrap.cc:492] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:43.752002 18721 ts_tablet_manager.cc:1403] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.175s	user 0.013s	sys 0.005s
I20260709 12:21:43.753515 18841 consensus_queue.cc:237] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.755118 18779 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:21:43.742033 18850 raft_consensus.cc:697] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:21:43.766683 18850 consensus_queue.cc:237] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.746783 18680 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
W20260709 12:21:43.777601 18494 leader_election.cc:343] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.778105 18494 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:43.779098 18783 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:43.790743 18722 tablet_bootstrap.cc:492] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:43.791431 18722 ts_tablet_manager.cc:1403] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.216s	user 0.012s	sys 0.025s
I20260709 12:21:43.796705 18724 raft_consensus.cc:359] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.797448 18724 raft_consensus.cc:385] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.797734 18724 raft_consensus.cc:740] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.798352 18724 consensus_queue.cc:260] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.799060 18722 raft_consensus.cc:359] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.799713 18722 raft_consensus.cc:385] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.800009 18722 raft_consensus.cc:740] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.800423 18724 ts_tablet_manager.cc:1434] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.102s	user 0.027s	sys 0.023s
I20260709 12:21:43.800642 18722 consensus_queue.cc:260] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.801358 18724 tablet_bootstrap.cc:492] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:43.804706 18721 raft_consensus.cc:359] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.805500 18721 raft_consensus.cc:385] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.805763 18721 raft_consensus.cc:740] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.806386 18721 consensus_queue.cc:260] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.808717 18722 ts_tablet_manager.cc:1434] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:21:43.809746 18722 tablet_bootstrap.cc:492] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:43.808032 18779 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:21:43.811847 18721 ts_tablet_manager.cc:1434] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 12:21:43.812736 18721 tablet_bootstrap.cc:492] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:43.836575 18722 tablet_bootstrap.cc:654] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.836669 18724 tablet_bootstrap.cc:654] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.849047 18783 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.849552 18783 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.847683 18427 catalog_manager.cc:5697] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:43.869127 18783 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:43.871265 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:43.871853 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:21:43.872916 18494 leader_election.cc:343] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:43.873718 18494 leader_election.cc:343] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.874143 18494 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:43.877039 18783 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:43.877310 18721 tablet_bootstrap.cc:654] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.874889 18724 tablet_bootstrap.cc:492] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:43.878005 18724 ts_tablet_manager.cc:1403] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.077s	user 0.008s	sys 0.023s
I20260709 12:21:43.879556 18841 consensus_queue.cc:1048] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:43.879405 18424 catalog_manager.cc:5697] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:43.880707 18724 raft_consensus.cc:359] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.881392 18724 raft_consensus.cc:385] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.881644 18724 raft_consensus.cc:740] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.881865 18722 tablet_bootstrap.cc:492] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:43.882328 18722 ts_tablet_manager.cc:1403] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.002s
I20260709 12:21:43.882313 18724 consensus_queue.cc:260] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.885845 18724 ts_tablet_manager.cc:1434] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:21:43.887199 18722 raft_consensus.cc:359] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.887715 18724 tablet_bootstrap.cc:492] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:43.887912 18722 raft_consensus.cc:385] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.888371 18722 raft_consensus.cc:740] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.890661 18722 consensus_queue.cc:260] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.893877 18722 ts_tablet_manager.cc:1434] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:21:43.894866 18722 tablet_bootstrap.cc:492] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:43.897447 18724 tablet_bootstrap.cc:654] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.912245 18779 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.913046 18779 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.916990 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:43.917905 18527 raft_consensus.cc:2393] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 1: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:21:43.922595 18783 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.923180 18783 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.924572 18779 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:43.925997 18783 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:43.926280 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:43.927107 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:43.927116 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:43.929296 18722 tablet_bootstrap.cc:654] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.931525 18724 tablet_bootstrap.cc:492] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:43.931926 18570 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:43.932271 18724 ts_tablet_manager.cc:1403] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.006s
I20260709 12:21:43.932358 18494 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:43.933288 18779 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.934708 18783 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:43.939076 18721 tablet_bootstrap.cc:492] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:43.939514 18721 ts_tablet_manager.cc:1403] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.127s	user 0.016s	sys 0.012s
I20260709 12:21:43.940896 18779 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:43.942862 18721 raft_consensus.cc:359] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.943840 18721 raft_consensus.cc:385] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.944221 18721 raft_consensus.cc:740] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.935025 18724 raft_consensus.cc:359] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.944885 18724 raft_consensus.cc:385] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.945142 18724 raft_consensus.cc:740] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.945271 18721 consensus_queue.cc:260] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.945755 18724 consensus_queue.cc:260] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.948581 18721 ts_tablet_manager.cc:1434] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:21:43.950340 18721 tablet_bootstrap.cc:492] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:43.951953 18724 ts_tablet_manager.cc:1434] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 12:21:43.953203 18724 tablet_bootstrap.cc:492] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:43.966449 18724 tablet_bootstrap.cc:654] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.969305 18780 consensus_queue.cc:1048] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:43.971079 18727 consensus_queue.cc:1048] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:43.972671 18721 tablet_bootstrap.cc:654] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.981537 18782 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:43.982617 18722 tablet_bootstrap.cc:492] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:43.983110 18722 ts_tablet_manager.cc:1403] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.088s	user 0.016s	sys 0.019s
I20260709 12:21:43.983953 18721 tablet_bootstrap.cc:492] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:43.984405 18721 ts_tablet_manager.cc:1403] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.008s
I20260709 12:21:43.987824 18841 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.987915 18721 raft_consensus.cc:359] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.988600 18841 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.989436 18721 raft_consensus.cc:385] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.989876 18721 raft_consensus.cc:740] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.990991 18721 consensus_queue.cc:260] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.992554 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:43.993463 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:21:43.993945 18646 leader_election.cc:343] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.985946 18722 raft_consensus.cc:359] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.995180 18722 raft_consensus.cc:385] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.995541 18722 raft_consensus.cc:740] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
W20260709 12:21:43.995946 18644 leader_election.cc:343] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.996368 18722 consensus_queue.cc:260] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:43.996711 18644 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:43.997701 18727 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:43.998407 18722 ts_tablet_manager.cc:1434] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:21:43.991387 18841 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:43.999410 18722 tablet_bootstrap.cc:492] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:44.001466 18782 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:43.995247 18721 ts_tablet_manager.cc:1434] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:21:44.004647 18721 tablet_bootstrap.cc:492] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:44.015328 18721 tablet_bootstrap.cc:654] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.020961 18780 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.021548 18780 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.023348 18842 consensus_queue.cc:1048] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:44.024432 18722 tablet_bootstrap.cc:654] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.026736 18780 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:44.028692 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:44.029438 18604 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:44.031963 18494 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:44.042459 18780 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:44.042867 18780 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.043195 18780 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.038584 18782 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.043737 18782 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.039618 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:44.048593 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:44.050101 18782 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:44.052579 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:44.055603 18570 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:21:44.056546 18494 leader_election.cc:343] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.058036 18782 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:44.064111 18780 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.067237 18780 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:44.068856 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:44.069519 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:44.078838 18603 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.083577 18604 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:44.094574 18494 leader_election.cc:343] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.103108 18721 tablet_bootstrap.cc:492] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:44.103629 18721 ts_tablet_manager.cc:1403] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.099s	user 0.020s	sys 0.009s
I20260709 12:21:44.106256 18604 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:44.106930 18721 raft_consensus.cc:359] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.108358 18727 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.115610 18721 raft_consensus.cc:385] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.115856 18727 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.116681 18494 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:44.117966 18780 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:44.118065 18727 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:44.118767 18780 raft_consensus.cc:697] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:44.115998 18721 raft_consensus.cc:740] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.119709 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:44.120182 18721 consensus_queue.cc:260] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.120801 18722 tablet_bootstrap.cc:492] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
W20260709 12:21:44.121285 18646 leader_election.cc:343] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.122489 18721 ts_tablet_manager.cc:1434] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:21:44.121279 18722 ts_tablet_manager.cc:1403] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.122s	user 0.017s	sys 0.006s
I20260709 12:21:44.123615 18721 tablet_bootstrap.cc:492] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:44.125420 18722 raft_consensus.cc:359] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.126255 18722 raft_consensus.cc:385] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.126555 18722 raft_consensus.cc:740] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.127288 18722 consensus_queue.cc:260] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.128815 18722 ts_tablet_manager.cc:1434] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:21:44.129271 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:44.129822 18724 tablet_bootstrap.cc:492] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:44.130297 18724 ts_tablet_manager.cc:1403] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.177s	user 0.015s	sys 0.070s
W20260709 12:21:44.130743 18644 leader_election.cc:343] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.131182 18722 tablet_bootstrap.cc:492] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:44.131211 18644 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:44.134204 18727 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:44.139047 18724 raft_consensus.cc:359] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.139837 18724 raft_consensus.cc:385] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.140092 18724 raft_consensus.cc:740] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.141520 18722 tablet_bootstrap.cc:654] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.142874 18724 consensus_queue.cc:260] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.143491 18780 consensus_queue.cc:237] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.144279 18721 tablet_bootstrap.cc:654] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.145643 18724 ts_tablet_manager.cc:1434] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:21:44.146673 18724 tablet_bootstrap.cc:492] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:44.177613 18722 tablet_bootstrap.cc:492] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:44.178145 18722 ts_tablet_manager.cc:1403] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.000s
I20260709 12:21:44.181113 18722 raft_consensus.cc:359] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.182109 18722 raft_consensus.cc:385] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.182425 18722 raft_consensus.cc:740] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.183099 18722 consensus_queue.cc:260] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.185779 18724 tablet_bootstrap.cc:654] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.185444 18427 catalog_manager.cc:5697] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:44.190673 18721 tablet_bootstrap.cc:492] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:44.191282 18721 ts_tablet_manager.cc:1403] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.000s
I20260709 12:21:44.192188 18722 ts_tablet_manager.cc:1434] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:21:44.193806 18722 tablet_bootstrap.cc:492] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:44.194890 18888 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.195376 18888 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.197738 18721 raft_consensus.cc:359] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.198462 18721 raft_consensus.cc:385] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.198750 18721 raft_consensus.cc:740] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.199010 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:44.199504 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:44.199388 18721 consensus_queue.cc:260] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.200122 18677 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
W20260709 12:21:44.200768 18494 leader_election.cc:343] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.201000 18727 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.201555 18783 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.201508 18727 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.202049 18783 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.198164 18888 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:44.204278 18783 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:44.205160 18783 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.205617 18783 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.206624 18724 tablet_bootstrap.cc:492] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:44.207191 18724 ts_tablet_manager.cc:1403] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.061s	user 0.005s	sys 0.013s
I20260709 12:21:44.203685 18727 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:44.209841 18724 raft_consensus.cc:359] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.210690 18724 raft_consensus.cc:385] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.211033 18724 raft_consensus.cc:740] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.211814 18724 consensus_queue.cc:260] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.213557 18724 ts_tablet_manager.cc:1434] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:21:44.214639 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:44.214926 18724 tablet_bootstrap.cc:492] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:44.215322 18603 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:44.218900 18722 tablet_bootstrap.cc:654] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.219287 18530 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.215459 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:44.234261 18721 ts_tablet_manager.cc:1434] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 12:21:44.235347 18721 tablet_bootstrap.cc:492] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:44.237279 18850 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.238343 18783 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:44.237973 18850 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.240362 18729 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:44.228964 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:44.242722 18779 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:44.245260 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:44.245769 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:44.249063 18841 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:44.249571 18841 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.257174 18841 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.266412 18850 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:44.229367 18494 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:44.276340 18888 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.276932 18888 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.279016 18888 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:44.282088 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:44.283645 18724 tablet_bootstrap.cc:654] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:44.283875 18570 leader_election.cc:343] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:44.288501 18572 leader_election.cc:343] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:44.272701 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 47015.8us
I20260709 12:21:44.284752 18783 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:44.292038 18572 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:44.304358 18727 consensus_queue.cc:1048] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:44.306190 18722 tablet_bootstrap.cc:492] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:44.306815 18722 ts_tablet_manager.cc:1403] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.113s	user 0.017s	sys 0.019s
I20260709 12:21:44.301951 18841 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.302652 18783 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.306783 18729 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:44.306974 18494 leader_election.cc:343] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.313366 18722 raft_consensus.cc:359] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.313664 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:44.314121 18722 raft_consensus.cc:385] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.314312 18527 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:44.314438 18722 raft_consensus.cc:740] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.317687 18722 consensus_queue.cc:260] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.319190 18729 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.319980 18729 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.321271 18722 ts_tablet_manager.cc:1434] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:21:44.321839 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:44.322465 18527 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.322891 18722 tablet_bootstrap.cc:492] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:44.323462 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:44.323796 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:44.324095 18529 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:44.324368 18677 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:44.325330 18572 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:44.326153 18779 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:44.326490 18779 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.326804 18779 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.327054 18729 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:44.329874 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:44.330875 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:44.331544 18677 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:44.332640 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:44.333590 18678 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:44.335172 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:44.335839 18603 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:44.309754 18783 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.343454 18527 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:44.376101 18722 tablet_bootstrap.cc:654] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.370266 18841 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:21:44.380332 18494 leader_election.cc:343] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.389137 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:44.399428 18724 tablet_bootstrap.cc:492] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:44.400156 18724 ts_tablet_manager.cc:1403] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.185s	user 0.034s	sys 0.020s
I20260709 12:21:44.392889 18494 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:44.405282 18603 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.417023 18780 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:44.413228 18494 leader_election.cc:343] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.435148 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:44.436038 18888 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:44.436461 18888 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.436810 18888 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.443959 18724 raft_consensus.cc:359] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.444552 18724 raft_consensus.cc:385] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.444859 18724 raft_consensus.cc:740] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.447476 18646 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:21:44.451956 18746 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:44.456296 18746 raft_consensus.cc:697] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:21:44.457580 18746 consensus_queue.cc:237] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.460289 18724 consensus_queue.cc:260] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.466379 18722 tablet_bootstrap.cc:492] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:44.466923 18722 ts_tablet_manager.cc:1403] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.144s	user 0.018s	sys 0.017s
I20260709 12:21:44.470549 18721 tablet_bootstrap.cc:654] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.470389 18722 raft_consensus.cc:359] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.471129 18722 raft_consensus.cc:385] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.471427 18722 raft_consensus.cc:740] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.472725 18722 consensus_queue.cc:260] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.475430 18724 ts_tablet_manager.cc:1434] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.075s	user 0.005s	sys 0.003s
I20260709 12:21:44.476401 18724 tablet_bootstrap.cc:492] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:44.480568 18722 ts_tablet_manager.cc:1434] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:21:44.486800 18722 tablet_bootstrap.cc:492] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:44.490430 18494 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:44.492573 18780 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:44.492462 18783 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.493021 18780 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.493391 18780 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.494485 18783 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:44.495047 18603 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:44.501925 18780 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.503211 18779 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.508365 18780 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:44.505761 18724 tablet_bootstrap.cc:654] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.505990 18722 tablet_bootstrap.cc:654] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.514285 18779 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:44.509544 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:44.514631 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:44.504545 18746 consensus_queue.cc:1048] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:44.513424 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:44.516419 18680 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.517129 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:44.517715 18677 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.513257 18427 catalog_manager.cc:5697] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:44.524149 18899 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.524829 18899 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.530407 18899 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:44.531530 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:44.533457 18604 raft_consensus.cc:2393] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 1: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:21:44.505810 18750 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.534828 18750 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.515232 18603 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.541026 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:21:44.542518 18644 leader_election.cc:343] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.543604 18677 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:44.515250 18530 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.559024 18680 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:44.546830 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:44.559844 18750 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:44.566599 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:44.567878 18677 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:44.573890 18494 leader_election.cc:343] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.577222 18494 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:21:44.503404 18888 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.579156 18603 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:44.581210 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:44.582625 18779 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:44.583169 18779 raft_consensus.cc:697] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:21:44.584393 18724 tablet_bootstrap.cc:492] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:44.584069 18779 consensus_queue.cc:237] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.584872 18724 ts_tablet_manager.cc:1403] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.109s	user 0.017s	sys 0.013s
I20260709 12:21:44.585098 18530 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:44.586416 18721 tablet_bootstrap.cc:492] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:44.586493 18888 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:44.587101 18721 ts_tablet_manager.cc:1403] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.352s	user 0.039s	sys 0.065s
I20260709 12:21:44.587634 18724 raft_consensus.cc:359] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.588336 18724 raft_consensus.cc:385] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.588622 18724 raft_consensus.cc:740] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.589494 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:44.590114 18606 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.591764 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:44.592538 18680 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:44.589329 18724 consensus_queue.cc:260] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.596748 18722 tablet_bootstrap.cc:492] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:44.597268 18722 ts_tablet_manager.cc:1403] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.111s	user 0.019s	sys 0.015s
I20260709 12:21:44.598941 18606 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:21:44.600570 18721 raft_consensus.cc:359] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.602797 18724 ts_tablet_manager.cc:1434] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:21:44.603499 18721 raft_consensus.cc:385] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.604043 18721 raft_consensus.cc:740] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.604537 18724 tablet_bootstrap.cc:492] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:44.600494 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:44.604835 18721 consensus_queue.cc:260] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.606228 18646 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:44.607507 18721 ts_tablet_manager.cc:1434] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:21:44.607628 18746 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.608640 18721 tablet_bootstrap.cc:492] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:44.611601 18724 tablet_bootstrap.cc:654] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.601112 18783 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:44.600279 18722 raft_consensus.cc:359] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.602046 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:44.614173 18722 raft_consensus.cc:385] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.599736 18677 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:44.614593 18722 raft_consensus.cc:740] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.615429 18722 consensus_queue.cc:260] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.615805 18783 raft_consensus.cc:697] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:44.617167 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:44.618261 18780 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:44.618746 18780 raft_consensus.cc:697] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:44.619660 18842 consensus_queue.cc:1048] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:44.619573 18780 consensus_queue.cc:237] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:44.621050 18646 leader_election.cc:343] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.621642 18646 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:44.622581 18750 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:44.631613 18494 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:44.632567 18888 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:44.633059 18888 raft_consensus.cc:697] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:44.633363 18721 tablet_bootstrap.cc:654] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.633888 18722 ts_tablet_manager.cc:1434] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.004s
I20260709 12:21:44.633944 18888 consensus_queue.cc:237] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.617527 18783 consensus_queue.cc:237] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.635506 18722 tablet_bootstrap.cc:492] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:44.644815 18722 tablet_bootstrap.cc:654] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.661484 18680 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:21:44.672047 18722 tablet_bootstrap.cc:492] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:44.672529 18722 ts_tablet_manager.cc:1403] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.000s
I20260709 12:21:44.691061 18724 tablet_bootstrap.cc:492] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:44.691574 18724 ts_tablet_manager.cc:1403] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.087s	user 0.024s	sys 0.010s
I20260709 12:21:44.680972 18746 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:44.693109 18750 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.693670 18750 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.695729 18750 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:44.696713 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:44.698431 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:21:44.698769 18646 leader_election.cc:343] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.699090 18606 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:44.699965 18722 raft_consensus.cc:359] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.700649 18722 raft_consensus.cc:385] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.700965 18722 raft_consensus.cc:740] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.701748 18721 tablet_bootstrap.cc:492] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:44.701638 18722 consensus_queue.cc:260] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.702184 18721 ts_tablet_manager.cc:1403] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.094s	user 0.032s	sys 0.025s
I20260709 12:21:44.700482 18644 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:21:44.704963 18427 catalog_manager.cc:5697] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:44.708659 18722 ts_tablet_manager.cc:1434] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.001s
I20260709 12:21:44.709698 18722 tablet_bootstrap.cc:492] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:44.706887 18750 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:44.713207 18750 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.713649 18750 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:44.717044 18475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:44.721259 18750 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.726552 18721 raft_consensus.cc:359] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.729678 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:44.731807 18603 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.730841 18750 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:44.740764 18721 raft_consensus.cc:385] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.745302 18721 raft_consensus.cc:740] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.746073 18721 consensus_queue.cc:260] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.746315 18724 raft_consensus.cc:359] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.747114 18724 raft_consensus.cc:385] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.747399 18724 raft_consensus.cc:740] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.748046 18724 consensus_queue.cc:260] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.749467 18721 ts_tablet_manager.cc:1434] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.002s
I20260709 12:21:44.750420 18721 tablet_bootstrap.cc:492] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:44.750837 18724 ts_tablet_manager.cc:1434] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 12:21:44.751793 18724 tablet_bootstrap.cc:492] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:44.755923 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:21:44.757347 18646 leader_election.cc:343] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.760628 18722 tablet_bootstrap.cc:654] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.763023 18603 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:44.764811 18644 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:21:44.765895 18899 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:44.766494 18899 raft_consensus.cc:697] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:21:44.767401 18899 consensus_queue.cc:237] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.772324 18888 consensus_queue.cc:1048] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:44.775625 18721 tablet_bootstrap.cc:654] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.776181 18727 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.776618 18724 tablet_bootstrap.cc:654] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.776662 18727 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.789986 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:21:44.792176 18644 leader_election.cc:343] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.792932 18727 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:44.796275 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:21:44.798321 18646 leader_election.cc:343] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.798923 18646 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:44.800377 18750 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:44.803680 18722 tablet_bootstrap.cc:492] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:44.804165 18722 ts_tablet_manager.cc:1403] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.011s
I20260709 12:21:44.806917 18722 raft_consensus.cc:359] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.807566 18722 raft_consensus.cc:385] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.807843 18722 raft_consensus.cc:740] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.808575 18722 consensus_queue.cc:260] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.811964 18722 ts_tablet_manager.cc:1434] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:44.803309 18425 catalog_manager.cc:5697] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:44.812866 18722 tablet_bootstrap.cc:492] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:44.812943 18425 catalog_manager.cc:5697] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:44.815094 18425 catalog_manager.cc:5697] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 0 to 2, leader changed from <none> to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 2 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:44.819037 18722 tablet_bootstrap.cc:654] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.821812 18724 tablet_bootstrap.cc:492] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:44.822312 18724 ts_tablet_manager.cc:1403] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.008s
I20260709 12:21:44.825098 18724 raft_consensus.cc:359] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.825771 18724 raft_consensus.cc:385] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.826045 18724 raft_consensus.cc:740] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.826718 18724 consensus_queue.cc:260] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.828756 18724 ts_tablet_manager.cc:1434] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:21:44.829784 18724 tablet_bootstrap.cc:492] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:44.829831 18427 catalog_manager.cc:5697] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:44.836632 18724 tablet_bootstrap.cc:654] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.838670 18721 tablet_bootstrap.cc:492] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:44.839334 18721 ts_tablet_manager.cc:1403] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.009s
I20260709 12:21:44.843327 18721 raft_consensus.cc:359] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.844475 18721 raft_consensus.cc:385] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.844842 18721 raft_consensus.cc:740] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.860791 18721 consensus_queue.cc:260] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.865940 18721 ts_tablet_manager.cc:1434] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:21:44.867367 18721 tablet_bootstrap.cc:492] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:44.873345 18750 consensus_queue.cc:1048] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:44.877738 18779 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.878538 18779 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.882529 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:21:44.884052 18572 leader_election.cc:343] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.888068 18779 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:44.890283 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:21:44.892251 18570 leader_election.cc:343] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.892771 18570 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:44.893554 18779 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:44.899262 18721 tablet_bootstrap.cc:654] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.900965 18722 tablet_bootstrap.cc:492] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:44.903499 18724 tablet_bootstrap.cc:492] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:44.903400 18888 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.904036 18724 ts_tablet_manager.cc:1403] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.074s	user 0.032s	sys 0.018s
I20260709 12:21:44.903992 18888 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.906188 18888 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:44.907982 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:44.901441 18722 ts_tablet_manager.cc:1403] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.089s	user 0.042s	sys 0.024s
I20260709 12:21:44.906740 18724 raft_consensus.cc:359] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.909195 18724 raft_consensus.cc:385] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.909547 18724 raft_consensus.cc:740] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.910287 18724 consensus_queue.cc:260] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.912359 18724 ts_tablet_manager.cc:1434] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:21:44.912053 18722 raft_consensus.cc:359] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.912719 18722 raft_consensus.cc:385] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.912989 18722 raft_consensus.cc:740] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.913431 18724 tablet_bootstrap.cc:492] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:44.913687 18722 consensus_queue.cc:260] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.915990 18722 ts_tablet_manager.cc:1434] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:21:44.907982 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:44.919070 18680 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:44.920334 18724 tablet_bootstrap.cc:654] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.924295 18746 consensus_queue.cc:1048] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:21:44.926276 18494 leader_election.cc:343] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.926741 18724 tablet_bootstrap.cc:492] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:44.926939 18494 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:44.927663 18888 raft_consensus.cc:2804] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:44.927798 18724 ts_tablet_manager.cc:1403] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 12:21:44.928074 18888 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.928431 18888 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.931488 18724 raft_consensus.cc:359] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.933456 18724 raft_consensus.cc:385] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.934166 18724 raft_consensus.cc:740] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.935482 18722 tablet_bootstrap.cc:492] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:44.935408 18724 consensus_queue.cc:260] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.939766 18724 ts_tablet_manager.cc:1434] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:21:44.940888 18721 tablet_bootstrap.cc:492] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:44.941393 18721 ts_tablet_manager.cc:1403] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.074s	user 0.015s	sys 0.004s
I20260709 12:21:44.943104 18722 tablet_bootstrap.cc:654] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.935336 18888 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.945080 18724 tablet_bootstrap.cc:492] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:44.946280 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:44.948196 18888 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:44.950132 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:44.950835 18680 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.952461 18724 tablet_bootstrap.cc:654] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.959937 18724 tablet_bootstrap.cc:492] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:44.960407 18724 ts_tablet_manager.cc:1403] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
W20260709 12:21:44.960464 18494 leader_election.cc:343] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.959436 18680 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:44.972699 18721 raft_consensus.cc:359] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.973609 18721 raft_consensus.cc:385] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.973981 18721 raft_consensus.cc:740] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.975138 18494 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:44.974877 18721 consensus_queue.cc:260] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.975947 18888 raft_consensus.cc:2804] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:44.976464 18888 raft_consensus.cc:697] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:44.977330 18888 consensus_queue.cc:237] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.977933 18721 ts_tablet_manager.cc:1434] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 12:21:44.978991 18721 tablet_bootstrap.cc:492] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:44.987612 18724 raft_consensus.cc:359] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.988131 18722 tablet_bootstrap.cc:492] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:44.988989 18724 raft_consensus.cc:385] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.989310 18724 raft_consensus.cc:740] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.989959 18724 consensus_queue.cc:260] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.991984 18724 ts_tablet_manager.cc:1434] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:21:44.992084 18722 ts_tablet_manager.cc:1403] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.057s	user 0.027s	sys 0.015s
I20260709 12:21:44.993258 18779 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.993695 18724 tablet_bootstrap.cc:492] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:44.993764 18779 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:44.994434 18721 tablet_bootstrap.cc:654] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.001006 18902 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.001461 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:45.001549 18902 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.000658 18427 catalog_manager.cc:5697] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:45.002184 18680 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:45.003082 18746 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.013198 18729 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.003768 18570 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:44.996301 18779 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:45.014863 18729 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.015807 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:45.016456 18527 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:45.014804 18746 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.015811 18779 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:45.020776 18779 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.021126 18779 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.029579 18724 tablet_bootstrap.cc:654] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.017465 18729 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:45.035903 18722 raft_consensus.cc:359] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.036640 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:45.037772 18746 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:45.037937 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:45.036659 18722 raft_consensus.cc:385] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.039831 18722 raft_consensus.cc:740] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.040752 18722 consensus_queue.cc:260] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.041642 18902 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:45.043119 18722 ts_tablet_manager.cc:1434] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 12:21:45.042408 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:45.044538 18722 tablet_bootstrap.cc:492] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
W20260709 12:21:45.050501 18572 leader_election.cc:343] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.053669 18898 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.054221 18898 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.056586 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:21:45.057854 18644 leader_election.cc:343] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:45.059592 18646 leader_election.cc:343] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.060472 18646 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:45.061512 18898 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:45.062026 18727 raft_consensus.cc:2749] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:45.063098 18888 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.063597 18888 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.065987 18888 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:21:45.069806 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 66149us
I20260709 12:21:45.070283 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:45.071985 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:45.072650 18680 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:45.069936 18842 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.072793 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:45.076066 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:21:45.078267 18729 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.077708 18888 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:45.079044 18888 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.077124 18842 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.078480 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:21:45.079224 18644 leader_election.cc:343] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.075064 18779 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.078835 18729 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.080188 18677 raft_consensus.cc:2393] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 1: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:21:45.082121 18842 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:45.082846 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:45.083062 18729 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:45.084972 18779 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:45.085594 18779 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:45.086666 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:45.087280 18528 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.088196 18570 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:45.088423 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:45.089062 18677 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
W20260709 12:21:45.089394 18570 leader_election.cc:343] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.089844 18570 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:45.090615 18930 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.091087 18570 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:45.079427 18888 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.093744 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:45.095021 18902 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:45.095194 18779 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:45.097165 18902 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.097561 18902 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.098202 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:21:45.094988 18646 leader_election.cc:343] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.099293 18646 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:45.099406 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:45.100095 18727 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:45.100090 18677 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:45.102155 18494 leader_election.cc:343] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.111063 18722 tablet_bootstrap.cc:654] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.106171 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:45.113569 18721 tablet_bootstrap.cc:492] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:45.113971 18721 ts_tablet_manager.cc:1403] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.135s	user 0.025s	sys 0.029s
I20260709 12:21:45.117295 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:45.118525 18678 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:45.121325 18528 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:45.122632 18930 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:45.125097 18888 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.127408 18888 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:45.128281 18494 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:45.130308 18724 tablet_bootstrap.cc:492] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:45.130769 18724 ts_tablet_manager.cc:1403] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.137s	user 0.019s	sys 0.000s
I20260709 12:21:45.130687 18605 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:21:45.131475 18842 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:45.134446 18842 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.134742 18780 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:45.135794 18842 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.129356 18680 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:21:45.138563 18783 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:45.135972 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:45.136394 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:45.141479 18678 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.141525 18677 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:45.138950 18527 raft_consensus.cc:2393] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 1: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:21:45.143397 18783 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:45.142329 18724 raft_consensus.cc:359] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.145699 18724 raft_consensus.cc:385] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.145984 18724 raft_consensus.cc:740] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.146871 18724 consensus_queue.cc:260] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.148002 18570 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:45.151284 18724 ts_tablet_manager.cc:1434] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260709 12:21:45.152307 18724 tablet_bootstrap.cc:492] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:45.158947 18930 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:45.159521 18930 raft_consensus.cc:697] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:21:45.159629 18902 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.160838 18930 consensus_queue.cc:237] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.162120 18721 raft_consensus.cc:359] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.162817 18721 raft_consensus.cc:385] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.163117 18721 raft_consensus.cc:740] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.163271 18603 raft_consensus.cc:2393] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 1: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:21:45.165397 18721 consensus_queue.cc:260] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.162369 18902 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:45.175938 18721 ts_tablet_manager.cc:1434] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 12:21:45.180991 18721 tablet_bootstrap.cc:492] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:45.185330 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:45.201623 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:45.204725 18527 raft_consensus.cc:2393] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 1: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:21:45.190616 18783 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:21:45.216434 18934 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.217195 18934 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.229554 18934 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:45.232446 18721 tablet_bootstrap.cc:654] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.209483 18779 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:21:45.234699 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:45.241123 18603 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:45.223893 18572 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:45.244418 18779 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:45.245792 18494 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:45.247656 18780 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:45.247767 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:45.246371 18783 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:45.249790 18724 tablet_bootstrap.cc:654] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.260502 18425 catalog_manager.cc:5697] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:45.219678 18678 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:45.248229 18780 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:45.271227 18937 log.cc:927] Time spent T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:21:45.274902 18494 leader_election.cc:343] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.278025 18722 tablet_bootstrap.cc:492] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:45.278505 18722 ts_tablet_manager.cc:1403] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.234s	user 0.010s	sys 0.012s
I20260709 12:21:45.283097 18842 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.273113 18780 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.285528 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:45.295946 18888 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:45.296504 18888 raft_consensus.cc:697] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:45.297533 18888 consensus_queue.cc:237] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.305768 18842 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:45.292160 18940 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 12:21:45.327860 18727 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:45.343724 18780 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.348253 18902 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.354806 18902 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.362660 18902 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:45.364306 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:45.371671 18722 raft_consensus.cc:359] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.372977 18722 raft_consensus.cc:385] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.373462 18722 raft_consensus.cc:740] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.374548 18722 consensus_queue.cc:260] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.379520 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:45.380250 18674 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:45.377651 18527 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:45.384927 18779 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.385129 18570 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:45.385474 18779 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.387379 18933 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:45.389351 18779 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:45.391424 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:21:45.393479 18572 leader_election.cc:343] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.391295 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:45.394254 18721 tablet_bootstrap.cc:492] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:45.394497 18674 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:45.394869 18721 ts_tablet_manager.cc:1403] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.217s	user 0.016s	sys 0.006s
I20260709 12:21:45.395918 18570 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:21:45.398620 18724 tablet_bootstrap.cc:492] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:45.400105 18724 ts_tablet_manager.cc:1403] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.248s	user 0.016s	sys 0.017s
I20260709 12:21:45.400534 18779 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:45.416002 18779 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.416414 18779 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.417989 18724 raft_consensus.cc:359] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.418711 18724 raft_consensus.cc:385] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.418983 18724 raft_consensus.cc:740] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.419621 18724 consensus_queue.cc:260] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.402583 18780 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:45.387900 18933 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.407717 18722 ts_tablet_manager.cc:1434] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.129s	user 0.000s	sys 0.009s
I20260709 12:21:45.398813 18721 raft_consensus.cc:359] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.421118 18721 raft_consensus.cc:385] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.421487 18721 raft_consensus.cc:740] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.421826 18724 ts_tablet_manager.cc:1434] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:21:45.422844 18724 tablet_bootstrap.cc:492] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:45.422338 18721 consensus_queue.cc:260] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.420632 18933 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.426683 18779 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.429800 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:21:45.432076 18572 leader_election.cc:343] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.434800 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:45.435567 18680 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.437922 18721 ts_tablet_manager.cc:1434] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.003s
I20260709 12:21:45.439178 18721 tablet_bootstrap.cc:492] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:45.440418 18722 tablet_bootstrap.cc:492] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:45.443013 18680 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:45.443506 18779 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:45.445097 18570 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:21:45.446655 18779 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:45.448091 18779 raft_consensus.cc:697] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:21:45.449429 18779 consensus_queue.cc:237] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:45.453089 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 167635us
I20260709 12:21:45.457028 18528 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.460433 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:45.461117 18601 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.461067 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:45.467514 18425 catalog_manager.cc:5697] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:45.473006 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:45.510094 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:21:45.518406 18494 leader_election.cc:343] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.510814 18677 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:45.523162 18494 leader_election.cc:343] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.533272 18601 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:45.538801 18942 consensus_queue.cc:1048] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:21:45.540666 18677 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:45.536268 18494 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:45.549906 18942 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:45.550473 18942 raft_consensus.cc:697] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:45.551292 18942 consensus_queue.cc:237] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.554497 18954 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.555037 18954 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.547529 18933 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.564589 18954 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:45.566586 18727 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:45.568598 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:45.569221 18528 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.569846 18722 tablet_bootstrap.cc:654] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.573477 18724 tablet_bootstrap.cc:654] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.576476 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:45.577144 18679 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.578505 18933 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:45.582655 18494 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:45.583555 18605 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.584007 18942 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:45.585026 18942 raft_consensus.cc:697] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:45.586428 18942 consensus_queue.cc:237] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.589370 18528 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:45.591377 18572 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:45.593384 18933 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:45.593864 18933 raft_consensus.cc:697] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:21:45.591377 18679 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:45.594718 18933 consensus_queue.cc:237] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.600932 18721 tablet_bootstrap.cc:654] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.601621 18935 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:45.605576 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:45.605683 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:45.604581 18942 consensus_queue.cc:1048] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:21:45.617594 18425 catalog_manager.cc:5697] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:45.634418 18494 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:45.639142 18935 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:45.650663 18424 catalog_manager.cc:5697] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:45.652510 18424 catalog_manager.cc:5697] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:45.658982 18722 tablet_bootstrap.cc:492] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:45.666281 18722 ts_tablet_manager.cc:1403] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.226s	user 0.010s	sys 0.010s
I20260709 12:21:45.679509 18722 raft_consensus.cc:359] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.681794 18722 raft_consensus.cc:385] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.682525 18722 raft_consensus.cc:740] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.683569 18722 consensus_queue.cc:260] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.683993 18727 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.688110 18727 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.688726 18722 ts_tablet_manager.cc:1434] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:21:45.690873 18727 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:45.692600 18722 tablet_bootstrap.cc:492] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:45.693684 18949 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:45.689785 18426 catalog_manager.cc:5697] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:45.699589 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:21:45.701570 18644 leader_election.cc:343] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.702587 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:45.703651 18721 tablet_bootstrap.cc:492] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:45.704455 18721 ts_tablet_manager.cc:1403] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.266s	user 0.016s	sys 0.013s
W20260709 12:21:45.706538 18646 leader_election.cc:343] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.707015 18646 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:45.708647 18721 raft_consensus.cc:359] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.709548 18721 raft_consensus.cc:385] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.709786 18722 tablet_bootstrap.cc:654] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.709725 18746 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:45.709977 18721 raft_consensus.cc:740] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.711189 18721 consensus_queue.cc:260] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.714323 18721 ts_tablet_manager.cc:1434] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:21:45.715464 18724 tablet_bootstrap.cc:492] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:45.715564 18721 tablet_bootstrap.cc:492] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:45.716017 18724 ts_tablet_manager.cc:1403] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.293s	user 0.017s	sys 0.034s
I20260709 12:21:45.723769 18721 tablet_bootstrap.cc:654] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.725646 18722 tablet_bootstrap.cc:492] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:45.726893 18722 ts_tablet_manager.cc:1403] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.007s
I20260709 12:21:45.727787 18724 raft_consensus.cc:359] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.728683 18724 raft_consensus.cc:385] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.728987 18724 raft_consensus.cc:740] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.729868 18722 raft_consensus.cc:359] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.730032 18724 consensus_queue.cc:260] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.730625 18722 raft_consensus.cc:385] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.730953 18722 raft_consensus.cc:740] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.731835 18722 consensus_queue.cc:260] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.732726 18724 ts_tablet_manager.cc:1434] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:21:45.734052 18724 tablet_bootstrap.cc:492] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:45.734696 18722 ts_tablet_manager.cc:1434] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:21:45.735580 18722 tablet_bootstrap.cc:492] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:45.741365 18722 tablet_bootstrap.cc:654] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.744355 18724 tablet_bootstrap.cc:654] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.754454 18722 tablet_bootstrap.cc:492] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:45.755079 18722 ts_tablet_manager.cc:1403] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.007s
I20260709 12:21:45.758262 18722 raft_consensus.cc:359] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.758952 18722 raft_consensus.cc:385] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.759212 18722 raft_consensus.cc:740] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.761327 18721 tablet_bootstrap.cc:492] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:45.761807 18721 ts_tablet_manager.cc:1403] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.046s	user 0.006s	sys 0.010s
I20260709 12:21:45.764781 18721 raft_consensus.cc:359] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.765826 18721 raft_consensus.cc:385] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.766254 18721 raft_consensus.cc:740] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.768222 18722 consensus_queue.cc:260] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.770896 18722 ts_tablet_manager.cc:1434] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:21:45.772351 18722 tablet_bootstrap.cc:492] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:45.766939 18721 consensus_queue.cc:260] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.778118 18721 ts_tablet_manager.cc:1434] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:21:45.778755 18722 tablet_bootstrap.cc:654] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.779640 18721 tablet_bootstrap.cc:492] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
W20260709 12:21:45.780926 18475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:45.790810 18722 tablet_bootstrap.cc:492] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:45.791849 18721 tablet_bootstrap.cc:654] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.792461 18722 ts_tablet_manager.cc:1403] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.021s	user 0.004s	sys 0.014s
I20260709 12:21:45.795437 18722 raft_consensus.cc:359] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.796192 18722 raft_consensus.cc:385] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.796425 18724 tablet_bootstrap.cc:492] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:45.796439 18722 raft_consensus.cc:740] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.797225 18724 ts_tablet_manager.cc:1403] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.063s	user 0.016s	sys 0.002s
I20260709 12:21:45.797406 18722 consensus_queue.cc:260] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.799679 18722 ts_tablet_manager.cc:1434] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:21:45.800155 18724 raft_consensus.cc:359] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.800839 18724 raft_consensus.cc:385] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.800941 18722 tablet_bootstrap.cc:492] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:45.801128 18724 raft_consensus.cc:740] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.801900 18724 consensus_queue.cc:260] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.807698 18722 tablet_bootstrap.cc:654] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.809489 18724 ts_tablet_manager.cc:1434] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:21:45.810820 18724 tablet_bootstrap.cc:492] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:45.815099 18721 tablet_bootstrap.cc:492] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:45.815676 18721 ts_tablet_manager.cc:1403] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.010s
I20260709 12:21:45.818074 18724 tablet_bootstrap.cc:654] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.820006 18949 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.820593 18722 tablet_bootstrap.cc:492] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:45.821064 18722 ts_tablet_manager.cc:1403] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:21:45.820502 18949 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.823489 18949 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:45.823653 18722 raft_consensus.cc:359] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.824553 18722 raft_consensus.cc:385] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.818365 18721 raft_consensus.cc:359] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.825170 18721 raft_consensus.cc:385] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.825567 18721 raft_consensus.cc:740] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.826646 18746 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.826601 18721 consensus_queue.cc:260] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.824819 18722 raft_consensus.cc:740] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.827255 18746 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.828552 18722 consensus_queue.cc:260] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.830637 18724 tablet_bootstrap.cc:492] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:45.831159 18724 ts_tablet_manager.cc:1403] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.006s
I20260709 12:21:45.831583 18722 ts_tablet_manager.cc:1434] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:21:45.830281 18746 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:45.832566 18722 tablet_bootstrap.cc:492] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:45.833853 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:45.834281 18724 raft_consensus.cc:359] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.835165 18724 raft_consensus.cc:385] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:21:45.835186 18644 leader_election.cc:343] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.835738 18724 raft_consensus.cc:740] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.836443 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:45.836553 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:45.837147 18676 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:45.837945 18721 ts_tablet_manager.cc:1434] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.002s
I20260709 12:21:45.838912 18721 tablet_bootstrap.cc:492] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:45.842247 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:45.842923 18527 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:45.841740 18724 consensus_queue.cc:260] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.844859 18727 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.845332 18727 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.846027 18721 tablet_bootstrap.cc:654] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.846236 18724 ts_tablet_manager.cc:1434] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:21:45.847332 18724 tablet_bootstrap.cc:492] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:45.850419 18727 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:45.854377 18722 tablet_bootstrap.cc:654] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.855434 18494 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:21:45.856041 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:45.856693 18601 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:45.857290 18949 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:45.857712 18949 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.858110 18949 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.863977 18644 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:45.865801 18750 raft_consensus.cc:2804] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:45.854387 18724 tablet_bootstrap.cc:654] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.866276 18750 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.866680 18750 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.875406 18949 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.877612 18949 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:45.881299 18721 tablet_bootstrap.cc:492] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:45.888321 18721 ts_tablet_manager.cc:1403] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.021s
I20260709 12:21:45.889777 18746 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.890331 18746 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:45.856748 18494 leader_election.cc:343] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.892427 18721 raft_consensus.cc:359] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.893508 18721 raft_consensus.cc:385] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.893357 18949 consensus_queue.cc:1048] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:45.893901 18721 raft_consensus.cc:740] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.894608 18721 consensus_queue.cc:260] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.896966 18721 ts_tablet_manager.cc:1434] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:21:45.897955 18721 tablet_bootstrap.cc:492] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:45.903434 18646 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:45.904160 18721 tablet_bootstrap.cc:654] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.904706 18727 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:45.905119 18727 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.905514 18727 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.922823 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:45.926556 18746 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:45.927661 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:45.930797 18605 raft_consensus.cc:2393] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 1: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:21:45.934489 18750 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.937731 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:45.979596 18724 tablet_bootstrap.cc:492] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:45.980481 18724 ts_tablet_manager.cc:1403] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.134s	user 0.034s	sys 0.050s
I20260709 12:21:45.983204 18724 raft_consensus.cc:359] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.983937 18724 raft_consensus.cc:385] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.984206 18724 raft_consensus.cc:740] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.984974 18724 consensus_queue.cc:260] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:45.986582 18724 ts_tablet_manager.cc:1434] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:21:45.987493 18724 tablet_bootstrap.cc:492] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:45.991180 18530 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.993672 18750 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:45.994771 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:45.995560 18527 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:46.000226 18724 tablet_bootstrap.cc:654] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.003739 18935 consensus_queue.cc:1048] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:46.006031 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:46.015892 18750 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.016616 18750 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:46.021683 18494 leader_election.cc:343] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.999208 18727 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.023770 18676 raft_consensus.cc:2393] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 1: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:21:46.029064 18727 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:46.032539 18722 tablet_bootstrap.cc:492] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:46.019397 18750 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:46.033069 18722 ts_tablet_manager.cc:1403] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.201s	user 0.036s	sys 0.091s
I20260709 12:21:46.034403 18494 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:46.036222 18942 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:46.037768 18604 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.061353 18783 consensus_queue.cc:1048] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:21:46.066413 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:46.061501 18842 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:21:46.067049 18530 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.072441 18722 raft_consensus.cc:359] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.073099 18721 tablet_bootstrap.cc:492] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:46.073714 18721 ts_tablet_manager.cc:1403] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.176s	user 0.071s	sys 0.042s
I20260709 12:21:46.073408 18722 raft_consensus.cc:385] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.074234 18722 raft_consensus.cc:740] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.074916 18722 consensus_queue.cc:260] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.076475 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:46.077359 18529 raft_consensus.cc:2393] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 1: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:21:46.078867 18722 ts_tablet_manager.cc:1434] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 12:21:46.079936 18842 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.081108 18722 tablet_bootstrap.cc:492] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:46.080420 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:46.083133 18954 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:21:46.061015 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 97880.5us
I20260709 12:21:46.080435 18842 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.086969 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:46.087374 18530 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:46.087605 18601 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.088131 18842 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:46.088290 18646 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:46.092710 18982 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.092912 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:46.093433 18601 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:46.093572 18606 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:46.095253 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:46.090905 18721 raft_consensus.cc:359] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.099538 18721 raft_consensus.cc:385] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.099836 18721 raft_consensus.cc:740] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.102262 18721 consensus_queue.cc:260] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:46.102504 18494 leader_election.cc:343] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:46.106812 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:46.115696 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:46.118476 18678 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:46.108114 18982 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:46.119799 18724 tablet_bootstrap.cc:492] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:46.120393 18724 ts_tablet_manager.cc:1403] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.133s	user 0.033s	sys 0.003s
I20260709 12:21:46.122097 18721 ts_tablet_manager.cc:1434] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 12:21:46.123540 18729 consensus_queue.cc:1048] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:46.124631 18494 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:46.126389 18986 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:46.126925 18986 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.127449 18986 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.128698 18721 tablet_bootstrap.cc:492] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:46.140075 18722 tablet_bootstrap.cc:654] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.145422 18724 raft_consensus.cc:359] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:46.146545 18646 leader_election.cc:343] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:46.108583 18842 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:21:46.149482 18724 raft_consensus.cc:385] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.153235 18724 raft_consensus.cc:740] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.154251 18724 consensus_queue.cc:260] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.163550 18646 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:21:46.166014 18983 raft_consensus.cc:2804] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:46.166774 18983 raft_consensus.cc:697] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:21:46.165855 18986 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.171162 18750 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.172359 18933 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.171921 18750 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.175660 18933 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.179544 18724 ts_tablet_manager.cc:1434] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.001s
I20260709 12:21:46.180477 18724 tablet_bootstrap.cc:492] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:46.182039 18721 tablet_bootstrap.cc:654] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.184065 18933 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:46.186084 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:46.168800 18983 consensus_queue.cc:237] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.190724 18750 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:46.191982 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:46.192549 18935 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:46.196712 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:21:46.197139 18646 leader_election.cc:343] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:46.198177 18572 leader_election.cc:343] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:46.198217 18676 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:46.204244 18644 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:21:46.205943 18986 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:46.207140 18750 raft_consensus.cc:2804] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:46.211701 18842 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:46.212699 18570 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:21:46.207866 18750 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.214049 18750 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:46.220964 18644 leader_election.cc:343] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:46.221582 18644 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:46.229665 18992 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:46.228204 18935 raft_consensus.cc:2804] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:46.228912 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:46.241484 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:46.230794 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:46.248634 18605 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.258332 18750 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:46.255426 18644 leader_election.cc:343] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:46.237007 18935 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.245831 18679 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.260161 18644 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:46.286262 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:46.261734 18935 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.291188 18724 tablet_bootstrap.cc:654] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.291512 18983 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:46.271904 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 59283.2us
I20260709 12:21:46.316900 18942 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.343977 18996 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.344502 18942 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.344609 18996 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:46.350523 18646 leader_election.cc:343] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:46.377291 18992 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.380035 18750 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:46.397622 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:46.398273 18601 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.390235 18992 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.402060 18992 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:46.393378 18729 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
W20260709 12:21:46.405746 18995 log.cc:927] Time spent T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:21:46.405882 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:46.406585 18600 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:46.410626 18494 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:46.413548 18721 tablet_bootstrap.cc:492] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:46.413746 18949 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:46.414072 18721 ts_tablet_manager.cc:1403] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.288s	user 0.014s	sys 0.012s
I20260709 12:21:46.414117 18949 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.414526 18949 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.421989 18996 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:46.424865 18942 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:46.425242 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:46.427374 18601 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:46.428309 18722 tablet_bootstrap.cc:492] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:46.428913 18722 ts_tablet_manager.cc:1403] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.348s	user 0.030s	sys 0.051s
I20260709 12:21:46.431466 18679 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:46.438205 18426 catalog_manager.cc:5697] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:46.437506 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:46.437577 18721 raft_consensus.cc:359] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.466194 18721 raft_consensus.cc:385] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.466533 18721 raft_consensus.cc:740] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.453362 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:46.467204 18721 consensus_queue.cc:260] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.467712 18676 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:46.473678 18494 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:21:46.478591 18724 tablet_bootstrap.cc:492] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:46.479100 18724 ts_tablet_manager.cc:1403] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.299s	user 0.010s	sys 0.017s
I20260709 12:21:46.475931 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:46.486317 18949 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.446485 18644 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:21:46.489863 18983 raft_consensus.cc:2804] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:21:46.489988 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 43645.5us
I20260709 12:21:46.490356 18983 raft_consensus.cc:697] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:21:46.490763 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:46.491416 18983 consensus_queue.cc:237] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.492208 18528 raft_consensus.cc:2393] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 1: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:21:46.494407 18722 raft_consensus.cc:359] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.488986 18724 raft_consensus.cc:359] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.495524 18722 raft_consensus.cc:385] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.495934 18724 raft_consensus.cc:385] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.496004 18722 raft_consensus.cc:740] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.496414 18724 raft_consensus.cc:740] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.497014 18722 consensus_queue.cc:260] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.498304 18721 ts_tablet_manager.cc:1434] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.000s
W20260709 12:21:46.491531 18644 leader_election.cc:343] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:46.499235 18721 tablet_bootstrap.cc:492] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:46.493448 18935 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.495208 18942 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:46.505376 18722 ts_tablet_manager.cc:1434] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.001s
I20260709 12:21:46.507292 18724 consensus_queue.cc:260] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.498482 18679 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:46.508685 18722 tablet_bootstrap.cc:492] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:46.510241 18935 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:46.518605 18949 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:46.510429 18724 ts_tablet_manager.cc:1434] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
W20260709 12:21:46.513595 18646 leader_election.cc:343] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:46.520233 18646 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:46.508522 18942 raft_consensus.cc:697] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:46.521907 18898 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:46.521550 18942 consensus_queue.cc:237] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.502027 18605 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:46.515009 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:46.525704 18724 tablet_bootstrap.cc:492] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:46.537019 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:46.537686 18605 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.537083 18570 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:21:46.542254 18722 tablet_bootstrap.cc:654] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:46.551967 18572 leader_election.cc:343] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:46.571738 18721 tablet_bootstrap.cc:654] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.580587 18605 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:46.581094 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:46.592725 18676 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.586490 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:46.596493 18679 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.599715 18676 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:46.590473 18724 tablet_bootstrap.cc:654] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.605723 18983 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.614718 18935 raft_consensus.cc:2764] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:21:46.606449 18983 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.618301 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:46.620553 18983 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:46.620219 18679 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
W20260709 12:21:46.621942 18646 leader_election.cc:343] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:46.621846 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:46.623708 18721 tablet_bootstrap.cc:492] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:46.624306 18494 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:21:46.625142 18644 leader_election.cc:343] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:46.625492 18644 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:46.625545 18721 ts_tablet_manager.cc:1403] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.127s	user 0.013s	sys 0.001s
I20260709 12:21:46.626427 18949 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:46.625810 18426 catalog_manager.cc:5697] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:46.626818 18983 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:46.627358 18949 raft_consensus.cc:697] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:46.627503 18570 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:21:46.628731 18996 raft_consensus.cc:2804] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:46.628362 18949 consensus_queue.cc:237] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.629626 18996 raft_consensus.cc:697] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:21:46.633399 18722 tablet_bootstrap.cc:492] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:46.633847 18722 ts_tablet_manager.cc:1403] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.127s	user 0.016s	sys 0.004s
I20260709 12:21:46.633949 18996 consensus_queue.cc:237] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.636601 18722 raft_consensus.cc:359] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.637295 18722 raft_consensus.cc:385] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.631155 18721 raft_consensus.cc:359] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.641542 18721 raft_consensus.cc:385] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.641870 18721 raft_consensus.cc:740] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.632085 18724 tablet_bootstrap.cc:492] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:46.642736 18724 ts_tablet_manager.cc:1403] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.122s	user 0.013s	sys 0.016s
I20260709 12:21:46.645795 18721 consensus_queue.cc:260] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.648205 18721 ts_tablet_manager.cc:1434] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:21:46.648077 18724 raft_consensus.cc:359] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.649088 18724 raft_consensus.cc:385] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.649526 18724 raft_consensus.cc:740] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.650612 18724 consensus_queue.cc:260] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.655526 18722 raft_consensus.cc:740] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.657584 18722 consensus_queue.cc:260] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.659509 18724 ts_tablet_manager.cc:1434] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:21:46.655072 18983 consensus_queue.cc:1048] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:46.659789 18722 ts_tablet_manager.cc:1434] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 12:21:46.655290 18721 tablet_bootstrap.cc:492] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:46.660984 18722 tablet_bootstrap.cc:492] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:46.662681 18724 tablet_bootstrap.cc:492] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:46.655495 18425 catalog_manager.cc:5697] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:46.676214 18724 tablet_bootstrap.cc:654] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.678041 18722 tablet_bootstrap.cc:654] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.677821 18996 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.677778 18721 tablet_bootstrap.cc:654] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.678479 18996 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.680745 18996 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:46.681389 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:46.682752 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:21:46.685300 18572 leader_election.cc:343] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:46.684530 18424 catalog_manager.cc:5697] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:46.685832 18570 leader_election.cc:343] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:46.686455 18983 consensus_queue.cc:1048] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:46.686630 18570 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:46.688104 18996 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:46.731264 18721 tablet_bootstrap.cc:492] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:46.731905 18721 ts_tablet_manager.cc:1403] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.019s
I20260709 12:21:46.727097 18426 catalog_manager.cc:5697] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:46.738499 18721 raft_consensus.cc:359] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.740831 18721 raft_consensus.cc:385] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.741202 18721 raft_consensus.cc:740] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.741954 18721 consensus_queue.cc:260] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.739670 18724 tablet_bootstrap.cc:492] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:46.743014 18724 ts_tablet_manager.cc:1403] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.081s	user 0.022s	sys 0.009s
I20260709 12:21:46.744410 18721 ts_tablet_manager.cc:1434] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 12:21:46.745627 18721 tablet_bootstrap.cc:492] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:46.747313 18724 raft_consensus.cc:359] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.748139 18724 raft_consensus.cc:385] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.748458 18724 raft_consensus.cc:740] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.749359 18722 tablet_bootstrap.cc:492] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:46.749217 18724 consensus_queue.cc:260] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.750067 18722 ts_tablet_manager.cc:1403] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.089s	user 0.019s	sys 0.011s
I20260709 12:21:46.752167 18724 ts_tablet_manager.cc:1434] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:21:46.752802 18721 tablet_bootstrap.cc:654] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.753257 18724 tablet_bootstrap.cc:492] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:46.753149 18722 raft_consensus.cc:359] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.753995 18722 raft_consensus.cc:385] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.754441 18722 raft_consensus.cc:740] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.755462 18722 consensus_queue.cc:260] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.759076 18722 ts_tablet_manager.cc:1434] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:21:46.760082 18722 tablet_bootstrap.cc:492] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:46.760862 18724 tablet_bootstrap.cc:654] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.771579 18722 tablet_bootstrap.cc:654] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.776683 18724 tablet_bootstrap.cc:492] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:46.777834 18724 ts_tablet_manager.cc:1403] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.000s
I20260709 12:21:46.780076 18722 tablet_bootstrap.cc:492] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:46.780565 18722 ts_tablet_manager.cc:1403] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.005s
I20260709 12:21:46.780937 18724 raft_consensus.cc:359] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.781611 18724 raft_consensus.cc:385] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.781867 18724 raft_consensus.cc:740] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.782902 18724 consensus_queue.cc:260] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.785069 18721 tablet_bootstrap.cc:492] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:46.785518 18721 ts_tablet_manager.cc:1403] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.011s
I20260709 12:21:46.784888 18722 raft_consensus.cc:359] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.786494 18722 raft_consensus.cc:385] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.786758 18722 raft_consensus.cc:740] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.787039 18724 ts_tablet_manager.cc:1434] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:21:46.788172 18724 tablet_bootstrap.cc:492] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:46.787443 18722 consensus_queue.cc:260] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.788239 18721 raft_consensus.cc:359] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.788968 18721 raft_consensus.cc:385] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.789486 18721 raft_consensus.cc:740] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.790740 18722 ts_tablet_manager.cc:1434] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:21:46.790405 18721 consensus_queue.cc:260] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.791795 18722 tablet_bootstrap.cc:492] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:46.795256 18724 tablet_bootstrap.cc:654] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.797912 18721 ts_tablet_manager.cc:1434] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:21:46.799803 18722 tablet_bootstrap.cc:654] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.798884 18721 tablet_bootstrap.cc:492] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:46.806402 18727 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.807309 18727 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.811515 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:46.812716 18727 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:21:46.813987 18646 leader_election.cc:343] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:46.819842 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:21:46.821509 18644 leader_election.cc:343] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:46.821961 18644 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:46.822947 18983 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:46.839723 18721 tablet_bootstrap.cc:654] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.846444 18722 tablet_bootstrap.cc:492] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:46.846828 18722 ts_tablet_manager.cc:1403] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.015s
I20260709 12:21:46.849648 18721 tablet_bootstrap.cc:492] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:46.849670 18722 raft_consensus.cc:359] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.850244 18721 ts_tablet_manager.cc:1403] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.002s
I20260709 12:21:46.850495 18722 raft_consensus.cc:385] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.850762 18722 raft_consensus.cc:740] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.851686 18722 consensus_queue.cc:260] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.854209 18721 raft_consensus.cc:359] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.854775 18722 ts_tablet_manager.cc:1434] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:21:46.854947 18721 raft_consensus.cc:385] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.855204 18721 raft_consensus.cc:740] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.855872 18722 tablet_bootstrap.cc:492] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:46.855872 18721 consensus_queue.cc:260] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.857143 18724 tablet_bootstrap.cc:492] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:46.858088 18724 ts_tablet_manager.cc:1403] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.015s
I20260709 12:21:46.860692 18724 raft_consensus.cc:359] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.861338 18724 raft_consensus.cc:385] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.862124 18722 tablet_bootstrap.cc:654] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.861629 18724 raft_consensus.cc:740] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.881193 18721 ts_tablet_manager.cc:1434] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.031s	user 0.021s	sys 0.005s
I20260709 12:21:46.882616 18721 tablet_bootstrap.cc:492] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:46.883219 18724 consensus_queue.cc:260] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.891701 18727 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.892402 18727 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.896634 18724 ts_tablet_manager.cc:1434] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 12:21:46.901597 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:46.902726 18724 tablet_bootstrap.cc:492] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:46.903978 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:21:46.904666 18644 leader_election.cc:343] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:46.906133 18646 leader_election.cc:343] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:46.906466 18727 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:46.906569 18646 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:46.907624 18727 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:46.908600 18721 tablet_bootstrap.cc:654] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.909534 18724 tablet_bootstrap.cc:654] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.918505 18722 tablet_bootstrap.cc:492] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:46.919297 18721 tablet_bootstrap.cc:492] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:46.919904 18721 ts_tablet_manager.cc:1403] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.001s
W20260709 12:21:46.921370 18475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:46.922617 18721 raft_consensus.cc:359] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.923319 18721 raft_consensus.cc:385] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.923568 18721 raft_consensus.cc:740] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.924186 18722 ts_tablet_manager.cc:1403] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.021s
I20260709 12:21:46.926852 18949 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.927979 18724 tablet_bootstrap.cc:492] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:46.927470 18949 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.928470 18724 ts_tablet_manager.cc:1403] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 12:21:46.924254 18721 consensus_queue.cc:260] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.928851 18722 raft_consensus.cc:359] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.929551 18722 raft_consensus.cc:385] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.929831 18722 raft_consensus.cc:740] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.930845 18721 ts_tablet_manager.cc:1434] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:21:46.930642 18722 consensus_queue.cc:260] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.931057 18724 raft_consensus.cc:359] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.931788 18724 raft_consensus.cc:385] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.932067 18724 raft_consensus.cc:740] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.933017 18722 ts_tablet_manager.cc:1434] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:21:46.932983 18724 consensus_queue.cc:260] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.933511 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:46.933990 18842 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.934464 18842 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.934942 18722 tablet_bootstrap.cc:492] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:46.935510 18724 ts_tablet_manager.cc:1434] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260709 12:21:46.934971 18494 leader_election.cc:343] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:46.936522 18842 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:46.938702 18529 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.938570 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:46.939306 18679 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:46.939495 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:46.940888 18727 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.941390 18727 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.941735 18935 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.942431 18935 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.943372 18727 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:46.944288 18722 tablet_bootstrap.cc:654] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.944480 18935 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:46.944852 18494 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:46.946112 18986 raft_consensus.cc:2804] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:46.946483 18986 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.946820 18986 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.949653 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:46.952085 18724 tablet_bootstrap.cc:492] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:46.951994 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:46.953162 18603 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:46.955202 18644 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:46.958570 18727 raft_consensus.cc:2804] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:46.959059 18724 tablet_bootstrap.cc:654] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.960474 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:46.961292 18605 raft_consensus.cc:2393] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 1: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:21:46.963439 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:46.964537 18680 raft_consensus.cc:2393] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 1: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:21:46.959086 18727 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.976884 18727 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.970623 18724 tablet_bootstrap.cc:492] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:46.980139 18724 ts_tablet_manager.cc:1403] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.005s
I20260709 12:21:46.937422 18949 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:46.983640 18727 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:46.985491 18646 leader_election.cc:343] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:46.986681 18494 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:46.985651 18727 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:46.988509 18954 raft_consensus.cc:2749] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:46.987392 18898 consensus_queue.cc:1048] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:21:46.991545 18724 raft_consensus.cc:359] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.974844 18721 tablet_bootstrap.cc:492] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:46.975579 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:47.004330 18529 raft_consensus.cc:2393] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 1: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:21:46.973507 18986 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:46.995509 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:47.004670 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:47.006222 18572 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:47.007053 18986 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:47.010324 18935 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.007148 18724 raft_consensus.cc:385] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.011247 18724 raft_consensus.cc:740] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.007918 18721 tablet_bootstrap.cc:654] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.015023 18724 consensus_queue.cc:260] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.017155 18724 ts_tablet_manager.cc:1434] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 12:21:47.017426 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:47.018045 18724 tablet_bootstrap.cc:492] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:47.018113 18680 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:47.025666 18646 leader_election.cc:343] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.017177 18722 tablet_bootstrap.cc:492] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:47.031418 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:47.036928 18605 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.037163 18722 ts_tablet_manager.cc:1403] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.102s	user 0.038s	sys 0.030s
I20260709 12:21:47.042719 18722 raft_consensus.cc:359] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.043321 18605 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:47.043581 18722 raft_consensus.cc:385] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.044101 18722 raft_consensus.cc:740] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.044973 18680 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:47.044909 18722 consensus_queue.cc:260] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.009096 18603 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.036341 18721 tablet_bootstrap.cc:492] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:47.045464 18898 consensus_queue.cc:1048] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:47.046135 18721 ts_tablet_manager.cc:1403] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.072s	user 0.005s	sys 0.007s
I20260709 12:21:47.047560 18722 ts_tablet_manager.cc:1434] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:21:47.048660 18722 tablet_bootstrap.cc:492] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:47.032904 18935 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:47.050415 18996 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.050786 18721 raft_consensus.cc:359] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.050872 18996 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.051577 18721 raft_consensus.cc:385] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.051960 18721 raft_consensus.cc:740] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.052690 18721 consensus_queue.cc:260] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.054644 18603 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:47.054989 18721 ts_tablet_manager.cc:1434] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:21:47.054831 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:47.055727 18722 tablet_bootstrap.cc:654] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.055987 18721 tablet_bootstrap.cc:492] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:47.055538 18679 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:47.057670 18570 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:47.045394 18724 tablet_bootstrap.cc:654] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.058377 19005 raft_consensus.cc:2804] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:47.058756 19005 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.059115 19005 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.061714 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:47.062387 18527 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:47.064508 18996 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:47.067839 18494 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:47.074783 18721 tablet_bootstrap.cc:654] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.076265 18842 raft_consensus.cc:2804] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:47.076810 18842 raft_consensus.cc:697] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:47.077646 18842 consensus_queue.cc:237] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.080003 18942 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:47.083634 18986 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.084452 18986 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.086592 18986 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:47.100103 18721 tablet_bootstrap.cc:492] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:47.100795 18721 ts_tablet_manager.cc:1403] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.000s
I20260709 12:21:47.103591 18644 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:21:47.107849 18898 raft_consensus.cc:2804] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:47.108639 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:47.109414 18898 raft_consensus.cc:697] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:21:47.110538 18898 consensus_queue.cc:237] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.114991 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:47.116051 18680 raft_consensus.cc:2393] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 1: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:21:47.118834 18942 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.119657 18942 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.122478 18942 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:47.123864 18935 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.124390 18935 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.127606 18935 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:47.127842 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:21:47.130174 18570 leader_election.cc:343] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.130239 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:47.131006 18529 raft_consensus.cc:2468] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:47.130864 19005 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.133020 18572 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:47.134509 18996 raft_consensus.cc:2804] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:47.134879 18996 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.135219 18996 raft_consensus.cc:3060] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.135859 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:47.136544 18680 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.140866 18983 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.141414 18983 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.142748 18996 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.144152 18983 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:47.145798 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:47.146663 18529 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.146915 18983 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.147455 18983 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.147511 18680 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:47.149906 18570 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:47.150411 18721 raft_consensus.cc:359] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.154105 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:47.154673 18721 raft_consensus.cc:385] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.154943 18529 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:47.155141 18721 raft_consensus.cc:740] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.156106 18721 consensus_queue.cc:260] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.158278 18530 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.167158 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:21:47.172051 18644 leader_election.cc:343] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.172878 19005 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:47.174088 19005 raft_consensus.cc:2804] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:47.176491 18935 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.176988 18935 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.177274 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:47.181475 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:47.189422 18724 tablet_bootstrap.cc:492] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:47.189339 19040 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:47.190315 18724 ts_tablet_manager.cc:1403] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.172s	user 0.018s	sys 0.009s
I20260709 12:21:47.190968 19040 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:47.175114 18983 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:47.194519 18996 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:47.194556 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:47.195710 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:47.158288 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:47.196627 18680 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:47.196125 18425 catalog_manager.cc:5697] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:47.174535 19005 raft_consensus.cc:697] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:21:47.196957 18494 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:21:47.197247 18570 leader_election.cc:343] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.196623 18721 ts_tablet_manager.cc:1434] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.000s
I20260709 12:21:47.200052 18721 tablet_bootstrap.cc:492] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
W20260709 12:21:47.200673 18644 leader_election.cc:343] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.197877 19005 consensus_queue.cc:237] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.200510 18954 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:47.216483 18721 tablet_bootstrap.cc:654] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.220475 18935 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:47.222438 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:47.223320 18527 raft_consensus.cc:3060] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.228608 18721 tablet_bootstrap.cc:492] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:47.228293 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:47.229218 18721 ts_tablet_manager.cc:1403] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.000s
I20260709 12:21:47.229633 18675 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
W20260709 12:21:47.201570 18494 leader_election.cc:343] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.204576 18842 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:47.232445 18570 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:47.233513 19041 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:47.233265 18721 raft_consensus.cc:359] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.234009 19041 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.234405 18721 raft_consensus.cc:385] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.234525 19041 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.234750 18721 raft_consensus.cc:740] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.212131 18724 raft_consensus.cc:359] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.235574 18724 raft_consensus.cc:385] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.235996 18724 raft_consensus.cc:740] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.236661 18494 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:47.236960 18724 consensus_queue.cc:260] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.241125 18721 consensus_queue.cc:260] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:47.243883 18646 leader_election.cc:343] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.249202 18724 ts_tablet_manager.cc:1434] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.058s	user 0.011s	sys 0.000s
I20260709 12:21:47.250214 18724 tablet_bootstrap.cc:492] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:47.250288 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:47.250734 18527 raft_consensus.cc:2468] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:47.249037 18646 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:47.261960 19042 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:47.262044 18646 leader_election.cc:343] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.241060 18842 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:47.263844 18842 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.264286 18842 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.255240 18721 ts_tablet_manager.cc:1434] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:21:47.266044 18646 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:47.268713 18425 catalog_manager.cc:5697] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:47.271256 18721 tablet_bootstrap.cc:492] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:47.292608 18572 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:47.300635 18722 tablet_bootstrap.cc:492] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:47.301323 18722 ts_tablet_manager.cc:1403] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.253s	user 0.069s	sys 0.070s
I20260709 12:21:47.289053 18983 raft_consensus.cc:2749] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:47.286669 18942 consensus_queue.cc:1048] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:21:47.296998 18996 raft_consensus.cc:2804] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:47.313359 18722 raft_consensus.cc:359] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.314230 18722 raft_consensus.cc:385] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:21:47.308923 18572 leader_election.cc:343] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.314517 18722 raft_consensus.cc:740] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.315337 18722 consensus_queue.cc:260] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.325676 18996 raft_consensus.cc:697] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:21:47.329918 18724 tablet_bootstrap.cc:654] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.334667 18722 ts_tablet_manager.cc:1434] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:21:47.338575 18722 tablet_bootstrap.cc:492] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
W20260709 12:21:47.339303 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 50927.1us
I20260709 12:21:47.342011 18942 consensus_queue.cc:1048] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:47.364673 18842 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.365770 19041 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.359144 18949 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.368026 18427 catalog_manager.cc:5697] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:47.381963 18842 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:47.385552 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:47.385891 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:47.386195 18675 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.379670 18949 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.390542 18949 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:47.391889 18983 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.392421 18983 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.393214 18750 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.393784 18750 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.394584 18983 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:47.398958 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:47.403126 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:47.355525 18996 consensus_queue.cc:237] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.410351 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:47.421185 18529 raft_consensus.cc:2393] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 1: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:21:47.398886 19049 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.403682 18527 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:47.425041 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:47.432821 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:47.433169 18603 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:47.434865 18646 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:21:47.428445 18750 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:47.442263 18721 tablet_bootstrap.cc:654] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.443648 18724 tablet_bootstrap.cc:492] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:47.444597 18724 ts_tablet_manager.cc:1403] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.195s	user 0.017s	sys 0.004s
I20260709 12:21:47.437739 18983 raft_consensus.cc:2804] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:47.426539 19049 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.449108 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:47.449340 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:47.450202 18603 raft_consensus.cc:2393] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 1: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:21:47.449139 18983 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.451606 18983 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.453361 19041 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:47.454572 18644 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:47.457520 18750 raft_consensus.cc:3060] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.466324 18494 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:47.468155 18942 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.470494 18722 tablet_bootstrap.cc:654] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.488620 18605 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.492689 18750 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:47.501173 19049 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:21:47.494779 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 65886.1us
I20260709 12:21:47.517449 18605 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:47.519035 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:47.519846 18679 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.499154 18983 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.536803 19050 consensus_queue.cc:1048] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:47.534935 18942 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:47.535101 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:47.528044 18675 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:47.539175 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:47.527498 18679 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:47.541687 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:47.542295 18527 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.542498 18604 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.527257 18983 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:47.544310 18494 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:21:47.558259 19050 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:47.558391 18949 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.558815 19050 raft_consensus.cc:697] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:47.558887 18949 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.559737 19050 consensus_queue.cc:237] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:47.521874 18572 leader_election.cc:343] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.543058 18724 raft_consensus.cc:359] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.549741 18677 raft_consensus.cc:2393] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 1: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:21:47.548951 18842 consensus_queue.cc:1048] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:47.570725 18724 raft_consensus.cc:385] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.572690 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:47.572986 18724 raft_consensus.cc:740] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.579680 18722 tablet_bootstrap.cc:492] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:47.580641 18722 ts_tablet_manager.cc:1403] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.245s	user 0.013s	sys 0.005s
I20260709 12:21:47.586258 18724 consensus_queue.cc:260] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.573813 18527 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:47.589445 18570 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:21:47.590730 18750 consensus_queue.cc:1048] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:47.595458 18646 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:21:47.602037 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:47.602730 19040 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:47.602985 18677 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:47.603322 19040 raft_consensus.cc:697] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:21:47.598681 18983 raft_consensus.cc:2804] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:47.605665 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:21:47.607060 18494 leader_election.cc:343] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.612630 18494 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:47.589498 18949 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:47.616117 18724 ts_tablet_manager.cc:1434] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.171s	user 0.009s	sys 0.000s
I20260709 12:21:47.604283 19040 consensus_queue.cc:237] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.618461 18724 tablet_bootstrap.cc:492] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:47.624776 18425 catalog_manager.cc:5697] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:47.643198 18572 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:47.644626 18996 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:47.621076 19050 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:47.655854 19050 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.658007 18724 tablet_bootstrap.cc:654] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.642802 18604 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:47.658020 19050 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.654572 18722 raft_consensus.cc:359] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.664683 18722 raft_consensus.cc:385] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.665076 18722 raft_consensus.cc:740] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.665940 18722 consensus_queue.cc:260] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.657605 18721 tablet_bootstrap.cc:492] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:47.668161 18721 ts_tablet_manager.cc:1403] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.397s	user 0.016s	sys 0.014s
I20260709 12:21:47.646152 18983 raft_consensus.cc:697] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:21:47.681766 19050 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.684610 18722 ts_tablet_manager.cc:1434] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.103s	user 0.005s	sys 0.002s
I20260709 12:21:47.685776 18722 tablet_bootstrap.cc:492] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:47.687840 18721 raft_consensus.cc:359] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.688728 18721 raft_consensus.cc:385] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.688303 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:47.689572 18721 raft_consensus.cc:740] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.690344 18721 consensus_queue.cc:260] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.675149 18983 consensus_queue.cc:237] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.691097 18427 catalog_manager.cc:5697] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:47.691890 18494 leader_election.cc:343] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.692761 18721 ts_tablet_manager.cc:1434] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 12:21:47.693861 18721 tablet_bootstrap.cc:492] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:47.697952 18724 tablet_bootstrap.cc:492] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:47.698722 18724 ts_tablet_manager.cc:1403] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.000s
I20260709 12:21:47.701658 18724 raft_consensus.cc:359] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.702472 18724 raft_consensus.cc:385] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.702920 18724 raft_consensus.cc:740] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.709585 19050 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:47.710700 18724 consensus_queue.cc:260] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.712459 18724 ts_tablet_manager.cc:1434] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:21:47.713393 18724 tablet_bootstrap.cc:492] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:47.717614 18722 tablet_bootstrap.cc:654] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.721287 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:47.722098 18677 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.724900 18721 tablet_bootstrap.cc:654] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.737035 18750 consensus_queue.cc:1048] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:47.739478 18724 tablet_bootstrap.cc:654] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.743569 18750 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.744692 18750 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.747063 18750 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:47.748616 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:21:47.750774 18644 leader_election.cc:343] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.753376 18724 tablet_bootstrap.cc:492] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:47.753928 18724 ts_tablet_manager.cc:1403] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.000s
I20260709 12:21:47.763721 18724 raft_consensus.cc:359] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.764496 18724 raft_consensus.cc:385] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.764768 18724 raft_consensus.cc:740] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.767854 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:47.769608 18721 tablet_bootstrap.cc:492] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:47.770090 18721 ts_tablet_manager.cc:1403] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.006s
I20260709 12:21:47.773480 18426 catalog_manager.cc:5697] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:47.778106 18677 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:47.779793 18721 raft_consensus.cc:359] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.780506 18721 raft_consensus.cc:385] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.780794 18721 raft_consensus.cc:740] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.782160 18724 consensus_queue.cc:260] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.783802 18724 ts_tablet_manager.cc:1434] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 12:21:47.784729 18724 tablet_bootstrap.cc:492] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:47.784425 19040 consensus_queue.cc:1048] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:47.781436 18721 consensus_queue.cc:260] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.793773 18494 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:47.798810 19050 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:47.799401 19050 raft_consensus.cc:697] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:47.799182 19040 consensus_queue.cc:1048] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:47.800498 19050 consensus_queue.cc:237] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.801199 18721 ts_tablet_manager.cc:1434] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.002s
I20260709 12:21:47.802165 18721 tablet_bootstrap.cc:492] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
W20260709 12:21:47.812832 18646 leader_election.cc:343] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.813313 18646 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:47.814392 19068 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:47.818166 18722 tablet_bootstrap.cc:492] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:47.818764 18722 ts_tablet_manager.cc:1403] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.133s	user 0.016s	sys 0.012s
I20260709 12:21:47.822533 18722 raft_consensus.cc:359] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.823294 18722 raft_consensus.cc:385] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.830657 19052 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.831220 19052 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.834192 19052 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:47.835554 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:47.840812 18724 tablet_bootstrap.cc:654] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.840893 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:47.841856 18676 raft_consensus.cc:2393] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 1: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:21:47.842831 18427 catalog_manager.cc:5697] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:47.843597 18570 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:47.845206 19049 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.823566 18722 raft_consensus.cc:740] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.863247 19049 raft_consensus.cc:2749] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:47.848598 18722 consensus_queue.cc:260] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.867643 18722 ts_tablet_manager.cc:1434] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.002s
I20260709 12:21:47.873098 18425 catalog_manager.cc:5697] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:47.874537 18722 tablet_bootstrap.cc:492] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:47.881899 18721 tablet_bootstrap.cc:654] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.884968 19050 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.885506 19050 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.888634 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:47.889017 18721 tablet_bootstrap.cc:492] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:47.889413 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:47.889686 18721 ts_tablet_manager.cc:1403] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.002s
W20260709 12:21:47.890225 18494 leader_election.cc:343] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.890854 18676 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:47.892526 18494 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:47.893743 19050 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:47.893908 18949 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:47.894133 19040 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.894335 18949 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.894694 18949 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.894615 19040 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.896834 19040 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:47.898043 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:47.899312 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:21:47.900619 18570 leader_election.cc:343] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:47.901068 18572 leader_election.cc:343] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.901501 18572 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:47.902804 19049 consensus_queue.cc:1048] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:47.904224 19049 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:47.914132 18724 tablet_bootstrap.cc:492] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:47.914310 18721 raft_consensus.cc:359] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.914729 18724 ts_tablet_manager.cc:1403] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.130s	user 0.018s	sys 0.006s
I20260709 12:21:47.915020 18721 raft_consensus.cc:385] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.915299 18721 raft_consensus.cc:740] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.916033 18721 consensus_queue.cc:260] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.917398 18724 raft_consensus.cc:359] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.917559 18949 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.918016 18721 ts_tablet_manager.cc:1434] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.004s
I20260709 12:21:47.918090 18724 raft_consensus.cc:385] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.918447 18724 raft_consensus.cc:740] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.919001 18721 tablet_bootstrap.cc:492] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:47.920367 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:47.919020 18724 consensus_queue.cc:260] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.922216 18722 tablet_bootstrap.cc:654] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.922412 19049 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.922897 19049 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.923604 18724 ts_tablet_manager.cc:1434] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:21:47.927719 18724 tablet_bootstrap.cc:492] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
W20260709 12:21:47.928501 18494 leader_election.cc:343] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.938076 18983 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.938624 18983 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.940862 18983 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:47.943020 18949 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:47.946470 18722 tablet_bootstrap.cc:492] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:47.947259 18842 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.947793 18842 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.949796 18842 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:47.951138 18722 ts_tablet_manager.cc:1403] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.077s	user 0.011s	sys 0.025s
I20260709 12:21:47.951470 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:47.952113 18605 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:47.953126 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:47.953718 19049 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:47.953778 18529 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:47.955435 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:47.956656 18721 tablet_bootstrap.cc:654] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.957309 18646 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:21:47.957623 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:47.958380 18676 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:47.958899 19068 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:21:47.960752 18572 leader_election.cc:343] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.961107 19068 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.961493 19068 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:47.962774 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:47.964322 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:47.964948 18677 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.965174 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:47.966485 18570 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:21:47.970284 18724 tablet_bootstrap.cc:654] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.970722 19068 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:47.973073 18494 leader_election.cc:343] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:47.975459 18494 leader_election.cc:343] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.975859 18494 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:47.975555 18722 raft_consensus.cc:359] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.976598 18722 raft_consensus.cc:385] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.976969 18722 raft_consensus.cc:740] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.977563 19049 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:47.984692 19049 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.985051 19049 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.986387 18677 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:47.988420 18494 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:47.988593 18722 consensus_queue.cc:260] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.990038 18942 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:47.991446 18942 raft_consensus.cc:697] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:47.993510 18942 consensus_queue.cc:237] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:47.988512 19050 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:48.000592 18722 ts_tablet_manager.cc:1434] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 12:21:48.003262 18722 tablet_bootstrap.cc:492] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:48.015735 18724 tablet_bootstrap.cc:492] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:48.016567 18724 ts_tablet_manager.cc:1403] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.092s	user 0.016s	sys 0.001s
I20260709 12:21:48.018239 18721 tablet_bootstrap.cc:492] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:48.025285 18721 ts_tablet_manager.cc:1403] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.106s	user 0.010s	sys 0.007s
I20260709 12:21:48.025738 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:48.026405 18724 raft_consensus.cc:359] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.026876 18605 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.027107 18724 raft_consensus.cc:385] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:48.022522 19068 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:48.027448 18724 raft_consensus.cc:740] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:48.032585 18724 consensus_queue.cc:260] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.036654 18724 ts_tablet_manager.cc:1434] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 12:21:48.037935 18724 tablet_bootstrap.cc:492] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
W20260709 12:21:48.041764 18475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:48.030125 19049 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.050000 19049 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:48.035285 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:48.051123 18527 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.053951 18605 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:21:48.056010 18644 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:48.056806 18983 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:48.057343 18983 raft_consensus.cc:697] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:21:48.058326 18983 consensus_queue.cc:237] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.057296 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:21:48.060787 18572 leader_election.cc:343] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:48.072273 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:48.073167 18677 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:48.064643 19049 consensus_queue.cc:1048] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:21:48.079128 18721 raft_consensus.cc:359] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.079900 18721 raft_consensus.cc:385] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:48.080181 18721 raft_consensus.cc:740] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:48.080808 18721 consensus_queue.cc:260] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.095376 18721 ts_tablet_manager.cc:1434] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.001s
I20260709 12:21:48.098141 18721 tablet_bootstrap.cc:492] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:48.095870 18427 catalog_manager.cc:5697] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.101312 18425 catalog_manager.cc:5697] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 0 to 2, leader changed from <none> to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:48.119388 18722 tablet_bootstrap.cc:654] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:48.118729 18526 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:48.156181 18954 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.163424 18949 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.163966 18949 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.167728 19071 consensus_queue.cc:1048] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:48.148403 18677 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:48.167508 18949 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:48.174388 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:48.175232 18680 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:48.177479 18494 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:21:48.184433 18842 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:48.184867 18842 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.185226 18842 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.186702 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:48.177572 18942 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:21:48.189359 18570 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:21:48.190459 19049 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:48.190985 19049 raft_consensus.cc:697] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:21:48.198366 18724 tablet_bootstrap.cc:654] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:48.200342 18996 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.196976 18527 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:21:48.208091 18842 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.191906 19049 consensus_queue.cc:237] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.220064 18721 tablet_bootstrap.cc:654] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:48.228063 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 50635.5us
I20260709 12:21:48.231930 18527 raft_consensus.cc:1240] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:21:48.235836 18996 consensus_queue.cc:1059] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:48.237040 19042 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.237133 18996 raft_consensus.cc:3055] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:48.237746 18996 raft_consensus.cc:740] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:21:48.237679 19042 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.239319 18996 consensus_queue.cc:260] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.239910 19042 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:48.240799 18996 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.212759 18842 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:48.242792 19042 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.244032 19042 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.246589 19042 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:48.250499 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:48.253786 18724 tablet_bootstrap.cc:492] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
W20260709 12:21:48.254837 18644 leader_election.cc:343] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:48.255496 18722 tablet_bootstrap.cc:492] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:48.255986 18722 ts_tablet_manager.cc:1403] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.253s	user 0.018s	sys 0.023s
I20260709 12:21:48.256960 18724 ts_tablet_manager.cc:1403] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.219s	user 0.010s	sys 0.008s
I20260709 12:21:48.260321 18722 raft_consensus.cc:359] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.261021 18722 raft_consensus.cc:385] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:48.261269 18722 raft_consensus.cc:740] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:48.269326 18722 consensus_queue.cc:260] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.277129 18722 ts_tablet_manager.cc:1434] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 12:21:48.279542 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:48.283973 18722 tablet_bootstrap.cc:492] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:48.284099 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:48.294430 18724 raft_consensus.cc:359] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.295159 18724 raft_consensus.cc:385] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:48.295436 18724 raft_consensus.cc:740] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:48.277552 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:48.297098 18724 consensus_queue.cc:260] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.297578 18526 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:48.300266 18724 ts_tablet_manager.cc:1434] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.002s
I20260709 12:21:48.301118 18724 tablet_bootstrap.cc:492] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:48.282732 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:48.304487 18601 raft_consensus.cc:2410] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:21:48.304811 18679 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.304253 18721 tablet_bootstrap.cc:492] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:48.308776 19055 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.309413 19055 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.308017 18721 ts_tablet_manager.cc:1403] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.211s	user 0.013s	sys 0.022s
W20260709 12:21:48.313634 19093 log.cc:927] Time spent T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:21:48.314265 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:48.314934 18604 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:48.316535 19055 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:48.317003 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:48.317111 19055 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.318884 18644 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:48.323024 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:21:48.324151 18572 leader_election.cc:343] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:48.320608 19055 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.325662 18427 catalog_manager.cc:5697] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.327136 19055 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:48.322568 19068 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:48.329376 19068 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.329470 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:48.329735 19068 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:48.330921 18570 leader_election.cc:343] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:48.331634 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:48.334268 18679 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
W20260709 12:21:48.347609 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 47933.5us
I20260709 12:21:48.349416 19071 consensus_queue.cc:1048] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.351673 18724 tablet_bootstrap.cc:654] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:48.345924 19068 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:48.353572 18646 leader_election.cc:343] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:48.355980 18676 raft_consensus.cc:2393] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 1: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:21:48.356992 19068 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:48.358994 18570 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:48.365602 18721 raft_consensus.cc:359] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.359513 18646 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:48.359968 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:48.362723 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:48.367347 19049 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:48.367667 19068 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:48.368072 19068 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.368392 19068 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:48.363138 18494 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:48.366295 18721 raft_consensus.cc:385] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:48.369611 18721 raft_consensus.cc:740] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:48.370265 18721 consensus_queue.cc:260] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.372068 19094 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:48.372121 18526 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:48.373296 18954 consensus_queue.cc:1048] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.375913 19094 raft_consensus.cc:697] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:48.378897 18572 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:21:48.379904 18646 leader_election.cc:343] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:48.380518 18996 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:48.381724 18722 tablet_bootstrap.cc:654] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:48.382359 18996 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.386438 18996 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:48.376866 19094 consensus_queue.cc:237] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.390841 18721 ts_tablet_manager.cc:1434] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.078s	user 0.004s	sys 0.003s
I20260709 12:21:48.392201 18721 tablet_bootstrap.cc:492] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:48.387998 19049 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:48.413671 18603 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:48.414029 18954 consensus_queue.cc:1048] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.417147 19068 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.417640 18722 tablet_bootstrap.cc:492] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:48.417836 18644 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:21:48.418113 18722 ts_tablet_manager.cc:1403] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.134s	user 0.012s	sys 0.000s
I20260709 12:21:48.418941 18898 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:48.419325 19068 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:48.419433 18898 raft_consensus.cc:697] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:21:48.420387 18898 consensus_queue.cc:237] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.423470 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:48.424407 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:21:48.424840 18644 leader_election.cc:343] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:48.425024 18529 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:48.425730 18721 tablet_bootstrap.cc:654] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:48.430588 19040 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.431325 19040 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.437412 19040 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:48.439033 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:48.441814 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:21:48.443977 18572 leader_election.cc:343] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:48.447247 18529 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:48.443955 18722 raft_consensus.cc:359] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.449157 18722 raft_consensus.cc:385] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:48.450654 18724 tablet_bootstrap.cc:492] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:48.451272 18722 raft_consensus.cc:740] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:48.451701 18724 ts_tablet_manager.cc:1403] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.151s	user 0.009s	sys 0.005s
I20260709 12:21:48.454427 18722 consensus_queue.cc:260] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.473201 18677 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:48.468523 18996 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.476359 18570 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:21:48.476754 18724 raft_consensus.cc:359] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.477484 18724 raft_consensus.cc:385] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:48.477741 18724 raft_consensus.cc:740] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:48.478034 18996 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:48.478634 18996 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:48.479033 18996 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.479925 18996 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:48.481177 18646 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:48.478354 18724 consensus_queue.cc:260] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.482272 19068 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:48.482630 19071 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.482746 19068 raft_consensus.cc:697] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:21:48.484699 18724 ts_tablet_manager.cc:1434] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 12:21:48.483116 19071 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.495647 18724 tablet_bootstrap.cc:492] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:48.483614 19068 consensus_queue.cc:237] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.565132 19087 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.603875 18427 catalog_manager.cc:5697] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:48.565944 19087 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:48.601751 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 44533.2us
I20260709 12:21:48.641698 18426 catalog_manager.cc:5697] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 1 to 2, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 2 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.644781 19071 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:48.637033 19094 consensus_queue.cc:1048] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:21:48.647220 18600 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:21:48.647905 19087 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:48.648828 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:48.649466 18529 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:48.656352 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:48.656992 18527 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:21:48.662204 18722 ts_tablet_manager.cc:1434] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.244s	user 0.023s	sys 0.003s
I20260709 12:21:48.661016 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:21:48.664675 18570 leader_election.cc:343] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:48.665138 18722 tablet_bootstrap.cc:492] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:48.663915 18898 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:21:48.670207 18721 tablet_bootstrap.cc:492] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:48.670703 18721 ts_tablet_manager.cc:1403] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.279s	user 0.012s	sys 0.009s
W20260709 12:21:48.671674 18644 leader_election.cc:343] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:48.690201 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:48.691974 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:21:48.697120 18494 consensus_peers.cc:597] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:48.698553 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:48.706563 18721 raft_consensus.cc:359] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:48.707337 18646 leader_election.cc:343] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:48.707646 18721 raft_consensus.cc:385] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:48.708699 18721 raft_consensus.cc:740] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:48.708684 18646 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:48.709834 18721 consensus_queue.cc:260] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:48.707561 18494 leader_election.cc:343] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:48.711932 19040 consensus_queue.cc:1048] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.712569 19103 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:48.722883 18724 tablet_bootstrap.cc:654] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:48.738341 18721 ts_tablet_manager.cc:1434] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.002s
W20260709 12:21:48.738454 18494 leader_election.cc:343] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:48.739413 18721 tablet_bootstrap.cc:492] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:48.739482 18494 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:48.714718 18898 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:21:48.708258 18996 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.752000 18996 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:48.753364 18426 catalog_manager.cc:5697] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:48.756379 19107 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:48.763428 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:48.764107 18680 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:48.790680 18680 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:48.792666 18570 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:48.787245 18529 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:48.798233 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:48.807121 19041 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:48.807714 19041 raft_consensus.cc:697] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:21:48.808578 19041 consensus_queue.cc:237] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.813707 18572 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:48.815300 18996 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:48.816043 18996 raft_consensus.cc:697] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:21:48.816905 18996 consensus_queue.cc:237] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:48.846606 18572 leader_election.cc:343] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:48.848743 18721 tablet_bootstrap.cc:654] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:48.854449 18572 consensus_peers.cc:597] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:48.871307 19055 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.874521 19055 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.876857 19055 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:48.879118 18722 tablet_bootstrap.cc:654] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:48.882690 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:48.907467 18680 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:21:48.917129 18724 tablet_bootstrap.cc:492] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:48.917811 18724 ts_tablet_manager.cc:1403] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.422s	user 0.022s	sys 0.020s
I20260709 12:21:48.919955 18949 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:48.923907 19087 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.924672 19087 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.926687 19087 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:48.926942 18724 raft_consensus.cc:359] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.927659 18724 raft_consensus.cc:385] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:48.928704 18724 raft_consensus.cc:740] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:48.929463 18724 consensus_queue.cc:260] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:48.930924 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:48.931538 18724 ts_tablet_manager.cc:1434] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 12:21:48.932441 18724 tablet_bootstrap.cc:492] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:48.933977 18599 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
W20260709 12:21:48.934188 18494 leader_election.cc:343] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:48.934414 18599 pending_rounds.cc:85] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9: Aborting all ops after (but not including) 0
I20260709 12:21:48.934787 18599 pending_rounds.cc:107] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:21:48.934916 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:48.935209 18599 raft_consensus.cc:2889] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:48.935529 18676 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:48.934682 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:48.936615 18527 raft_consensus.cc:2393] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 1: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:21:48.943054 18942 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:48.937896 18427 catalog_manager.cc:5697] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.946039 18427 catalog_manager.cc:5697] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.949036 18494 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:48.951992 19087 raft_consensus.cc:2804] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:48.952981 19087 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.953451 19087 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:48.955610 18572 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:48.956789 19055 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:48.964465 19104 consensus_queue.cc:1048] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:21:48.979110 18721 tablet_bootstrap.cc:492] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:48.979983 18721 ts_tablet_manager.cc:1403] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.241s	user 0.019s	sys 0.003s
W20260709 12:21:48.989185 18646 consensus_peers.cc:597] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:48.998951 18721 raft_consensus.cc:359] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.000413 18721 raft_consensus.cc:385] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:49.000844 18721 raft_consensus.cc:740] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:49.003999 18721 consensus_queue.cc:260] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.012451 18721 ts_tablet_manager.cc:1434] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 12:21:49.013175 19055 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:49.017112 18721 tablet_bootstrap.cc:492] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:49.019450 19087 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.023465 19087 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:49.028100 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:49.038910 18724 tablet_bootstrap.cc:654] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:49.039826 18494 leader_election.cc:343] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:49.043587 18721 tablet_bootstrap.cc:654] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:49.047204 18722 tablet_bootstrap.cc:492] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:49.048008 18722 ts_tablet_manager.cc:1403] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.385s	user 0.045s	sys 0.024s
I20260709 12:21:49.076980 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:49.077653 18680 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:49.082175 18722 raft_consensus.cc:359] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.082942 18722 raft_consensus.cc:385] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:49.083213 18722 raft_consensus.cc:740] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:49.095678 18722 consensus_queue.cc:260] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.098456 18724 tablet_bootstrap.cc:492] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:49.098981 18724 ts_tablet_manager.cc:1403] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.167s	user 0.019s	sys 0.037s
I20260709 12:21:49.099637 18722 ts_tablet_manager.cc:1434] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 12:21:49.100626 18722 tablet_bootstrap.cc:492] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:49.101856 18724 raft_consensus.cc:359] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.102541 18724 raft_consensus.cc:385] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:49.102825 18724 raft_consensus.cc:740] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:49.103569 18724 consensus_queue.cc:260] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.105787 18724 ts_tablet_manager.cc:1434] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:21:49.106690 18721 tablet_bootstrap.cc:492] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:49.107268 18721 ts_tablet_manager.cc:1403] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.000s
I20260709 12:21:49.109750 18722 tablet_bootstrap.cc:654] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:49.109912 18721 raft_consensus.cc:359] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.110730 18721 raft_consensus.cc:385] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:49.111074 18721 raft_consensus.cc:740] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:49.110283 18680 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:49.111863 18721 consensus_queue.cc:260] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.115869 18721 ts_tablet_manager.cc:1434] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:21:49.117036 18721 tablet_bootstrap.cc:492] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:49.120608 18494 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:49.121439 18842 raft_consensus.cc:2804] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:49.121934 18842 raft_consensus.cc:697] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:49.122714 18721 tablet_bootstrap.cc:654] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:49.122804 18842 consensus_queue.cc:237] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.106700 18724 tablet_bootstrap.cc:492] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:49.130035 18724 tablet_bootstrap.cc:654] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:49.142987 18721 tablet_bootstrap.cc:492] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:49.144078 18721 ts_tablet_manager.cc:1403] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.004s
I20260709 12:21:49.148247 18724 tablet_bootstrap.cc:492] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:49.148741 18724 ts_tablet_manager.cc:1403] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.008s
I20260709 12:21:49.150498 18721 raft_consensus.cc:359] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.152110 18721 raft_consensus.cc:385] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:49.151333 18724 raft_consensus.cc:359] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.152428 18721 raft_consensus.cc:740] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:49.152647 18724 raft_consensus.cc:385] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:49.153038 18724 raft_consensus.cc:740] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:49.153152 18721 consensus_queue.cc:260] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.153775 18724 consensus_queue.cc:260] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.154707 18983 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:49.156948 18724 ts_tablet_manager.cc:1434] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:21:49.157928 18724 tablet_bootstrap.cc:492] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
W20260709 12:21:49.158322 18475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:49.160398 18721 ts_tablet_manager.cc:1434] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 12:21:49.163609 18722 tablet_bootstrap.cc:492] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:49.164126 18722 ts_tablet_manager.cc:1403] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.001s
I20260709 12:21:49.164186 18724 tablet_bootstrap.cc:654] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:49.167109 18722 raft_consensus.cc:359] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.167879 18722 raft_consensus.cc:385] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:49.168171 18722 raft_consensus.cc:740] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:49.168929 18722 consensus_queue.cc:260] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.171284 18722 ts_tablet_manager.cc:1434] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:21:49.171960 18721 tablet_bootstrap.cc:492] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:49.172253 18722 tablet_bootstrap.cc:492] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:49.178831 18527 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:49.195684 18603 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:49.219179 18721 tablet_bootstrap.cc:654] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:49.215314 19104 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:21:49.227356 18996 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.227928 18996 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.230751 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:49.231420 18530 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:49.235304 18996 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:49.235925 18721 tablet_bootstrap.cc:492] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:49.237181 18721 ts_tablet_manager.cc:1403] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.076s	user 0.022s	sys 0.015s
I20260709 12:21:49.237159 18572 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:49.238617 18722 tablet_bootstrap.cc:654] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:49.238699 18996 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:49.193882 19107 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.239461 18996 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.240072 18996 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:49.251716 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:49.239706 19107 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.274017 18721 raft_consensus.cc:359] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.275024 18721 raft_consensus.cc:385] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:49.275360 18721 raft_consensus.cc:740] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:49.271427 18676 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:49.284390 18570 leader_election.cc:343] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:49.289636 19055 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.319111 18721 consensus_queue.cc:260] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.372594 19107 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:21:49.373952 19131 log.cc:927] Time spent T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:21:49.374027 18983 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.374804 18983 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.353804 19055 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.379599 18996 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.414119 18996 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:49.415073 18724 tablet_bootstrap.cc:492] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:49.415776 18724 ts_tablet_manager.cc:1403] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.258s	user 0.057s	sys 0.061s
I20260709 12:21:49.383708 19041 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:21:49.407380 18983 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:49.480619 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:49.483115 18599 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:49.486454 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:49.507478 19056 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.508724 19056 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.514787 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:49.516954 18722 tablet_bootstrap.cc:492] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:49.518287 18722 ts_tablet_manager.cc:1403] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.346s	user 0.020s	sys 0.020s
I20260709 12:21:49.539582 19107 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.540483 19107 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.546574 18722 raft_consensus.cc:359] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.554044 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:49.529194 19055 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:49.533252 18529 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:49.563608 18721 ts_tablet_manager.cc:1434] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.323s	user 0.020s	sys 0.039s
I20260709 12:21:49.547545 18722 raft_consensus.cc:385] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:49.543152 19107 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:49.555922 18599 raft_consensus.cc:2468] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:49.556768 18494 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:49.557935 18724 raft_consensus.cc:359] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.572963 18724 raft_consensus.cc:385] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:49.573475 18724 raft_consensus.cc:740] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:49.574486 18724 consensus_queue.cc:260] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.575156 18721 tablet_bootstrap.cc:492] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:49.572485 18722 raft_consensus.cc:740] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:49.536284 18427 catalog_manager.cc:5697] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:49.596549 18722 consensus_queue.cc:260] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.581653 19087 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:49.582789 19056 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:49.583508 18724 ts_tablet_manager.cc:1434] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.167s	user 0.009s	sys 0.002s
W20260709 12:21:49.587594 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 48950.2us
I20260709 12:21:49.588485 18644 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:49.600100 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:49.598623 19087 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.601614 19087 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:49.590554 18529 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:49.606865 18724 tablet_bootstrap.cc:492] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:49.621773 18898 raft_consensus.cc:2804] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:49.622318 18898 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.622674 18898 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:49.629195 19104 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.630604 18721 tablet_bootstrap.cc:654] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:49.639959 18572 consensus_peers.cc:597] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:49.652287 18722 ts_tablet_manager.cc:1434] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.133s	user 0.008s	sys 0.004s
I20260709 12:21:49.629798 19104 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.672220 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:49.682642 18722 tablet_bootstrap.cc:492] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:49.686908 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:49.692152 19104 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:21:49.694945 18646 leader_election.cc:343] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:49.699986 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:49.712203 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:49.712445 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:49.725106 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:21:49.728380 18644 leader_election.cc:343] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:49.728430 18572 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:49.729635 19056 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:49.730189 19056 raft_consensus.cc:697] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:21:49.730886 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:49.731197 19056 consensus_queue.cc:237] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.737505 18721 tablet_bootstrap.cc:492] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:49.737896 18721 ts_tablet_manager.cc:1403] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.163s	user 0.040s	sys 0.024s
I20260709 12:21:49.748656 19143 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.748847 18996 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:21:49.752275 18572 leader_election.cc:343] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:49.756601 18724 tablet_bootstrap.cc:654] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:49.738493 18898 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.764962 18680 raft_consensus.cc:2393] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 1: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:21:49.765297 18524 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:49.770480 18898 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:49.775146 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:49.775807 18603 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:49.749933 19143 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.783663 18603 raft_consensus.cc:2468] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:49.785606 18644 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:49.788769 18898 raft_consensus.cc:2804] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:49.791152 19143 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:49.796093 19087 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.802469 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:49.803961 19087 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:21:49.805161 18570 leader_election.cc:343] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:49.805159 18996 consensus_queue.cc:1048] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:21:49.809118 18570 leader_election.cc:343] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:49.810611 18529 raft_consensus.cc:2393] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 1: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:21:49.811084 18722 tablet_bootstrap.cc:654] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:49.808266 18721 raft_consensus.cc:359] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.812178 18721 raft_consensus.cc:385] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:49.812588 18721 raft_consensus.cc:740] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:49.816246 18572 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:49.809330 18898 raft_consensus.cc:697] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:21:49.820364 18898 consensus_queue.cc:237] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.821642 19056 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:49.831452 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:49.838822 18570 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:49.842967 18996 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:49.851548 18724 tablet_bootstrap.cc:492] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:49.852267 18724 ts_tablet_manager.cc:1403] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.250s	user 0.016s	sys 0.007s
I20260709 12:21:49.853168 18603 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:49.855793 18721 consensus_queue.cc:260] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.856683 19107 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.856594 18724 raft_consensus.cc:359] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.857344 19107 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.857755 18724 raft_consensus.cc:385] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:49.858175 18724 raft_consensus.cc:740] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:49.859889 18528 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:49.859730 18724 consensus_queue.cc:260] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.865701 19107 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:49.868039 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:49.868357 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:49.882104 18528 raft_consensus.cc:2468] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
W20260709 12:21:49.883062 18646 leader_election.cc:343] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:49.885938 18722 tablet_bootstrap.cc:492] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:49.891961 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:49.894042 18676 raft_consensus.cc:2468] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:49.888661 18724 ts_tablet_manager.cc:1434] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.036s	user 0.010s	sys 0.000s
I20260709 12:21:49.892657 18722 ts_tablet_manager.cc:1403] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.210s	user 0.026s	sys 0.005s
I20260709 12:21:49.896279 18724 tablet_bootstrap.cc:492] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:49.887020 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:49.898296 18722 raft_consensus.cc:359] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.908305 18722 raft_consensus.cc:385] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:49.908643 18722 raft_consensus.cc:740] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:49.892107 18646 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:49.901078 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:49.909824 18898 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:49.914306 18724 tablet_bootstrap.cc:654] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:49.909379 18722 consensus_queue.cc:260] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:49.914816 18721 ts_tablet_manager.cc:1434] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.173s	user 0.011s	sys 0.000s
I20260709 12:21:49.915185 18676 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:49.913085 18426 catalog_manager.cc:5697] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:49.920236 18494 leader_election.cc:343] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:49.923208 18722 ts_tablet_manager.cc:1434] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 12:21:49.909364 19056 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:49.934602 18722 tablet_bootstrap.cc:492] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:49.946745 19143 consensus_queue.cc:1048] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:21:49.950668 18721 tablet_bootstrap.cc:492] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:49.973992 18676 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:49.970613 18494 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:21:49.975306 18601 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:49.981767 18842 raft_consensus.cc:2804] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:49.982203 18842 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.982542 18842 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:49.982625 18722 tablet_bootstrap.cc:654] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:49.991928 18721 tablet_bootstrap.cc:654] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:49.993752 18494 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:49.995042 19143 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:50.007200 18494 leader_election.cc:343] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:50.012673 19050 consensus_queue.cc:1048] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:50.016510 18842 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.025262 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:50.026116 18603 raft_consensus.cc:2393] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 1: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:21:50.032965 18722 tablet_bootstrap.cc:492] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:50.033485 18722 ts_tablet_manager.cc:1403] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.099s	user 0.010s	sys 0.005s
I20260709 12:21:50.035586 19138 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.039397 19138 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.041450 18722 raft_consensus.cc:359] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.042148 18722 raft_consensus.cc:385] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:50.036849 18721 tablet_bootstrap.cc:492] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:50.042443 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:50.043018 18721 ts_tablet_manager.cc:1403] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.011s
W20260709 12:21:50.044018 18572 leader_election.cc:343] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:50.045439 19138 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:50.045748 18721 raft_consensus.cc:359] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.046412 18721 raft_consensus.cc:385] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:50.046648 18721 raft_consensus.cc:740] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:50.038841 18724 tablet_bootstrap.cc:492] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:50.046679 19138 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.047399 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:50.049114 19138 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:21:50.049932 18570 leader_election.cc:343] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:50.050432 18570 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:50.051244 19138 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:50.047859 18724 ts_tablet_manager.cc:1403] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.152s	user 0.016s	sys 0.009s
I20260709 12:21:50.051803 19138 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:50.033581 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:50.052493 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:50.054527 18724 raft_consensus.cc:359] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.055238 18724 raft_consensus.cc:385] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:50.055510 18724 raft_consensus.cc:740] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:50.025974 18842 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:50.056183 18724 consensus_queue.cc:260] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.058701 18724 ts_tablet_manager.cc:1434] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:21:50.042454 18722 raft_consensus.cc:740] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:50.060181 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:50.060662 18722 consensus_queue.cc:260] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.047326 18721 consensus_queue.cc:260] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.062054 18572 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:50.063210 18996 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:50.063874 18721 ts_tablet_manager.cc:1434] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.003s
I20260709 12:21:50.064812 18721 tablet_bootstrap.cc:492] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:50.066293 18722 ts_tablet_manager.cc:1434] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 12:21:50.067303 18722 tablet_bootstrap.cc:492] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:50.071791 18724 tablet_bootstrap.cc:492] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:50.085527 18721 tablet_bootstrap.cc:654] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:50.094132 18494 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:21:50.094904 18842 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:50.095371 18842 raft_consensus.cc:697] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:50.103986 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:50.109468 18722 tablet_bootstrap.cc:654] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:50.110644 18494 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:50.110910 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:50.111516 18676 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:50.113039 18842 consensus_queue.cc:237] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.114707 19050 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:50.128355 18724 tablet_bootstrap.cc:654] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:50.129930 18425 catalog_manager.cc:5697] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:50.131937 18676 raft_consensus.cc:2468] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
W20260709 12:21:50.135049 18494 leader_election.cc:343] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:50.178746 18721 tablet_bootstrap.cc:492] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:50.179328 18721 ts_tablet_manager.cc:1403] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.115s	user 0.007s	sys 0.005s
I20260709 12:21:50.186429 18721 raft_consensus.cc:359] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.187312 18721 raft_consensus.cc:385] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:50.187616 18721 raft_consensus.cc:740] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:50.188325 18721 consensus_queue.cc:260] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.189867 18721 ts_tablet_manager.cc:1434] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 12:21:50.191507 18494 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:50.192404 19143 raft_consensus.cc:2804] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:50.192945 19143 raft_consensus.cc:697] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:50.193956 18724 tablet_bootstrap.cc:492] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:50.194804 18724 ts_tablet_manager.cc:1403] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.135s	user 0.015s	sys 0.000s
I20260709 12:21:50.198568 18724 raft_consensus.cc:359] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.199339 18724 raft_consensus.cc:385] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:50.193995 19143 consensus_queue.cc:237] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.200021 18724 raft_consensus.cc:740] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:50.200838 18724 consensus_queue.cc:260] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.195829 18721 tablet_bootstrap.cc:492] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:50.203109 18724 ts_tablet_manager.cc:1434] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:21:50.204257 18724 tablet_bootstrap.cc:492] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9: Bootstrap starting.
I20260709 12:21:50.208112 18722 tablet_bootstrap.cc:492] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:50.208654 18722 ts_tablet_manager.cc:1403] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.142s	user 0.020s	sys 0.023s
I20260709 12:21:50.210850 18724 tablet_bootstrap.cc:654] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:50.211863 18475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:50.212422 18722 raft_consensus.cc:359] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.213132 18722 raft_consensus.cc:385] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:50.213476 18722 raft_consensus.cc:740] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:50.214224 18722 consensus_queue.cc:260] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.215679 18724 tablet_bootstrap.cc:492] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9: No bootstrap required, opened a new log
I20260709 12:21:50.216204 18724 ts_tablet_manager.cc:1403] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9: Time spent bootstrapping tablet: real 0.012s	user 0.003s	sys 0.008s
I20260709 12:21:50.217844 18721 tablet_bootstrap.cc:654] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:50.218993 18724 raft_consensus.cc:359] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.219822 18724 raft_consensus.cc:385] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:50.220170 18724 raft_consensus.cc:740] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Initialized, Role: FOLLOWER
I20260709 12:21:50.220902 18724 consensus_queue.cc:260] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.223232 18724 ts_tablet_manager.cc:1434] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:21:50.240324 19050 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.240937 19050 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.241516 18722 ts_tablet_manager.cc:1434] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:21:50.242573 18722 tablet_bootstrap.cc:492] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1: Bootstrap starting.
I20260709 12:21:50.242980 19050 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:50.251567 18426 catalog_manager.cc:5697] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:50.259236 18721 tablet_bootstrap.cc:492] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:50.259776 18721 ts_tablet_manager.cc:1403] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.064s	user 0.004s	sys 0.009s
I20260709 12:21:50.259994 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:50.260471 18722 tablet_bootstrap.cc:654] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:50.262605 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:50.262629 18721 raft_consensus.cc:359] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.263530 18721 raft_consensus.cc:385] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:50.264048 18721 raft_consensus.cc:740] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:50.264853 18721 consensus_queue.cc:260] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.265388 18983 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.265842 18983 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.267189 18721 ts_tablet_manager.cc:1434] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:21:50.268633 18721 tablet_bootstrap.cc:492] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7: Bootstrap starting.
I20260709 12:21:50.269757 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:50.270582 18526 raft_consensus.cc:2393] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 1: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:21:50.270655 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:50.271633 19049 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.272064 18494 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:50.272164 19049 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.272502 18983 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:50.272949 19050 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:50.274304 19049 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:50.274245 18646 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:21:50.275460 18983 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:50.278208 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:50.278611 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:50.278993 18526 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:50.279131 18676 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 0.
I20260709 12:21:50.280308 18572 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:50.282325 18996 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:50.282697 18996 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.283054 18996 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:50.285110 18721 tablet_bootstrap.cc:654] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:50.285902 19049 consensus_queue.cc:1048] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:50.293641 18983 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:50.297322 18722 tablet_bootstrap.cc:492] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1: No bootstrap required, opened a new log
I20260709 12:21:50.297812 18722 ts_tablet_manager.cc:1403] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.000s
I20260709 12:21:50.301201 18722 raft_consensus.cc:359] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.302289 18722 raft_consensus.cc:385] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:50.302644 18722 raft_consensus.cc:740] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Initialized, Role: FOLLOWER
I20260709 12:21:50.303634 18722 consensus_queue.cc:260] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.320286 18722 ts_tablet_manager.cc:1434] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.004s
I20260709 12:21:50.311372 18996 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.323383 18996 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:50.323585 18983 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:50.325979 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:50.326695 18677 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:50.334062 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:50.334842 18526 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:50.339123 18721 tablet_bootstrap.cc:492] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7: No bootstrap required, opened a new log
I20260709 12:21:50.339643 18721 ts_tablet_manager.cc:1403] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7: Time spent bootstrapping tablet: real 0.071s	user 0.020s	sys 0.034s
I20260709 12:21:50.339637 18677 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:50.341289 19068 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.341737 19068 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.342312 18570 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:50.343740 19068 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:50.345002 19049 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:50.345501 19049 raft_consensus.cc:697] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:21:50.345670 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:50.346331 18602 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:50.346294 19049 consensus_queue.cc:237] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.346822 18526 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:21:50.349515 18721 raft_consensus.cc:359] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.351277 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:50.351416 18721 raft_consensus.cc:385] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:50.352756 18644 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:50.355149 19068 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:50.355520 19068 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.356230 19140 consensus_queue.cc:1048] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:50.360296 19068 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:50.362795 19143 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.363291 19143 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.365269 19143 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:50.352840 18721 raft_consensus.cc:740] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Initialized, Role: FOLLOWER
I20260709 12:21:50.368201 18721 consensus_queue.cc:260] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.369493 18529 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 0.
I20260709 12:21:50.370411 18721 ts_tablet_manager.cc:1434] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.000s
I20260709 12:21:50.371327 18525 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:50.373219 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:21:50.373821 18605 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:50.375160 18494 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:50.375885 19050 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:50.376240 19050 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.376590 19050 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:50.377578 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:50.378190 18676 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 0.
I20260709 12:21:50.384266 19050 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.386471 19050 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:50.382689 19068 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.390616 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:50.391173 18605 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:50.393347 18426 catalog_manager.cc:5697] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:50.394337 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:21:50.394901 18602 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:50.398708 18605 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:50.399868 18644 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:21:50.400789 19142 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:50.401252 19142 raft_consensus.cc:697] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:21:50.401551 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:21:50.402158 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:21:50.402068 19142 consensus_queue.cc:237] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.402722 18676 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:50.402158 18527 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:50.418907 18676 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:50.419705 19068 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 1 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:50.421844 18494 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:21:50.424881 19143 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:50.425423 19143 raft_consensus.cc:697] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:21:50.426311 19143 consensus_queue.cc:237] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.426144 18527 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:21:50.430233 18983 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:50.431835 18602 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:21:50.431676 18427 catalog_manager.cc:5697] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:50.464692 18425 catalog_manager.cc:5697] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:50.480578 18426 catalog_manager.cc:5697] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:50.491073 18996 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.491618 18996 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:21:50.493774 18996 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:50.494434 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:21:50.494452 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:21:50.495196 18677 raft_consensus.cc:2393] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 1: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:21:50.496059 18570 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:21:50.496655 18996 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:50.501559 18996 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:50.579658 19050 consensus_queue.cc:1048] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:50.603233 18842 consensus_queue.cc:1048] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:50.760695 19050 consensus_queue.cc:1048] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:50.764324 18842 consensus_queue.cc:1048] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:50.807878 18842 consensus_queue.cc:1048] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:50.824826 19143 consensus_queue.cc:1048] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:50.935818 19140 consensus_queue.cc:1048] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:50.936259 19068 consensus_queue.cc:1048] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:50.957074 19049 consensus_queue.cc:1048] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:50.970911 19068 consensus_queue.cc:1048] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:52.159210 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:52.194203 19200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:52.194204 19203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:52.194612 19201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:52.195463 17346 server_base.cc:1061] running on GCE node
I20260709 12:21:52.198184 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:52.198567 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:52.198917 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599712198891 us; error 0 us; skew 500 ppm
I20260709 12:21:52.199831 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:52.203648 17346 webserver.cc:533] Webserver started at http://127.16.240.132:46777/ using document root <none> and password file <none>
I20260709 12:21:52.204497 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:52.204761 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:52.205134 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:52.206475 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-3-root/instance:
uuid: "8c29c312e4544452b1162d7f81a58cb4"
format_stamp: "Formatted at 2026-07-09 12:21:52 on dist-test-slave-7xpw"
I20260709 12:21:52.212688 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:21:52.217579 19208 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:52.218597 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 12:21:52.218976 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-3-root
uuid: "8c29c312e4544452b1162d7f81a58cb4"
format_stamp: "Formatted at 2026-07-09 12:21:52 on dist-test-slave-7xpw"
I20260709 12:21:52.219353 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:52.249581 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:52.251442 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:52.254628 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:52.259562 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:52.259990 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:21:52.260365 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:52.260661 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:52.404291 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.132:45879
I20260709 12:21:52.404408 19274 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.132:45879 every 8 connection(s)
I20260709 12:21:52.409387 17346 auto_leader_rebalancer-test.cc:439] add a tserver: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:21:52.430429 19275 heartbeater.cc:344] Connected to a master server at 127.16.240.190:43515
I20260709 12:21:52.430982 19275 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:52.432006 19275 heartbeater.cc:507] Master 127.16.240.190:43515 requested a full tablet report, sending...
I20260709 12:21:52.434773 18427 ts_manager.cc:194] Registered new tserver with Master: 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:21:52.436554 18427 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60812
I20260709 12:21:53.439440 19275 heartbeater.cc:499] Master 127.16.240.190:43515 was elected leader, sending a full tablet report...
I20260709 12:21:53.465662 18524 consensus_queue.cc:237] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:53.479564 18677 raft_consensus.cc:1275] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:53.482425 18602 raft_consensus.cc:1275] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:53.483852 19283 consensus_queue.cc:1048] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:53.485622 19050 consensus_queue.cc:1048] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:53.490450 18494 consensus_peers.cc:597] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d92b776ce9bf460fbd0c74b31953276d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:53.496384 19283 raft_consensus.cc:2955] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:53.498837 18602 raft_consensus.cc:2955] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:53.499234 18677 raft_consensus.cc:2955] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:53.514328 18427 catalog_manager.cc:5697] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:53.537771 18676 consensus_queue.cc:237] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:53.561672 18603 raft_consensus.cc:1275] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:53.563520 19266 consensus_queue.cc:1048] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:53.566100 18524 raft_consensus.cc:1275] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:53.568486 19198 consensus_queue.cc:1048] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:21:53.598686 18644 consensus_peers.cc:597] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 91ba7e5c69124062865d447b2968bc2e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:53.599409 19198 raft_consensus.cc:2955] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:53.601209 18603 raft_consensus.cc:2955] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:53.607441 18525 raft_consensus.cc:2955] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:53.622892 18676 consensus_queue.cc:237] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:53.626434 18426 catalog_manager.cc:5697] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:53.663537 18644 consensus_peers.cc:597] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a0ba9bae3e1f4f9a97bb68834d01038c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:53.664592 18603 raft_consensus.cc:1275] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:53.666782 18524 raft_consensus.cc:1275] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:53.671871 19297 consensus_queue.cc:1048] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:53.672806 19198 consensus_queue.cc:1048] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:53.690382 19198 raft_consensus.cc:2955] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:53.692342 18524 raft_consensus.cc:2955] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:53.700273 18603 raft_consensus.cc:2955] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:53.710233 18426 catalog_manager.cc:5697] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:53.737815 18605 consensus_queue.cc:237] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:53.755393 18679 raft_consensus.cc:1275] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:53.755414 18524 raft_consensus.cc:1275] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:53.759639 19049 consensus_queue.cc:1048] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:53.760653 19279 consensus_queue.cc:1048] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:53.775460 18996 raft_consensus.cc:2955] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:53.777053 18679 raft_consensus.cc:2955] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
W20260709 12:21:53.781985 18570 consensus_peers.cc:597] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 512f9ba3d0d04063899283c39177bcdf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:53.786043 18524 raft_consensus.cc:2955] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:53.807365 18426 catalog_manager.cc:5697] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:53.934544 19308 ts_tablet_manager.cc:933] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:21:53.938218 19308 tablet_copy_client.cc:323] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.129:45155
I20260709 12:21:53.970489 18540 tablet_copy_service.cc:140] P 2f9872512f1646bc835906bd0e98c6a7: Received BeginTabletCopySession request for tablet d92b776ce9bf460fbd0c74b31953276d from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:43124)
I20260709 12:21:53.971095 18540 tablet_copy_service.cc:161] P 2f9872512f1646bc835906bd0e98c6a7: Beginning new tablet copy session on tablet d92b776ce9bf460fbd0c74b31953276d from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:43124: session id = 8c29c312e4544452b1162d7f81a58cb4-d92b776ce9bf460fbd0c74b31953276d
I20260709 12:21:53.978082 18540 tablet_copy_source_session.cc:215] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:53.985174 19308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d92b776ce9bf460fbd0c74b31953276d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:53.999867 19308 tablet_copy_client.cc:806] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:54.000918 19308 tablet_copy_client.cc:670] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:54.006398 19308 tablet_copy_client.cc:538] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:54.015276 19308 tablet_bootstrap.cc:492] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:21:54.037921 19308 tablet_bootstrap.cc:492] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:54.039108 19308 tablet_bootstrap.cc:492] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:21:54.040011 19308 ts_tablet_manager.cc:1403] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.012s
I20260709 12:21:54.042487 19312 ts_tablet_manager.cc:933] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:54.043411 19308 raft_consensus.cc:359] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:54.044431 19308 raft_consensus.cc:740] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:21:54.045375 19308 consensus_queue.cc:260] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:54.052888 19312 tablet_copy_client.cc:323] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.131:36757
I20260709 12:21:54.059304 19308 ts_tablet_manager.cc:1434] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.007s
I20260709 12:21:54.063220 19315 ts_tablet_manager.cc:933] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:54.072295 19315 tablet_copy_client.cc:323] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.131:36757
I20260709 12:21:54.077096 18540 tablet_copy_service.cc:342] P 2f9872512f1646bc835906bd0e98c6a7: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-d92b776ce9bf460fbd0c74b31953276d received from {username='slave'} at 127.0.0.1:43124
I20260709 12:21:54.077608 18540 tablet_copy_service.cc:434] P 2f9872512f1646bc835906bd0e98c6a7: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-d92b776ce9bf460fbd0c74b31953276d on tablet d92b776ce9bf460fbd0c74b31953276d with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:21:54.080147 18690 tablet_copy_service.cc:140] P a0dee333a83a45f1ab0c1bb6d094afd1: Received BeginTabletCopySession request for tablet a0ba9bae3e1f4f9a97bb68834d01038c from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:50938)
I20260709 12:21:54.080287 18689 tablet_copy_service.cc:140] P a0dee333a83a45f1ab0c1bb6d094afd1: Received BeginTabletCopySession request for tablet 91ba7e5c69124062865d447b2968bc2e from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:50938)
I20260709 12:21:54.080739 18690 tablet_copy_service.cc:161] P a0dee333a83a45f1ab0c1bb6d094afd1: Beginning new tablet copy session on tablet a0ba9bae3e1f4f9a97bb68834d01038c from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:50938: session id = 8c29c312e4544452b1162d7f81a58cb4-a0ba9bae3e1f4f9a97bb68834d01038c
I20260709 12:21:54.081584 18689 tablet_copy_service.cc:161] P a0dee333a83a45f1ab0c1bb6d094afd1: Beginning new tablet copy session on tablet 91ba7e5c69124062865d447b2968bc2e from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:50938: session id = 8c29c312e4544452b1162d7f81a58cb4-91ba7e5c69124062865d447b2968bc2e
I20260709 12:21:54.092924 18689 tablet_copy_source_session.cc:215] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:54.095888 18690 tablet_copy_source_session.cc:215] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:54.096048 19315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91ba7e5c69124062865d447b2968bc2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:54.099201 19312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0ba9bae3e1f4f9a97bb68834d01038c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:54.112694 19315 tablet_copy_client.cc:806] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:54.113375 19315 tablet_copy_client.cc:670] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:54.116220 19312 tablet_copy_client.cc:806] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:54.116755 19312 tablet_copy_client.cc:670] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:54.119158 19315 tablet_copy_client.cc:538] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:54.121744 19312 tablet_copy_client.cc:538] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:54.126974 19315 tablet_bootstrap.cc:492] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:21:54.136878 19312 tablet_bootstrap.cc:492] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:21:54.155306 19315 tablet_bootstrap.cc:492] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:54.156354 19315 tablet_bootstrap.cc:492] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:21:54.157099 19315 ts_tablet_manager.cc:1403] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.030s	user 0.026s	sys 0.005s
I20260709 12:21:54.160812 19315 raft_consensus.cc:359] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:54.161916 19315 raft_consensus.cc:740] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:21:54.162815 19315 consensus_queue.cc:260] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:54.166301 19315 ts_tablet_manager.cc:1434] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:21:54.181627 19312 tablet_bootstrap.cc:492] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:54.182749 19312 tablet_bootstrap.cc:492] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:21:54.183525 19312 ts_tablet_manager.cc:1403] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.047s	user 0.022s	sys 0.008s
I20260709 12:21:54.186499 19312 raft_consensus.cc:359] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:54.187333 18690 tablet_copy_service.cc:342] P a0dee333a83a45f1ab0c1bb6d094afd1: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-91ba7e5c69124062865d447b2968bc2e received from {username='slave'} at 127.0.0.1:50938
I20260709 12:21:54.193792 19312 raft_consensus.cc:740] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:21:54.193943 18690 tablet_copy_service.cc:434] P a0dee333a83a45f1ab0c1bb6d094afd1: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-91ba7e5c69124062865d447b2968bc2e on tablet 91ba7e5c69124062865d447b2968bc2e with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:21:54.194617 19312 consensus_queue.cc:260] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:54.197176 19312 ts_tablet_manager.cc:1434] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:21:54.202044 18690 tablet_copy_service.cc:342] P a0dee333a83a45f1ab0c1bb6d094afd1: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-a0ba9bae3e1f4f9a97bb68834d01038c received from {username='slave'} at 127.0.0.1:50938
I20260709 12:21:54.202479 18690 tablet_copy_service.cc:434] P a0dee333a83a45f1ab0c1bb6d094afd1: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-a0ba9bae3e1f4f9a97bb68834d01038c on tablet a0ba9bae3e1f4f9a97bb68834d01038c with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:21:54.218117 19312 ts_tablet_manager.cc:933] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:54.233821 19312 tablet_copy_client.cc:323] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.130:37079
I20260709 12:21:54.253559 18616 tablet_copy_service.cc:140] P c7bd71f1f37c45f28b52c154e59356b9: Received BeginTabletCopySession request for tablet 512f9ba3d0d04063899283c39177bcdf from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:39798)
I20260709 12:21:54.254150 18616 tablet_copy_service.cc:161] P c7bd71f1f37c45f28b52c154e59356b9: Beginning new tablet copy session on tablet 512f9ba3d0d04063899283c39177bcdf from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:39798: session id = 8c29c312e4544452b1162d7f81a58cb4-512f9ba3d0d04063899283c39177bcdf
I20260709 12:21:54.260679 18616 tablet_copy_source_session.cc:215] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:54.264717 19312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 512f9ba3d0d04063899283c39177bcdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:54.280505 19312 tablet_copy_client.cc:806] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:54.281085 19312 tablet_copy_client.cc:670] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:54.284711 19312 tablet_copy_client.cc:538] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:54.294232 19312 tablet_bootstrap.cc:492] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:21:54.322758 19312 tablet_bootstrap.cc:492] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:54.323560 19312 tablet_bootstrap.cc:492] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:21:54.324352 19312 ts_tablet_manager.cc:1403] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.007s
I20260709 12:21:54.327034 19312 raft_consensus.cc:359] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:54.327716 19312 raft_consensus.cc:740] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:21:54.329155 19312 consensus_queue.cc:260] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:54.334245 19312 ts_tablet_manager.cc:1434] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.006s
I20260709 12:21:54.336139 18616 tablet_copy_service.cc:342] P c7bd71f1f37c45f28b52c154e59356b9: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-512f9ba3d0d04063899283c39177bcdf received from {username='slave'} at 127.0.0.1:39798
I20260709 12:21:54.336628 18616 tablet_copy_service.cc:434] P c7bd71f1f37c45f28b52c154e59356b9: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-512f9ba3d0d04063899283c39177bcdf on tablet 512f9ba3d0d04063899283c39177bcdf with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:21:54.534662 19248 raft_consensus.cc:1217] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:54.536520 19247 raft_consensus.cc:1217] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:54.554473 19247 raft_consensus.cc:1217] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:54.731437 19247 raft_consensus.cc:1217] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:55.000419 19322 raft_consensus.cc:1064] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:21:55.002904 19322 consensus_queue.cc:237] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:21:55.013312 19247 raft_consensus.cc:1275] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:55.014001 18605 raft_consensus.cc:1275] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:55.016438 18524 raft_consensus.cc:1275] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:55.016335 19324 consensus_queue.cc:1048] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:55.017345 19322 consensus_queue.cc:1048] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:55.018985 19324 consensus_queue.cc:1048] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:55.050900 19198 raft_consensus.cc:1064] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:21:55.053208 19198 consensus_queue.cc:237] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:21:55.057529 19217 raft_consensus.cc:1064] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:21:55.060690 19217 consensus_queue.cc:237] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:21:55.088858 19247 raft_consensus.cc:1275] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:55.091516 19050 consensus_queue.cc:1048] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:55.092818 19248 raft_consensus.cc:1275] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:55.097065 18676 raft_consensus.cc:1275] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:55.122109 18996 raft_consensus.cc:1064] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:21:55.123131 19050 consensus_queue.cc:1048] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:55.125698 18996 consensus_queue.cc:237] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:21:55.104275 19335 raft_consensus.cc:2955] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.114197 18605 raft_consensus.cc:1275] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:55.103909 19322 consensus_queue.cc:1048] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:55.134143 19050 consensus_queue.cc:1048] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:55.140785 18525 raft_consensus.cc:1275] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:55.143456 18603 raft_consensus.cc:1275] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:55.147194 19334 consensus_queue.cc:1048] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:55.148262 19326 raft_consensus.cc:2955] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.150715 19333 consensus_queue.cc:1048] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:55.160521 18676 raft_consensus.cc:2955] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.162701 18525 raft_consensus.cc:2955] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.180522 18603 raft_consensus.cc:2955] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.188501 19247 raft_consensus.cc:2955] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.200048 19248 raft_consensus.cc:1275] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:55.212957 19327 consensus_queue.cc:1048] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:55.224915 18677 raft_consensus.cc:1275] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:55.226620 19307 consensus_queue.cc:1048] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:55.230751 18524 raft_consensus.cc:1275] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:55.237360 18425 catalog_manager.cc:5697] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:55.241048 19342 raft_consensus.cc:2955] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.242384 18602 raft_consensus.cc:2955] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.239836 18425 catalog_manager.cc:5697] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.238371 19307 consensus_queue.cc:1048] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:55.280191 18524 raft_consensus.cc:2955] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.283953 19247 raft_consensus.cc:2955] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.293004 18996 raft_consensus.cc:2955] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.293709 18525 raft_consensus.cc:2955] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.302464 18676 raft_consensus.cc:2955] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.315984 19247 raft_consensus.cc:2955] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.325233 18427 catalog_manager.cc:5697] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.341687 18676 consensus_queue.cc:237] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:21:55.347028 18426 catalog_manager.cc:5697] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:55.367954 18602 consensus_queue.cc:237] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:21:55.368482 19247 raft_consensus.cc:1275] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:21:55.368919 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 64625.9us
I20260709 12:21:55.370573 19342 consensus_queue.cc:1048] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:55.372875 19247 raft_consensus.cc:2955] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.376748 18676 consensus_queue.cc:237] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:21:55.382046 18603 raft_consensus.cc:2955] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.386068 19246 raft_consensus.cc:1275] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:55.387152 18601 raft_consensus.cc:1275] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:55.388995 19245 raft_consensus.cc:1275] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:55.389473 19342 consensus_queue.cc:1048] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:55.393060 19327 consensus_queue.cc:1048] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:55.396473 18525 raft_consensus.cc:1275] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:55.398293 18996 consensus_queue.cc:1048] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:55.401173 19335 raft_consensus.cc:2955] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.404259 19245 raft_consensus.cc:2955] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.413050 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a0ba9bae3e1f4f9a97bb68834d01038c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:55.391300 19342 consensus_queue.cc:1048] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:55.415874 19328 raft_consensus.cc:2955] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.416919 19338 raft_consensus.cc:2955] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.423030 18524 raft_consensus.cc:2955] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.432518 18529 raft_consensus.cc:1275] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:55.425846 18602 raft_consensus.cc:2955] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.442860 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 91ba7e5c69124062865d447b2968bc2e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:55.445086 19246 raft_consensus.cc:2955] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.454540 18425 catalog_manager.cc:5697] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:55.462877 19334 consensus_queue.cc:1048] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:55.463418 18424 catalog_manager.cc:5697] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.474099 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 512f9ba3d0d04063899283c39177bcdf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:55.489708 18665 tablet_service.cc:1558] Processing DeleteTablet for tablet 512f9ba3d0d04063899283c39177bcdf with delete_type TABLET_DATA_TOMBSTONED (TS a0dee333a83a45f1ab0c1bb6d094afd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40796
I20260709 12:21:55.468569 19248 raft_consensus.cc:2955] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.516306 18587 tablet_service.cc:1558] Processing DeleteTablet for tablet a0ba9bae3e1f4f9a97bb68834d01038c with delete_type TABLET_DATA_TOMBSTONED (TS c7bd71f1f37c45f28b52c154e59356b9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40934
I20260709 12:21:55.518321 18524 raft_consensus.cc:2955] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.520053 19360 tablet_replica.cc:333] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:21:55.511049 18427 catalog_manager.cc:5697] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.521452 19360 raft_consensus.cc:2243] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:55.523144 19360 raft_consensus.cc:2272] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:55.522166 19361 tablet_replica.cc:333] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:21:55.529838 19361 raft_consensus.cc:2243] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:55.535909 19361 raft_consensus.cc:2272] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:55.539100 19360 ts_tablet_manager.cc:1916] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:55.539441 19361 ts_tablet_manager.cc:1916] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:55.545809 18512 tablet_service.cc:1558] Processing DeleteTablet for tablet 91ba7e5c69124062865d447b2968bc2e with delete_type TABLET_DATA_TOMBSTONED (TS 2f9872512f1646bc835906bd0e98c6a7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57364
I20260709 12:21:55.554262 19362 tablet_replica.cc:333] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:21:55.555390 19362 raft_consensus.cc:2243] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:55.556195 19362 raft_consensus.cc:2272] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:55.557179 18524 consensus_queue.cc:237] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:21:55.561122 19361 ts_tablet_manager.cc:1929] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:55.561830 19361 log.cc:1199] T a0ba9bae3e1f4f9a97bb68834d01038c P c7bd71f1f37c45f28b52c154e59356b9: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-1-root/wals/a0ba9bae3e1f4f9a97bb68834d01038c
I20260709 12:21:55.563705 18411 catalog_manager.cc:5028] TS c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): tablet a0ba9bae3e1f4f9a97bb68834d01038c (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:21:55.571511 19248 raft_consensus.cc:1275] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:55.572069 18602 raft_consensus.cc:1275] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:55.575469 19356 consensus_queue.cc:1048] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:55.581377 19356 consensus_queue.cc:1048] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:55.590910 19357 raft_consensus.cc:2955] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.593240 18602 raft_consensus.cc:2955] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.594899 19362 ts_tablet_manager.cc:1916] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:55.607488 19248 raft_consensus.cc:2955] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.618683 19360 ts_tablet_manager.cc:1929] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:55.623795 19360 log.cc:1199] T 512f9ba3d0d04063899283c39177bcdf P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-2-root/wals/512f9ba3d0d04063899283c39177bcdf
I20260709 12:21:55.629436 18411 catalog_manager.cc:5028] TS a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): tablet 512f9ba3d0d04063899283c39177bcdf (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:21:55.630570 18413 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d92b776ce9bf460fbd0c74b31953276d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:55.631156 18424 catalog_manager.cc:5697] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:55.642674 19362 ts_tablet_manager.cc:1929] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:55.643231 19362 log.cc:1199] T 91ba7e5c69124062865d447b2968bc2e P 2f9872512f1646bc835906bd0e98c6a7: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-0-root/wals/91ba7e5c69124062865d447b2968bc2e
I20260709 12:21:55.645038 18413 catalog_manager.cc:5028] TS 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): tablet 91ba7e5c69124062865d447b2968bc2e (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:21:55.647971 18665 tablet_service.cc:1558] Processing DeleteTablet for tablet d92b776ce9bf460fbd0c74b31953276d with delete_type TABLET_DATA_TOMBSTONED (TS a0dee333a83a45f1ab0c1bb6d094afd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40796
I20260709 12:21:55.649040 19360 tablet_replica.cc:333] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:21:55.650027 19360 raft_consensus.cc:2243] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:55.650712 19360 raft_consensus.cc:2272] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:55.653983 19360 ts_tablet_manager.cc:1916] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:55.669252 19360 ts_tablet_manager.cc:1929] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:55.669675 19360 log.cc:1199] T d92b776ce9bf460fbd0c74b31953276d P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-2-root/wals/d92b776ce9bf460fbd0c74b31953276d
I20260709 12:21:55.671387 18411 catalog_manager.cc:5028] TS a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): tablet d92b776ce9bf460fbd0c74b31953276d (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:21:56.722767 18524 consensus_queue.cc:237] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
W20260709 12:21:56.732604 18494 consensus_peers.cc:597] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d52124cfb8a140deaab206a18aadc308. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:56.732928 18676 raft_consensus.cc:1275] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:56.733239 18603 raft_consensus.cc:1275] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:56.734172 19341 consensus_queue.cc:1048] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:56.735016 19357 consensus_queue.cc:1048] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:56.742611 19341 raft_consensus.cc:2955] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:56.744848 18676 raft_consensus.cc:2955] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:56.745388 18603 raft_consensus.cc:2955] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:56.764107 18679 consensus_queue.cc:237] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:56.767607 18426 catalog_manager.cc:5697] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
W20260709 12:21:56.773334 18644 consensus_peers.cc:597] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f6c6156a485f436881bf4d1fb67194d2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:56.772794 18603 raft_consensus.cc:1275] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:56.775039 19335 consensus_queue.cc:1048] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:56.781384 18529 raft_consensus.cc:1275] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:56.783277 19335 consensus_queue.cc:1048] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:21:56.797646 19338 raft_consensus.cc:2955] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:56.802373 18603 raft_consensus.cc:2955] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:56.803777 18529 raft_consensus.cc:2955] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:56.840075 18679 consensus_queue.cc:237] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:56.849359 18603 raft_consensus.cc:1275] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:56.853454 18644 consensus_peers.cc:597] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 678726cf80464d89802570ca4d73600f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:56.852661 18425 catalog_manager.cc:5697] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:56.855727 19376 consensus_queue.cc:1048] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:56.859103 18524 raft_consensus.cc:1275] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:56.860590 19376 consensus_queue.cc:1048] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:56.871791 19376 raft_consensus.cc:2955] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:56.874421 18524 raft_consensus.cc:2955] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:56.897858 18601 consensus_queue.cc:237] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:56.903574 18603 raft_consensus.cc:2955] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:56.907358 18424 catalog_manager.cc:5697] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:56.912174 18570 consensus_peers.cc:597] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9141b3d8f87474d8f4752290efe5963. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:56.912756 18679 raft_consensus.cc:1275] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:56.914070 19363 consensus_queue.cc:1048] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:56.915019 18524 raft_consensus.cc:1275] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:56.916664 19363 consensus_queue.cc:1048] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:56.941761 18996 raft_consensus.cc:2955] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:56.945190 18679 raft_consensus.cc:2955] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:56.963066 18525 raft_consensus.cc:2955] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:56.966619 18425 catalog_manager.cc:5697] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:57.246866 19384 ts_tablet_manager.cc:933] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:57.248855 19384 tablet_copy_client.cc:323] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.131:36757
I20260709 12:21:57.250640 18690 tablet_copy_service.cc:140] P a0dee333a83a45f1ab0c1bb6d094afd1: Received BeginTabletCopySession request for tablet f6c6156a485f436881bf4d1fb67194d2 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:50938)
I20260709 12:21:57.251204 18690 tablet_copy_service.cc:161] P a0dee333a83a45f1ab0c1bb6d094afd1: Beginning new tablet copy session on tablet f6c6156a485f436881bf4d1fb67194d2 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:50938: session id = 8c29c312e4544452b1162d7f81a58cb4-f6c6156a485f436881bf4d1fb67194d2
I20260709 12:21:57.257375 18690 tablet_copy_source_session.cc:215] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:57.260486 19384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c6156a485f436881bf4d1fb67194d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:57.270870 19386 ts_tablet_manager.cc:933] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:21:57.276093 19384 tablet_copy_client.cc:806] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:57.276818 19384 tablet_copy_client.cc:670] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:57.282207 19384 tablet_copy_client.cc:538] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:57.286761 19386 tablet_copy_client.cc:323] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.129:45155
I20260709 12:21:57.289179 18540 tablet_copy_service.cc:140] P 2f9872512f1646bc835906bd0e98c6a7: Received BeginTabletCopySession request for tablet d52124cfb8a140deaab206a18aadc308 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:43124)
I20260709 12:21:57.289794 18540 tablet_copy_service.cc:161] P 2f9872512f1646bc835906bd0e98c6a7: Beginning new tablet copy session on tablet d52124cfb8a140deaab206a18aadc308 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:43124: session id = 8c29c312e4544452b1162d7f81a58cb4-d52124cfb8a140deaab206a18aadc308
I20260709 12:21:57.293669 19384 tablet_bootstrap.cc:492] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:21:57.296115 18540 tablet_copy_source_session.cc:215] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:57.301964 19386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d52124cfb8a140deaab206a18aadc308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:57.328132 19386 tablet_copy_client.cc:806] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:57.329347 19386 tablet_copy_client.cc:670] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:57.334923 19386 tablet_copy_client.cc:538] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:57.352963 19386 tablet_bootstrap.cc:492] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:21:57.420806 19386 tablet_bootstrap.cc:492] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:57.423457 19386 tablet_bootstrap.cc:492] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:21:57.427490 19386 ts_tablet_manager.cc:1403] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.083s	user 0.021s	sys 0.006s
I20260709 12:21:57.430907 19386 raft_consensus.cc:359] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:57.431947 19386 raft_consensus.cc:740] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:21:57.432735 19386 consensus_queue.cc:260] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:57.438825 19391 ts_tablet_manager.cc:933] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:21:57.442570 19384 tablet_bootstrap.cc:492] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:57.449667 19384 tablet_bootstrap.cc:492] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:21:57.451124 19384 ts_tablet_manager.cc:1403] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.158s	user 0.070s	sys 0.050s
I20260709 12:21:57.442955 19386 ts_tablet_manager.cc:1434] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.005s
I20260709 12:21:57.456312 19384 raft_consensus.cc:359] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:57.461189 19384 raft_consensus.cc:740] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:21:57.462193 19384 consensus_queue.cc:260] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:57.461400 19390 ts_tablet_manager.cc:933] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:21:57.463488 19391 tablet_copy_client.cc:323] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.130:37079
I20260709 12:21:57.465595 18540 tablet_copy_service.cc:342] P 2f9872512f1646bc835906bd0e98c6a7: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-d52124cfb8a140deaab206a18aadc308 received from {username='slave'} at 127.0.0.1:43124
I20260709 12:21:57.466112 18540 tablet_copy_service.cc:434] P 2f9872512f1646bc835906bd0e98c6a7: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-d52124cfb8a140deaab206a18aadc308 on tablet d52124cfb8a140deaab206a18aadc308 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:21:57.467738 19384 ts_tablet_manager.cc:1434] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.005s
I20260709 12:21:57.472594 19390 tablet_copy_client.cc:323] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.131:36757
I20260709 12:21:57.478856 18616 tablet_copy_service.cc:140] P c7bd71f1f37c45f28b52c154e59356b9: Received BeginTabletCopySession request for tablet f9141b3d8f87474d8f4752290efe5963 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:39798)
I20260709 12:21:57.479419 18616 tablet_copy_service.cc:161] P c7bd71f1f37c45f28b52c154e59356b9: Beginning new tablet copy session on tablet f9141b3d8f87474d8f4752290efe5963 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:39798: session id = 8c29c312e4544452b1162d7f81a58cb4-f9141b3d8f87474d8f4752290efe5963
I20260709 12:21:57.490481 18690 tablet_copy_service.cc:342] P a0dee333a83a45f1ab0c1bb6d094afd1: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-f6c6156a485f436881bf4d1fb67194d2 received from {username='slave'} at 127.0.0.1:50938
I20260709 12:21:57.490998 18690 tablet_copy_service.cc:434] P a0dee333a83a45f1ab0c1bb6d094afd1: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-f6c6156a485f436881bf4d1fb67194d2 on tablet f6c6156a485f436881bf4d1fb67194d2 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:21:57.494310 18690 tablet_copy_service.cc:140] P a0dee333a83a45f1ab0c1bb6d094afd1: Received BeginTabletCopySession request for tablet 678726cf80464d89802570ca4d73600f from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:50938)
I20260709 12:21:57.494819 18690 tablet_copy_service.cc:161] P a0dee333a83a45f1ab0c1bb6d094afd1: Beginning new tablet copy session on tablet 678726cf80464d89802570ca4d73600f from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:50938: session id = 8c29c312e4544452b1162d7f81a58cb4-678726cf80464d89802570ca4d73600f
I20260709 12:21:57.507339 18616 tablet_copy_source_session.cc:215] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:57.508433 18690 tablet_copy_source_session.cc:215] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:57.511085 19391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9141b3d8f87474d8f4752290efe5963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:57.517976 19390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 678726cf80464d89802570ca4d73600f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:57.532383 19391 tablet_copy_client.cc:806] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:57.535394 19390 tablet_copy_client.cc:806] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:57.536381 19390 tablet_copy_client.cc:670] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:57.533025 19391 tablet_copy_client.cc:670] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:57.541608 19390 tablet_copy_client.cc:538] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:57.544682 19391 tablet_copy_client.cc:538] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:57.552060 19390 tablet_bootstrap.cc:492] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:21:57.553628 19391 tablet_bootstrap.cc:492] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:21:57.585088 19391 tablet_bootstrap.cc:492] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:57.586097 19391 tablet_bootstrap.cc:492] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:21:57.586839 19391 ts_tablet_manager.cc:1403] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.033s	user 0.027s	sys 0.004s
I20260709 12:21:57.588312 19390 tablet_bootstrap.cc:492] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:57.589331 19390 tablet_bootstrap.cc:492] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:21:57.589843 19391 raft_consensus.cc:359] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:57.590325 19390 ts_tablet_manager.cc:1403] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.016s
I20260709 12:21:57.590519 19391 raft_consensus.cc:740] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:21:57.591141 19391 consensus_queue.cc:260] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:57.593312 19391 ts_tablet_manager.cc:1434] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:21:57.593338 19390 raft_consensus.cc:359] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:57.594355 19390 raft_consensus.cc:740] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:21:57.596035 18616 tablet_copy_service.cc:342] P c7bd71f1f37c45f28b52c154e59356b9: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-f9141b3d8f87474d8f4752290efe5963 received from {username='slave'} at 127.0.0.1:39798
I20260709 12:21:57.595250 19390 consensus_queue.cc:260] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:57.596519 18616 tablet_copy_service.cc:434] P c7bd71f1f37c45f28b52c154e59356b9: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-f9141b3d8f87474d8f4752290efe5963 on tablet f9141b3d8f87474d8f4752290efe5963 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:21:57.598450 19390 ts_tablet_manager.cc:1434] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:57.600452 18690 tablet_copy_service.cc:342] P a0dee333a83a45f1ab0c1bb6d094afd1: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-678726cf80464d89802570ca4d73600f received from {username='slave'} at 127.0.0.1:50938
I20260709 12:21:57.600899 18690 tablet_copy_service.cc:434] P a0dee333a83a45f1ab0c1bb6d094afd1: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-678726cf80464d89802570ca4d73600f on tablet 678726cf80464d89802570ca4d73600f with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:21:57.668403 19248 raft_consensus.cc:1217] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:57.761495 19248 raft_consensus.cc:1217] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:57.817734 19248 raft_consensus.cc:1217] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:57.857590 19248 raft_consensus.cc:1217] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:58.165462 19356 raft_consensus.cc:1064] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:21:58.167972 19356 consensus_queue.cc:237] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:21:58.177835 19248 raft_consensus.cc:1275] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:58.180876 18603 raft_consensus.cc:1275] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:58.182199 18676 raft_consensus.cc:1275] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:58.182021 19396 consensus_queue.cc:1048] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:58.184552 19396 consensus_queue.cc:1048] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:58.187389 19396 consensus_queue.cc:1048] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:58.198004 19376 raft_consensus.cc:1064] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:21:58.200627 19376 consensus_queue.cc:237] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:21:58.220983 18603 raft_consensus.cc:1275] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:58.221017 19245 raft_consensus.cc:1275] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:58.223011 19335 consensus_queue.cc:1048] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:58.225821 19393 consensus_queue.cc:1048] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:58.234906 18525 raft_consensus.cc:1275] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:58.233150 19396 raft_consensus.cc:2955] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.259267 18679 raft_consensus.cc:2955] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.259940 19407 consensus_queue.cc:1048] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:58.280282 19245 raft_consensus.cc:2955] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.280393 19248 raft_consensus.cc:2955] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.286492 18603 raft_consensus.cc:2955] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.294942 18424 catalog_manager.cc:5697] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:58.268462 19335 raft_consensus.cc:2955] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.306497 18525 raft_consensus.cc:2955] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.323282 18996 raft_consensus.cc:1064] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:21:58.325723 18996 consensus_queue.cc:237] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:21:58.336546 18602 raft_consensus.cc:2955] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.339996 19245 raft_consensus.cc:1275] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:58.342412 18525 raft_consensus.cc:1275] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:58.341913 19328 consensus_queue.cc:1048] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:21:58.346372 19364 consensus_queue.cc:1048] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:58.351912 18676 raft_consensus.cc:1275] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:58.355187 18996 consensus_queue.cc:1048] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:58.397866 18526 raft_consensus.cc:2955] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.400257 19415 raft_consensus.cc:2955] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.395352 18676 raft_consensus.cc:2955] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.416595 18424 catalog_manager.cc:5697] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.417259 19245 raft_consensus.cc:2955] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.433555 18525 consensus_queue.cc:237] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:21:58.446267 19407 raft_consensus.cc:1064] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:21:58.455166 18424 catalog_manager.cc:5697] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.459328 18676 raft_consensus.cc:1275] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:58.459328 19245 raft_consensus.cc:1275] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:58.454056 19407 consensus_queue.cc:237] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:21:58.467461 19356 consensus_queue.cc:1048] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:58.472757 19401 consensus_queue.cc:1048] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:58.474085 18676 consensus_queue.cc:237] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:21:58.497329 18603 consensus_queue.cc:237] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:21:58.503253 19356 raft_consensus.cc:2955] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.507682 19245 raft_consensus.cc:2955] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.509227 18677 raft_consensus.cc:2955] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.512687 18525 raft_consensus.cc:1275] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:58.513000 19248 raft_consensus.cc:1275] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:58.514006 18603 raft_consensus.cc:1275] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:58.514376 19364 consensus_queue.cc:1048] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:58.516134 19335 consensus_queue.cc:1048] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:58.517660 19335 consensus_queue.cc:1048] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:58.521844 19248 raft_consensus.cc:1275] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:58.524415 19415 consensus_queue.cc:1048] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:58.528614 18413 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d52124cfb8a140deaab206a18aadc308 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:58.530185 19376 raft_consensus.cc:2955] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.533481 18996 raft_consensus.cc:2955] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.541612 18603 raft_consensus.cc:2955] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.541265 19246 raft_consensus.cc:2955] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.541625 19248 raft_consensus.cc:2955] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.548903 18525 raft_consensus.cc:2955] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.570559 19245 raft_consensus.cc:1275] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:58.574446 19335 consensus_queue.cc:1048] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:58.579026 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f6c6156a485f436881bf4d1fb67194d2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:58.588665 18427 catalog_manager.cc:5697] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.591271 18525 raft_consensus.cc:1275] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:58.597258 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f9141b3d8f87474d8f4752290efe5963 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:58.574620 18603 raft_consensus.cc:1275] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:58.601666 19376 consensus_queue.cc:1048] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:58.603762 19335 consensus_queue.cc:1048] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:58.616382 18587 tablet_service.cc:1558] Processing DeleteTablet for tablet d52124cfb8a140deaab206a18aadc308 with delete_type TABLET_DATA_TOMBSTONED (TS c7bd71f1f37c45f28b52c154e59356b9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40934
I20260709 12:21:58.621919 18426 catalog_manager.cc:5697] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:58.629496 19423 tablet_replica.cc:333] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:21:58.635463 19423 raft_consensus.cc:2243] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.636821 19423 raft_consensus.cc:2272] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.641331 19423 ts_tablet_manager.cc:1916] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:58.640565 19376 raft_consensus.cc:2955] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.647616 18525 raft_consensus.cc:2955] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.651680 18512 tablet_service.cc:1558] Processing DeleteTablet for tablet f6c6156a485f436881bf4d1fb67194d2 with delete_type TABLET_DATA_TOMBSTONED (TS 2f9872512f1646bc835906bd0e98c6a7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57364
I20260709 12:21:58.652190 18425 catalog_manager.cc:5697] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:58.662897 18603 raft_consensus.cc:2955] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.681738 19423 ts_tablet_manager.cc:1929] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:58.681468 19246 raft_consensus.cc:2955] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.683085 18665 tablet_service.cc:1558] Processing DeleteTablet for tablet f9141b3d8f87474d8f4752290efe5963 with delete_type TABLET_DATA_TOMBSTONED (TS a0dee333a83a45f1ab0c1bb6d094afd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40796
I20260709 12:21:58.700637 19426 tablet_replica.cc:333] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:21:58.701789 19426 raft_consensus.cc:2243] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.702605 19426 raft_consensus.cc:2272] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.703464 19423 log.cc:1199] T d52124cfb8a140deaab206a18aadc308 P c7bd71f1f37c45f28b52c154e59356b9: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-1-root/wals/d52124cfb8a140deaab206a18aadc308
I20260709 12:21:58.696012 18425 catalog_manager.cc:5697] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:58.709753 18411 catalog_manager.cc:5028] TS c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): tablet d52124cfb8a140deaab206a18aadc308 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:21:58.714123 19426 ts_tablet_manager.cc:1916] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:58.718030 19427 tablet_replica.cc:333] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:21:58.723907 19427 raft_consensus.cc:2243] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.724706 19427 raft_consensus.cc:2272] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.738032 19427 ts_tablet_manager.cc:1916] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:58.751789 18677 consensus_queue.cc:237] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:21:58.752496 19426 ts_tablet_manager.cc:1929] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:58.753123 19426 log.cc:1199] T f6c6156a485f436881bf4d1fb67194d2 P 2f9872512f1646bc835906bd0e98c6a7: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-0-root/wals/f6c6156a485f436881bf4d1fb67194d2
I20260709 12:21:58.754804 18413 catalog_manager.cc:5028] TS 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): tablet f6c6156a485f436881bf4d1fb67194d2 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:21:58.758836 19246 raft_consensus.cc:1275] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:58.758852 18525 raft_consensus.cc:1275] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:58.761070 19393 consensus_queue.cc:1048] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:58.766520 19407 consensus_queue.cc:1048] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:58.770026 19427 ts_tablet_manager.cc:1929] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:58.770536 19427 log.cc:1199] T f9141b3d8f87474d8f4752290efe5963 P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-2-root/wals/f9141b3d8f87474d8f4752290efe5963
I20260709 12:21:58.772539 18411 catalog_manager.cc:5028] TS a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): tablet f9141b3d8f87474d8f4752290efe5963 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:21:58.775942 19393 raft_consensus.cc:2955] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.778401 19246 raft_consensus.cc:2955] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.786370 18526 raft_consensus.cc:2955] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:21:58.790566 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 678726cf80464d89802570ca4d73600f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:58.797578 18424 catalog_manager.cc:5697] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:58.814781 18587 tablet_service.cc:1558] Processing DeleteTablet for tablet 678726cf80464d89802570ca4d73600f with delete_type TABLET_DATA_TOMBSTONED (TS c7bd71f1f37c45f28b52c154e59356b9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40934
I20260709 12:21:58.815801 19423 tablet_replica.cc:333] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:21:58.816864 19423 raft_consensus.cc:2243] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.817516 19423 raft_consensus.cc:2272] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.821341 19423 ts_tablet_manager.cc:1916] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:58.839053 19423 ts_tablet_manager.cc:1929] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:58.839557 19423 log.cc:1199] T 678726cf80464d89802570ca4d73600f P c7bd71f1f37c45f28b52c154e59356b9: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-1-root/wals/678726cf80464d89802570ca4d73600f
I20260709 12:21:58.841068 18411 catalog_manager.cc:5028] TS c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): tablet 678726cf80464d89802570ca4d73600f (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:21:59.905023 18679 consensus_queue.cc:237] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:59.915217 18529 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:21:59.917002 18644 consensus_peers.cc:597] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5ab652408d034870b0f276a90a6132d7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:59.917059 19376 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:59.918043 18601 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:59.919801 19435 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:59.930325 19376 raft_consensus.cc:2955] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:59.935590 18529 raft_consensus.cc:2955] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:59.937320 18601 raft_consensus.cc:2955] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:59.952214 18602 consensus_queue.cc:237] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:21:59.961115 18425 catalog_manager.cc:5697] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 2 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:21:59.967140 18529 raft_consensus.cc:1275] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:59.967664 18676 raft_consensus.cc:1275] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:59.967932 18570 consensus_peers.cc:597] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 75f0f0df600b45d1b1ba9f3a58145915. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:59.972020 19436 consensus_queue.cc:1048] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:59.973752 18996 consensus_queue.cc:1048] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:00.045316 19436 raft_consensus.cc:2955] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:00.048913 18676 raft_consensus.cc:2955] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:00.056322 18526 raft_consensus.cc:2955] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:00.061761 18529 consensus_queue.cc:237] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:00.070880 18426 catalog_manager.cc:5697] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:00.089133 18676 raft_consensus.cc:1275] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:00.090525 18601 raft_consensus.cc:1275] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:22:00.091284 18494 consensus_peers.cc:597] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 172bc8a62f9b4215b7395487dd4afd2b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:00.092322 19396 consensus_queue.cc:1048] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:00.093304 19433 consensus_queue.cc:1048] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:00.102186 19433 raft_consensus.cc:2955] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:00.105162 18601 raft_consensus.cc:2955] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:00.103833 18676 raft_consensus.cc:2955] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:00.121222 18526 consensus_queue.cc:237] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:00.125785 18424 catalog_manager.cc:5697] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:00.136821 18676 raft_consensus.cc:1275] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:00.141728 18601 raft_consensus.cc:1275] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:22:00.143596 18494 consensus_peers.cc:597] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cdefe54c01e0436d82e68981b642554b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:00.145303 19432 consensus_queue.cc:1048] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:00.148401 19433 consensus_queue.cc:1048] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:00.161343 19356 raft_consensus.cc:2955] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:00.162482 18602 raft_consensus.cc:2955] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:00.172533 18676 raft_consensus.cc:2955] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:00.182243 18425 catalog_manager.cc:5697] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:00.309337 19453 ts_tablet_manager.cc:933] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:00.311319 19453 tablet_copy_client.cc:323] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.131:36757
I20260709 12:22:00.313292 18690 tablet_copy_service.cc:140] P a0dee333a83a45f1ab0c1bb6d094afd1: Received BeginTabletCopySession request for tablet 5ab652408d034870b0f276a90a6132d7 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:50938)
I20260709 12:22:00.313841 18690 tablet_copy_service.cc:161] P a0dee333a83a45f1ab0c1bb6d094afd1: Beginning new tablet copy session on tablet 5ab652408d034870b0f276a90a6132d7 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:50938: session id = 8c29c312e4544452b1162d7f81a58cb4-5ab652408d034870b0f276a90a6132d7
I20260709 12:22:00.323993 18690 tablet_copy_source_session.cc:215] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:00.327903 19453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ab652408d034870b0f276a90a6132d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:00.345988 19453 tablet_copy_client.cc:806] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:00.346645 19453 tablet_copy_client.cc:670] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:00.351035 19453 tablet_copy_client.cc:538] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:00.362263 19453 tablet_bootstrap.cc:492] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:22:00.390218 19453 tablet_bootstrap.cc:492] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:00.391239 19453 tablet_bootstrap.cc:492] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:22:00.392030 19453 ts_tablet_manager.cc:1403] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.012s
I20260709 12:22:00.395282 19453 raft_consensus.cc:359] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:00.396169 19453 raft_consensus.cc:740] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:22:00.396773 19453 consensus_queue.cc:260] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:00.401423 19453 ts_tablet_manager.cc:1434] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:22:00.401651 19457 ts_tablet_manager.cc:933] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:00.405421 19457 tablet_copy_client.cc:323] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.130:37079
I20260709 12:22:00.405855 18690 tablet_copy_service.cc:342] P a0dee333a83a45f1ab0c1bb6d094afd1: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-5ab652408d034870b0f276a90a6132d7 received from {username='slave'} at 127.0.0.1:50938
I20260709 12:22:00.406426 18690 tablet_copy_service.cc:434] P a0dee333a83a45f1ab0c1bb6d094afd1: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-5ab652408d034870b0f276a90a6132d7 on tablet 5ab652408d034870b0f276a90a6132d7 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:00.408624 18616 tablet_copy_service.cc:140] P c7bd71f1f37c45f28b52c154e59356b9: Received BeginTabletCopySession request for tablet 75f0f0df600b45d1b1ba9f3a58145915 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:39798)
I20260709 12:22:00.409291 18616 tablet_copy_service.cc:161] P c7bd71f1f37c45f28b52c154e59356b9: Beginning new tablet copy session on tablet 75f0f0df600b45d1b1ba9f3a58145915 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:39798: session id = 8c29c312e4544452b1162d7f81a58cb4-75f0f0df600b45d1b1ba9f3a58145915
I20260709 12:22:00.418031 18616 tablet_copy_source_session.cc:215] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:00.422235 19457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75f0f0df600b45d1b1ba9f3a58145915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:00.440717 19457 tablet_copy_client.cc:806] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:00.441421 19457 tablet_copy_client.cc:670] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:00.447976 19457 tablet_copy_client.cc:538] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:00.459390 19457 tablet_bootstrap.cc:492] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:22:00.483240 19457 tablet_bootstrap.cc:492] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:00.484285 19457 tablet_bootstrap.cc:492] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:22:00.484997 19457 ts_tablet_manager.cc:1403] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.026s	user 0.021s	sys 0.005s
I20260709 12:22:00.488746 19457 raft_consensus.cc:359] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:00.489672 19457 raft_consensus.cc:740] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:22:00.490386 19457 consensus_queue.cc:260] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:00.495421 19457 ts_tablet_manager.cc:1434] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:22:00.498904 18616 tablet_copy_service.cc:342] P c7bd71f1f37c45f28b52c154e59356b9: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-75f0f0df600b45d1b1ba9f3a58145915 received from {username='slave'} at 127.0.0.1:39798
I20260709 12:22:00.499387 18616 tablet_copy_service.cc:434] P c7bd71f1f37c45f28b52c154e59356b9: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-75f0f0df600b45d1b1ba9f3a58145915 on tablet 75f0f0df600b45d1b1ba9f3a58145915 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:00.663872 19457 ts_tablet_manager.cc:933] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:22:00.665797 19457 tablet_copy_client.cc:323] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.129:45155
I20260709 12:22:00.667869 18540 tablet_copy_service.cc:140] P 2f9872512f1646bc835906bd0e98c6a7: Received BeginTabletCopySession request for tablet 172bc8a62f9b4215b7395487dd4afd2b from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:43124)
I20260709 12:22:00.668582 18540 tablet_copy_service.cc:161] P 2f9872512f1646bc835906bd0e98c6a7: Beginning new tablet copy session on tablet 172bc8a62f9b4215b7395487dd4afd2b from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:43124: session id = 8c29c312e4544452b1162d7f81a58cb4-172bc8a62f9b4215b7395487dd4afd2b
I20260709 12:22:00.675042 18540 tablet_copy_source_session.cc:215] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:00.679855 19457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172bc8a62f9b4215b7395487dd4afd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:00.702636 19457 tablet_copy_client.cc:806] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:00.703234 19457 tablet_copy_client.cc:670] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:00.707401 19457 tablet_copy_client.cc:538] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:00.715236 19457 tablet_bootstrap.cc:492] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:22:00.732594 19457 tablet_bootstrap.cc:492] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:00.733400 19457 tablet_bootstrap.cc:492] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:22:00.734005 19457 ts_tablet_manager.cc:1403] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.019s	user 0.019s	sys 0.000s
I20260709 12:22:00.736792 19457 raft_consensus.cc:359] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:00.737849 19457 raft_consensus.cc:740] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:22:00.738536 19457 consensus_queue.cc:260] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:00.740760 19457 ts_tablet_manager.cc:1434] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:22:00.743119 18540 tablet_copy_service.cc:342] P 2f9872512f1646bc835906bd0e98c6a7: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-172bc8a62f9b4215b7395487dd4afd2b received from {username='slave'} at 127.0.0.1:43124
I20260709 12:22:00.743558 18540 tablet_copy_service.cc:434] P 2f9872512f1646bc835906bd0e98c6a7: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-172bc8a62f9b4215b7395487dd4afd2b on tablet 172bc8a62f9b4215b7395487dd4afd2b with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:00.748193 19457 ts_tablet_manager.cc:933] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:22:00.751523 19457 tablet_copy_client.cc:323] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.129:45155
I20260709 12:22:00.753154 18540 tablet_copy_service.cc:140] P 2f9872512f1646bc835906bd0e98c6a7: Received BeginTabletCopySession request for tablet cdefe54c01e0436d82e68981b642554b from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:43124)
I20260709 12:22:00.753643 18540 tablet_copy_service.cc:161] P 2f9872512f1646bc835906bd0e98c6a7: Beginning new tablet copy session on tablet cdefe54c01e0436d82e68981b642554b from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:43124: session id = 8c29c312e4544452b1162d7f81a58cb4-cdefe54c01e0436d82e68981b642554b
I20260709 12:22:00.760012 18540 tablet_copy_source_session.cc:215] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:00.763355 19457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdefe54c01e0436d82e68981b642554b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:00.779968 19457 tablet_copy_client.cc:806] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:00.780555 19457 tablet_copy_client.cc:670] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:00.784693 19457 tablet_copy_client.cc:538] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:00.793500 19457 tablet_bootstrap.cc:492] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:22:00.809788 19457 tablet_bootstrap.cc:492] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:00.810755 19457 tablet_bootstrap.cc:492] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:22:00.811430 19457 ts_tablet_manager.cc:1403] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.004s
I20260709 12:22:00.814141 19457 raft_consensus.cc:359] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:00.814924 19457 raft_consensus.cc:740] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:22:00.815511 19457 consensus_queue.cc:260] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:00.817803 19457 ts_tablet_manager.cc:1434] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:22:00.821805 18540 tablet_copy_service.cc:342] P 2f9872512f1646bc835906bd0e98c6a7: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-cdefe54c01e0436d82e68981b642554b received from {username='slave'} at 127.0.0.1:43124
I20260709 12:22:00.822254 18540 tablet_copy_service.cc:434] P 2f9872512f1646bc835906bd0e98c6a7: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-cdefe54c01e0436d82e68981b642554b on tablet cdefe54c01e0436d82e68981b642554b with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:00.924916 19246 raft_consensus.cc:1217] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:22:01.017381 19246 raft_consensus.cc:1217] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:01.056545 19246 raft_consensus.cc:1217] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:01.276595 19246 raft_consensus.cc:1217] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:01.325525 19464 raft_consensus.cc:1064] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:22:01.329550 19464 consensus_queue.cc:237] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:01.339027 18526 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:22:01.340734 19246 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 LEARNER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:22:01.341151 19464 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:01.343295 18602 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:22:01.350879 19464 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:01.358974 19434 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:01.371083 19434 raft_consensus.cc:2955] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.389189 18529 raft_consensus.cc:2955] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.393441 19246 raft_consensus.cc:2955] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.404884 18425 catalog_manager.cc:5697] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:01.418146 19436 raft_consensus.cc:1064] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:22:01.421201 19436 consensus_queue.cc:237] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:01.432730 18602 raft_consensus.cc:2955] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.445199 18679 raft_consensus.cc:1275] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:01.445467 19246 raft_consensus.cc:1275] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:01.446762 19436 consensus_queue.cc:1048] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:01.453696 19364 consensus_queue.cc:1048] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:22:01.494087 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 52466.5us
I20260709 12:22:01.499572 19473 raft_consensus.cc:2955] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.504230 18524 raft_consensus.cc:1275] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:01.504092 19246 raft_consensus.cc:2955] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.509572 19474 consensus_queue.cc:1048] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:01.526166 18676 raft_consensus.cc:2955] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.539328 18676 consensus_queue.cc:237] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:01.545084 18524 raft_consensus.cc:2955] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.548137 19248 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:22:01.548197 18601 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:22:01.550164 19467 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:01.552865 18424 catalog_manager.cc:5697] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:01.565678 19464 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:01.578514 19464 raft_consensus.cc:2955] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.580042 18602 raft_consensus.cc:2955] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.594132 19246 raft_consensus.cc:2955] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.608340 18602 consensus_queue.cc:237] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:01.611769 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5ab652408d034870b0f276a90a6132d7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:01.614982 18424 catalog_manager.cc:5697] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New cstate: current_term: 2 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.622489 19246 raft_consensus.cc:1275] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:01.624321 19473 consensus_queue.cc:1048] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:01.628468 18676 raft_consensus.cc:1275] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:01.631076 19473 consensus_queue.cc:1048] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:01.633112 19474 raft_consensus.cc:2955] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.635861 19246 raft_consensus.cc:2955] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.641296 18676 raft_consensus.cc:2955] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.650296 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 75f0f0df600b45d1b1ba9f3a58145915 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:01.658807 18512 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ab652408d034870b0f276a90a6132d7 with delete_type TABLET_DATA_TOMBSTONED (TS 2f9872512f1646bc835906bd0e98c6a7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57364
I20260709 12:22:01.661370 19481 tablet_replica.cc:333] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:22:01.662930 19481 raft_consensus.cc:2243] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.663879 19481 raft_consensus.cc:2272] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.668049 19481 ts_tablet_manager.cc:1916] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:01.664012 18425 catalog_manager.cc:5697] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:01.690054 19433 raft_consensus.cc:1064] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:22:01.692931 19433 consensus_queue.cc:237] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:01.710860 19246 raft_consensus.cc:1275] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:01.713843 18676 raft_consensus.cc:1275] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:01.716012 19396 consensus_queue.cc:1048] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:01.717080 19481 ts_tablet_manager.cc:1929] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:22:01.717553 19481 log.cc:1199] T 5ab652408d034870b0f276a90a6132d7 P 2f9872512f1646bc835906bd0e98c6a7: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-0-root/wals/5ab652408d034870b0f276a90a6132d7
I20260709 12:22:01.717808 19356 consensus_queue.cc:1048] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:01.719671 18413 catalog_manager.cc:5028] TS 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): tablet 5ab652408d034870b0f276a90a6132d7 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:22:01.735894 18602 raft_consensus.cc:1275] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:01.739619 19396 consensus_queue.cc:1048] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:01.748590 18512 tablet_service.cc:1558] Processing DeleteTablet for tablet 75f0f0df600b45d1b1ba9f3a58145915 with delete_type TABLET_DATA_TOMBSTONED (TS 2f9872512f1646bc835906bd0e98c6a7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57364
I20260709 12:22:01.750465 19481 tablet_replica.cc:333] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:22:01.751886 19481 raft_consensus.cc:2243] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.752717 19481 raft_consensus.cc:2272] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.764757 19481 ts_tablet_manager.cc:1916] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:01.796178 19433 raft_consensus.cc:2955] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.797349 19246 raft_consensus.cc:2955] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.809796 19481 ts_tablet_manager.cc:1929] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:01.810380 19481 log.cc:1199] T 75f0f0df600b45d1b1ba9f3a58145915 P 2f9872512f1646bc835906bd0e98c6a7: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-0-root/wals/75f0f0df600b45d1b1ba9f3a58145915
I20260709 12:22:01.811951 18413 catalog_manager.cc:5028] TS 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): tablet 75f0f0df600b45d1b1ba9f3a58145915 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:22:01.811501 18677 raft_consensus.cc:2955] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.831179 18426 catalog_manager.cc:5697] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.838383 18605 raft_consensus.cc:2955] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.854646 18529 consensus_queue.cc:237] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:01.861497 18605 raft_consensus.cc:1275] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:01.861955 19246 raft_consensus.cc:1275] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:01.862927 19356 consensus_queue.cc:1048] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:01.864558 19356 consensus_queue.cc:1048] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:01.871382 19483 raft_consensus.cc:2955] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.879034 19246 raft_consensus.cc:2955] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.883391 18602 raft_consensus.cc:2955] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.899143 19396 raft_consensus.cc:1064] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:22:01.899677 18427 catalog_manager.cc:5697] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.901558 19396 consensus_queue.cc:237] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:01.913201 18413 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 172bc8a62f9b4215b7395487dd4afd2b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:01.917465 18665 tablet_service.cc:1558] Processing DeleteTablet for tablet 172bc8a62f9b4215b7395487dd4afd2b with delete_type TABLET_DATA_TOMBSTONED (TS a0dee333a83a45f1ab0c1bb6d094afd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40796
I20260709 12:22:01.930841 18677 raft_consensus.cc:1275] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:01.931043 18605 raft_consensus.cc:1275] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:01.934516 19356 consensus_queue.cc:1048] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:01.937852 19396 consensus_queue.cc:1048] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:01.957268 19488 tablet_replica.cc:333] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:22:01.959637 19488 raft_consensus.cc:2243] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.960546 19488 raft_consensus.cc:2272] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.962051 19246 raft_consensus.cc:1275] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:01.964207 19483 consensus_queue.cc:1048] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:01.980682 19488 ts_tablet_manager.cc:1916] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:01.992923 19433 raft_consensus.cc:2955] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:01.996644 18601 raft_consensus.cc:2955] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:02.000710 19248 raft_consensus.cc:2955] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:02.020215 18677 raft_consensus.cc:2955] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:02.025475 18425 catalog_manager.cc:5697] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:02.057421 18529 consensus_queue.cc:237] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:02.067577 19248 raft_consensus.cc:1275] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:02.068017 18677 raft_consensus.cc:1275] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:02.070098 19488 ts_tablet_manager.cc:1929] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:02.070502 19488 log.cc:1199] T 172bc8a62f9b4215b7395487dd4afd2b P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-2-root/wals/172bc8a62f9b4215b7395487dd4afd2b
I20260709 12:22:02.071848 19487 consensus_queue.cc:1048] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:02.074589 18411 catalog_manager.cc:5028] TS a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): tablet 172bc8a62f9b4215b7395487dd4afd2b (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:22:02.075273 19433 consensus_queue.cc:1048] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:02.087049 19487 raft_consensus.cc:2955] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:02.091382 18677 raft_consensus.cc:2955] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:02.094264 19248 raft_consensus.cc:2955] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:02.107944 18413 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cdefe54c01e0436d82e68981b642554b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:02.117604 18427 catalog_manager.cc:5697] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New cstate: current_term: 1 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:02.131693 18587 tablet_service.cc:1558] Processing DeleteTablet for tablet cdefe54c01e0436d82e68981b642554b with delete_type TABLET_DATA_TOMBSTONED (TS c7bd71f1f37c45f28b52c154e59356b9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40934
I20260709 12:22:02.133754 19494 tablet_replica.cc:333] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:22:02.134994 19494 raft_consensus.cc:2243] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:02.135739 19494 raft_consensus.cc:2272] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:02.139591 19494 ts_tablet_manager.cc:1916] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:02.153715 19494 ts_tablet_manager.cc:1929] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:02.154234 19494 log.cc:1199] T cdefe54c01e0436d82e68981b642554b P c7bd71f1f37c45f28b52c154e59356b9: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-1-root/wals/cdefe54c01e0436d82e68981b642554b
I20260709 12:22:02.156229 18411 catalog_manager.cc:5028] TS c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): tablet cdefe54c01e0436d82e68981b642554b (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:22:03.248215 18676 consensus_queue.cc:237] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
W20260709 12:22:03.255683 18644 consensus_peers.cc:597] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4eceb66ae237462f8f0e7e3b03872311. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:03.255785 18529 raft_consensus.cc:1275] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:03.255785 18602 raft_consensus.cc:1275] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:03.258260 19495 consensus_queue.cc:1048] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:03.260416 19495 consensus_queue.cc:1048] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:03.266057 19464 raft_consensus.cc:2955] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:03.268481 18529 raft_consensus.cc:2955] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:03.271589 18602 raft_consensus.cc:2955] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:03.282059 18601 consensus_queue.cc:237] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:03.287449 18426 catalog_manager.cc:5697] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:03.296868 18570 consensus_peers.cc:597] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 222ae469827d4570aa1d61844f01eae9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:03.300209 18679 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:03.300331 18524 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:03.301892 19497 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:03.302932 19496 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:03.322505 19497 raft_consensus.cc:2955] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:03.325570 18679 raft_consensus.cc:2955] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:03.342605 18601 consensus_queue.cc:237] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:03.336760 18529 raft_consensus.cc:2955] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:03.347117 18427 catalog_manager.cc:5697] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:03.363636 18529 raft_consensus.cc:1275] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:22:03.363893 18570 consensus_peers.cc:597] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 400ea90be13249389635103ccb1dfee6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:03.365052 19497 consensus_queue.cc:1048] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:03.367681 18679 raft_consensus.cc:1275] T 400ea90be13249389635103ccb1dfee6 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:03.374958 19497 consensus_queue.cc:1048] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:03.380322 19497 raft_consensus.cc:2955] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:03.384064 18529 raft_consensus.cc:2955] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:03.394515 18679 raft_consensus.cc:2955] T 400ea90be13249389635103ccb1dfee6 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:03.404887 18427 catalog_manager.cc:5697] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:03.407958 18679 consensus_queue.cc:237] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
W20260709 12:22:03.419942 18644 consensus_peers.cc:597] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 49c1709156f048cd8184a38476ebfe0d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:03.423611 18601 raft_consensus.cc:1275] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:03.425736 18529 raft_consensus.cc:1275] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:03.426527 19464 consensus_queue.cc:1048] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:22:03.437870 19495 consensus_queue.cc:1048] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:03.459282 19464 raft_consensus.cc:2955] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:03.460964 18601 raft_consensus.cc:2955] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:03.461953 18529 raft_consensus.cc:2955] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:03.476647 18425 catalog_manager.cc:5697] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:03.669304 19515 ts_tablet_manager.cc:933] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:03.671273 19515 tablet_copy_client.cc:323] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.131:36757
I20260709 12:22:03.673075 18690 tablet_copy_service.cc:140] P a0dee333a83a45f1ab0c1bb6d094afd1: Received BeginTabletCopySession request for tablet 4eceb66ae237462f8f0e7e3b03872311 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:50938)
I20260709 12:22:03.673609 18690 tablet_copy_service.cc:161] P a0dee333a83a45f1ab0c1bb6d094afd1: Beginning new tablet copy session on tablet 4eceb66ae237462f8f0e7e3b03872311 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:50938: session id = 8c29c312e4544452b1162d7f81a58cb4-4eceb66ae237462f8f0e7e3b03872311
I20260709 12:22:03.680236 18690 tablet_copy_source_session.cc:215] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:03.683324 19515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eceb66ae237462f8f0e7e3b03872311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:03.705046 19515 tablet_copy_client.cc:806] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:03.705726 19515 tablet_copy_client.cc:670] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:03.710421 19515 tablet_copy_client.cc:538] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:03.720880 19515 tablet_bootstrap.cc:492] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:22:03.735188 19517 ts_tablet_manager.cc:933] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:03.738248 19517 tablet_copy_client.cc:323] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.130:37079
I20260709 12:22:03.740036 18616 tablet_copy_service.cc:140] P c7bd71f1f37c45f28b52c154e59356b9: Received BeginTabletCopySession request for tablet 222ae469827d4570aa1d61844f01eae9 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:39798)
I20260709 12:22:03.740680 18616 tablet_copy_service.cc:161] P c7bd71f1f37c45f28b52c154e59356b9: Beginning new tablet copy session on tablet 222ae469827d4570aa1d61844f01eae9 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:39798: session id = 8c29c312e4544452b1162d7f81a58cb4-222ae469827d4570aa1d61844f01eae9
I20260709 12:22:03.744426 19515 tablet_bootstrap.cc:492] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:03.745949 19515 tablet_bootstrap.cc:492] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:22:03.746573 19515 ts_tablet_manager.cc:1403] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.001s
I20260709 12:22:03.749552 19515 raft_consensus.cc:359] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:03.750367 19515 raft_consensus.cc:740] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:22:03.751407 19515 consensus_queue.cc:260] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:03.763262 18616 tablet_copy_source_session.cc:215] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:03.767446 19517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222ae469827d4570aa1d61844f01eae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:03.768270 19515 ts_tablet_manager.cc:1434] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 12:22:03.771018 18690 tablet_copy_service.cc:342] P a0dee333a83a45f1ab0c1bb6d094afd1: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-4eceb66ae237462f8f0e7e3b03872311 received from {username='slave'} at 127.0.0.1:50938
I20260709 12:22:03.771479 18690 tablet_copy_service.cc:434] P a0dee333a83a45f1ab0c1bb6d094afd1: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-4eceb66ae237462f8f0e7e3b03872311 on tablet 4eceb66ae237462f8f0e7e3b03872311 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:03.786885 19517 tablet_copy_client.cc:806] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:03.787568 19517 tablet_copy_client.cc:670] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:03.791429 19517 tablet_copy_client.cc:538] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:03.798324 19517 tablet_bootstrap.cc:492] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:22:03.818863 19517 tablet_bootstrap.cc:492] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:03.819727 19517 tablet_bootstrap.cc:492] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:22:03.820387 19517 ts_tablet_manager.cc:1403] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.007s
I20260709 12:22:03.822853 19517 raft_consensus.cc:359] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:03.823513 19517 raft_consensus.cc:740] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:22:03.824069 19517 consensus_queue.cc:260] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:03.826879 19517 ts_tablet_manager.cc:1434] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:22:03.829360 18616 tablet_copy_service.cc:342] P c7bd71f1f37c45f28b52c154e59356b9: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-222ae469827d4570aa1d61844f01eae9 received from {username='slave'} at 127.0.0.1:39798
I20260709 12:22:03.829949 18616 tablet_copy_service.cc:434] P c7bd71f1f37c45f28b52c154e59356b9: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-222ae469827d4570aa1d61844f01eae9 on tablet 222ae469827d4570aa1d61844f01eae9 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:03.923853 19517 ts_tablet_manager.cc:933] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:03.926689 19517 tablet_copy_client.cc:323] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.130:37079
I20260709 12:22:03.929248 18616 tablet_copy_service.cc:140] P c7bd71f1f37c45f28b52c154e59356b9: Received BeginTabletCopySession request for tablet 400ea90be13249389635103ccb1dfee6 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:39798)
I20260709 12:22:03.929801 18616 tablet_copy_service.cc:161] P c7bd71f1f37c45f28b52c154e59356b9: Beginning new tablet copy session on tablet 400ea90be13249389635103ccb1dfee6 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:39798: session id = 8c29c312e4544452b1162d7f81a58cb4-400ea90be13249389635103ccb1dfee6
I20260709 12:22:03.936473 18616 tablet_copy_source_session.cc:215] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:03.939428 19517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400ea90be13249389635103ccb1dfee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:03.959250 19517 tablet_copy_client.cc:806] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:03.959947 19517 tablet_copy_client.cc:670] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:03.975215 19517 tablet_copy_client.cc:538] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:03.990847 19517 tablet_bootstrap.cc:492] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:22:04.025813 19517 tablet_bootstrap.cc:492] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:04.027230 19517 tablet_bootstrap.cc:492] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:22:04.028268 19517 ts_tablet_manager.cc:1403] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.011s
I20260709 12:22:04.032480 19517 raft_consensus.cc:359] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:04.033454 19517 raft_consensus.cc:740] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:22:04.034327 19515 ts_tablet_manager.cc:933] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:04.034178 19517 consensus_queue.cc:260] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:04.046608 19517 ts_tablet_manager.cc:1434] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:22:04.048636 18616 tablet_copy_service.cc:342] P c7bd71f1f37c45f28b52c154e59356b9: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-400ea90be13249389635103ccb1dfee6 received from {username='slave'} at 127.0.0.1:39798
I20260709 12:22:04.049237 18616 tablet_copy_service.cc:434] P c7bd71f1f37c45f28b52c154e59356b9: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-400ea90be13249389635103ccb1dfee6 on tablet 400ea90be13249389635103ccb1dfee6 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:04.051527 19515 tablet_copy_client.cc:323] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.131:36757
I20260709 12:22:04.053277 18690 tablet_copy_service.cc:140] P a0dee333a83a45f1ab0c1bb6d094afd1: Received BeginTabletCopySession request for tablet 49c1709156f048cd8184a38476ebfe0d from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:50938)
I20260709 12:22:04.053798 18690 tablet_copy_service.cc:161] P a0dee333a83a45f1ab0c1bb6d094afd1: Beginning new tablet copy session on tablet 49c1709156f048cd8184a38476ebfe0d from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:50938: session id = 8c29c312e4544452b1162d7f81a58cb4-49c1709156f048cd8184a38476ebfe0d
I20260709 12:22:04.061880 18690 tablet_copy_source_session.cc:215] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:04.065264 19515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c1709156f048cd8184a38476ebfe0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.083065 19515 tablet_copy_client.cc:806] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:04.083633 19515 tablet_copy_client.cc:670] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:04.088140 19515 tablet_copy_client.cc:538] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:04.100107 19515 tablet_bootstrap.cc:492] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:22:04.120605 19515 tablet_bootstrap.cc:492] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:04.121475 19515 tablet_bootstrap.cc:492] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:22:04.122224 19515 ts_tablet_manager.cc:1403] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 12:22:04.124490 19515 raft_consensus.cc:359] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:04.125277 19515 raft_consensus.cc:740] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:22:04.125928 19515 consensus_queue.cc:260] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:04.129823 19515 ts_tablet_manager.cc:1434] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:04.132819 18690 tablet_copy_service.cc:342] P a0dee333a83a45f1ab0c1bb6d094afd1: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-49c1709156f048cd8184a38476ebfe0d received from {username='slave'} at 127.0.0.1:50938
I20260709 12:22:04.133312 18690 tablet_copy_service.cc:434] P a0dee333a83a45f1ab0c1bb6d094afd1: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-49c1709156f048cd8184a38476ebfe0d on tablet 49c1709156f048cd8184a38476ebfe0d with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:04.179358 19248 raft_consensus.cc:1217] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:04.306126 19248 raft_consensus.cc:1217] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:04.349108 19245 raft_consensus.cc:1217] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:04.491083 19245 raft_consensus.cc:1217] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:04.736157 19531 raft_consensus.cc:1064] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:22:04.738741 19531 consensus_queue.cc:237] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:04.740502 19436 raft_consensus.cc:1064] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:22:04.742892 19436 consensus_queue.cc:237] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:04.756078 19245 raft_consensus.cc:1275] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:04.757704 19525 consensus_queue.cc:1048] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:04.759809 18529 raft_consensus.cc:1275] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:04.759090 18679 raft_consensus.cc:1275] T 400ea90be13249389635103ccb1dfee6 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:04.761607 19436 consensus_queue.cc:1048] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:04.763774 18529 raft_consensus.cc:1275] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:04.763990 19245 raft_consensus.cc:1275] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:04.764816 18601 raft_consensus.cc:1275] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:04.766997 19531 consensus_queue.cc:1048] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:04.771104 19467 consensus_queue.cc:1048] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:04.774726 19532 consensus_queue.cc:1048] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:04.775672 19523 consensus_queue.cc:1048] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:04.799376 19525 raft_consensus.cc:1064] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:22:04.802353 19525 consensus_queue.cc:237] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:04.809933 19495 raft_consensus.cc:2955] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:04.822607 19246 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:04.824638 19523 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:04.825477 18524 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:04.826901 19436 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:04.824613 18526 raft_consensus.cc:2955] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:04.828074 18679 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:04.835916 19436 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:04.840327 19246 raft_consensus.cc:2955] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:04.857440 18425 catalog_manager.cc:5697] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:04.866847 19527 raft_consensus.cc:2955] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:04.879426 18525 raft_consensus.cc:2955] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:04.885623 19246 raft_consensus.cc:2955] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:04.903992 18676 raft_consensus.cc:2955] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:04.907042 18677 raft_consensus.cc:2955] T 400ea90be13249389635103ccb1dfee6 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:04.899437 19523 raft_consensus.cc:2955] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:04.912983 18601 raft_consensus.cc:2955] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:04.916152 19467 raft_consensus.cc:1064] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:22:04.922565 19467 consensus_queue.cc:237] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:04.940552 18525 raft_consensus.cc:2955] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:04.952487 18424 catalog_manager.cc:5697] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:04.956525 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 53778.4us
I20260709 12:22:04.982252 19245 raft_consensus.cc:1275] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:04.983789 18601 raft_consensus.cc:1275] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:04.984876 18525 raft_consensus.cc:1275] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:04.984639 19532 consensus_queue.cc:1048] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:04.990698 18601 consensus_queue.cc:237] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:04.995818 19532 consensus_queue.cc:1048] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:04.997295 19531 consensus_queue.cc:1048] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:04.996002 18676 consensus_queue.cc:237] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:05.016623 18526 raft_consensus.cc:1275] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:05.023965 19547 consensus_queue.cc:1048] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:05.024659 18427 catalog_manager.cc:5697] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
W20260709 12:22:05.028143 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 60773.8us
I20260709 12:22:05.110249 19246 raft_consensus.cc:1275] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:05.112829 19248 raft_consensus.cc:2955] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:05.118213 19246 raft_consensus.cc:1275] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:05.127302 19525 consensus_queue.cc:1048] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:05.142927 19547 raft_consensus.cc:2955] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:05.145659 18601 consensus_queue.cc:237] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:05.151177 19464 consensus_queue.cc:1048] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:05.155282 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 400ea90be13249389635103ccb1dfee6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:05.158568 18679 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:05.158752 19245 raft_consensus.cc:2955] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:05.164475 19436 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:05.170279 18426 catalog_manager.cc:5697] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:05.175794 19246 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:05.182818 18525 raft_consensus.cc:1275] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:05.188496 19527 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:05.192287 19552 raft_consensus.cc:2955] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:05.196231 18665 tablet_service.cc:1558] Processing DeleteTablet for tablet 400ea90be13249389635103ccb1dfee6 with delete_type TABLET_DATA_TOMBSTONED (TS a0dee333a83a45f1ab0c1bb6d094afd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40796
W20260709 12:22:05.206694 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 49162.8us
I20260709 12:22:05.211117 19558 consensus_queue.cc:1048] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:05.218816 19248 raft_consensus.cc:2955] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:05.220340 18679 raft_consensus.cc:2955] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
W20260709 12:22:05.232599 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 84552us
I20260709 12:22:05.234731 19532 raft_consensus.cc:2955] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:05.239234 19561 tablet_replica.cc:333] T 400ea90be13249389635103ccb1dfee6 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:22:05.238893 19531 raft_consensus.cc:2955] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:05.248948 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 222ae469827d4570aa1d61844f01eae9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:05.248082 18525 raft_consensus.cc:2955] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:05.246968 18526 raft_consensus.cc:2955] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:05.258332 19248 raft_consensus.cc:2955] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:05.261554 18426 catalog_manager.cc:5697] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:05.276383 18512 tablet_service.cc:1558] Processing DeleteTablet for tablet 222ae469827d4570aa1d61844f01eae9 with delete_type TABLET_DATA_TOMBSTONED (TS 2f9872512f1646bc835906bd0e98c6a7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57364
I20260709 12:22:05.279727 19561 raft_consensus.cc:2243] T 400ea90be13249389635103ccb1dfee6 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:05.280560 19561 raft_consensus.cc:2272] T 400ea90be13249389635103ccb1dfee6 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:05.291275 18602 raft_consensus.cc:2955] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:05.292281 19248 raft_consensus.cc:2955] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:05.298393 19561 ts_tablet_manager.cc:1916] T 400ea90be13249389635103ccb1dfee6 P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:05.302827 18525 raft_consensus.cc:2955] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:05.306432 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4eceb66ae237462f8f0e7e3b03872311 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:05.328718 18426 catalog_manager.cc:5697] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:05.344211 19562 tablet_replica.cc:333] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:22:05.345757 19562 raft_consensus.cc:2243] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:05.346567 19562 raft_consensus.cc:2272] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:05.356469 19562 ts_tablet_manager.cc:1916] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:05.357393 18424 catalog_manager.cc:5697] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:05.369442 18587 tablet_service.cc:1558] Processing DeleteTablet for tablet 4eceb66ae237462f8f0e7e3b03872311 with delete_type TABLET_DATA_TOMBSTONED (TS c7bd71f1f37c45f28b52c154e59356b9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40934
I20260709 12:22:05.369418 19561 ts_tablet_manager.cc:1929] T 400ea90be13249389635103ccb1dfee6 P a0dee333a83a45f1ab0c1bb6d094afd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:05.379540 19561 log.cc:1199] T 400ea90be13249389635103ccb1dfee6 P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-2-root/wals/400ea90be13249389635103ccb1dfee6
I20260709 12:22:05.380297 18676 consensus_queue.cc:237] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:05.387282 18411 catalog_manager.cc:5028] TS a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): tablet 400ea90be13249389635103ccb1dfee6 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:22:05.388093 19248 raft_consensus.cc:1275] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:05.388695 19563 tablet_replica.cc:333] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:22:05.389956 18526 raft_consensus.cc:1275] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:05.390035 19563 raft_consensus.cc:2243] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:05.391436 19563 raft_consensus.cc:2272] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:05.392186 19559 consensus_queue.cc:1048] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:05.394093 19559 consensus_queue.cc:1048] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:05.402520 19563 ts_tablet_manager.cc:1916] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:05.403967 19531 raft_consensus.cc:2955] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:05.406029 19245 raft_consensus.cc:2955] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:05.410856 18525 raft_consensus.cc:2955] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:05.423189 19562 ts_tablet_manager.cc:1929] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:05.423730 19562 log.cc:1199] T 222ae469827d4570aa1d61844f01eae9 P 2f9872512f1646bc835906bd0e98c6a7: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-0-root/wals/222ae469827d4570aa1d61844f01eae9
I20260709 12:22:05.425679 18413 catalog_manager.cc:5028] TS 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): tablet 222ae469827d4570aa1d61844f01eae9 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:22:05.440837 18426 catalog_manager.cc:5697] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:05.446973 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 49c1709156f048cd8184a38476ebfe0d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:05.455935 18587 tablet_service.cc:1558] Processing DeleteTablet for tablet 49c1709156f048cd8184a38476ebfe0d with delete_type TABLET_DATA_TOMBSTONED (TS c7bd71f1f37c45f28b52c154e59356b9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40934
I20260709 12:22:05.460474 19563 ts_tablet_manager.cc:1929] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:05.461066 19563 log.cc:1199] T 4eceb66ae237462f8f0e7e3b03872311 P c7bd71f1f37c45f28b52c154e59356b9: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-1-root/wals/4eceb66ae237462f8f0e7e3b03872311
I20260709 12:22:05.462937 19563 tablet_replica.cc:333] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:22:05.462900 18411 catalog_manager.cc:5028] TS c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): tablet 4eceb66ae237462f8f0e7e3b03872311 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:22:05.464798 19563 raft_consensus.cc:2243] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:05.465953 19563 raft_consensus.cc:2272] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:05.470696 19563 ts_tablet_manager.cc:1916] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:05.486999 19563 ts_tablet_manager.cc:1929] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:05.487385 19563 log.cc:1199] T 49c1709156f048cd8184a38476ebfe0d P c7bd71f1f37c45f28b52c154e59356b9: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-1-root/wals/49c1709156f048cd8184a38476ebfe0d
I20260709 12:22:05.488762 18411 catalog_manager.cc:5028] TS c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): tablet 49c1709156f048cd8184a38476ebfe0d (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:22:06.534217 18601 consensus_queue.cc:237] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
W20260709 12:22:06.542943 18570 consensus_peers.cc:597] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6840b12ab24d4f62b563a6d5d868d0c4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:06.543951 18525 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:06.544368 18676 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:06.545547 19523 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:06.546366 19565 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:06.561327 19565 raft_consensus.cc:2955] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:06.577782 18676 raft_consensus.cc:2955] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:06.573004 18525 raft_consensus.cc:2955] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:06.583984 18601 consensus_queue.cc:237] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:06.588630 18426 catalog_manager.cc:5697] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:06.615499 18570 consensus_peers.cc:597] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3c52474787041b099fe01aa8c862c04. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:06.615965 18676 raft_consensus.cc:1275] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:06.619141 18526 raft_consensus.cc:1275] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:06.617983 19565 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:06.621003 19523 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:06.632647 18676 raft_consensus.cc:2955] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:06.628913 19565 raft_consensus.cc:2955] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:06.647449 18526 raft_consensus.cc:2955] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:06.658514 18602 consensus_queue.cc:237] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:06.666311 18426 catalog_manager.cc:5697] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:06.672587 18526 raft_consensus.cc:1275] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:22:06.673309 18570 consensus_peers.cc:597] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55f8787198c1435695beded3041a941e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:06.674522 18676 raft_consensus.cc:1275] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:06.676163 19569 consensus_queue.cc:1048] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:06.677196 19523 consensus_queue.cc:1048] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:06.690011 19527 raft_consensus.cc:2955] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:06.692955 18679 raft_consensus.cc:2955] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:06.695497 18526 raft_consensus.cc:2955] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:06.707512 18676 consensus_queue.cc:237] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:06.716662 18427 catalog_manager.cc:5697] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:06.722653 18602 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:22:06.723896 18644 consensus_peers.cc:597] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 30ca83d13be54a41b9c5aaebfc89de05. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:06.724787 19467 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:06.725975 18525 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:06.727492 19531 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:06.737100 19531 raft_consensus.cc:2955] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:06.738552 18602 raft_consensus.cc:2955] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:06.745117 18526 raft_consensus.cc:2955] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:06.781510 18426 catalog_manager.cc:5697] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:07.006649 19585 ts_tablet_manager.cc:933] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:07.015656 19585 tablet_copy_client.cc:323] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.130:37079
I20260709 12:22:07.017382 18616 tablet_copy_service.cc:140] P c7bd71f1f37c45f28b52c154e59356b9: Received BeginTabletCopySession request for tablet 6840b12ab24d4f62b563a6d5d868d0c4 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:39798)
I20260709 12:22:07.017858 18616 tablet_copy_service.cc:161] P c7bd71f1f37c45f28b52c154e59356b9: Beginning new tablet copy session on tablet 6840b12ab24d4f62b563a6d5d868d0c4 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:39798: session id = 8c29c312e4544452b1162d7f81a58cb4-6840b12ab24d4f62b563a6d5d868d0c4
I20260709 12:22:07.026163 18616 tablet_copy_source_session.cc:215] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:07.029775 19585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6840b12ab24d4f62b563a6d5d868d0c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.048043 19585 tablet_copy_client.cc:806] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:07.048738 19585 tablet_copy_client.cc:670] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:07.053121 19585 tablet_copy_client.cc:538] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:07.064610 19585 tablet_bootstrap.cc:492] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:22:07.082165 19585 tablet_bootstrap.cc:492] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:07.082979 19585 tablet_bootstrap.cc:492] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:22:07.083564 19585 ts_tablet_manager.cc:1403] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.011s
I20260709 12:22:07.085772 19585 raft_consensus.cc:359] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:07.086391 19585 raft_consensus.cc:740] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:22:07.087028 19585 consensus_queue.cc:260] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:07.089968 19585 ts_tablet_manager.cc:1434] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:07.092988 18616 tablet_copy_service.cc:342] P c7bd71f1f37c45f28b52c154e59356b9: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-6840b12ab24d4f62b563a6d5d868d0c4 received from {username='slave'} at 127.0.0.1:39798
I20260709 12:22:07.093436 18616 tablet_copy_service.cc:434] P c7bd71f1f37c45f28b52c154e59356b9: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-6840b12ab24d4f62b563a6d5d868d0c4 on tablet 6840b12ab24d4f62b563a6d5d868d0c4 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:07.115257 19585 ts_tablet_manager.cc:933] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:07.117035 19585 tablet_copy_client.cc:323] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.130:37079
I20260709 12:22:07.118713 18616 tablet_copy_service.cc:140] P c7bd71f1f37c45f28b52c154e59356b9: Received BeginTabletCopySession request for tablet 55f8787198c1435695beded3041a941e from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:39798)
I20260709 12:22:07.119290 18616 tablet_copy_service.cc:161] P c7bd71f1f37c45f28b52c154e59356b9: Beginning new tablet copy session on tablet 55f8787198c1435695beded3041a941e from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:39798: session id = 8c29c312e4544452b1162d7f81a58cb4-55f8787198c1435695beded3041a941e
I20260709 12:22:07.125933 18616 tablet_copy_source_session.cc:215] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:07.129599 19585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55f8787198c1435695beded3041a941e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.147245 19585 tablet_copy_client.cc:806] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:07.148144 19585 tablet_copy_client.cc:670] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:07.156056 19585 tablet_copy_client.cc:538] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:07.168677 19585 tablet_bootstrap.cc:492] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:22:07.213517 19590 ts_tablet_manager.cc:933] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:07.215792 19592 ts_tablet_manager.cc:933] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:07.232016 19590 tablet_copy_client.cc:323] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.130:37079
I20260709 12:22:07.232892 19592 tablet_copy_client.cc:323] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.131:36757
I20260709 12:22:07.234808 18616 tablet_copy_service.cc:140] P c7bd71f1f37c45f28b52c154e59356b9: Received BeginTabletCopySession request for tablet c3c52474787041b099fe01aa8c862c04 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:39798)
I20260709 12:22:07.235383 18616 tablet_copy_service.cc:161] P c7bd71f1f37c45f28b52c154e59356b9: Beginning new tablet copy session on tablet c3c52474787041b099fe01aa8c862c04 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:39798: session id = 8c29c312e4544452b1162d7f81a58cb4-c3c52474787041b099fe01aa8c862c04
I20260709 12:22:07.237810 19585 tablet_bootstrap.cc:492] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:07.238725 19585 tablet_bootstrap.cc:492] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:22:07.239399 19585 ts_tablet_manager.cc:1403] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.071s	user 0.028s	sys 0.034s
I20260709 12:22:07.241907 18616 tablet_copy_source_session.cc:215] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:07.242583 19585 raft_consensus.cc:359] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:07.243465 19585 raft_consensus.cc:740] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:22:07.244205 19585 consensus_queue.cc:260] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:07.248981 19585 ts_tablet_manager.cc:1434] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:22:07.255172 18690 tablet_copy_service.cc:140] P a0dee333a83a45f1ab0c1bb6d094afd1: Received BeginTabletCopySession request for tablet 30ca83d13be54a41b9c5aaebfc89de05 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:50938)
I20260709 12:22:07.255808 18690 tablet_copy_service.cc:161] P a0dee333a83a45f1ab0c1bb6d094afd1: Beginning new tablet copy session on tablet 30ca83d13be54a41b9c5aaebfc89de05 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:50938: session id = 8c29c312e4544452b1162d7f81a58cb4-30ca83d13be54a41b9c5aaebfc89de05
I20260709 12:22:07.259413 18616 tablet_copy_service.cc:342] P c7bd71f1f37c45f28b52c154e59356b9: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-55f8787198c1435695beded3041a941e received from {username='slave'} at 127.0.0.1:39798
I20260709 12:22:07.259935 18616 tablet_copy_service.cc:434] P c7bd71f1f37c45f28b52c154e59356b9: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-55f8787198c1435695beded3041a941e on tablet 55f8787198c1435695beded3041a941e with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:07.285207 19590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c52474787041b099fe01aa8c862c04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.285920 18690 tablet_copy_source_session.cc:215] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:07.317124 19592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30ca83d13be54a41b9c5aaebfc89de05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.327723 19590 tablet_copy_client.cc:806] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:07.328434 19590 tablet_copy_client.cc:670] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:07.342284 19592 tablet_copy_client.cc:806] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:07.343005 19592 tablet_copy_client.cc:670] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:07.350173 19592 tablet_copy_client.cc:538] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:07.351255 19590 tablet_copy_client.cc:538] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:07.360875 19592 tablet_bootstrap.cc:492] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:22:07.361312 19590 tablet_bootstrap.cc:492] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:22:07.402240 19590 tablet_bootstrap.cc:492] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:07.404075 19590 tablet_bootstrap.cc:492] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:22:07.405149 19590 ts_tablet_manager.cc:1403] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.044s	user 0.027s	sys 0.004s
I20260709 12:22:07.407362 19592 tablet_bootstrap.cc:492] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:07.408325 19592 tablet_bootstrap.cc:492] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:22:07.409039 19592 ts_tablet_manager.cc:1403] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.008s
I20260709 12:22:07.408972 19590 raft_consensus.cc:359] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:07.410130 19590 raft_consensus.cc:740] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:22:07.410849 19590 consensus_queue.cc:260] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:07.412669 19592 raft_consensus.cc:359] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:07.413631 19592 raft_consensus.cc:740] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:22:07.414047 19590 ts_tablet_manager.cc:1434] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:07.414855 19592 consensus_queue.cc:260] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:07.417639 18616 tablet_copy_service.cc:342] P c7bd71f1f37c45f28b52c154e59356b9: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-c3c52474787041b099fe01aa8c862c04 received from {username='slave'} at 127.0.0.1:39798
I20260709 12:22:07.418110 18616 tablet_copy_service.cc:434] P c7bd71f1f37c45f28b52c154e59356b9: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-c3c52474787041b099fe01aa8c862c04 on tablet c3c52474787041b099fe01aa8c862c04 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:07.418331 19592 ts_tablet_manager.cc:1434] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.007s
I20260709 12:22:07.420930 18690 tablet_copy_service.cc:342] P a0dee333a83a45f1ab0c1bb6d094afd1: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-30ca83d13be54a41b9c5aaebfc89de05 received from {username='slave'} at 127.0.0.1:50938
I20260709 12:22:07.421365 18690 tablet_copy_service.cc:434] P a0dee333a83a45f1ab0c1bb6d094afd1: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-30ca83d13be54a41b9c5aaebfc89de05 on tablet 30ca83d13be54a41b9c5aaebfc89de05 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:07.457469 19248 raft_consensus.cc:1217] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:07.570394 19248 raft_consensus.cc:1217] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:07.717849 19248 raft_consensus.cc:1217] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:07.725294 19248 raft_consensus.cc:1217] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:07.896010 19523 raft_consensus.cc:1064] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:22:07.897935 19523 consensus_queue.cc:237] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:07.910054 19248 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:07.910135 18525 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:07.912955 18679 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:07.912902 19569 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:07.915239 19527 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:07.927196 19523 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:07.942592 19598 raft_consensus.cc:2955] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:07.945217 18679 raft_consensus.cc:2955] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:07.973557 18427 catalog_manager.cc:5697] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:07.976207 18525 raft_consensus.cc:2955] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:07.979830 19245 raft_consensus.cc:2955] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:08.022472 19569 raft_consensus.cc:1064] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:22:08.028544 19569 consensus_queue.cc:237] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:08.045339 18679 raft_consensus.cc:1275] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:08.046046 18525 raft_consensus.cc:1275] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:08.046802 19569 consensus_queue.cc:1048] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:08.047446 19248 raft_consensus.cc:1275] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:08.048427 19598 consensus_queue.cc:1048] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:08.049722 19523 consensus_queue.cc:1048] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:08.085428 18602 consensus_queue.cc:237] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:08.085566 19523 raft_consensus.cc:2955] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:08.091917 18677 raft_consensus.cc:2955] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:08.094731 19245 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:08.096334 19569 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:08.097078 18525 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:08.101332 19569 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:08.098682 18526 raft_consensus.cc:2955] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:08.115178 19527 raft_consensus.cc:2955] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:08.116529 19245 raft_consensus.cc:2955] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:08.122781 18525 raft_consensus.cc:2955] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:08.129336 19531 raft_consensus.cc:1064] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:22:08.132006 19531 consensus_queue.cc:237] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:08.152330 18425 catalog_manager.cc:5697] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:08.156399 19248 raft_consensus.cc:2955] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:08.157481 18424 catalog_manager.cc:5697] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:08.162459 19245 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:08.166975 18526 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:08.168993 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6840b12ab24d4f62b563a6d5d868d0c4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:08.169807 19583 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:08.175545 18665 tablet_service.cc:1558] Processing DeleteTablet for tablet 6840b12ab24d4f62b563a6d5d868d0c4 with delete_type TABLET_DATA_TOMBSTONED (TS a0dee333a83a45f1ab0c1bb6d094afd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40796
I20260709 12:22:08.187683 18603 consensus_queue.cc:237] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:08.205212 19583 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:08.205971 18602 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:08.219190 19612 tablet_replica.cc:333] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:22:08.220919 19245 raft_consensus.cc:1275] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:08.222129 19612 raft_consensus.cc:2243] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.223001 19612 raft_consensus.cc:2272] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.222903 19523 consensus_queue.cc:1048] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:08.225323 18526 raft_consensus.cc:1275] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:08.226310 19610 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:08.227032 19523 consensus_queue.cc:1048] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:08.231997 19612 ts_tablet_manager.cc:1916] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:08.234364 19523 raft_consensus.cc:2955] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:08.235855 19248 raft_consensus.cc:2955] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:08.251874 19598 raft_consensus.cc:1064] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:22:08.254701 19598 consensus_queue.cc:237] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:08.260632 19610 raft_consensus.cc:2955] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:08.280058 19612 ts_tablet_manager.cc:1929] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:08.280616 19612 log.cc:1199] T 6840b12ab24d4f62b563a6d5d868d0c4 P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-2-root/wals/6840b12ab24d4f62b563a6d5d868d0c4
I20260709 12:22:08.280292 18424 catalog_manager.cc:5697] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:08.281699 18526 raft_consensus.cc:2955] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:08.295961 18526 raft_consensus.cc:1275] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:08.298458 19616 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:08.299005 18603 raft_consensus.cc:2955] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:08.312584 18425 catalog_manager.cc:5697] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:08.358870 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 72056.8us
I20260709 12:22:08.361220 19248 raft_consensus.cc:1275] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 LEARNER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:08.365477 18677 raft_consensus.cc:1275] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:08.366384 19245 raft_consensus.cc:2955] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:08.417269 19527 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:08.418699 19569 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:08.422073 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 55f8787198c1435695beded3041a941e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:08.422976 18411 catalog_manager.cc:5028] TS a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): tablet 6840b12ab24d4f62b563a6d5d868d0c4 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
W20260709 12:22:08.826193 18411 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 403207us
W20260709 12:22:09.313081 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 981978us
I20260709 12:22:09.321630 19620 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.322314 19620 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.324734 19620 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:09.419406 19620 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.420189 19620 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.422922 19620 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:09.439224 19624 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.439927 19624 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.442018 19624 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:09.442396 19624 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.442730 19624 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.444276 19623 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.444408 19622 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.444887 19623 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.445065 19622 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.447214 19623 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:09.447386 19622 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:09.450177 19621 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.450773 19621 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.453173 18665 tablet_service.cc:1558] Processing DeleteTablet for tablet 55f8787198c1435695beded3041a941e with delete_type TABLET_DATA_TOMBSTONED (TS a0dee333a83a45f1ab0c1bb6d094afd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40796
I20260709 12:22:09.466279 19527 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.477262 19527 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.481328 19527 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:09.484843 19627 tablet_replica.cc:333] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:22:09.486397 19627 raft_consensus.cc:2243] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:09.491014 19629 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:09.491705 19627 raft_consensus.cc:2272] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:09.491663 19629 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:09.494808 19629 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:09.495151 19621 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:09.495337 19629 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.494980 19627 ts_tablet_manager.cc:1916] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:09.504732 19624 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:09.505589 19629 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:09.508392 19629 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:09.509399 19624 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.510890 19624 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.517630 19622 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.518210 19622 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.520457 19622 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:09.522868 19624 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:09.523110 19616 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:09.523806 19616 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.527558 19623 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.528133 19623 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.528484 19569 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.531888 19569 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.532830 19623 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:09.549482 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:09.550129 19630 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:09.551211 19619 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.551136 19630 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.551819 19619 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.539692 19624 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:09.544795 19623 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.577972 19623 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.581347 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:09.583165 18603 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:09.582321 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:09.601295 19631 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.601918 19631 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:09.602452 19622 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:09.603008 19622 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:09.605509 19621 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.606074 19621 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.608198 19621 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:09.608667 19631 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:09.609226 19631 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.609766 19631 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:09.613049 19622 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:09.613770 19621 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.614305 19621 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:09.616511 19631 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:09.616758 19621 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:09.585762 19629 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.568075 19598 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.624432 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:09.682336 18524 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:09.682801 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:09.683940 19633 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.685506 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:09.681564 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:09.686158 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:09.686479 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:09.687388 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:09.649437 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:09.648984 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:09.691884 18603 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:09.681237 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:09.713413 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:09.714550 19527 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.715063 19527 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.684546 19633 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:09.717407 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 402440us
I20260709 12:22:09.676034 19627 ts_tablet_manager.cc:1929] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:09.682837 19623 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:09.598109 19616 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:09.621163 19569 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:09.676179 19621 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:09.713436 19631 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:09.725682 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:09.586447 19624 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.723119 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:09.648689 19629 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:09.725775 19527 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:09.721019 19630 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:09.714468 19626 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:09.697913 19598 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.743453 19527 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:09.728932 19627 log.cc:1199] T 55f8787198c1435695beded3041a941e P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-2-root/wals/55f8787198c1435695beded3041a941e
I20260709 12:22:09.733106 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:09.796262 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:09.771166 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:09.738335 19623 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.802459 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:09.750061 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:09.858094 18605 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:09.765308 19638 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.809350 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:09.850014 19527 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:09.838924 19642 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.801069 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:09.785115 19637 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.866253 18680 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:09.749596 19626 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.771651 19619 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:09.826500 19624 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:09.828315 19629 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:09.795380 19646 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:09.868988 19527 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:09.780699 19636 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:09.740221 19621 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.740592 19569 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.860129 19633 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:09.765659 19641 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.863605 19648 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.743432 19631 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:09.861061 19622 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.872572 19629 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:09.874717 19645 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.878412 19569 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.872639 19624 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:09.866609 19623 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.874622 19642 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.873531 19638 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.884500 19622 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:09.890267 19626 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:09.877092 19646 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:09.882759 19645 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.873059 19637 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.880213 19641 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:09.886500 19648 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.733981 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:09.825177 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:09.874719 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:09.952286 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:09.966951 19557 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:09.885154 19629 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:09.876791 19636 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:09.801762 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.168922 19650 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:10.090801 19569 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:09.979192 19631 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:10.065745 19623 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:09.992202 19648 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:10.153802 19621 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.148761 19617 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.151999 19620 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.087564 18672 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:10.091042 19633 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.088212 18675 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:09.894832 19647 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:10.072309 18674 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
W20260709 12:22:10.149112 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 386454us
I20260709 12:22:10.084424 19622 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:10.214699 19630 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.215803 19630 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.897467 19642 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.227082 19641 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:10.230698 19653 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.231376 19630 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:10.231832 19653 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:10.170384 19650 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:10.239842 19621 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:22:10.232760 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 403592us
I20260709 12:22:10.247100 19654 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.242959 19621 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.254364 19645 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:10.210238 19631 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:10.248991 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 444118us
I20260709 12:22:10.248070 19654 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:09.891342 19624 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:10.273813 19652 log.cc:927] Time spent T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.251s	user 0.002s	sys 0.000s
I20260709 12:22:10.264520 19654 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:10.245947 19620 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.287117 19584 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:10.270572 19647 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:10.246349 19557 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.289707 19639 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:10.283938 19653 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:10.288105 19584 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.298506 19635 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:10.298663 19632 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:10.290922 19247 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:10.303094 19658 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:10.268421 19633 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.306519 19635 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.310307 19637 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:10.294471 19631 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:10.313397 19620 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.314790 19631 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.302127 19650 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:10.318183 19527 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:10.323617 19567 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:10.321249 19527 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.323781 19656 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:10.256858 19617 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.311590 19642 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.355502 18673 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:10.318113 19651 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:10.324920 19567 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:10.322806 19639 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:10.304141 19658 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.329459 19616 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.357864 19632 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:10.384773 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 50592.9us
W20260709 12:22:10.431129 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 104523us
W20260709 12:22:10.420460 18645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.035s	sys 0.094s
I20260709 12:22:10.379081 19633 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:10.439208 19567 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:22:10.444119 19271 debug-util.cc:398] Leaking SignalData structure 0x7b080027e4e0 after lost signal to thread 17349
W20260709 12:22:10.446020 19271 debug-util.cc:398] Leaking SignalData structure 0x7b0800261a20 after lost signal to thread 18461
W20260709 12:22:10.448458 19271 debug-util.cc:398] Leaking SignalData structure 0x7b080030d9e0 after lost signal to thread 18554
W20260709 12:22:10.448931 19271 debug-util.cc:398] Leaking SignalData structure 0x7b0800326320 after lost signal to thread 18555
W20260709 12:22:10.450937 19271 debug-util.cc:398] Leaking SignalData structure 0x7b08002defc0 after lost signal to thread 18630
W20260709 12:22:10.453676 19271 debug-util.cc:398] Leaking SignalData structure 0x7b08003205e0 after lost signal to thread 18705
W20260709 12:22:10.458815 18645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.035s	sys 0.099s
I20260709 12:22:10.457368 19527 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.456543 18644 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:10.463660 19617 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.388684 19624 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:10.434444 19647 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.434863 19638 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:10.401315 19598 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.470780 19621 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.471176 19635 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.430047 19616 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.471966 19635 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:10.472841 19635 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.474112 19616 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.475374 19635 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.462400 19584 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.486991 19557 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:10.462028 19271 debug-util.cc:398] Leaking SignalData structure 0x7b080030ecc0 after lost signal to thread 18706
I20260709 12:22:10.425411 19642 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.407177 19656 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:10.504770 19642 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.492697 18572 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:10.391602 19651 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.504868 19656 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:22:10.500294 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 43913.7us
I20260709 12:22:10.507366 19630 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:10.507934 19630 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.508364 19630 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.510823 19658 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.517078 19632 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.512065 19639 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:10.515055 18411 catalog_manager.cc:5028] TS a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): tablet 55f8787198c1435695beded3041a941e (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:22:10.515059 19636 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:10.531839 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 152185us
I20260709 12:22:10.533811 19642 raft_consensus.cc:2804] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:10.534392 19642 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:10.534790 19642 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:10.528589 19271 debug-util.cc:398] Leaking SignalData structure 0x7b080032b280 after lost signal to thread 19274
I20260709 12:22:10.538802 19598 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.540927 19598 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.557845 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.558861 18675 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:10.551642 18644 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:10.565014 19649 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.009s	sys 0.017s
I20260709 12:22:10.578680 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:10.581755 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 44555.2us
I20260709 12:22:10.582386 19623 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:10.578742 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.582862 19623 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.583359 19623 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:10.582567 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.586763 18678 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:10.579803 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.587909 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.587982 19629 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:10.580518 19649 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.009s	sys 0.018s
I20260709 12:22:10.591524 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:10.591912 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:10.594165 18675 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:10.596678 19244 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:10.597110 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.598344 19662 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:10.598616 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.598766 19621 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.595072 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.599298 18524 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:10.598956 19662 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.599372 19621 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.604655 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.601641 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.604811 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.608189 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.608614 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.608235 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.617164 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.618672 19646 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:10.618888 18674 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:10.620574 18672 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:10.621577 18570 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:10.623189 19569 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:10.623637 19569 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.624044 19569 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.625208 19651 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.626020 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.632535 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.616910 18675 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:10.638310 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.639312 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.633127 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.641806 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.642310 19621 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.610668 18526 raft_consensus.cc:2955] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:10.643460 18644 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:10.644482 19624 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:10.644877 19624 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.645282 19624 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.645237 18570 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:10.652976 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.620366 19598 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.654593 18605 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:10.654740 19662 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.655503 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.661098 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.662395 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.662892 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.660434 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.663692 18425 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47728 (request call id 205) took 2355 ms. Trace:
I20260709 12:22:10.664342 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.665086 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.669411 19651 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:10.670140 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.671361 18528 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:10.672420 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.673678 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.674813 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.674746 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.676179 18602 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:10.674986 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.667279 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.678627 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.680073 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:10.680238 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.680831 19245 raft_consensus.cc:2468] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:10.677738 18603 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:10.680992 18601 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:10.669984 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.681699 18605 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:10.670284 19651 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.686864 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.688109 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.688513 18601 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:10.689595 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.691150 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.691043 19623 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.692011 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.692456 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.693193 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.693493 19623 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:10.693626 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.694301 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.696184 19651 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.696115 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.702963 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.703671 18604 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:10.703934 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.667661 18425 rpcz_store.cc:276] 0709 12:22:08.308579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.308745 (+   166us) service_pool.cc:224] Handling call
0709 12:22:10.663484 (+2354739us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:09.435484 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:09.436112 (+   628us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:09.436146 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:22:09.436452 (+   306us) tablet.cc:662] Decoding operations
0709 12:22:09.437249 (+   797us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:09.437335 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:09.437373 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:22:09.437576 (+   203us) tablet.cc:701] Row locks acquired
0709 12:22:09.437595 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:22:09.437743 (+   148us) write_op.cc:270] Start()
0709 12:22:09.437854 (+   111us) write_op.cc:276] Timestamp: P: 1783599729437702 usec, L: 0
0709 12:22:09.437879 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:22:09.460203 (+ 22324us) log.cc:844] Serialized 602 byte log entry
0709 12:22:09.685172 (+224969us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b1800206200. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793f23f3 00007efc793f47c1 00007efc793f4779 00007efc793f4709 00007efc793f46d1 00007efc793f39cd 0000000000388634 0000000000388479 00007efc793d583a
0709 12:22:09.976638 (+291466us) op_driver.cc:464] REPLICATION: finished
0709 12:22:10.221473 (+244835us) spinlock_profiling.cc:243] Waited 80.6 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc793d50ac 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793f1c02 00007efc7ff15ef0
0709 12:22:10.591979 (+370506us) write_op.cc:301] APPLY: starting
0709 12:22:10.592672 (+   693us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:10.592837 (+   165us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:10.593782 (+   945us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:10.607491 (+ 13709us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:10.636642 (+ 29151us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:22:10.636705 (+    63us) write_op.cc:312] APPLY: finished
0709 12:22:10.637118 (+   413us) log.cc:844] Serialized 22 byte log entry
0709 12:22:10.638494 (+  1376us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:10.638633 (+   139us) write_op.cc:454] Released schema lock
0709 12:22:10.638687 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:10.645931 (+  7244us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:10.645965 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":604447,"apply.run_cpu_time_us":3341,"apply.run_wall_time_us":53937,"num_ops":1,"prepare.queue_time_us":918,"prepare.run_cpu_time_us":23133,"prepare.run_wall_time_us":54929,"raft.queue_time_us":121808,"replication_time_us":538281,"spinlock_wait_cycles":355049856,"thread_start_us":742666,"threads_started":4,"wal-append.queue_time_us":44289}]]}
I20260709 12:22:10.706264 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.706939 18605 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:10.696115 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:10.707855 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.708655 18603 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:10.708751 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.712734 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.713425 18601 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:10.700603 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.708266 19247 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:10.705968 19630 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.721024 19642 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.722285 18426 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60812 (request call id 99) took 1201 ms. Trace:
I20260709 12:22:10.723026 19630 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:10.723453 19642 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.722671 18426 rpcz_store.cc:276] 0709 12:22:09.521274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.521436 (+   162us) service_pool.cc:224] Handling call
0709 12:22:10.722087 (+1200651us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6787,"reported_tablets":1}
I20260709 12:22:10.724710 19598 raft_consensus.cc:2955] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:10.730841 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.737489 19212 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:10.738240 19624 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.738698 18570 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:10.738837 19646 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:10.741106 19624 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:10.741184 18570 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:10.742455 19527 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:10.742823 19621 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:10.743263 19621 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.743666 19621 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.745713 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.744566 18604 raft_consensus.cc:1240] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:10.741096 19569 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:10.749048 19569 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:10.745038 18570 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:10.752163 18570 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:10.753028 19616 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:10.753420 19616 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.753605 19569 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:10.753841 19616 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.754019 19569 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.754441 19569 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.753446 18570 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:10.757172 19642 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:10.757566 19642 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.757652 18570 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:10.757983 19642 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.758523 19527 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:10.758700 18570 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:10.758927 19527 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.759353 19527 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:10.759932 18570 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:10.760725 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.761059 18570 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:10.761978 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.763159 19617 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:10.763160 19619 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:10.763657 19617 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.763180 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.764132 19619 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:10.763489 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.764716 19619 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.765118 19619 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.764135 19617 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.768595 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.767932 18570 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:10.770190 19653 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:10.770594 19653 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.770991 19653 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.772620 18570 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:10.777411 19527 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.779114 19643 raft_consensus.cc:2804] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:10.781484 19616 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.783470 19643 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.783959 19643 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.767736 19651 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:10.782543 18570 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:10.789691 19527 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.790911 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.792863 19620 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:10.793226 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.793388 19620 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.795921 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.796938 18675 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 1.
I20260709 12:22:10.797839 19616 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.798792 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.800343 19620 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.801275 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:10.801466 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.772392 19642 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.782619 19621 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.808678 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:10.811033 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.814863 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:10.818359 19617 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.824054 19651 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:10.826678 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:10.828258 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 53968.3us
I20260709 12:22:10.823321 19653 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.836174 18570 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:10.836164 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:10.842262 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:10.845122 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.845239 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:10.846017 18603 raft_consensus.cc:2393] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 2: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:10.846128 18602 raft_consensus.cc:2393] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:10.846138 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.846913 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.849782 18601 raft_consensus.cc:2393] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 2: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:10.850484 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.852120 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.853334 18601 raft_consensus.cc:1240] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:10.853377 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:10.854692 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.854849 18605 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.859000 18597 raft_consensus.cc:1240] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:10.860445 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:10.863641 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:10.864382 18600 raft_consensus.cc:1240] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:10.864930 18605 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:10.865382 19617 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.840019 19651 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:10.866182 18598 raft_consensus.cc:1240] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:10.866532 19651 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.867007 19651 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.864410 18602 raft_consensus.cc:2393] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 2: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:10.868949 18601 raft_consensus.cc:1240] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:10.869285 19621 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.871125 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.872756 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.863148 19643 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.874845 19620 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.912201 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.914923 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.917060 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.917131 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.914964 18527 raft_consensus.cc:2955] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:10.920101 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.925146 18678 raft_consensus.cc:1240] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:10.846709 19619 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.927166 18604 raft_consensus.cc:1240] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:10.928603 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.935360 18606 raft_consensus.cc:1240] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:10.936271 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:10.936661 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.937539 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:10.937976 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.938423 19642 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.911938 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.940685 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.940863 19569 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.942533 19643 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.943084 19569 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.939263 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.948812 18604 raft_consensus.cc:1240] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:10.949049 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.949909 18673 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:10.950248 19620 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.950920 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.951296 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.951624 18673 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:10.952593 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.953614 18671 raft_consensus.cc:1240] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:10.934487 19210 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:10.955641 19619 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:10.956393 19646 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:10.956905 19646 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.957276 19646 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.944103 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.943091 18675 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:10.943819 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.944674 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.963410 18601 raft_consensus.cc:1240] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:10.965422 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:10.968773 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:10.969940 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.970840 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.970471 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.970078 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.973410 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:10.972015 18679 raft_consensus.cc:1240] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:10.977492 18644 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:10.984491 19210 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:10.984786 18644 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:10.987581 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:10.986743 19620 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.988637 19620 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.989866 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.986758 19654 raft_consensus.cc:2804] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:10.990954 19654 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:10.991104 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:10.991417 19654 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.987207 18676 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:10.991918 18675 raft_consensus.cc:2393] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 3: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:10.992820 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:11.002390 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:10.986050 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.973179 19651 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:10.953606 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:10.992507 19653 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:11.001070 19623 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:11.019210 18570 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:11.004426 19629 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.022348 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:11.025044 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:11.025251 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:11.043563 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:11.001672 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:11.028887 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:11.040122 18570 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:11.042654 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:11.046128 19245 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.044375 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:11.046671 18570 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:11.026743 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:11.048415 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:11.047775 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:11.050449 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:11.049235 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:11.051028 18680 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.052299 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:11.053913 19527 raft_consensus.cc:2804] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:11.054283 19527 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:11.054632 19527 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.039589 19623 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:11.061335 18676 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.056378 19626 raft_consensus.cc:2804] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:11.093775 18572 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:11.026171 18679 raft_consensus.cc:2955] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:11.060585 18606 raft_consensus.cc:1240] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:11.056617 18599 raft_consensus.cc:1240] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:11.052186 19653 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:11.056941 19666 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:11.064294 19623 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.092964 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:11.095705 19626 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:11.118839 19210 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:11.117957 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 116564us
W20260709 12:22:11.130635 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 50325.8us
I20260709 12:22:11.109254 18604 raft_consensus.cc:1240] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:11.110332 19653 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:11.112766 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:11.120047 19626 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.165493 18680 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
W20260709 12:22:11.158854 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 103284us
W20260709 12:22:11.165088 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 118517us
I20260709 12:22:11.129549 19621 raft_consensus.cc:2804] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:11.155557 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:11.170147 18570 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:11.159994 19653 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:11.160627 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:11.165046 19670 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:11.170440 19621 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:11.176144 18672 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.160779 19666 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:11.192107 18646 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:11.187731 19598 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:11.161331 19248 raft_consensus.cc:2955] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:11.204627 18572 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:11.201534 18675 raft_consensus.cc:2393] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 2: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:11.207059 19527 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:11.195899 18644 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:11.196506 19621 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.205809 19676 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.210171 19637 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:11.205857 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 87086.3us
I20260709 12:22:11.213433 18572 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:11.215422 19665 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:11.216180 19665 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:11.217502 19673 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:11.217947 19673 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:11.218317 19673 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.218778 19665 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:11.213738 19210 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:11.212298 19675 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.224977 19527 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:11.226051 18676 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:11.201531 19651 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:11.203264 19598 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:11.256366 19210 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:11.226194 19637 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:11.257925 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 44565.1us
I20260709 12:22:11.259670 18572 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:11.253137 19598 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.268303 18572 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:11.269160 19527 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.275197 19245 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:11.203630 19670 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:11.260789 19637 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:11.261577 19643 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.263404 19666 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:11.280092 19637 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:11.285775 18572 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:11.294420 19653 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:11.295460 19598 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:11.296133 19669 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:11.296226 19629 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.296754 19669 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:11.276106 19676 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.278769 19567 consensus_queue.cc:1059] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:22:11.298044 19598 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:11.298699 19567 raft_consensus.cc:3055] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:11.299036 19598 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.299118 19567 raft_consensus.cc:740] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:11.300436 19567 consensus_queue.cc:260] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:11.297116 19670 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:11.303862 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 108101us
I20260709 12:22:11.301826 19567 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:11.307156 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 95495.3us
I20260709 12:22:11.306666 18644 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:11.310575 18572 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:11.299034 19669 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:11.316570 19653 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:11.321239 18570 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:11.304834 19629 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.325877 18644 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:11.328228 18644 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:11.329494 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 73230.8us
I20260709 12:22:11.330581 19210 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:11.332089 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:11.309087 19662 consensus_queue.cc:1059] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:22:11.334082 19210 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:11.319319 19626 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:11.337983 18644 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:11.337373 18572 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:11.327214 19633 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:11.327407 19643 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:11.336069 19669 raft_consensus.cc:2804] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:11.335381 19675 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:11.335176 19662 raft_consensus.cc:3055] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:11.346535 19662 raft_consensus.cc:740] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:11.345902 19685 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.348433 18644 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:11.340643 19678 consensus_queue.cc:1059] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:22:11.349525 18644 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:11.340207 19638 raft_consensus.cc:2804] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:11.342314 19616 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.329267 19674 consensus_queue.cc:1059] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:22:11.342387 19633 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:11.344663 19669 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:11.350836 19629 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.335381 19646 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:11.341972 19677 consensus_queue.cc:1059] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:22:11.335556 19666 consensus_queue.cc:1059] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:22:11.353715 19638 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:11.403154 19683 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.355239 19675 raft_consensus.cc:697] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:11.350595 19665 consensus_queue.cc:1059] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:22:11.358348 19633 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.359163 19669 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.417016 19626 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:11.424798 19675 consensus_queue.cc:237] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:11.405865 19638 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.347532 19662 consensus_queue.cc:260] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:11.445495 19247 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:11.452219 19687 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:11.452785 19687 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
W20260709 12:22:11.453239 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 103772us
I20260709 12:22:11.453306 19687 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.446076 19681 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:11.447678 19623 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:11.460592 19623 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:22:11.462324 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 106851us
I20260709 12:22:11.454427 18644 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:11.444981 19674 consensus_queue.cc:1059] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:22:11.475363 19623 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:11.467859 18644 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:11.477794 19623 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:11.478526 19623 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.480036 18644 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:11.464393 19665 raft_consensus.cc:3055] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:11.466609 19662 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:11.491484 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:11.485144 19690 raft_consensus.cc:2764] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 12:22:11.486002 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 141214us
I20260709 12:22:11.486420 19693 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:11.490118 19686 raft_consensus.cc:3055] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:11.495319 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:11.463178 19681 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:11.506727 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:11.491307 19665 raft_consensus.cc:740] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:11.510283 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:11.510250 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:11.482843 19682 raft_consensus.cc:2764] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:22:11.517011 19671 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:11.501351 19681 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.503912 19686 raft_consensus.cc:740] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:11.504210 19693 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:11.502780 19674 consensus_queue.cc:1059] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:22:11.538466 19669 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:11.540196 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:11.540766 19669 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:11.522720 19646 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:11.542867 18646 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:11.545462 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:11.545593 19621 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:11.547664 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:11.548282 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:11.550160 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:11.533380 19671 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:11.551246 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:11.555642 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:11.531252 19693 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.585070 19659 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:11.589673 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.540261 19673 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:11.587841 19674 raft_consensus.cc:3055] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:22:11.610132 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 78112.4us
I20260709 12:22:11.610234 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:11.619935 18646 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:11.624882 18426 catalog_manager.cc:5697] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 2 to 3, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:11.651491 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:11.612677 19674 raft_consensus.cc:740] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:22:11.665275 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 48631.2us
I20260709 12:22:11.615636 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:11.670562 18646 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:11.633142 19620 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:11.598426 19665 consensus_queue.cc:260] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:11.650905 19690 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.688035 19695 raft_consensus.cc:3055] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:11.688529 19695 raft_consensus.cc:740] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:11.690949 19691 raft_consensus.cc:3055] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:11.691398 19691 raft_consensus.cc:740] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:11.644106 19671 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:11.695261 19691 consensus_queue.cc:260] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:11.696585 19691 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.696754 19624 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.674825 18673 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.678495 19686 consensus_queue.cc:260] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:11.737766 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 242867us
I20260709 12:22:11.692611 19638 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:11.747888 18646 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:11.751689 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:11.694172 19633 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:11.747851 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 413815us
I20260709 12:22:11.748186 19681 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:11.716302 19623 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:11.800733 19210 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:11.801543 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 53800.1us
W20260709 12:22:11.747663 18672 consensus_meta.cc:287] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.004s
I20260709 12:22:11.808885 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:11.810096 18529 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.817770 19210 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:11.821547 18646 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:11.822628 18676 raft_consensus.cc:2393] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 2: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:11.765822 19624 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.751029 19687 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:11.817823 18672 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
W20260709 12:22:11.820884 19654 consensus_meta.cc:287] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.829s	user 0.007s	sys 0.006s
I20260709 12:22:11.819278 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:11.818763 19673 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:11.834565 19670 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.821537 19621 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:11.834874 19567 consensus_meta.cc:287] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.521s	user 0.006s	sys 0.006s
I20260709 12:22:11.841361 18679 raft_consensus.cc:2393] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 2: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:11.841522 18646 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:11.840555 18675 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.826169 19671 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.842660 18678 raft_consensus.cc:1240] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:11.845386 19666 consensus_queue.cc:1059] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:22:11.841424 19637 consensus_meta.cc:287] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.004s
I20260709 12:22:11.835183 19686 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:11.876500 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 396527us
I20260709 12:22:11.734680 19674 consensus_queue.cc:260] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:11.888317 19688 raft_consensus.cc:3055] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:11.837754 19654 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:11.895350 19698 consensus_queue.cc:1059] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:22:11.895926 19682 consensus_queue.cc:1059] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:11.897768 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.900424 19698 raft_consensus.cc:3055] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:11.901038 19698 raft_consensus.cc:740] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:11.902801 19698 consensus_queue.cc:260] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:11.909741 19688 raft_consensus.cc:740] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:11.881557 19637 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:11.927801 18680 raft_consensus.cc:2393] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 3: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:11.930343 19697 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.932143 19681 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:11.932926 19698 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.933305 18646 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:11.883606 19567 consensus_queue.cc:1059] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:22:11.821913 19695 consensus_queue.cc:260] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:11.938552 18529 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:11.948379 19630 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:11.951493 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.955336 18646 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:11.989655 19674 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.936832 19637 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:11.991495 19630 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:11.997442 19633 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:11.947490 18673 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:11.947666 18675 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:12.010852 19624 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.020136 19687 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:12.037930 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:12.042637 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 208505us
I20260709 12:22:12.076849 18601 raft_consensus.cc:1240] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.077934 19654 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:12.084601 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:12.035709 19638 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:12.084954 18602 raft_consensus.cc:1240] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.018402 19688 consensus_queue.cc:260] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.073045 19623 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:12.090090 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:12.098829 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 202092us
I20260709 12:22:12.100831 18605 raft_consensus.cc:1240] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.100960 18644 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:12.081954 19701 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:12.094386 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:12.092792 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:12.092440 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:12.097136 18597 raft_consensus.cc:1240] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:12.110044 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.115715 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:22:12.120911 19699 log.cc:927] Time spent T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:22:12.121603 18671 raft_consensus.cc:1240] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.122097 19701 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:12.123521 18598 raft_consensus.cc:1240] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.127627 18644 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:12.108202 19210 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.240.131:36757 timed out after 1.511s (SENT) [suppressed 4 similar messages]
I20260709 12:22:12.105861 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:12.104763 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:12.135630 18529 raft_consensus.cc:1240] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.113523 19688 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.131526 19623 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:12.145848 18601 raft_consensus.cc:1240] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.144897 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:12.149683 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:12.154309 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:12.155308 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:12.156123 18602 raft_consensus.cc:2393] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 2: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:12.157832 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:12.157933 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:12.158514 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:12.141979 19659 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.160578 18601 raft_consensus.cc:2393] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 2: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:12.164332 19696 raft_consensus.cc:3055] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:12.164217 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:12.166666 19701 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:12.167452 19697 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:12.172951 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:12.173800 19678 raft_consensus.cc:3055] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:12.174376 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:12.177958 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:12.178222 18570 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:12.179423 19695 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.158002 19623 raft_consensus.cc:697] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:12.191109 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:12.199275 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:12.173866 19707 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:22:12.224356 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 46212.1us
I20260709 12:22:12.189898 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:22:12.221452 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 112994us
I20260709 12:22:12.242494 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:12.242849 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:12.226583 18602 raft_consensus.cc:2393] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 2: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:12.185501 19701 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:22:12.254807 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.229547 18570 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:12.234392 19707 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.235950 18597 raft_consensus.cc:2393] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 2: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:12.198838 19678 raft_consensus.cc:740] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:12.239116 19709 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:12.226955 19706 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:12.171926 19696 raft_consensus.cc:740] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:12.266703 19707 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:12.267390 19651 raft_consensus.cc:2749] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:22:12.268535 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:12.241245 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 78878us
I20260709 12:22:12.256456 19671 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:12.201187 19697 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:12.256723 18599 raft_consensus.cc:1240] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.257264 19679 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.258078 19694 raft_consensus.cc:3055] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:12.253978 19701 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.259373 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1107) took 1244 ms. Trace:
I20260709 12:22:12.259104 19623 consensus_queue.cc:237] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.276684 19697 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:12.252677 19693 consensus_meta.cc:287] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.659s	user 0.012s	sys 0.001s
I20260709 12:22:12.277226 19697 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:12.266058 19706 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.267717 19696 consensus_queue.cc:260] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.270175 18570 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:12.277334 19693 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.282545 19701 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:12.285244 19621 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:12.275173 18678 rpcz_store.cc:276] 0709 12:22:11.014748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.129780 (+115032us) service_pool.cc:224] Handling call
0709 12:22:11.518456 (+388676us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baeee 000000000036eb39 00007efc8142e1e0 00007efc814f70c4 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:11.835586 (+317130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:11.873755 (+ 38169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.259119 (+385364us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b540039f650. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:12.259278 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":731284096}
I20260709 12:22:12.269629 19671 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:12.277765 19697 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:12.273926 19694 raft_consensus.cc:740] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:12.296953 19616 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:12.296944 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:12.298760 18527 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:12.300164 19693 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:12.301075 18570 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:12.303061 18494 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.268280 19678 consensus_queue.cc:260] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.304356 18599 raft_consensus.cc:1240] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.304950 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:12.308673 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:12.274106 19670 consensus_queue.cc:1059] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:22:12.305572 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:12.313113 19694 consensus_queue.cc:260] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:12.313859 18494 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.314687 18570 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:12.342525 18570 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:12.313766 19700 raft_consensus.cc:3055] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:12.273433 19709 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.328953 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:12.344415 18494 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.345055 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:12.344048 18603 raft_consensus.cc:1240] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.328073 19697 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:12.346325 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:12.306495 19687 consensus_queue.cc:1059] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:22:12.347803 19687 raft_consensus.cc:3055] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:12.309489 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:12.344053 18526 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 1.
I20260709 12:22:12.352130 18680 raft_consensus.cc:1240] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.352259 18678 raft_consensus.cc:1240] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:12.349747 19689 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:12.353080 19679 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.308351 19621 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.353224 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:12.354578 18673 raft_consensus.cc:1240] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.354938 18671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1106) took 1340 ms. Trace:
I20260709 12:22:12.355070 19671 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:12.344703 19567 raft_consensus.cc:2749] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.355724 19621 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:12.349843 18676 raft_consensus.cc:1240] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.358371 18570 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:12.331149 19706 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:12.359395 19670 consensus_queue.cc:1059] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:22:12.348212 19687 raft_consensus.cc:740] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:12.345607 18494 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.311978 19701 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:12.314185 19616 raft_consensus.cc:697] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:12.389079 18494 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.389854 19567 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.314437 19688 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.326416 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:12.391024 19678 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.391398 18606 raft_consensus.cc:2393] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 2: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:12.390089 19616 consensus_queue.cc:237] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.349965 18679 raft_consensus.cc:1240] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.324738 19651 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.368054 19694 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.355345 18671 rpcz_store.cc:276] 0709 12:22:11.014506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.120274 (+105768us) service_pool.cc:224] Handling call
0709 12:22:11.558461 (+438187us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:12.121350 (+562889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.136642 (+ 15292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.354745 (+218103us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b54001f1b50. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:12.354878 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1298283776}
I20260709 12:22:12.343420 19700 raft_consensus.cc:740] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:12.384467 19212 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:12.385733 19637 consensus_queue.cc:1059] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:12.359652 18522 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 1.
I20260709 12:22:12.373262 19702 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.386945 18570 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:12.388032 19706 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.388667 19701 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.353281 19689 raft_consensus.cc:697] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:12.390758 18494 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.403612 18570 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:12.408322 18494 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.410221 19626 raft_consensus.cc:2749] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.411511 19701 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:12.404322 19713 raft_consensus.cc:2804] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:12.412194 19713 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:12.412563 19713 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.396200 19679 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.386544 19671 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:12.432818 19687 consensus_queue.cc:260] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.434928 18572 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:12.417058 19688 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.404299 19569 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.441555 19689 consensus_queue.cc:237] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.443945 19718 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:12.442989 19671 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:12.444500 19718 raft_consensus.cc:697] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:12.416558 19697 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:12.446259 19718 consensus_queue.cc:237] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.446473 19697 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:12.426780 19706 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.456444 19697 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:12.457698 19669 raft_consensus.cc:3055] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:12.458174 19669 raft_consensus.cc:740] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:12.457948 19567 consensus_queue.cc:1059] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:12.459213 19709 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:12.459537 19701 consensus_queue.cc:1059] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:12.459954 19709 consensus_queue.cc:1059] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:12.460121 19567 raft_consensus.cc:3055] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:12.460744 19567 raft_consensus.cc:740] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:12.461179 19707 raft_consensus.cc:3055] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:12.461604 19707 raft_consensus.cc:740] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:12.462548 19707 consensus_queue.cc:260] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.460788 19701 raft_consensus.cc:3055] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:12.464289 19701 raft_consensus.cc:740] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:12.465263 19701 consensus_queue.cc:260] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.466595 19701 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.462582 19567 consensus_queue.cc:260] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.474563 19669 consensus_queue.cc:260] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.483479 19669 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.486914 19665 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.454445 19210 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:12.478976 19696 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.481613 19694 consensus_queue.cc:1059] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:12.475383 18494 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:12.496178 19210 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:12.514267 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 61136.3us
W20260709 12:22:12.525220 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 50000.4us
I20260709 12:22:12.514832 19697 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.530028 18494 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:12.531801 18494 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:12.532691 18604 raft_consensus.cc:1240] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.527124 19688 raft_consensus.cc:2749] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.536149 18646 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.537385 18646 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.538414 18646 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.539422 18679 raft_consensus.cc:1240] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.539768 19708 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.540128 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:12.540377 19623 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:12.540490 19637 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.540717 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:12.534312 19706 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.544021 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:12.544587 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:12.544656 18601 raft_consensus.cc:1240] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.532233 19567 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.545431 18646 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.546283 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:12.547326 18673 raft_consensus.cc:1240] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.558248 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:12.558597 18603 raft_consensus.cc:1240] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.547722 19637 consensus_queue.cc:1059] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:12.548281 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:12.549367 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:12.552656 18646 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.540402 18606 raft_consensus.cc:1240] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.542549 19697 raft_consensus.cc:2749] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.570044 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:12.571431 18524 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:12.567096 19623 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.572965 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:12.573390 18528 raft_consensus.cc:1275] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:12.575721 19242 raft_consensus.cc:1240] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.576694 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:12.577409 19681 raft_consensus.cc:2749] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.579197 18646 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.581416 19714 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.574092 19630 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:12.576992 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:12.589752 18646 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.592182 18646 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.593930 19630 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.586843 19670 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:22:12.600023 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.585491 19713 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:12.601238 19630 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:12.594136 19693 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.602201 19248 raft_consensus.cc:1240] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.603080 18572 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:12.599545 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 103437us
I20260709 12:22:12.590428 19671 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:12.605353 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:12.595513 19714 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:12.602283 19713 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:12.611001 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:12.610060 18644 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.598675 19681 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:12.608291 19626 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:12.614012 19700 consensus_queue.cc:260] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.617955 19626 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:12.618486 19626 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.618552 19700 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.621407 19693 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.621551 18644 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:12.622752 19670 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.623190 18644 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:12.624068 19212 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:12.629381 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:12.630080 18527 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.632586 19637 raft_consensus.cc:2749] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.633796 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:12.632756 19681 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:12.636324 19678 raft_consensus.cc:3055] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:12.636759 19678 raft_consensus.cc:740] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:12.637697 19678 consensus_queue.cc:260] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.638733 19678 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.640302 19707 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.646428 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:12.648485 18602 raft_consensus.cc:2393] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 2: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:12.650207 18527 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 2.
I20260709 12:22:12.650552 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:12.651738 19212 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:12.619450 19714 raft_consensus.cc:697] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:12.661223 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:12.636358 19681 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:12.609092 19689 consensus_queue.cc:1048] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:22:12.680980 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:12.682874 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.686522 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:12.679924 19713 raft_consensus.cc:2804] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:22:12.692476 18494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:12.692950 18494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.693113 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:12.669896 19714 consensus_queue.cc:237] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.699206 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:12.699222 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:12.700640 18673 raft_consensus.cc:2393] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 2: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:12.704133 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:12.712026 19210 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:12.720307 19671 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.720180 19706 consensus_queue.cc:1059] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:12.717689 18494 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.702965 19626 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:12.726320 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:12.728048 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.724614 19706 raft_consensus.cc:3055] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:12.724346 19670 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:12.729512 19706 raft_consensus.cc:740] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:12.729987 19670 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.730520 19706 consensus_queue.cc:260] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.724287 19694 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.714556 19713 raft_consensus.cc:697] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 2 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:12.735303 19670 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:12.741353 18494 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.723198 19687 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.753544 19694 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.755666 19694 consensus_queue.cc:1059] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:12.761516 18426 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47714 (request call id 189) took 1567 ms. Trace:
I20260709 12:22:12.764855 19694 raft_consensus.cc:3055] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:12.765295 19694 raft_consensus.cc:740] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:12.766149 19694 consensus_queue.cc:260] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.767483 19694 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.785940 19665 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.786621 19665 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.788961 19665 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:12.791798 19626 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:12.795089 19713 consensus_queue.cc:237] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:12.761934 18426 rpcz_store.cc:276] 0709 12:22:11.194635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.194799 (+   164us) service_pool.cc:224] Handling call
0709 12:22:12.761454 (+1566655us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:12.129246 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:12.187967 (+ 58721us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:12.188023 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:22:12.188046 (+    23us) tablet.cc:662] Decoding operations
0709 12:22:12.188464 (+   418us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:12.188562 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:12.188592 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:22:12.188937 (+   345us) tablet.cc:701] Row locks acquired
0709 12:22:12.188990 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:22:12.189180 (+   190us) write_op.cc:270] Start()
0709 12:22:12.189349 (+   169us) write_op.cc:276] Timestamp: P: 1783599732189091 usec, L: 0
0709 12:22:12.189376 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:22:12.190300 (+   924us) log.cc:844] Serialized 602 byte log entry
0709 12:22:12.384985 (+194685us) spinlock_profiling.cc:243] Waited 8.36 ms on lock 0x7b180007bbe0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793f23f3 00007efc793f47c1 00007efc793f4779 00007efc793f4709 00007efc793f46d1 00007efc793f39cd 0000000000388634 0000000000388479 00007efc793d583a
0709 12:22:12.534736 (+149751us) op_driver.cc:464] REPLICATION: finished
0709 12:22:12.623908 (+ 89172us) write_op.cc:301] APPLY: starting
0709 12:22:12.623997 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:12.625851 (+  1854us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:12.625890 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:12.631225 (+  5335us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:12.631464 (+   239us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:22:12.631518 (+    54us) write_op.cc:312] APPLY: finished
0709 12:22:12.682721 (+ 51203us) log.cc:844] Serialized 22 byte log entry
0709 12:22:12.688906 (+  6185us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:12.694037 (+  5131us) write_op.cc:454] Released schema lock
0709 12:22:12.697955 (+  3918us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:12.715175 (+ 17220us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:12.715217 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11740,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":87402,"apply.run_cpu_time_us":2645,"apply.run_wall_time_us":91238,"num_ops":1,"prepare.queue_time_us":441748,"prepare.run_cpu_time_us":18756,"prepare.run_wall_time_us":149355,"raft.queue_time_us":109101,"raft.run_cpu_time_us":15858,"raft.run_wall_time_us":84133,"replication_time_us":337850,"spinlock_wait_cycles":19221248,"thread_start_us":508433,"threads_started":4,"wal-append.queue_time_us":65996}]]}
I20260709 12:22:12.769060 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:12.773847 18599 consensus_queue.cc:237] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:12.775374 19722 raft_consensus.cc:2804] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:12.775858 19706 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:12.808645 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 360730us
I20260709 12:22:12.817198 18570 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:22:12.815060 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 66681.6us
I20260709 12:22:12.818147 18644 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.820083 19210 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:12.826467 19718 raft_consensus.cc:2804] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:12.827229 19718 raft_consensus.cc:697] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:12.828500 19718 consensus_queue.cc:237] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.825743 19714 consensus_queue.cc:1059] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:22:12.830513 19714 raft_consensus.cc:3055] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:12.830868 19714 raft_consensus.cc:740] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:12.829345 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:12.833634 18570 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:12.841835 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:12.824268 19671 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.822896 19638 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.846053 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:12.847484 18676 raft_consensus.cc:1240] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.848984 18679 raft_consensus.cc:1240] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.851703 19724 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:12.852933 18523 raft_consensus.cc:1275] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:12.853019 18673 raft_consensus.cc:1240] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.872584 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:12.875645 18494 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.853897 18526 raft_consensus.cc:1240] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.877575 18494 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:12.878675 19706 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.878887 19707 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.880848 18494 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:12.882905 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.843350 18570 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:12.823904 19722 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:12.865504 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:12.886816 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 43585.1us
I20260709 12:22:12.893774 18679 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:12.894193 18570 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:12.890586 18605 raft_consensus.cc:1240] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.854642 19678 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.901746 18570 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:12.879729 19724 raft_consensus.cc:697] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:12.904819 18570 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:12.907858 18570 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:12.880414 18671 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:12.905779 18494 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.895921 19707 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.896173 19722 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.841858 19714 consensus_queue.cc:260] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:12.896751 19651 raft_consensus.cc:2804] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:12.915695 18494 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.903964 19619 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:12.917797 18570 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:12.907321 19720 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.909823 19616 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.901373 19678 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.931103 19678 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:12.936955 19714 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.939426 18494 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:12.917068 19621 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.939891 19707 consensus_queue.cc:1059] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:12.916699 19694 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.947077 18525 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:12.948681 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:12.949565 18679 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:12.922202 19688 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.919029 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:12.951299 19651 raft_consensus.cc:697] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:12.968065 18598 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:12.927281 19709 consensus_queue.cc:1059] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:22:12.970458 18646 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.964486 19724 consensus_queue.cc:237] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.968796 19651 consensus_queue.cc:237] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:12.917893 19665 consensus_queue.cc:1059] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:22:12.949090 19678 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:12.980753 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 63048.3us
I20260709 12:22:12.972664 18494 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:12.972283 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:12.984705 19665 raft_consensus.cc:3055] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:12.988198 18426 catalog_manager.cc:5697] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 1 to 2, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:12.991448 18646 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.996354 18494 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:12.997268 19709 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:12.997648 19709 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.997977 19709 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.989070 19704 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.999523 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:12.999833 18599 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:12.989410 19679 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:13.000931 19679 raft_consensus.cc:697] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:13.001901 19679 consensus_queue.cc:237] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:13.002441 19241 raft_consensus.cc:1275] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:13.003520 19688 raft_consensus.cc:2804] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:13.005313 19688 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:13.005698 19688 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:13.007653 19670 consensus_queue.cc:1048] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:12.992744 19665 raft_consensus.cc:740] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:13.009848 19665 consensus_queue.cc:260] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:13.015846 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:13.017198 19709 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.017740 19671 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:13.019904 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:13.020502 18599 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.021219 19688 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.029287 18676 raft_consensus.cc:1275] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:13.030593 19709 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:13.030858 19567 raft_consensus.cc:3055] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:13.032264 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:13.032537 19567 raft_consensus.cc:740] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:13.032820 18673 raft_consensus.cc:1275] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:13.033145 18598 raft_consensus.cc:2393] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 2: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:13.035158 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:13.031826 19244 raft_consensus.cc:1275] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:13.036168 19696 raft_consensus.cc:3055] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:13.036566 19696 raft_consensus.cc:740] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:13.037411 19567 consensus_queue.cc:260] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.037546 19696 consensus_queue.cc:260] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:13.038231 18679 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:13.038808 19567 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:13.035719 18676 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.039058 19242 raft_consensus.cc:1240] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
W20260709 12:22:13.040877 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 46338.6us
I20260709 12:22:13.038839 19696 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:13.041623 18644 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:13.041787 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:13.034915 18424 catalog_manager.cc:5697] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 1 to 2, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 2 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:12.983393 19678 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.032081 19688 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:13.052892 18676 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:13.062363 18494 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:13.075579 18679 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:13.048349 19637 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:13.052258 19678 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.079857 18494 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:13.057801 19619 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.078217 19688 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:13.063553 19670 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:13.084010 18570 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:13.038810 19722 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:13.099363 19665 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:13.069332 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:13.110407 19245 raft_consensus.cc:1240] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:13.076540 19690 consensus_queue.cc:1059] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:22:13.112618 19248 raft_consensus.cc:1240] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:13.091101 19706 raft_consensus.cc:2804] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:13.115458 19709 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.120092 19706 raft_consensus.cc:697] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:13.120494 19709 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.121168 19706 consensus_queue.cc:237] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.122654 19709 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:13.115347 19717 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:13.113337 19621 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:13.085572 19619 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.115942 19569 consensus_queue.cc:1048] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:13.116308 19720 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:13.117026 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:13.096165 19688 raft_consensus.cc:697] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:13.128536 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:13.130342 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 49525us
I20260709 12:22:13.137328 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:13.139612 18599 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:13.144114 19722 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:13.150393 18679 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:13.156071 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:13.156299 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:13.150422 18425 catalog_manager.cc:5697] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 1 to 2, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:13.159396 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 45129.4us
I20260709 12:22:13.144614 19619 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:13.157932 18598 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:13.169988 18603 raft_consensus.cc:1275] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:13.164568 19637 raft_consensus.cc:697] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:13.175655 19688 consensus_queue.cc:237] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.159196 19694 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:13.176785 19638 consensus_queue.cc:1059] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:13.158874 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:13.187860 19694 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.195933 19694 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:13.196679 19704 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:13.197224 19704 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.199258 19704 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:13.171453 18425 catalog_manager.cc:5697] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 1 to 2, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:13.200462 19704 raft_consensus.cc:3055] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:13.200929 19704 raft_consensus.cc:740] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:13.201896 19704 consensus_queue.cc:260] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:13.203614 19210 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:13.184693 19679 consensus_queue.cc:1048] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:22:13.211484 19567 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.211789 19722 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:13.212064 19567 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:13.218622 19210 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:13.229327 19210 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:13.230329 19671 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:13.231187 19671 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:13.213248 19696 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.237757 19567 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:13.237524 19637 consensus_queue.cc:237] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.212811 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:13.237008 19696 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.240891 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:13.203030 19704 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:13.213068 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:13.251845 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:13.246807 19722 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:13.273154 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:13.213711 19678 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.273829 19248 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:13.214607 19626 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:22:13.286545 18522 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:13.287249 18526 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:13.291031 19688 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.291580 19688 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.297180 18494 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:13.276108 19687 consensus_queue.cc:1048] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:22:13.296203 19688 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:13.298769 19688 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:13.299706 19688 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.300599 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:13.300740 19688 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.269376 19724 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.286545 18528 raft_consensus.cc:1275] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:13.301801 19724 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.303248 19671 consensus_queue.cc:1048] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:13.280573 19722 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:13.274091 19681 raft_consensus.cc:3055] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:22:13.341403 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 65145.5us
I20260709 12:22:13.342317 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:13.344002 18603 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:13.353911 18644 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:13.334509 19722 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:13.330982 19681 raft_consensus.cc:740] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:13.376609 19693 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:13.412101 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 44392.4us
I20260709 12:22:13.412537 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:13.413208 18676 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:22:13.414340 18494 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:13.359195 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:13.415395 19737 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:13.417392 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:13.421175 18603 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:13.421598 19567 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:13.419852 19671 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:13.422047 19567 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.422485 19567 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.423666 19671 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:13.425899 19671 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:13.420392 19737 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:13.417057 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 83242.5us
I20260709 12:22:13.428555 19737 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:13.430896 19210 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:13.435222 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:13.441540 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:13.448015 19706 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:13.450734 18673 raft_consensus.cc:1275] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:13.471079 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:13.434029 19671 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:13.448715 19706 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:13.432986 19637 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:22:13.488632 19621 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 12:22:13.489045 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 52515.8us
I20260709 12:22:13.487135 19696 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:13.498744 19678 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:13.500264 19621 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:13.502393 18572 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:13.503171 19694 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.521763 18530 raft_consensus.cc:1275] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:13.530788 18526 raft_consensus.cc:1275] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:13.533124 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:13.535308 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:13.542342 18605 raft_consensus.cc:1240] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:13.548949 19210 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:13.546247 19742 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.548219 19704 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.548692 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:13.562876 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:13.564642 18676 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:13.567823 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:13.568531 19720 raft_consensus.cc:2955] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:13.556339 19722 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:13.575083 18570 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:13.558650 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:13.552188 19687 consensus_queue.cc:1059] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:22:13.580155 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:13.554334 19679 consensus_queue.cc:1048] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:22:13.550086 19671 consensus_queue.cc:1048] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:22:13.585009 19738 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:13.571170 18604 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.590926 18494 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:13.560746 19706 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:13.563835 19704 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.591923 19731 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:13.596712 19737 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.599361 19738 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.591552 19688 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:13.585173 19742 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.603883 19678 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:13.615845 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:13.617830 18599 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:13.608517 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:13.612609 19738 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.623157 19724 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:13.635526 18674 raft_consensus.cc:1275] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:13.636412 18530 raft_consensus.cc:1240] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:13.638294 19704 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:13.612285 19731 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.654793 18494 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:13.614847 19737 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.643168 19694 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:13.659538 19706 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.660616 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:13.661322 18673 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:13.661099 19706 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.661652 18599 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:13.666011 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:13.672926 19696 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:13.673003 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c3c52474787041b099fe01aa8c862c04 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:13.648741 19567 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.673610 19696 raft_consensus.cc:697] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:13.674489 18604 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:13.675524 19567 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:13.676155 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:13.676519 18528 raft_consensus.cc:2393] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 3: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:13.677143 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:13.677778 18674 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:13.677879 19737 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:13.664238 19694 consensus_queue.cc:1048] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:22:13.674631 19696 consensus_queue.cc:237] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.687052 19742 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:13.687086 19688 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:13.688341 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:13.690657 18680 raft_consensus.cc:2955] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:13.663636 19706 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:13.697780 18494 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:13.704023 19731 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:13.700263 19678 raft_consensus.cc:2804] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:13.704170 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:13.712781 19678 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.719797 18676 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:13.719962 19678 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.718412 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:13.720887 18672 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.696463 19738 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.717747 18494 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:13.733947 18605 raft_consensus.cc:1275] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:22:13.745676 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 378174us
I20260709 12:22:13.750929 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:13.733712 19706 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:13.753368 19706 raft_consensus.cc:697] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:13.754498 18599 raft_consensus.cc:2393] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 3: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:13.754218 19706 consensus_queue.cc:237] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.751897 19709 consensus_queue.cc:1048] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:22:13.751669 19688 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.756944 19688 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.759049 19688 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:13.752729 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:13.763691 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:13.764338 18527 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
W20260709 12:22:13.764423 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 169152us
I20260709 12:22:13.766326 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:13.766901 18527 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:13.768745 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:13.754230 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:13.806753 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:13.815205 18680 raft_consensus.cc:2393] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 2: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:13.811152 18673 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:13.779830 19569 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.825549 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:13.832326 19681 consensus_queue.cc:260] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.836174 18646 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:13.886544 19624 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:13.825213 19242 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:13.889201 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 44537.3us
W20260709 12:22:13.896551 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 55271.9us
I20260709 12:22:13.894620 18646 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:13.901298 18646 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:13.834868 18672 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:13.888551 19681 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:13.893077 19567 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.907773 19724 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:22:13.834407 19569 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.928289 19738 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:13.942512 18673 raft_consensus.cc:1275] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:13.908526 19742 raft_consensus.cc:2804] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:13.905211 19755 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:13.952852 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 396132us
I20260709 12:22:13.977675 19665 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:13.979197 19679 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.979797 19679 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.983392 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:13.984407 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:13.944818 19688 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.991997 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:13.992992 18529 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:13.947882 19742 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.934561 19567 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:13.954384 19755 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.009202 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:13.995438 19742 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:14.001758 19754 log.cc:927] Time spent T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:22:14.015064 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:14.027006 19665 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.027631 19665 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.029044 18602 raft_consensus.cc:1275] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:14.029726 19665 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:14.034138 18572 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:14.036569 19757 consensus_queue.cc:1059] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:14.038451 19757 raft_consensus.cc:2804] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:14.038879 19757 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:14.039263 19757 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:13.992031 19738 consensus_queue.cc:1048] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:22:14.006182 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:13.995787 19688 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.009889 19755 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.056119 19569 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:14.039346 19768 raft_consensus.cc:3055] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:14.041465 19709 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.039459 19678 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.056401 19679 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:14.090039 19693 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.135787 18527 raft_consensus.cc:2393] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
W20260709 12:22:14.134692 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 82582.3us
I20260709 12:22:14.124552 19768 raft_consensus.cc:740] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:14.117072 19709 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.141108 19621 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:14.137560 19693 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.178196 19567 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:14.162590 19765 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.192342 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:14.193254 18529 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:14.181929 19768 consensus_queue.cc:260] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:14.204008 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:14.205801 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:14.206691 18672 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:14.211135 19247 raft_consensus.cc:2955] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:14.215996 19688 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:14.218247 19242 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:14.219074 19244 raft_consensus.cc:1240] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:14.220111 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:14.220968 18673 raft_consensus.cc:2393] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 3: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:14.223819 19681 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.225219 19681 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.233091 18526 raft_consensus.cc:1240] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:14.236023 19678 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:14.237752 19681 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:14.238155 19709 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:14.240017 19775 log.cc:927] Time spent T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.263s	user 0.002s	sys 0.000s
I20260709 12:22:14.183188 19765 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.253958 18426 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47708 (request call id 169) took 1299 ms. Trace:
I20260709 12:22:14.254490 18426 rpcz_store.cc:276] 0709 12:22:12.954650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.955934 (+  1284us) service_pool.cc:224] Handling call
0709 12:22:14.253880 (+1297946us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:13.163834 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:13.248288 (+ 84454us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:13.249791 (+  1503us) write_op.cc:435] Acquired schema lock
0709 12:22:13.250278 (+   487us) tablet.cc:662] Decoding operations
0709 12:22:13.294255 (+ 43977us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:13.296615 (+  2360us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:13.296648 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:22:13.296855 (+   207us) tablet.cc:701] Row locks acquired
0709 12:22:13.296871 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:22:13.297007 (+   136us) write_op.cc:270] Start()
0709 12:22:13.297136 (+   129us) write_op.cc:276] Timestamp: P: 1783599733296967 usec, L: 0
0709 12:22:13.297155 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:22:13.304299 (+  7144us) log.cc:844] Serialized 538 byte log entry
0709 12:22:13.488870 (+184571us) op_driver.cc:464] REPLICATION: finished
0709 12:22:13.778557 (+289687us) write_op.cc:301] APPLY: starting
0709 12:22:13.778653 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:13.778756 (+   103us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:13.787381 (+  8625us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:13.787695 (+   314us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:13.787875 (+   180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:22:13.787921 (+    46us) write_op.cc:312] APPLY: finished
0709 12:22:13.789120 (+  1199us) log.cc:844] Serialized 22 byte log entry
0709 12:22:13.827370 (+ 38250us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:13.835320 (+  7950us) write_op.cc:454] Released schema lock
0709 12:22:13.840603 (+  5283us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:13.897719 (+ 57116us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:13.897769 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3388,"reported_tablets":1,"spinlock_wait_cycles":9088,"child_traces":[["op",{"apply.queue_time_us":289376,"apply.run_cpu_time_us":6877,"apply.run_wall_time_us":119114,"num_ops":1,"prepare.queue_time_us":132831,"prepare.run_cpu_time_us":3607,"prepare.run_wall_time_us":146277,"replication_time_us":191505,"thread_start_us":249564,"threads_started":2}]]}
I20260709 12:22:14.267284 19681 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:14.266498 19766 log.cc:927] Time spent T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.294s	user 0.005s	sys 0.000s
I20260709 12:22:14.268389 19681 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.269052 19757 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.318117 18572 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:14.318802 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 177110us
I20260709 12:22:14.327425 18526 raft_consensus.cc:1275] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:14.317243 19709 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.317905 19693 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:14.342828 19717 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.339589 19678 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:14.346884 19717 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.347437 19651 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:14.363704 19616 consensus_queue.cc:1059] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:14.364723 19616 raft_consensus.cc:3055] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:14.365082 19616 raft_consensus.cc:740] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:14.365931 19616 consensus_queue.cc:260] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.367182 19616 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.371148 18675 raft_consensus.cc:1275] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:14.373092 19768 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.367501 18570 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:14.374837 18605 raft_consensus.cc:1240] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:14.378824 18527 raft_consensus.cc:1275] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:14.373711 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:14.380194 18671 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:14.380594 19700 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.381131 19717 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:14.381229 19700 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:14.383585 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:14.383718 19619 consensus_queue.cc:1048] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:14.384254 18527 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:14.384498 19700 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:14.385161 19619 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:14.356393 19774 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.345083 19709 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:14.389989 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:14.396494 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:14.397459 19720 consensus_queue.cc:1048] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:14.403177 19248 raft_consensus.cc:2468] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:14.360035 19651 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.407204 18644 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:14.405239 19774 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.417744 19742 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.355381 19678 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.412400 18572 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:14.423012 19700 raft_consensus.cc:2804] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:14.424208 19681 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:14.394971 19765 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:14.411643 19651 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.440611 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:14.446794 18677 raft_consensus.cc:2393] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 3: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:14.421561 19755 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.434330 19700 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.436508 19619 raft_consensus.cc:2804] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:14.494665 19619 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.504102 19671 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:14.525795 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 143613us
I20260709 12:22:14.528206 18570 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:14.495096 19700 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.515200 19619 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.571602 18525 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:14.591272 18572 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:14.593889 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:14.594610 18680 raft_consensus.cc:2393] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 2: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
W20260709 12:22:14.566902 19766 log.cc:927] Time spent T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.129s	user 0.004s	sys 0.010s
I20260709 12:22:14.568668 19709 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:14.596125 19787 raft_consensus.cc:2804] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:14.598683 19742 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:14.600250 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:14.606469 18603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1039) took 1066 ms. Trace:
I20260709 12:22:14.564692 19671 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:14.778425 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:14.743048 18679 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:22:14.759018 18646 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:14.761354 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:14.744477 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:14.811451 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 52519.2us
I20260709 12:22:14.732539 18601 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:22:14.811517 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:14.714869 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:14.807925 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:14.818077 18680 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
W20260709 12:22:14.660868 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 51245us
I20260709 12:22:14.818037 18605 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:14.812009 18676 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:14.821389 18602 raft_consensus.cc:2410] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:14.564877 19757 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:14.580639 18678 raft_consensus.cc:1240] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:14.580330 19779 raft_consensus.cc:2804] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:14.585436 19794 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:14.828850 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:14.837216 19248 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:14.808411 18603 rpcz_store.cc:276] 0709 12:22:13.540590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.543958 (+  3368us) service_pool.cc:224] Handling call
0709 12:22:14.251633 (+707675us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b5800102f98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:14.251922 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:14.252273 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:14.252300 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:14.252804 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 12:22:14.427649 (+174845us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:14.427706 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:14.427807 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:14.599666 (+171859us) raft_consensus.cc:1685] finished
0709 12:22:14.599716 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:14.606379 (+  6663us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":269,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"spinlock_wait_cycles":2716928,"thread_start_us":174315,"threads_started":1,"wal-append.queue_time_us":344881}
I20260709 12:22:14.828711 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:14.835327 18674 raft_consensus.cc:1240] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:14.726649 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:14.820683 19714 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.839495 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:14.839766 18599 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:14.839952 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:14.840670 18597 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:14.839116 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:14.840880 19794 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.840957 18680 raft_consensus.cc:3055] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:14.842092 18680 raft_consensus.cc:740] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:14.842922 18680 consensus_queue.cc:260] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.843991 19794 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:14.610359 19678 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:14.835613 19779 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.845470 19779 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.844857 19794 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:14.664435 19637 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.757378 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:14.855327 19637 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:14.748446 19774 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:14.660501 19722 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:14.831768 19787 raft_consensus.cc:697] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:14.728263 19624 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.758610 19651 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.855705 18523 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
W20260709 12:22:14.758082 19796 log.cc:927] Time spent T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:22:14.857631 19637 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:14.856074 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:14.858150 18679 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:14.863788 18601 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:14.663628 19762 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.778627 19681 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.731148 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:14.729532 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:14.817376 19709 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:14.866367 19670 consensus_queue.cc:1059] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:22:14.858759 19794 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.872318 19709 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:14.874325 19794 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:14.874540 19709 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:14.820839 19706 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.857685 19787 consensus_queue.cc:237] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.618040 19755 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:14.868355 18572 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:14.875339 19706 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:14.877681 19681 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:14.882241 19768 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:14.882675 19768 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.883023 19768 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.883916 19785 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.884402 19785 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.886580 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:14.887216 18530 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.886626 19785 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:14.902652 18530 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:14.904659 19706 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:14.905290 19681 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:14.909485 18572 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:14.910889 19773 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:14.911661 19773 raft_consensus.cc:697] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:14.911877 19619 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.829316 19694 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:14.906364 19768 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.905651 18672 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:14.913041 19773 consensus_queue.cc:237] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.921129 19619 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:14.921658 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 93524.8us
I20260709 12:22:14.925761 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:14.929472 18530 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.870369 19714 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:14.858726 19624 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.930330 18494 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:14.944092 18530 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:14.945452 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:14.945942 18572 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:14.921674 19706 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:14.866391 19700 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:14.856575 19722 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:14.923079 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 921) took 1335 ms. Trace:
I20260709 12:22:14.964399 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:14.946375 19245 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:14.949645 19671 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:14.950346 19619 raft_consensus.cc:2804] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:14.955971 18673 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:14.927083 19709 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:14.870988 19762 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.921976 19779 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.973543 18644 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:14.956642 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:14.966341 18530 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 2.
I20260709 12:22:14.958375 19731 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.959134 19678 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:14.925966 19694 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.962747 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:15.000563 18600 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:14.996572 18494 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:15.001185 19694 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:15.001351 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:14.980016 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:15.001981 19779 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:14.979553 19785 raft_consensus.cc:2804] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:15.003352 19785 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.003769 19785 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.984686 19731 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.970399 18678 rpcz_store.cc:276] 0709 12:22:13.587577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.589240 (+  1663us) service_pool.cc:224] Handling call
0709 12:22:14.580137 (+990897us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:14.580408 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:14.853902 (+273494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:14.914632 (+ 60730us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3210496}
I20260709 12:22:14.999082 19762 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:14.999966 19651 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:14.984823 19709 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:14.976531 19619 raft_consensus.cc:697] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:14.992626 19212 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:14.973076 19706 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:15.031399 19807 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.022746 19619 consensus_queue.cc:237] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:15.032131 18675 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:15.032774 18530 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.960005 19794 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:22:15.013199 19722 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:15.016389 19700 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:15.029207 19624 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:15.041651 19731 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:15.030382 19806 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:15.030772 19709 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:15.046479 18530 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:15.046743 19806 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.057476 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:15.048086 19694 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:22:15.066370 19706 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:15.069775 18680 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.071110 18521 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:15.078204 18572 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:15.064877 18494 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:15.085605 18680 raft_consensus.cc:1275] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:22:15.086282 18680 pending_rounds.cc:85] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting all ops after (but not including) 1
I20260709 12:22:15.062772 19806 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.094643 19768 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:15.097247 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:15.086643 18680 pending_rounds.cc:107] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:22:15.102849 18680 raft_consensus.cc:2889] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:15.064872 19678 raft_consensus.cc:697] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:15.104528 18494 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:15.108093 19811 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:15.108649 19678 consensus_queue.cc:237] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:15.092953 19812 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:15.110291 19812 raft_consensus.cc:697] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:15.112504 18494 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:15.114100 18494 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:15.101347 19687 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.113323 18521 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.118537 19687 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:15.111177 19812 consensus_queue.cc:237] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:15.114815 19706 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:15.121984 19805 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:15.093187 19718 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:15.093606 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 107280us
I20260709 12:22:15.101194 19694 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:22:15.127909 19718 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.136236 19718 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.127451 19805 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.125399 19706 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.139698 19805 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:15.141232 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 130008us
I20260709 12:22:15.119163 19785 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:15.143222 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:15.143812 19245 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.139966 19706 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.146585 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:15.145354 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:15.151067 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:15.151726 18676 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:15.152667 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:15.153440 19569 consensus_queue.cc:1059] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:22:15.160705 19569 raft_consensus.cc:3055] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:15.161156 19569 raft_consensus.cc:740] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:15.161088 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:15.162031 18671 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.156527 19212 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:15.170102 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:15.170770 18679 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.153138 19813 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:15.174731 19245 raft_consensus.cc:2468] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:15.176397 18644 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:15.177255 19714 raft_consensus.cc:2804] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:15.177793 19714 raft_consensus.cc:697] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:15.179298 19808 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:15.182788 19569 consensus_queue.cc:260] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:15.184432 19569 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.187923 19687 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:15.188794 19714 consensus_queue.cc:237] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:15.200791 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:15.190793 19718 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:15.218071 19718 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:15.226329 18679 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:15.201514 18678 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:15.190788 19813 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:15.268726 19785 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:15.316073 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:15.284201 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:15.307634 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:15.334836 19245 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.335958 18605 raft_consensus.cc:2393] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:15.332831 18572 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:15.338853 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:15.287019 19816 log.cc:927] Time spent T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:22:15.325793 18602 raft_consensus.cc:2393] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
W20260709 12:22:15.250383 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 130597us
I20260709 12:22:15.250888 19805 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:15.328878 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:15.338550 19802 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.290164 19694 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:15.360472 19718 raft_consensus.cc:2804] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:15.350346 19245 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:15.289213 19807 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:15.372948 18526 raft_consensus.cc:1240] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:15.375384 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:15.307372 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:15.364141 19802 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:15.340090 19768 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:15.292695 19678 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:15.251277 19687 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:15.383562 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:15.384663 18597 raft_consensus.cc:2410] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:15.384701 18526 raft_consensus.cc:2393] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:15.387952 18527 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:15.291886 18521 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:15.288457 19806 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:15.385228 19805 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:15.379851 19718 raft_consensus.cc:697] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:15.397917 18572 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:15.399389 19643 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:15.376415 19694 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:15.401836 18644 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:15.402766 18644 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:15.404102 19785 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:15.404405 19624 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:15.404542 19785 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.404816 19624 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.404968 19785 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.405195 19624 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.386369 19768 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:15.385998 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:15.389479 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:15.403420 19694 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:15.391062 19678 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:15.400204 19643 raft_consensus.cc:697] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:15.290928 18671 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:15.393775 19794 raft_consensus.cc:2764] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:22:15.427481 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:15.428372 18526 raft_consensus.cc:2468] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:15.428659 19678 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:15.428838 19802 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:15.430401 19768 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:15.432121 19806 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:15.432864 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:15.433437 18526 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.422582 19805 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:15.436236 19805 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:15.438305 19805 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:15.416075 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:15.441241 18600 raft_consensus.cc:2393] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:15.441154 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:15.442239 18521 raft_consensus.cc:2393] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:15.443470 19706 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:15.444700 18530 raft_consensus.cc:2393] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:15.445557 19706 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:15.387481 19687 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:15.447153 18526 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:22:15.448349 19212 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:15.448971 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:15.448360 19687 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:22:15.456820 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:15.466971 18523 raft_consensus.cc:2393] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:15.468973 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:15.469704 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:15.470371 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:15.469331 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:15.470949 18530 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:15.470505 18529 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.469751 18526 raft_consensus.cc:2393] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:15.472934 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:15.473627 18525 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:15.481568 19643 consensus_queue.cc:237] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:15.464568 19806 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:15.488943 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:15.489494 19806 raft_consensus.cc:697] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:15.489739 19241 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:15.490010 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:15.490890 18523 raft_consensus.cc:2393] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:22:15.490455 19806 consensus_queue.cc:237] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:15.469960 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:15.463639 19706 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:15.506223 18570 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:15.532146 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:15.509617 19689 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:15.535669 18529 raft_consensus.cc:2468] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:15.544489 19689 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.546591 19689 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.512295 18521 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:15.525370 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:15.510049 19706 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:15.561090 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:15.554023 18523 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.563645 18525 raft_consensus.cc:1240] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:15.535847 19785 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:15.565461 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:15.566176 18526 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.566592 18494 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:15.567795 19805 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:15.571693 19817 log.cc:927] Time spent T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:22:15.509932 19718 consensus_queue.cc:237] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:15.578658 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:15.579367 18605 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:15.579957 18526 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:15.576195 19706 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:15.564571 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:15.591990 19241 raft_consensus.cc:2368] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3.
I20260709 12:22:15.554734 19762 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:22:15.589591 19624 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:15.590999 19785 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:15.596328 19624 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:15.597837 19813 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:15.604074 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:15.606261 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:22:15.608300 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 182815us
W20260709 12:22:15.622098 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 56740.2us
I20260709 12:22:15.623157 18494 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:15.625535 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:15.626668 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:15.627193 18605 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.603152 19689 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:15.631306 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:15.633373 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:15.634886 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:15.634016 18494 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:15.629578 19811 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:15.645392 19706 raft_consensus.cc:2764] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:22:15.629562 19768 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:15.649379 19768 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:15.653100 19689 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:15.654284 18523 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:15.640306 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:15.659672 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:15.660455 19245 raft_consensus.cc:2393] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 3: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:15.664755 18425 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47728 (request call id 206) took 2584 ms. Trace:
I20260709 12:22:15.671675 18605 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
W20260709 12:22:15.667819 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 117081us
I20260709 12:22:15.662667 18644 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:15.690335 18646 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:15.665347 18425 rpcz_store.cc:276] 0709 12:22:13.080541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.080687 (+   146us) service_pool.cc:224] Handling call
0709 12:22:15.664691 (+2584004us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:13.428444 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:13.428968 (+   524us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:13.428994 (+    26us) write_op.cc:435] Acquired schema lock
0709 12:22:13.429008 (+    14us) tablet.cc:662] Decoding operations
0709 12:22:13.429396 (+   388us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:13.429438 (+    42us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:13.429473 (+    35us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:22:13.429802 (+   329us) tablet.cc:701] Row locks acquired
0709 12:22:13.429816 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:22:13.429946 (+   130us) write_op.cc:270] Start()
0709 12:22:13.430062 (+   116us) write_op.cc:276] Timestamp: P: 1783599733429892 usec, L: 0
0709 12:22:13.430086 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:22:13.480286 (+ 50200us) log.cc:844] Serialized 934 byte log entry
0709 12:22:14.931994 (+1451708us) op_driver.cc:464] REPLICATION: finished
0709 12:22:14.981688 (+ 49694us) write_op.cc:301] APPLY: starting
0709 12:22:14.981779 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:14.981909 (+   130us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:14.982037 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:14.982446 (+   409us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:14.982725 (+   279us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:22:14.982804 (+    79us) write_op.cc:312] APPLY: finished
0709 12:22:14.983083 (+   279us) log.cc:844] Serialized 28 byte log entry
0709 12:22:14.983328 (+   245us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:14.983447 (+   119us) write_op.cc:454] Released schema lock
0709 12:22:14.983520 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:14.984039 (+   519us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:14.984084 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":43367,"apply.run_cpu_time_us":2274,"apply.run_wall_time_us":2274,"num_ops":2,"prepare.queue_time_us":225446,"prepare.run_cpu_time_us":3035,"prepare.run_wall_time_us":52172,"replication_time_us":1497605,"thread_start_us":21307,"threads_started":1}]]}
I20260709 12:22:15.698336 19759 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.698786 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:15.700636 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:15.701252 18671 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.706106 19700 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:15.706857 19700 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:15.708683 18671 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:22:15.709674 19700 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:15.710758 18644 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:15.714169 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:15.716446 18646 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:15.722859 18494 leader_election.cc:400] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879) with higher term. Message: Invalid argument: T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3.
I20260709 12:22:15.723268 18494 leader_election.cc:403] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:15.721637 18646 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:15.697458 19737 raft_consensus.cc:2804] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:22:15.731088 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 57003.9us
I20260709 12:22:15.738149 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:15.739506 18527 raft_consensus.cc:2393] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:15.679823 19794 consensus_queue.cc:1048] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:22:15.723766 19700 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:15.744915 19700 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.745317 19700 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.715396 19768 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:15.715029 19774 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.743561 18572 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:15.755736 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:15.756574 18530 raft_consensus.cc:2393] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:15.769790 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:15.772200 19619 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:15.772987 19619 raft_consensus.cc:697] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:15.774101 19619 consensus_queue.cc:237] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:15.778705 18494 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:15.742920 19706 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879) with higher term. Message: Invalid argument: T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3.
I20260709 12:22:15.752554 18523 raft_consensus.cc:1275] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:15.788057 19811 raft_consensus.cc:2804] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:15.794333 19245 raft_consensus.cc:1275] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:15.758215 19737 raft_consensus.cc:697] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:15.752977 19823 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:15.743819 19787 consensus_queue.cc:1059] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:22:15.788713 19785 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:22:15.805248 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 83570.6us
I20260709 12:22:15.811949 18644 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:15.768231 19774 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:15.800427 19811 raft_consensus.cc:697] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:22:15.817869 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 45872us
I20260709 12:22:15.823624 18530 raft_consensus.cc:1275] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:15.831004 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:15.832420 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:15.833140 19247 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:15.843313 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 91750.8us
I20260709 12:22:15.844231 18646 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:15.822537 19785 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:15.850075 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:15.854007 19829 log.cc:927] Time spent T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:22:15.854506 19835 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:15.855042 19835 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:15.857630 19835 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:15.860693 18674 raft_consensus.cc:1275] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:15.861375 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:15.861953 18605 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.865550 19737 consensus_queue.cc:237] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:15.868966 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:15.869776 18598 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:22:15.869892 18605 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:15.870802 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:15.870883 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:15.871197 19774 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:15.874384 19821 log.cc:927] Time spent T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 12:22:15.818614 19678 consensus_queue.cc:1048] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:22:15.876112 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:15.877923 19811 consensus_queue.cc:237] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:15.886334 18604 raft_consensus.cc:1275] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:15.888850 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:15.889650 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:15.890051 18603 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:15.890314 18675 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.891650 19797 raft_consensus.cc:3055] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:15.892127 19797 raft_consensus.cc:740] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:15.893034 19797 consensus_queue.cc:260] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:15.896611 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:15.897789 19797 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.899148 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:15.868976 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:15.902776 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:15.903765 18599 raft_consensus.cc:2393] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:15.905536 19241 raft_consensus.cc:1275] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:15.904183 19700 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:15.909008 19828 log.cc:927] Time spent T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:22:15.910324 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:15.912020 18678 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:15.912107 18424 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60812 (request call id 101) took 2905 ms. Trace:
I20260709 12:22:15.871855 18605 raft_consensus.cc:2393] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 3: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
W20260709 12:22:15.924556 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 80371.1us
I20260709 12:22:15.928229 19762 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:15.930936 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.887581 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:15.903537 19759 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:15.933054 18494 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:15.944183 18494 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:15.947968 18427 catalog_manager.cc:5697] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 2, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.953028 18646 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:15.954532 18427 catalog_manager.cc:5697] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 2, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.957629 18646 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:15.930382 19785 raft_consensus.cc:697] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:15.967396 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:15.912701 18424 rpcz_store.cc:276] 0709 12:22:13.006819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.006969 (+   150us) service_pool.cc:224] Handling call
0709 12:22:15.912028 (+2905059us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:13.304705 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:13.305227 (+   522us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:13.309323 (+  4096us) write_op.cc:435] Acquired schema lock
0709 12:22:13.309615 (+   292us) tablet.cc:662] Decoding operations
0709 12:22:13.360322 (+ 50707us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:13.368837 (+  8515us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:13.377753 (+  8916us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:22:13.426434 (+ 48681us) tablet.cc:701] Row locks acquired
0709 12:22:13.426458 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:22:13.426597 (+   139us) write_op.cc:270] Start()
0709 12:22:13.426736 (+   139us) write_op.cc:276] Timestamp: P: 1783599733426549 usec, L: 0
0709 12:22:13.426759 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:22:13.427679 (+   920us) log.cc:844] Serialized 538 byte log entry
0709 12:22:14.728789 (+1301110us) op_driver.cc:464] REPLICATION: finished
0709 12:22:14.971605 (+242816us) write_op.cc:301] APPLY: starting
0709 12:22:14.971786 (+   181us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:14.971940 (+   154us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:14.979994 (+  8054us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:15.016954 (+ 36960us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:15.017136 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:22:15.017188 (+    52us) write_op.cc:312] APPLY: finished
0709 12:22:15.037354 (+ 20166us) log.cc:844] Serialized 22 byte log entry
0709 12:22:15.037555 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:15.037653 (+    98us) write_op.cc:454] Released schema lock
0709 12:22:15.037700 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:15.038087 (+   387us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:15.038119 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":625392,"reported_tablets":1,"spinlock_wait_cycles":147712,"child_traces":[["op",{"apply.queue_time_us":201321,"apply.run_cpu_time_us":2475,"apply.run_wall_time_us":92235,"num_ops":1,"prepare.queue_time_us":227861,"prepare.run_cpu_time_us":3686,"prepare.run_wall_time_us":123542,"replication_time_us":1301855,"thread_start_us":140856,"threads_started":1}]]}
I20260709 12:22:15.968111 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:15.963181 18427 catalog_manager.cc:5697] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 2, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.963626 19759 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.969676 18677 raft_consensus.cc:1240] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:15.969372 18427 catalog_manager.cc:5697] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 2, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.970916 18427 catalog_manager.cc:5697] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 2, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.972118 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:15.972811 18427 catalog_manager.cc:5697] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 2, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.973588 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:15.971478 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:15.961424 18646 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:15.968274 18676 raft_consensus.cc:2368] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3.
I20260709 12:22:15.978490 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:15.952095 19678 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:15.951730 19706 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:15.979265 18680 raft_consensus.cc:2393] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 4: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:15.980926 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:15.996865 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:15.998333 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:15.992266 18427 catalog_manager.cc:5697] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 2, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:16.008761 18530 raft_consensus.cc:1275] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:16.005448 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:16.016692 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:15.954217 19805 consensus_queue.cc:1048] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:22:15.978339 19833 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:15.997491 19762 raft_consensus.cc:2749] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:16.014945 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:15.992780 19678 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:16.019200 18598 raft_consensus.cc:1240] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:16.015118 19706 raft_consensus.cc:697] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:16.086799 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:16.000793 19679 consensus_queue.cc:1048] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
W20260709 12:22:16.091544 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 257001us
I20260709 12:22:16.003935 19774 consensus_queue.cc:1048] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:22:16.040321 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:16.011732 19811 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 12:22:16.048547 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:16.118536 18680 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:16.090739 19678 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.141214 18570 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:16.080017 19761 consensus_queue.cc:1048] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:22:16.155221 18570 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:16.123667 19700 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:16.050783 19833 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:16.174189 19718 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:16.164654 19643 raft_consensus.cc:2804] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:16.188158 19706 consensus_queue.cc:237] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:16.139395 19785 consensus_queue.cc:237] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:16.149107 19689 consensus_queue.cc:1048] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:22:16.226066 18644 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:16.209648 19643 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:16.171060 18678 consensus_queue.cc:237] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:16.236948 18530 raft_consensus.cc:1275] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:22:16.233481 19834 log.cc:927] Time spent T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.253s	user 0.000s	sys 0.008s
I20260709 12:22:16.233608 19643 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.234196 19826 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:16.258492 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:22:16.244161 19842 log.cc:927] Time spent T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:22:16.260388 18525 raft_consensus.cc:1275] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:22:16.280769 19843 log.cc:927] Time spent T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:22:16.282598 19759 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:16.283566 19841 log.cc:927] Time spent T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:22:16.267269 19831 consensus_queue.cc:1048] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:22:16.297492 18671 raft_consensus.cc:1275] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:22:16.299607 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 338239us
I20260709 12:22:16.308523 18646 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:16.299011 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 349080us
I20260709 12:22:16.321766 19833 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:16.335287 19849 log.cc:927] Time spent T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:22:16.339031 18672 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:16.307029 19247 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:16.342628 19852 consensus_queue.cc:1048] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:16.369270 19245 raft_consensus.cc:1240] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:22:16.361312 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 50804.2us
I20260709 12:22:16.363034 19848 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:16.363981 19806 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:16.377931 18494 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:16.382195 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 83747us
W20260709 12:22:16.384631 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 76194.4us
I20260709 12:22:16.386210 18646 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:16.327406 18675 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
W20260709 12:22:16.399291 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 244176us
I20260709 12:22:16.418650 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:16.422575 19210 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:16.425742 18676 raft_consensus.cc:1275] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:16.434928 18676 raft_consensus.cc:1275] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:16.436036 18679 raft_consensus.cc:1275] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:22:16.436782 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 52749.6us
I20260709 12:22:16.382647 19832 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:16.395438 19681 raft_consensus.cc:2764] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:22:16.415968 19855 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:16.452363 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 63944us
I20260709 12:22:16.464478 18646 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:16.476718 18528 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:16.424196 19846 raft_consensus.cc:2804] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:16.484215 18570 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:16.485531 19844 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:16.485636 18522 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:16.486047 19844 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:16.487933 19706 consensus_queue.cc:1059] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.488338 19844 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:16.439670 19722 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:16.398330 19811 consensus_queue.cc:1059] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
W20260709 12:22:16.492134 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 45521.6us
I20260709 12:22:16.512288 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:16.382185 19848 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:16.445228 19823 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:16.395210 19806 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:16.539202 19852 consensus_queue.cc:1048] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:22:16.500845 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:16.505092 19831 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:16.549371 19848 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:16.496708 19846 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.527529 19844 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:22:16.665658 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 194456us
I20260709 12:22:16.446206 19832 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:16.538554 19787 consensus_queue.cc:1048] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.132s
I20260709 12:22:16.632371 19846 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.550909 19802 consensus_queue.cc:1048] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.165s
I20260709 12:22:16.549398 19811 consensus_queue.cc:1243] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:22:16.723012 18676 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:16.724872 18494 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:16.746197 18494 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:16.748680 18494 leader_election.cc:400] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3.
I20260709 12:22:16.749147 18494 leader_election.cc:403] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:16.538172 19864 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:16.752326 19678 consensus_meta.cc:287] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.603s	user 0.012s	sys 0.000s
I20260709 12:22:16.734143 19844 raft_consensus.cc:697] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:16.746245 19826 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.771795 18572 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:16.742898 19866 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:16.780546 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 229052us
I20260709 12:22:16.788604 18494 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:16.794158 18494 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:16.773408 19855 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:16.782810 19714 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.797627 19242 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:16.778476 19678 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:16.803474 19241 raft_consensus.cc:1275] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:16.781558 19794 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3.
I20260709 12:22:16.804327 19794 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:16.804626 19678 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:16.783373 19826 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:16.809839 18680 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:16.786280 19687 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:16.788115 19722 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:16.771217 19853 consensus_queue.cc:1059] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:22:16.763394 19864 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:16.811803 19871 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:16.818738 19857 log.cc:927] Time spent T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:22:16.819119 19877 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:16.809180 19882 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:16.809125 18672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 966) took 1482 ms (client timeout 1674 ms). Trace:
I20260709 12:22:16.816824 19679 raft_consensus.cc:2749] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:16.822664 19643 consensus_meta.cc:287] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.560s	user 0.008s	sys 0.001s
I20260709 12:22:16.794080 19759 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:16.789063 19866 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:16.847716 18672 rpcz_store.cc:269] 0709 12:22:15.327036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.775452 (+448416us) service_pool.cc:224] Handling call
0709 12:22:15.895364 (+119912us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:22:16.808903 (+913539us) spinlock_profiling.cc:243] Waited 53.9 ms on lock 0x7b5400290ed4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:16.809038 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138678272}
I20260709 12:22:16.905079 19866 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:16.815618 19832 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:16.840543 19687 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:16.908099 19643 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:16.909849 19687 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:16.910630 19643 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:16.912482 19759 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:16.913012 19826 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:16.914997 19759 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:16.915392 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:16.918792 18604 raft_consensus.cc:1240] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:16.807127 19714 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:16.844883 19722 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:16.924928 19852 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:16.931728 19852 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:16.934973 19722 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:16.934971 19714 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:16.935870 19847 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:16.936422 19847 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:16.936721 19852 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:16.932045 19759 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:16.938045 19759 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:16.938480 19847 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:16.952353 19864 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:16.940323 19880 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:16.952762 19759 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:16.953399 19880 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:16.958015 19880 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:16.960954 19806 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:16.920957 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 70621.5us
W20260709 12:22:16.978201 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 184085us
I20260709 12:22:16.979358 18494 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:16.981010 18494 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:16.982941 18494 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:16.985365 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:16.845940 19844 consensus_queue.cc:237] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:16.955823 18671 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:16.921388 19877 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:16.986662 19878 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:16.987872 19794 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:16.989199 19864 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:17.005668 19877 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:17.008767 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 238362us
W20260709 12:22:17.009452 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 237801us
I20260709 12:22:17.035286 19839 consensus_queue.cc:1048] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:22:16.989921 19855 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:22:17.000331 19878 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:17.042387 19884 log.cc:927] Time spent T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.198s	user 0.002s	sys 0.000s
I20260709 12:22:17.042645 19846 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:17.044026 18679 raft_consensus.cc:1240] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:17.050556 19813 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.096791 19855 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:17.096673 19813 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:17.097765 19679 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:17.153712 19855 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:17.098366 19679 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:17.187196 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 87096.3us
I20260709 12:22:17.157652 19886 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:17.199599 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:17.203510 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:17.204412 18677 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:17.156877 19855 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:17.225020 19718 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.118s
I20260709 12:22:17.202661 19773 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.189s
W20260709 12:22:17.515183 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 532262us
I20260709 12:22:17.397684 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:17.516309 18494 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:17.516415 18529 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:22:17.346426 19836 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.312512 19805 raft_consensus.cc:3055] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:17.344671 19832 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.546597 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:17.406037 19878 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:17.347128 19846 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:17.390777 19848 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:17.450929 19873 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:17.552834 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:17.589700 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:17.453276 19787 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:17.346737 19886 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:17.598169 19895 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:17.600551 19886 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:17.533075 19722 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:17.601585 19722 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:17.563041 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1070) took 1090 ms. Trace:
I20260709 12:22:17.603942 18523 rpcz_store.cc:276] 0709 12:22:16.467909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.490128 (+ 22219us) service_pool.cc:224] Handling call
0709 12:22:16.549158 (+ 59030us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:16.549528 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:16.549568 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:16.550114 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 12:22:16.844267 (+294153us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:16.847435 (+  3168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:16.847525 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:17.040879 (+193354us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:22:17.465475 (+424596us) raft_consensus.cc:1685] finished
0709 12:22:17.465533 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:17.548134 (+ 82601us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11101,"raft.queue_time_us":173362,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":18110,"spinlock_wait_cycles":14093568,"thread_start_us":56312,"threads_started":1,"wal-append.queue_time_us":212357}
I20260709 12:22:17.565847 19806 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:17.607092 19806 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:17.610495 19806 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:17.566910 19879 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:17.612408 19879 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:17.569981 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:17.618968 18601 raft_consensus.cc:1275] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:17.512734 19887 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:17.567246 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:17.580353 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:17.585031 19679 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:17.572937 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:17.571661 19896 raft_consensus.cc:2749] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:17.629294 19722 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:17.630115 19722 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:17.619009 18671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 976) took 1199 ms. Trace:
I20260709 12:22:17.592300 18598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 1189) took 1126 ms. Trace:
I20260709 12:22:17.594667 19787 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:17.596074 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:17.597149 19873 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:17.645228 19873 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:17.611334 19806 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:17.557830 19805 raft_consensus.cc:740] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:17.646209 19806 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:17.646668 19805 consensus_queue.cc:260] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:17.647694 19805 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.649195 19806 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:17.454696 19813 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:17.630714 19722 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:17.636451 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:17.632165 19895 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:17.588295 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:17.627242 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:22:17.655093 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 554729us
I20260709 12:22:17.635250 19879 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:17.598196 19848 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:17.620921 19836 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:17.717759 19826 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.731329 18597 raft_consensus.cc:2410] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:22:17.740231 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 86025.9us
W20260709 12:22:17.721031 19844 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.030s	sys 0.088s
W20260709 12:22:17.730634 19854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.082s	sys 0.138s
I20260709 12:22:17.638586 19887 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:17.717742 19873 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:17.626087 19832 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:17.721061 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:17.722805 19855 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:17.725538 18606 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
W20260709 12:22:17.756026 19844 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.030s	sys 0.088s
I20260709 12:22:17.634996 18671 rpcz_store.cc:276] 0709 12:22:16.419493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.436286 (+ 16793us) service_pool.cc:224] Handling call
0709 12:22:16.915225 (+478939us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:22:17.618723 (+703498us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b540039f654. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:17.618891 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59287680}
W20260709 12:22:17.759330 19854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.083s	sys 0.139s
I20260709 12:22:17.754194 19846 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:22:17.757850 19863 consensus_queue.cc:1048] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:22:17.757400 19826 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:17.803243 19806 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:17.784832 19873 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:17.798144 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:17.814368 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 296225us
W20260709 12:22:17.815157 18572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.020s	sys 0.043s
W20260709 12:22:17.819717 18572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.020s	sys 0.043s
W20260709 12:22:17.820066 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 631395us
I20260709 12:22:17.833101 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:22:17.826280 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 99871.1us
I20260709 12:22:17.831827 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:17.838200 18530 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
W20260709 12:22:17.844431 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 88977.8us
I20260709 12:22:17.853603 19906 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:17.854338 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:17.818187 19893 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:17.855173 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.805527 19806 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:18.314193 18646 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.506s (SENT) [suppressed 1 similar messages]
I20260709 12:22:18.616019 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:18.617112 18529 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:18.573421 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:18.117978 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 271573us
I20260709 12:22:17.874147 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:18.701053 18644 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:18.209898 18525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1072) took 1741 ms. Trace:
I20260709 12:22:17.638201 18598 rpcz_store.cc:276] 0709 12:22:16.465893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.527768 (+ 61875us) service_pool.cc:224] Handling call
0709 12:22:16.733208 (+205440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:16.778625 (+ 45417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:16.781106 (+  2481us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:16.824610 (+ 43504us) log.cc:844] Serialized 26 byte log entry
0709 12:22:17.154414 (+329804us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:17.180162 (+ 25748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:17.190901 (+ 10739us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:17.571403 (+380502us) raft_consensus.cc:1685] finished
0709 12:22:17.573948 (+  2545us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:17.588513 (+ 14565us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7360,"raft.queue_time_us":44026,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":35256,"thread_start_us":169692,"threads_started":1,"wal-append.queue_time_us":716245}
W20260709 12:22:18.706451 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 347398us
I20260709 12:22:18.701048 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:17.904678 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:18.716096 18601 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:18.716754 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:18.717583 18529 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:18.702314 18677 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
W20260709 12:22:18.573606 19908 log.cc:927] Time spent T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 12:22:18.272709 19896 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:18.737017 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:18.776412 18530 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:18.777714 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:18.779515 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:18.733772 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:17.867656 19836 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:17.860663 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:18.789513 18601 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:18.790153 19244 raft_consensus.cc:2468] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:22:18.510099 19902 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:17.848610 19855 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:17.873324 19848 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:18.364219 19887 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:17.861083 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:17.864516 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:18.455551 19805 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:18.305059 19918 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.487s
I20260709 12:22:18.726421 19844 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:18.703334 18525 rpcz_store.cc:276] 0709 12:22:16.468778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.470973 (+  2195us) service_pool.cc:224] Handling call
0709 12:22:16.538429 (+ 67456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:17.162602 (+624173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:17.162655 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:17.508389 (+345734us) log.cc:844] Serialized 26 byte log entry
0709 12:22:17.601091 (+ 92702us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b48003603d8. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc81408aa1 00007efc813ffb37 00007efc813ff9ca 00007efc814f726f 00007efc814f6f37 00007efc8150b55c 00007efc8150b508 00007efc8150b488 00007efc8150b443 00007efc8150a6ec 00007efc80434a96
0709 12:22:17.807641 (+206550us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:17.807703 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:17.807816 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:18.209466 (+401650us) raft_consensus.cc:1685] finished
0709 12:22:18.209495 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:18.209809 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":207084,"raft.queue_time_us":198653,"raft.run_cpu_time_us":13293,"raft.run_wall_time_us":863740,"spinlock_wait_cycles":9552768,"thread_start_us":675073,"threads_started":2,"wal-append.queue_time_us":327213}
I20260709 12:22:18.320004 19910 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:17.880336 19873 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:18.793550 19909 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:17.880472 18599 raft_consensus.cc:1275] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:22:18.119606 19904 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:18.316761 19722 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:17.884016 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:17.881376 19787 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:18.284363 19907 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:18.859534 19907 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:18.131973 19813 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:18.122872 19689 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:18.060689 19740 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:18.711123 18671 raft_consensus.cc:1275] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:22:18.819059 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.317669 19914 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:18.426519 19906 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:18.794622 18677 raft_consensus.cc:2393] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 3: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:18.298235 19212 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:18.802057 19681 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:18.787381 19896 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:18.888116 18601 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:18.848655 19722 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:18.834029 19903 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:18.731346 19893 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:18.850533 19915 log.cc:927] Time spent T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:22:18.903311 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 983) took 2475 ms. Trace:
I20260709 12:22:18.817032 19247 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:22:18.904079 18679 rpcz_store.cc:276] 0709 12:22:16.427462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.444832 (+ 17370us) service_pool.cc:224] Handling call
0709 12:22:16.911289 (+466457us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:16.911487 (+   198us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:17.044451 (+132964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:18.902921 (+1858470us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54003584d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:18.903197 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309732480}
I20260709 12:22:18.905694 18600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 1192) took 2438 ms. Trace:
I20260709 12:22:18.857523 19806 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:18.805799 19855 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:18.831126 19910 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:18.838254 19876 log.cc:927] Time spent T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 1.995s	user 0.019s	sys 0.038s
I20260709 12:22:18.809172 19848 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:18.828131 19805 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:18.838847 19909 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:18.830955 19836 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:18.874051 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 50) took 1567 ms. Trace:
I20260709 12:22:18.875183 19870 raft_consensus.cc:3055] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:18.870802 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:18.879483 19689 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:18.873227 18523 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:18.878958 19813 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:18.883224 19907 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:18.832504 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:18.891517 18601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40954 (request call id 1197) took 1066 ms. Trace:
I20260709 12:22:18.806262 19902 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:18.901139 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 603006us
I20260709 12:22:18.944643 18601 rpcz_store.cc:276] 0709 12:22:17.825470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.733481 (+908011us) service_pool.cc:224] Handling call
0709 12:22:18.891437 (+157956us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.893704 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:18.839769 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:18.798847 19891 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.000s	sys 0.016s
I20260709 12:22:18.861315 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40800 (request call id 1179) took 1009 ms. Trace:
I20260709 12:22:18.829681 19844 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:18.901842 19927 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.904606 19247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33372 (request call id 131) took 1050 ms. Trace:
I20260709 12:22:18.836826 18599 pending_rounds.cc:85] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9: Aborting all ops after (but not including) 1
I20260709 12:22:18.905982 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:18.911062 19245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 262) took 2395 ms. Trace:
I20260709 12:22:18.892138 19681 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:18.915148 18676 rpcz_store.cc:276] 0709 12:22:17.306302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.528999 (+222697us) service_pool.cc:224] Handling call
0709 12:22:17.529736 (+   737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:17.534810 (+  5074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:17.534856 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:17.589511 (+ 54655us) log.cc:844] Serialized 26 byte log entry
0709 12:22:17.976935 (+387424us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:17.977076 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:17.977173 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:18.873742 (+896569us) raft_consensus.cc:1685] finished
0709 12:22:18.873772 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:18.873986 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4560,"raft.queue_time_us":67697,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":145,"thread_start_us":323325,"threads_started":1,"wal-append.queue_time_us":687116}
I20260709 12:22:18.972771 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:18.974687 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:18.906263 18600 rpcz_store.cc:276] 0709 12:22:16.466844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.483551 (+ 16707us) service_pool.cc:224] Handling call
0709 12:22:16.483994 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:16.484487 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:16.484525 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:17.737517 (+1252992us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b2c0005b3b8. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7add8a11 00007efc7ade8372 00007efc7c51aa01 00007efc7c4df43a 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2
0709 12:22:17.797953 (+ 60436us) log.cc:844] Serialized 26 byte log entry
0709 12:22:18.130657 (+332704us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:18.130720 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:18.130855 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:18.905264 (+774409us) raft_consensus.cc:1685] finished
0709 12:22:18.905299 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:18.905589 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14542,"raft.queue_time_us":4356,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":97340800,"thread_start_us":273491,"threads_started":1,"wal-append.queue_time_us":763458}
I20260709 12:22:18.925884 19870 raft_consensus.cc:740] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:18.920693 19836 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:18.929103 19805 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:18.861091 19873 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.910312 18671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1177) took 1061 ms. Trace:
I20260709 12:22:18.877867 19914 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:18.959558 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:18.991817 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:19.005188 18601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40954 (request call id 1201) took 1115 ms. Trace:
I20260709 12:22:19.005412 18679 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:19.005612 18601 rpcz_store.cc:276] 0709 12:22:17.889308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.959269 (+1069961us) service_pool.cc:224] Handling call
0709 12:22:19.005123 (+ 45854us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.959141 19907 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:18.947959 18677 raft_consensus.cc:2376] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3. Re-sending same reply.
I20260709 12:22:18.982925 19893 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:18.964387 19245 rpcz_store.cc:276] 0709 12:22:16.515378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.515547 (+   169us) service_pool.cc:224] Handling call
0709 12:22:16.516009 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:16.527521 (+ 11512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:16.527569 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:16.549704 (+ 22135us) log.cc:844] Serialized 26 byte log entry
0709 12:22:16.745273 (+195569us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:16.745313 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:16.745389 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:18.367458 (+1622069us) spinlock_profiling.cc:243] Waited 72.1 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:22:18.908966 (+541508us) raft_consensus.cc:1685] finished
0709 12:22:18.908995 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:18.910943 (+  1948us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10970,"raft.queue_time_us":11717,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":20727,"spinlock_wait_cycles":165932288,"thread_start_us":194261,"threads_started":1,"wal-append.queue_time_us":293211}
I20260709 12:22:18.968354 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57384 (request call id 1079) took 1129 ms. Trace:
I20260709 12:22:18.912217 19848 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:18.958185 19891 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.000s	sys 0.017s
I20260709 12:22:18.913796 19722 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:18.979817 19681 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:19.007149 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:18.963832 19247 rpcz_store.cc:276] 0709 12:22:17.853786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.860814 (+  7028us) service_pool.cc:224] Handling call
0709 12:22:18.904479 (+1043665us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:19.011572 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:18.847239 19904 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:19.029139 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:18.963832 18599 pending_rounds.cc:107] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:22:19.036382 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:19.038731 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:19.039467 19896 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:18.878892 19740 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:19.040092 18599 raft_consensus.cc:2889] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:19.006300 19873 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.039650 18601 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 1.
I20260709 12:22:18.978287 19853 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:19.042130 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:19.046057 18679 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:18.918296 19903 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:19.008766 19855 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.049554 19248 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:19.007164 19805 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:19.010723 19906 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:18.997460 18598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40954 (request call id 1200) took 1102 ms. Trace:
I20260709 12:22:18.960587 18674 rpcz_store.cc:276] 0709 12:22:17.852064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.864259 (+ 12195us) service_pool.cc:224] Handling call
0709 12:22:18.848980 (+984721us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:19.045315 18677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1180) took 1123 ms. Trace:
I20260709 12:22:18.984046 19927 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.015126 19907 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.079000 18679 raft_consensus.cc:1240] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:19.011435 18523 rpcz_store.cc:276] 0709 12:22:17.827494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.836340 (+  8846us) service_pool.cc:224] Handling call
0709 12:22:18.956499 (+1120159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:19.090444 19722 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.054185 19909 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.079402 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1075) took 2585 ms. Trace:
I20260709 12:22:19.007401 18671 rpcz_store.cc:276] 0709 12:22:17.840380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.843529 (+  3149us) service_pool.cc:224] Handling call
0709 12:22:18.570409 (+726880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:18.872512 (+302103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:18.901337 (+ 28825us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:19.059661 18677 rpcz_store.cc:276] 0709 12:22:17.922218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.027020 (+1104802us) service_pool.cc:224] Handling call
0709 12:22:19.044682 (+ 17662us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.044907 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.044946 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:19.045003 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:19.045040 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.045107 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.045243 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:19.048004 19891 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:19.054329 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:19.094028 18527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.138s	sys 0.174s
I20260709 12:22:19.078416 19835 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:19.094077 18526 rpcz_store.cc:276] 0709 12:22:16.474240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.475924 (+  1684us) service_pool.cc:224] Handling call
0709 12:22:16.476271 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:16.544346 (+ 68075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:16.544399 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:16.544462 (+    63us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:16.544547 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.058786 (+2514239us) spinlock_profiling.cc:243] Waited 67.8 ms on lock 0x7b5400432454. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:19.058848 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.059018 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155942784}
I20260709 12:22:19.059329 18599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 1193) took 1236 ms. Trace:
I20260709 12:22:19.048162 19896 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:19.104202 18527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.138s	sys 0.174s
I20260709 12:22:19.058482 19805 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:19.049587 19870 consensus_queue.cc:260] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:19.091339 19907 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.112957 19835 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.121640 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:19.112485 19689 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.061187 19853 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.167209 18675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:22:19.111078 19891 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.173840 18605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1114) took 1501 ms. Trace:
I20260709 12:22:19.122455 19813 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.123988 19848 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.129878 19904 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:19.124758 19870 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:19.134406 19910 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.179641 19844 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.197949 18604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 1191) took 2731 ms. Trace:
I20260709 12:22:19.188360 19836 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:19.137488 18600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40954 (request call id 1202) took 1247 ms. Trace:
I20260709 12:22:19.122455 19740 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:19.190511 18605 rpcz_store.cc:276] 0709 12:22:17.672254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.672434 (+   180us) service_pool.cc:224] Handling call
0709 12:22:19.172943 (+1500509us) spinlock_profiling.cc:243] Waited 7.7 ms on lock 0x7b5800102f98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:19.173147 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.173370 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.173409 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:19.173470 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:19.173543 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.173619 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.173752 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17704192}
I20260709 12:22:19.111446 18599 rpcz_store.cc:276] 0709 12:22:17.821178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.827641 (+  6463us) service_pool.cc:224] Handling call
0709 12:22:17.879934 (+ 52293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.040683 (+1160749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.057343 (+ 16660us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:19.143471 18674 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:22:19.187397 19832 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:19.180532 18646 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.017s	sys 0.037s
W20260709 12:22:19.214637 18646 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.018s	sys 0.037s
W20260709 12:22:19.214957 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 900747us
I20260709 12:22:19.195173 19813 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.055027 18598 rpcz_store.cc:276] 0709 12:22:17.888965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.798350 (+909385us) service_pool.cc:224] Handling call
0709 12:22:18.991077 (+192727us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:19.189392 19914 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:19.198469 18604 rpcz_store.cc:276] 0709 12:22:16.466550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.487902 (+ 21352us) service_pool.cc:224] Handling call
0709 12:22:16.488211 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:16.919342 (+431131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.197689 (+2278347us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b54000d6e54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:19.197886 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":989603072}
I20260709 12:22:19.201117 18600 rpcz_store.cc:276] 0709 12:22:17.889617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.998635 (+1109018us) service_pool.cc:224] Handling call
0709 12:22:19.136563 (+137928us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:19.195585 18675 raft_consensus.cc:606] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:19.231576 18675 raft_consensus.cc:614] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:19.234620 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:19.236413 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:19.237246 18522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1080) took 1409 ms. Trace:
I20260709 12:22:19.238456 18600 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:22:19.239310 18600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 1199) took 1351 ms. Trace:
I20260709 12:22:19.136439 19896 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.215624 19805 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:19.244328 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1183) took 1122 ms. Trace:
I20260709 12:22:19.244877 19886 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:19.245426 19886 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:19.211207 19891 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.213757 19848 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.223867 19785 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:19.228996 19813 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:19.237804 18522 rpcz_store.cc:276] 0709 12:22:17.827905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.836404 (+  8499us) service_pool.cc:224] Handling call
0709 12:22:19.236233 (+1399829us) spinlock_profiling.cc:243] Waited 32.8 ms on lock 0x7b5800002798. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:19.236511 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.236758 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.236797 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:19.236867 (+    70us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:19.236916 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.236997 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.237166 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75398528}
I20260709 12:22:19.251245 19785 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.229049 19835 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.201505 19873 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.258671 19903 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:19.256119 19848 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.262174 19848 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.230453 19681 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.211073 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:19.218793 19832 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:19.253477 19813 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:19.264638 19832 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:19.254768 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 980) took 2830 ms. Trace:
I20260709 12:22:19.254907 19785 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:22:19.245137 18674 rpcz_store.cc:276] 0709 12:22:18.121459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.082701 (+961242us) service_pool.cc:224] Handling call
0709 12:22:19.110613 (+ 27912us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.218046 (+107433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.244251 (+ 26205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:19.266325 18601 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
W20260709 12:22:19.277842 19248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33372 (request call id 130) took 1434 ms (client timeout 1622 ms). Trace:
W20260709 12:22:19.281271 18644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.003s	sys 0.059s
W20260709 12:22:19.285375 18644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.003s	sys 0.059s
W20260709 12:22:19.284477 19248 rpcz_store.cc:269] 0709 12:22:17.853300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.854096 (+   796us) service_pool.cc:224] Handling call
0709 12:22:19.277607 (+1423511us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54005c12d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:19.277762 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":945640192}
I20260709 12:22:19.280475 18602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1099) took 1738 ms. Trace:
I20260709 12:22:19.286914 18602 rpcz_store.cc:276] 0709 12:22:17.541987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.542176 (+   189us) service_pool.cc:224] Handling call
0709 12:22:19.279561 (+1737385us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b5800102f98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:19.279837 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.280070 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.280107 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:19.280163 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:19.280203 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.280275 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.280405 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2454400}
I20260709 12:22:19.265509 18680 rpcz_store.cc:276] 0709 12:22:16.424300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.424409 (+   109us) service_pool.cc:224] Handling call
0709 12:22:16.809490 (+385081us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:16.810244 (+   754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.254493 (+2444249us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b5400290ed0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:19.254691 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":884957440}
I20260709 12:22:19.239662 18600 rpcz_store.cc:276] 0709 12:22:17.888525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.237677 (+1349152us) service_pool.cc:224] Handling call
0709 12:22:19.238011 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.238981 (+   970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.239243 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:19.266706 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:19.386021 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:19.449890 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 61837.4us
W20260709 12:22:19.407999 18570 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.013s	sys 0.054s
W20260709 12:22:19.529821 18570 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.013s	sys 0.054s
W20260709 12:22:19.530500 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 777495us
W20260709 12:22:19.505656 18495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.020s	sys 0.015s
W20260709 12:22:19.531673 18495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.020s	sys 0.015s
I20260709 12:22:19.311024 18676 raft_consensus.cc:2393] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 5: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
W20260709 12:22:19.331144 18529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.026s	sys 0.043s
W20260709 12:22:19.532569 18529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.032s	sys 0.055s
I20260709 12:22:19.279336 19826 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:19.548988 19914 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:19.579402 19247 raft_consensus.cc:1275] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:19.370426 19839 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:19.310590 19863 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.573531 19929 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:19.418634 19848 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:19.380658 19896 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.585162 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:19.585696 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:19.609750 18526 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:19.588568 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:19.610633 19248 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:19.611006 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:19.598308 19806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.017s	sys 0.004s
I20260709 12:22:19.595258 19927 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:19.596004 18528 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.026s	user 0.019s	sys 0.011s
I20260709 12:22:19.381937 19886 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:22:19.593560 19243 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.009s	sys 0.020s
I20260709 12:22:19.609870 18525 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:19.593973 19903 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.640322 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:19.642658 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:19.596482 19914 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.643394 18525 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:19.647272 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:19.648097 18525 raft_consensus.cc:2468] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:19.649072 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:19.652396 19757 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:19.652680 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:19.653016 19757 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:19.640153 19243 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.009s	sys 0.021s
W20260709 12:22:19.595009 18569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.349s	user 0.014s	sys 0.013s
W20260709 12:22:19.675055 18569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.429s	user 0.015s	sys 0.013s
I20260709 12:22:19.598620 19870 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.596719 19891 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:19.581324 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:19.625756 18528 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.055s	user 0.019s	sys 0.012s
I20260709 12:22:19.596000 19805 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:19.598239 19785 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:19.598426 19894 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:19.646787 19930 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:19.635442 19853 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.636155 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:19.600069 19700 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:19.654376 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:19.626827 19896 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:19.657538 18570 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:19.617305 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:19.653513 18606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40954 (request call id 1194) took 1831 ms (client timeout 2004 ms). Trace:
I20260709 12:22:19.691174 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:19.684387 19681 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:19.628245 19806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.017s	sys 0.004s
I20260709 12:22:19.649773 18525 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:19.602073 19839 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.633431 19927 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:19.605559 19863 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.607949 19929 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.682483 19805 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.581528 19826 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:19.687781 18604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39798 (request call id 40) took 1043 ms. Trace:
W20260709 12:22:19.687629 18643 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.007s	sys 0.051s
I20260709 12:22:19.684432 19873 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:19.655481 19761 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:22:19.646921 19802 consensus_queue.cc:1048] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:22:19.623342 19848 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.646407 19903 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:19.711562 18604 rpcz_store.cc:276] 0709 12:22:18.644527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.635876 (+991349us) service_pool.cc:224] Handling call
0709 12:22:19.687687 (+ 51811us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:19.690898 18606 rpcz_store.cc:269] 0709 12:22:17.822120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.827709 (+  5589us) service_pool.cc:224] Handling call
0709 12:22:19.652562 (+1824853us) spinlock_profiling.cc:243] Waited 8.8 ms on lock 0x7b5800102f98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baeee 000000000036eb39 00007efc8142e1e0 00007efc814f70c4 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:22:19.653429 (+   867us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20240128}
W20260709 12:22:19.719363 18643 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.002s	user 0.007s	sys 0.053s
I20260709 12:22:19.684106 19894 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:19.725740 19932 log.cc:927] Time spent T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:22:19.719641 19873 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.692269 19930 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.710744 19927 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.725571 19863 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:19.718420 19722 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.022s	sys 0.034s
I20260709 12:22:19.681340 19870 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.694909 19896 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.723461 19805 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.727391 18525 raft_consensus.cc:1275] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:19.731263 18570 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:19.682019 19785 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.721215 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:19.705971 19689 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:19.682693 19891 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:19.736742 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:19.784718 18680 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:19.726444 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1184) took 1584 ms. Trace:
I20260709 12:22:19.785885 18679 rpcz_store.cc:276] 0709 12:22:18.141835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.089257 (+947422us) service_pool.cc:224] Handling call
0709 12:22:19.089625 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:19.090696 (+  1071us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.090726 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:19.091289 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:22:19.604800 (+513511us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:19.604844 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.604916 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:19.726238 (+121322us) raft_consensus.cc:1685] finished
0709 12:22:19.726255 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.726387 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":546,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":110,"thread_start_us":479417,"threads_started":1,"wal-append.queue_time_us":611881}
I20260709 12:22:19.711652 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:19.695438 19700 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.706203 19931 raft_consensus.cc:2804] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:19.726920 19681 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:19.745908 19722 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.022s	sys 0.034s
I20260709 12:22:19.717482 19826 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:19.753612 19241 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.004s	sys 0.042s
W20260709 12:22:19.778841 19212 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.016s	sys 0.034s
W20260709 12:22:19.819955 19212 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.017s	sys 0.034s
W20260709 12:22:19.820299 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 813448us
I20260709 12:22:19.821627 19212 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:19.822822 19930 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.823719 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:19.824117 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:19.824342 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 1000) took 1458 ms. Trace:
I20260709 12:22:19.824433 18525 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 1.
I20260709 12:22:19.824820 18676 rpcz_store.cc:276] 0709 12:22:18.365760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.974232 (+608472us) service_pool.cc:224] Handling call
0709 12:22:19.824142 (+849910us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b5400403dd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:19.824280 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":763135360}
I20260709 12:22:19.825995 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:19.799052 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:19.819358 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:19.799844 18494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.039s	sys 0.067s
W20260709 12:22:19.827621 18494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.039s	sys 0.067s
W20260709 12:22:19.800823 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 69666.4us
I20260709 12:22:19.828895 18570 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:19.829058 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:19.829450 18527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1087) took 1987 ms. Trace:
I20260709 12:22:19.783146 19689 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.780077 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:19.752068 19740 consensus_queue.cc:1059] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:22:19.785952 18523 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:19.813681 19941 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:19.819577 19241 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.004s	sys 0.042s
W20260709 12:22:19.782311 19898 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.022s	sys 0.032s
I20260709 12:22:19.826117 19913 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.834494 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:19.842231 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:19.884555 18526 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 1.
I20260709 12:22:19.832365 19930 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:19.814249 19845 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:19.905702 19845 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:19.906247 19845 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:19.805445 19247 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:19.829841 18527 rpcz_store.cc:276] 0709 12:22:17.842159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.842415 (+   256us) service_pool.cc:224] Handling call
0709 12:22:17.842798 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:18.148012 (+305214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:18.148058 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:18.299741 (+151683us) log.cc:844] Serialized 26 byte log entry
0709 12:22:19.114231 (+814490us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:19.114291 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.114392 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:19.829267 (+714875us) raft_consensus.cc:1685] finished
0709 12:22:19.829287 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.829399 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":304679,"raft.queue_time_us":305440,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":184,"thread_start_us":543771,"threads_started":1,"wal-append.queue_time_us":1108678}
I20260709 12:22:19.816197 19896 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:19.830531 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 879158us
W20260709 12:22:19.930510 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 60043.4us
I20260709 12:22:19.814915 19903 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:19.818562 19927 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.817659 19839 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.815163 18672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 988) took 2618 ms. Trace:
I20260709 12:22:19.839363 19689 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:19.831703 19806 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:19.846658 19643 raft_consensus.cc:2804] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:19.938923 19643 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.890779 19774 raft_consensus.cc:3055] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:19.890978 18675 raft_consensus.cc:2393] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 4: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:19.892436 19700 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:19.892968 19873 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.893108 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:19.893357 19913 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.939445 19643 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:19.950366 19774 raft_consensus.cc:740] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:19.936046 19805 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:19.968057 19805 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:19.894238 19212 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
W20260709 12:22:19.970606 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 76454us
I20260709 12:22:19.970767 19805 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:19.971572 19806 raft_consensus.cc:2804] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:19.972215 19806 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:19.972661 19806 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:19.974843 19870 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.846150 19757 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.934196 18672 rpcz_store.cc:276] 0709 12:22:17.196811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.202414 (+  5603us) service_pool.cc:224] Handling call
0709 12:22:19.738134 (+2535720us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:19.758855 (+ 20721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.794112 (+ 35257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.797889 (+  3777us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:19.804001 (+  6112us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:19.811300 (+  7299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.814969 (+  3669us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.815107 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34397952}
I20260709 12:22:19.978077 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:19.895912 19826 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:19.896809 19848 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.900228 19930 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:19.901146 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:19.901487 19929 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.980716 18523 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 2.
I20260709 12:22:19.963868 19241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 270) took 1180 ms. Trace:
I20260709 12:22:19.981778 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:19.982270 19930 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:19.887614 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:19.903354 19785 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:19.937034 19943 log.cc:927] Time spent T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:22:19.892472 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:19.867990 19898 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.022s	sys 0.032s
I20260709 12:22:19.881839 19941 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:19.847232 19902 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:19.904913 19891 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:19.908211 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:20.054914 18526 raft_consensus.cc:2410] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:22:19.899372 19894 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:19.910925 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:19.933017 19945 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:19.933173 19797 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:19.933502 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:19.812014 19681 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:19.931505 18570 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:19.848026 19914 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:19.962237 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:19.967423 19913 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:20.301214 19826 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:20.696972 19806 consensus_meta.cc:287] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.724s	user 0.009s	sys 0.002s
I20260709 12:22:20.253737 19906 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:20.919077 19826 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:20.919806 19806 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:20.920657 19906 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:20.710021 19845 consensus_meta.cc:287] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.803s	user 0.010s	sys 0.001s
W20260709 12:22:20.710719 19689 consensus_meta.cc:287] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.576s	user 0.012s	sys 0.000s
I20260709 12:22:20.230453 19891 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:20.924085 19689 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:20.924443 19891 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:20.925308 19906 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:20.055465 19930 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:20.927889 19914 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:20.928459 19930 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:20.928897 19914 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:20.929354 19689 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:20.932055 19891 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:20.932210 19845 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:20.932785 19891 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:20.933583 19891 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:20.934795 19845 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:20.935820 19891 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:20.936381 19891 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:20.937286 19806 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:20.937142 19891 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:20.923261 19826 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:20.838356 18525 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.000s	sys 0.010s
I20260709 12:22:20.426872 19700 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.955433 19700 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:20.949347 18525 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.003s	sys 0.019s
I20260709 12:22:20.903179 19966 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.953749 19242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33388 (request call id 222) took 1108 ms. Trace:
I20260709 12:22:20.967422 19945 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:20.969673 19681 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:20.971063 19945 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:20.971712 19210 leader_election.cc:336] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Timed out: RequestConsensusVote RPC to 127.16.240.130:37079 timed out after 1.551s (SENT)
I20260709 12:22:20.974876 18527 raft_consensus.cc:2410] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:20.974836 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 1008) took 1374 ms. Trace:
I20260709 12:22:20.056226 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:20.976994 19624 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.280s	user 0.006s	sys 0.025s
I20260709 12:22:20.918205 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:20.259910 19785 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:20.518019 19955 log.cc:927] Time spent T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:22:20.978814 19930 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:20.979323 19700 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:20.979969 18675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 1018) took 1377 ms. Trace:
W20260709 12:22:20.420439 19722 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.005s	sys 0.004s
I20260709 12:22:20.957964 19914 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:20.422465 19944 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.002s	sys 0.008s
I20260709 12:22:20.981755 18676 rpcz_store.cc:276] 0709 12:22:19.600581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.910619 (+310038us) service_pool.cc:224] Handling call
0709 12:22:20.974545 (+1063926us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:20.309928 18597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 1195) took 2486 ms. Trace:
I20260709 12:22:20.381196 19243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 269) took 1649 ms. Trace:
I20260709 12:22:20.240700 19929 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:20.082971 18530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1101) took 1300 ms. Trace:
I20260709 12:22:20.109656 19212 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
W20260709 12:22:20.995332 19944 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.099s	user 0.008s	sys 0.020s
I20260709 12:22:20.993898 19785 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:20.996783 19797 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:20.996475 19929 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:20.997699 18527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1056) took 1061 ms. Trace:
I20260709 12:22:20.995333 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1065) took 1060 ms. Trace:
W20260709 12:22:20.998389 19722 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.157s	user 0.007s	sys 0.016s
W20260709 12:22:20.988914 19624 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.364s	user 0.006s	sys 0.026s
I20260709 12:22:21.002319 18527 rpcz_store.cc:276] 0709 12:22:19.930395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.933287 (+  2892us) service_pool.cc:224] Handling call
0709 12:22:20.990014 (+1056727us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:20.994174 19210 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:21.002072 19797 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.981638 19241 rpcz_store.cc:276] 0709 12:22:18.783843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.787069 (+  3226us) service_pool.cc:224] Handling call
0709 12:22:18.858225 (+ 71156us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:18.858736 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:18.858783 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:18.860238 (+  1455us) log.cc:844] Serialized 508 byte log entry
0709 12:22:19.907099 (+1046861us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:19.925378 (+ 18279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.936447 (+ 11069us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:19.948931 (+ 12484us) raft_consensus.cc:1685] finished
0709 12:22:19.948959 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.963740 (+ 14781us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1007693,"threads_started":1,"wal-append.queue_time_us":1038620,"wal-append.run_cpu_time_us":2013,"wal-append.run_wall_time_us":1029296}
I20260709 12:22:21.002701 19941 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:20.989060 18675 rpcz_store.cc:276] 0709 12:22:19.602581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.961866 (+359285us) service_pool.cc:224] Handling call
0709 12:22:20.979710 (+1017844us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:20.993158 19945 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:21.010366 18494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1057) took 1011 ms. Trace:
I20260709 12:22:21.017772 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1063) took 1072 ms. Trace:
I20260709 12:22:21.002965 18523 rpcz_store.cc:276] 0709 12:22:19.935348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.053589 (+118241us) service_pool.cc:224] Handling call
0709 12:22:20.995200 (+941611us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:20.997560 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 1.06588e+06us
I20260709 12:22:21.011466 19797 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:21.018920 18526 rpcz_store.cc:276] 0709 12:22:19.934536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.055958 (+121422us) service_pool.cc:224] Handling call
0709 12:22:21.004819 (+948861us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:21.018831 18494 rpcz_store.cc:276] 0709 12:22:19.930645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.894486 (+963841us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:22:20.990466 19242 rpcz_store.cc:276] 0709 12:22:18.841701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.850919 (+  9218us) service_pool.cc:224] Handling call
0709 12:22:19.880902 (+1029983us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5800003c98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:19.895363 (+ 14461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.895567 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.895599 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:19.895646 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:19.895699 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.925979 (+ 30280us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.937321 (+ 11342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23556352}
I20260709 12:22:21.022979 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.026324 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:21.026360 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 54943.7us
W20260709 12:22:21.034943 18494 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:57374 dropped due to backpressure: service queue is full with 50 items
I20260709 12:22:21.032648 19891 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:21.021889 18530 rpcz_store.cc:276] 0709 12:22:18.782155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.870637 (+ 88482us) service_pool.cc:224] Handling call
0709 12:22:18.894985 (+ 24348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.081106 (+186121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.081153 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:19.081244 (+    91us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:19.081289 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.082616 (+1001327us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b5400287654. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:20.082684 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.082886 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":427448704}
W20260709 12:22:21.031610 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 977824us
I20260709 12:22:21.020253 19966 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:21.041906 19785 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:21.042213 19906 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:21.037227 19806 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:21.050568 18528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1093) took 2481 ms. Trace:
I20260709 12:22:21.061594 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 990) took 3863 ms. Trace:
I20260709 12:22:21.044552 19945 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:21.063145 18526 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:21.053946 19906 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:21.050462 19929 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:21.053755 18528 rpcz_store.cc:276] 0709 12:22:18.569518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.569654 (+   136us) service_pool.cc:224] Handling call
0709 12:22:18.570054 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:19.679108 (+1109054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.679141 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:19.679597 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 12:22:20.085107 (+405510us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:20.085155 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.085245 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:21.050070 (+964825us) raft_consensus.cc:1685] finished
0709 12:22:21.050110 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.050343 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":277879,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":167,"thread_start_us":1495040,"threads_started":2,"wal-append.queue_time_us":1329456}
I20260709 12:22:21.056294 19832 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:21.077175 19906 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.998780 19243 rpcz_store.cc:276] 0709 12:22:18.732151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.734219 (+  2068us) service_pool.cc:224] Handling call
0709 12:22:18.837394 (+103175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:18.877445 (+ 40051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:18.877478 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:18.878056 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 12:22:19.683307 (+805251us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:19.694350 (+ 11043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.698173 (+  3823us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:20.379793 (+681620us) raft_consensus.cc:1685] finished
0709 12:22:20.379839 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.381097 (+  1258us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2363,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":145,"thread_start_us":783004,"threads_started":1,"wal-append.queue_time_us":900950}
I20260709 12:22:21.078287 18522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1103) took 1494 ms. Trace:
I20260709 12:22:21.069178 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1070) took 1010 ms. Trace:
I20260709 12:22:21.092734 18526 rpcz_store.cc:276] 0709 12:22:20.056436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.025726 (+969290us) service_pool.cc:224] Handling call
0709 12:22:21.066444 (+ 40718us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:21.097344 19806 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:21.098352 19806 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:21.099351 18671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 55) took 1719 ms. Trace:
I20260709 12:22:21.089706 18525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 53) took 1191 ms. Trace:
I20260709 12:22:21.062238 18678 rpcz_store.cc:276] 0709 12:22:17.197487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.202216 (+  4729us) service_pool.cc:224] Handling call
0709 12:22:19.578348 (+2376132us) spinlock_profiling.cc:243] Waited 8.32 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:19.578611 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:19.579274 (+   663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.579327 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:19.603492 (+ 24165us) log.cc:844] Serialized 26 byte log entry
0709 12:22:20.234951 (+631459us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:20.239865 (+  4914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.277984 (+ 38119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:21.044850 (+766866us) raft_consensus.cc:1685] finished
0709 12:22:21.044898 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.060328 (+ 15430us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1130,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":11701,"spinlock_wait_cycles":19144448,"thread_start_us":429595,"threads_started":1,"wal-append.queue_time_us":634903}
I20260709 12:22:21.106015 19722 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:21.109311 18673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 991) took 3911 ms. Trace:
I20260709 12:22:21.110091 19722 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:21.092609 18522 rpcz_store.cc:276] 0709 12:22:19.583619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.584222 (+   603us) service_pool.cc:224] Handling call
0709 12:22:19.827401 (+243179us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b5800002798. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:19.841427 (+ 14026us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.980919 (+139492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.980959 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:19.981011 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:19.981045 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.050935 (+1069890us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54002c7c54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:21.059769 (+  8834us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.078002 (+ 18233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323411584}
I20260709 12:22:21.116748 19895 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:21.117388 19929 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:21.118724 19929 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:21.101016 18671 rpcz_store.cc:276] 0709 12:22:19.379778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.380073 (+   295us) service_pool.cc:224] Handling call
0709 12:22:21.097862 (+1717789us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793baf8c 00007efc793baef6 000000000036eb39 00007efc8142e1e0 00007efc814f70c4 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:21.098223 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.098708 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.098745 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:21.098805 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:21.098843 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.098922 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.099099 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74479360}
I20260709 12:22:21.121521 19929 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:21.122671 19774 consensus_queue.cc:260] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:21.109248 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 109421us
I20260709 12:22:21.103901 19945 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:21.125202 19806 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:21.132370 19774 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:21.133471 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:21.134397 18677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50938 (request call id 59) took 1752 ms (client timeout 1710 ms). Trace:
I20260709 12:22:21.127911 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.128479 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:21.134817 18677 rpcz_store.cc:269] 0709 12:22:19.381702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.540670 (+158968us) service_pool.cc:224] Handling call
0709 12:22:21.133112 (+1592442us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:22:21.134333 (+  1221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42330496}
I20260709 12:22:21.135527 18602 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 1.
I20260709 12:22:21.135495 18530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1073) took 1077 ms. Trace:
I20260709 12:22:21.137115 18530 rpcz_store.cc:276] 0709 12:22:20.058114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.127419 (+1069305us) service_pool.cc:224] Handling call
0709 12:22:21.135396 (+  7977us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:21.137713 19878 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:21.138259 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.138420 19878 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:21.138957 18530 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:21.140036 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.035388 18494 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:57374 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1073)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1067)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1071)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1090)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1091)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1100)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1083)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1076)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1092)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1104)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1093)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1101)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1084)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1099)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1089)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1109)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1096)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1095)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1097)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1087)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1098)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1066)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1103)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1088)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1105)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1102)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1080)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1106)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1108)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1107)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1086)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1085)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1078)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1110)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1094)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1058)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1059)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1064)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1069)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1072)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1074)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1075)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1077)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1079)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1081)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1082)
I20260709 12:22:21.037452 18597 rpcz_store.cc:276] 0709 12:22:17.823325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.827846 (+  4521us) service_pool.cc:224] Handling call
0709 12:22:19.382934 (+1555088us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b5800102f98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baeee 000000000036eb39 00007efc8142e1e0 00007efc814f70c4 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:19.383152 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.383422 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:19.794665 (+411243us) log.cc:844] Serialized 14 byte log entry
0709 12:22:20.260002 (+465337us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:20.277948 (+ 17946us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:20.301013 (+ 23065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.309647 (+  8634us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.309845 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":294,"prepare.queue_time_us":858417,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":23227,"raft.queue_time_us":13671,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"spinlock_wait_cycles":46714624,"thread_start_us":799542,"threads_started":2,"wal-append.queue_time_us":1260708}
I20260709 12:22:21.131325 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.134109 19906 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:21.126312 19931 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:21.141836 19878 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:21.144150 19722 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:21.146240 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.148666 18601 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 2.
I20260709 12:22:21.144796 19931 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.150911 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.151252 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:21.151930 18599 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:21.154983 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.155375 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.159942 18603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1121) took 1323 ms. Trace:
I20260709 12:22:21.160883 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:21.161248 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.161773 18680 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:22:21.160454 18603 rpcz_store.cc:276] 0709 12:22:19.836025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.836588 (+   563us) service_pool.cc:224] Handling call
0709 12:22:19.837010 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:19.968332 (+131322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.968375 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:19.968979 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 12:22:20.236109 (+267130us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:20.236172 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.159179 (+923007us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54002238d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:21.159261 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:21.159324 (+    63us) raft_consensus.cc:1685] finished
0709 12:22:21.159339 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.159651 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1388,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":134,"spinlock_wait_cycles":300783872,"thread_start_us":266622,"threads_started":1,"wal-append.queue_time_us":1078308}
I20260709 12:22:21.164110 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:21.165843 18521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1082) took 3337 ms. Trace:
I20260709 12:22:21.166366 18521 rpcz_store.cc:276] 0709 12:22:17.828579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.836456 (+  7877us) service_pool.cc:224] Handling call
0709 12:22:21.164473 (+3328017us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x7b5800002798. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:21.164820 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.165264 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.165303 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:21.165361 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:21.165401 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.165480 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.165645 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77534464}
I20260709 12:22:21.169731 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.171962 18530 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:21.173053 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.174520 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.109903 18673 rpcz_store.cc:276] 0709 12:22:17.197851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.202247 (+  4396us) service_pool.cc:224] Handling call
0709 12:22:19.263618 (+2061371us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bae9c 00007efc793baa5b 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:19.275367 (+ 11749us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:19.329839 (+ 54472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.331862 (+  2023us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:19.570939 (+239077us) log.cc:844] Serialized 26 byte log entry
0709 12:22:20.228637 (+657698us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:20.403490 (+174853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.419330 (+ 15840us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:21.108009 (+688679us) raft_consensus.cc:1685] finished
0709 12:22:21.108066 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.109106 (+  1040us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110969,"raft.queue_time_us":18780,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":39774,"spinlock_wait_cycles":303578880,"thread_start_us":458914,"threads_started":1,"wal-append.queue_time_us":1366940}
I20260709 12:22:21.101316 18525 rpcz_store.cc:276] 0709 12:22:19.897880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.898028 (+   148us) service_pool.cc:224] Handling call
0709 12:22:19.898303 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.898482 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:20.993292 (+1094810us) log.cc:844] Serialized 14 byte log entry
0709 12:22:21.089088 (+ 95796us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:21.089205 (+   117us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:21.089289 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.089404 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.089612 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1148310,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":2752,"raft.queue_time_us":129,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":291,"spinlock_wait_cycles":13568,"thread_start_us":1135717,"threads_started":2,"wal-append.queue_time_us":77343}
I20260709 12:22:21.178094 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.181469 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.182322 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.183317 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.183861 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.184445 18570 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:21.184654 18604 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 1.
I20260709 12:22:21.184753 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.185662 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:21.187176 19950 log.cc:927] Time spent T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 1.368s	user 0.014s	sys 0.046s
I20260709 12:22:21.182387 18602 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:22:21.171500 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.188287 18521 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:21.188740 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:21.189364 18524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1096) took 2592 ms. Trace:
I20260709 12:22:21.189497 18602 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:21.189860 18524 rpcz_store.cc:276] 0709 12:22:18.597102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.702761 (+105659us) service_pool.cc:224] Handling call
0709 12:22:18.703186 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:19.189945 (+486759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.189978 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:19.201555 (+ 11577us) log.cc:844] Serialized 26 byte log entry
0709 12:22:19.645391 (+443836us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:19.645429 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.646070 (+   641us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:21.186363 (+1540293us) spinlock_profiling.cc:243] Waited 7.22 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:22:21.188860 (+  2497us) raft_consensus.cc:1685] finished
0709 12:22:21.188883 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.189166 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":148986,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":186,"spinlock_wait_cycles":16610560,"thread_start_us":882258,"threads_started":2,"wal-append.queue_time_us":564197}
I20260709 12:22:21.189503 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.192660 19966 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:21.192842 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.193517 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.197557 19906 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:21.198060 18529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1102) took 1644 ms. Trace:
I20260709 12:22:21.198499 18529 rpcz_store.cc:276] 0709 12:22:19.583183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.591640 (+  8457us) service_pool.cc:224] Handling call
0709 12:22:19.591956 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.726766 (+134810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.726801 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:19.726853 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:19.726881 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.197517 (+1470636us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54003b4054. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:21.197583 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.197828 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309567744}
I20260709 12:22:21.201946 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:21.202121 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 1.51632e+06us
I20260709 12:22:21.182524 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.209830 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.187402 18604 raft_consensus.cc:1240] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:21.220264 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:21.174575 19643 consensus_meta.cc:287] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 1.209s	user 0.016s	sys 0.000s
I20260709 12:22:21.216439 19839 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:21.217307 19940 consensus_queue.cc:1048] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:21.221563 19643 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:21.222311 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.223181 18600 raft_consensus.cc:2393] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:21.223711 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.224459 19643 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:21.205518 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.226226 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.225380 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.228308 18597 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:21.228930 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.227253 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.218654 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.225075 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.230870 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.231510 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.231603 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.231904 18598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40948 (request call id 1122) took 1395 ms. Trace:
I20260709 12:22:21.233747 18598 rpcz_store.cc:276] 0709 12:22:19.836454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.843994 (+  7540us) service_pool.cc:224] Handling call
0709 12:22:21.230458 (+1386464us) spinlock_profiling.cc:243] Waited 6.38 ms on lock 0x7b5800102f98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:22:21.231805 (+  1347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14745728}
I20260709 12:22:21.234687 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:21.235359 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 128170us
I20260709 12:22:21.233124 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.237025 18603 raft_consensus.cc:2393] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:21.230607 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:21.237830 18605 raft_consensus.cc:2393] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:21.238222 18605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40948 (request call id 1127) took 1394 ms. Trace:
I20260709 12:22:21.232875 19797 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:21.238560 18605 rpcz_store.cc:276] 0709 12:22:19.844250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.846126 (+  1876us) service_pool.cc:224] Handling call
0709 12:22:21.232421 (+1386295us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b5800102f98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:22:21.238168 (+  5747us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56433408}
I20260709 12:22:21.240047 18599 raft_consensus.cc:2393] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 5: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
W20260709 12:22:21.240717 19210 leader_election.cc:336] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Timed out: RequestConsensusVote RPC to 127.16.240.130:37079 timed out after 1.505s (SENT)
W20260709 12:22:21.241506 19210 leader_election.cc:336] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Timed out: RequestConsensusVote RPC to 127.16.240.131:36757 timed out after 1.505s (SENT)
I20260709 12:22:21.241910 19210 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:21.242044 18644 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:21.243052 19906 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:21.243310 19210 leader_election.cc:336] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Timed out: RequestConsensusVote RPC to 127.16.240.130:37079 timed out after 1.530s (SENT)
I20260709 12:22:21.244741 19832 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:21.245196 19832 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:21.245592 19832 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:21.247323 18606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1119) took 1412 ms. Trace:
I20260709 12:22:21.248538 19911 raft_consensus.cc:2955] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:21.257019 18606 rpcz_store.cc:276] 0709 12:22:19.835085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.839867 (+  4782us) service_pool.cc:224] Handling call
0709 12:22:21.241579 (+1401712us) spinlock_profiling.cc:243] Waited 6.53 ms on lock 0x7b5800102f98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baeee 000000000036eb39 00007efc8142e1e0 00007efc814f70c4 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:21.246245 (+  4666us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b5800102f98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793baf8c 00007efc793baef6 000000000036eb39 00007efc8142e1e0 00007efc814f70c4 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:21.246431 (+   186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.246695 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.246732 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:21.246886 (+   154us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:21.246925 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.246997 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.247130 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22331392}
I20260709 12:22:21.231693 19931 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:21.256558 18570 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:21.260443 19797 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:21.282527 18646 leader_election.cc:336] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.506s (SENT)
I20260709 12:22:21.283110 18646 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:21.284080 19931 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:21.284211 19906 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:21.286521 19883 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:21.287015 18602 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:21.284924 19906 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:21.288116 19832 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:21.273165 19970 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:21.290177 19906 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:21.290272 19970 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:21.292909 19970 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:21.292953 19832 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:21.297885 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:21.299425 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:21.300174 18678 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:21.301865 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.302896 18523 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:21.303208 18644 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:21.304502 19970 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:21.271569 19210 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:21.273975 19643 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:21.276103 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:21.278146 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:21.304970 19970 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:21.311246 19970 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:21.311877 18646 leader_election.cc:336] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.614s (SENT)
I20260709 12:22:21.316354 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:21.320250 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.321774 18526 raft_consensus.cc:2410] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:21.324543 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.325923 18526 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:21.327348 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.308398 19643 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:21.328320 19643 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:21.329640 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:21.330617 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 121262us
I20260709 12:22:21.331590 18572 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:21.332255 18646 leader_election.cc:336] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.610s (SENT)
I20260709 12:22:21.332753 18646 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:21.334435 19797 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:21.336673 19883 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:21.339375 18572 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:21.340417 19839 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:21.339520 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1066) took 1403 ms. Trace:
I20260709 12:22:21.340847 19839 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:21.341306 19839 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:21.341532 19906 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:21.341005 18526 rpcz_store.cc:276] 0709 12:22:19.936366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.326935 (+1390569us) service_pool.cc:224] Handling call
0709 12:22:21.339464 (+ 12529us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:21.352018 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.353415 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.305552 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.364413 19839 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:21.367008 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:21.367422 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:21.354061 19643 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:21.369289 18526 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
W20260709 12:22:21.349998 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 106732us
I20260709 12:22:21.380208 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.383736 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:21.386246 18526 raft_consensus.cc:2410] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:21.387351 19643 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:21.387413 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.374617 18523 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:21.389278 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.390568 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.390604 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.384788 19242 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:22:21.394328 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.396185 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.396986 19839 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:21.397905 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.407069 18524 raft_consensus.cc:2410] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:21.407792 18526 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:21.408896 19911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:40796 (request call id 73) took 5445 ms. Trace:
I20260709 12:22:21.409582 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:21.410405 18524 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:21.175226 18530 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:21.414590 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:21.416501 18523 raft_consensus.cc:2410] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:21.409535 19911 rpcz_store.cc:276] 0709 12:22:15.963182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.963807 (+   625us) service_pool.cc:224] Handling call
0709 12:22:16.168843 (+205036us) spinlock_profiling.cc:243] Waited 8.27 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b91c0 00007efc814a59d9 00007efc814a5442 00007efc7aa21c54
0709 12:22:16.331699 (+162856us) log.cc:844] Serialized 508 byte log entry
0709 12:22:16.954164 (+622465us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b2c0001e0b8. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7add8a11 00007efc7ade7a0a 00007efc7ade7693 00007efc7ade7631 00007efc7c51bb52 00007efc7c51bcf5 00007efc7c458691 00007efc7c438eaa 00007efc7c43fd53 00007efc7c43fcd9 00007efc7c43fc69
0709 12:22:21.408754 (+4454590us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109917,"raft.queue_time_us":225266,"raft.run_cpu_time_us":11846,"raft.run_wall_time_us":342521,"spinlock_wait_cycles":25762432,"thread_start_us":175574,"threads_started":2,"wal-append.queue_time_us":109478,"wal-append.run_cpu_time_us":1638,"wal-append.run_wall_time_us":1003361}
I20260709 12:22:21.428149 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:22:21.549782 19981 log.cc:927] Time spent T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:22:21.565301 18524 raft_consensus.cc:2410] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:21.429926 19970 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:22.326720 18526 raft_consensus.cc:1275] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:22.345191 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1060) took 2413 ms. Trace:
I20260709 12:22:22.345630 18526 rpcz_store.cc:276] 0709 12:22:19.931338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.561965 (+1630627us) service_pool.cc:224] Handling call
0709 12:22:22.197971 (+636006us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:22.344123 (+146152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.344371 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:22.346472 18530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1058) took 2409 ms. Trace:
W20260709 12:22:22.368767 18527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1071) took 2312 ms (client timeout 2036 ms). Trace:
W20260709 12:22:22.369403 18527 rpcz_store.cc:269] 0709 12:22:20.056692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.368449 (+2311757us) service_pool.cc:211] Skipping call since client already timed out
0709 12:22:22.368662 (+   213us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:22:22.371260 18527 raft_consensus.cc:1275] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:22.408609 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1059) took 2423 ms. Trace:
I20260709 12:22:22.635632 18523 rpcz_store.cc:276] 0709 12:22:19.931093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.417419 (+1486326us) service_pool.cc:224] Handling call
0709 12:22:21.584927 (+167508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:22.160414 (+575487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:22.163914 (+  3500us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:22.244770 (+ 80856us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:22.327530 (+ 82760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.343846 (+ 16316us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.354941 (+ 11095us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:22.638082 18523 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:22.638854 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1072) took 2581 ms. Trace:
I20260709 12:22:22.660432 18526 raft_consensus.cc:1240] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:22.661836 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1064) took 2727 ms. Trace:
I20260709 12:22:22.662550 18526 rpcz_store.cc:276] 0709 12:22:19.934796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.491993 (+2557197us) service_pool.cc:224] Handling call
0709 12:22:22.660191 (+168198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:22.661224 (+  1033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.661678 (+   454us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:22.670945 18527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1069) took 2441 ms. Trace:
I20260709 12:22:22.671609 18527 rpcz_store.cc:276] 0709 12:22:20.056172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.370256 (+2314084us) service_pool.cc:224] Handling call
0709 12:22:22.370772 (+   516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:22.371674 (+   902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.497181 (+125507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:22.639246 18523 rpcz_store.cc:276] 0709 12:22:20.057581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.637059 (+2579478us) service_pool.cc:224] Handling call
0709 12:22:22.637603 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:22.638504 (+   901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.638759 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:22.699134 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1075) took 2513 ms. Trace:
I20260709 12:22:22.723788 18526 raft_consensus.cc:1275] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:22.724845 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1077) took 1892 ms. Trace:
I20260709 12:22:22.730676 18527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1074) took 2672 ms. Trace:
I20260709 12:22:22.731302 18527 rpcz_store.cc:276] 0709 12:22:20.058446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.673029 (+2614583us) service_pool.cc:224] Handling call
0709 12:22:22.674208 (+  1179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:22.674866 (+   658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:22.674981 (+   115us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:22.675888 (+   907us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:22.676943 (+  1055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.730382 (+ 53439us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.730567 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:22.733716 18527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1079) took 1899 ms. Trace:
I20260709 12:22:22.346946 18530 rpcz_store.cc:276] 0709 12:22:19.930873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.416627 (+1485754us) service_pool.cc:224] Handling call
0709 12:22:21.565741 (+149114us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:22.339585 (+773844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:22.339633 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:22.339704 (+    71us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:22.339787 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.339882 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.340077 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:22.767642 18530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1081) took 1928 ms. Trace:
I20260709 12:22:22.768216 18530 rpcz_store.cc:276] 0709 12:22:20.839278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.766450 (+1927172us) service_pool.cc:224] Handling call
0709 12:22:22.766909 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:22.767196 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:22.767234 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:22.767288 (+    54us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:22.767327 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.767406 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.767567 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:22.777352 18530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1082) took 1937 ms. Trace:
I20260709 12:22:22.741451 18524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1061) took 2809 ms. Trace:
I20260709 12:22:22.916836 18530 rpcz_store.cc:276] 0709 12:22:20.839739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.776134 (+1936395us) service_pool.cc:224] Handling call
0709 12:22:22.776616 (+   482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:22.776901 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:22.776937 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:22.777006 (+    69us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:22.777047 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.777128 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.777282 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:22.700003 18523 rpcz_store.cc:276] 0709 12:22:20.185991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.697722 (+2511731us) service_pool.cc:224] Handling call
0709 12:22:22.698286 (+   564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:22.698631 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:22.698674 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:22.698733 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:22.698820 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.698902 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.699058 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:22.725418 18526 rpcz_store.cc:276] 0709 12:22:20.833102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.722769 (+1889667us) service_pool.cc:224] Handling call
0709 12:22:22.723264 (+   495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:22.724475 (+  1211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.724747 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:22.773103 18494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:22.919819 18494 connection.cc:256] RPC call timeout handler was delayed by -1.962160409000262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260709 12:22:22.920290 18494 connection.cc:256] RPC call timeout handler was delayed by -1.962160409000262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260709 12:22:22.920647 18494 connection.cc:256] RPC call timeout handler was delayed by -1.882960409000134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
W20260709 12:22:22.920979 18494 connection.cc:256] RPC call timeout handler was delayed by -1.882960409000134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
W20260709 12:22:22.921291 18494 connection.cc:256] RPC call timeout handler was delayed by -1.8622604090001005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 12:22:22.921602 18494 connection.cc:256] RPC call timeout handler was delayed by -1.8622604090001005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 12:22:22.921909 18494 connection.cc:256] RPC call timeout handler was delayed by -1.8622604090001005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 12:22:22.922240 18494 connection.cc:256] RPC call timeout handler was delayed by -1.8622604090001005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 12:22:22.922573 18494 connection.cc:256] RPC call timeout handler was delayed by -1.5454604090002704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
I20260709 12:22:22.917002 18524 rpcz_store.cc:276] 0709 12:22:19.931586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.566071 (+1634485us) service_pool.cc:224] Handling call
0709 12:22:22.362876 (+796805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:22.741115 (+378239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:22.741141 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:22.741181 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:22.741205 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.741257 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.741386 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:22.757655 18527 rpcz_store.cc:276] 0709 12:22:20.834915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.732633 (+1897718us) service_pool.cc:224] Handling call
0709 12:22:22.733046 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:22.733289 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:22.733325 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:22.733382 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:22.733423 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.733504 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.733649 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:22.922887 18494 connection.cc:256] RPC call timeout handler was delayed by -1.5454604090002704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
W20260709 12:22:22.925104 18494 connection.cc:256] RPC call timeout handler was delayed by -1.5184604090002267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
W20260709 12:22:22.925514 18494 connection.cc:256] RPC call timeout handler was delayed by -1.5184604090002267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
I20260709 12:22:22.942273 18494 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:22:22.980942 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 1.59643e+06us
W20260709 12:22:22.986771 18528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1090) took 2144 ms (client timeout 1506 ms). Trace:
W20260709 12:22:22.987334 18528 rpcz_store.cc:269] 0709 12:22:20.842798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.986489 (+2143691us) service_pool.cc:211] Skipping call since client already timed out
0709 12:22:22.986657 (+   168us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:22:23.008368 19945 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.009173 19945 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:23.020699 19945 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:23.031927 19210 leader_election.cc:336] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Timed out: RequestConsensusVote RPC to 127.16.240.130:37079 timed out after 1.874s (SENT)
I20260709 12:22:23.035938 19210 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:23.027601 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:23.046752 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 63963.3us
I20260709 12:22:23.047586 18644 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:23.048468 18494 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:22:23.045825 18674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50938 (request call id 53) took 3716 ms (client timeout 2084 ms). Trace:
W20260709 12:22:23.050253 18674 rpcz_store.cc:269] 0709 12:22:19.330116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.376368 (+ 46252us) service_pool.cc:224] Handling call
0709 12:22:23.027209 (+3650841us) spinlock_profiling.cc:243] Waited 54.9 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:22:23.045723 (+ 18514us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126235904}
W20260709 12:22:23.051591 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 67595.6us
I20260709 12:22:23.058862 18644 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:23.066263 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:21.195143 18521 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:23.069259 19945 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:22:23.069342 18521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1089) took 2226 ms (client timeout 1789 ms). Trace:
I20260709 12:22:23.069790 19832 consensus_queue.cc:1059] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:23.069936 19945 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:23.069823 18521 rpcz_store.cc:269] 0709 12:22:20.842450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.193174 (+350724us) service_pool.cc:224] Handling call
0709 12:22:23.069269 (+1876095us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:23.073956 18530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 54) took 1996 ms. Trace:
W20260709 12:22:23.070644 18678 consensus_meta.cc:287] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 1.770s	user 0.024s	sys 0.013s
I20260709 12:22:23.071453 19832 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:23.078234 18678 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:23.080173 19832 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:23.082201 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:23.081175 18678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 1024) took 1785 ms (client timeout 1635 ms). Trace:
I20260709 12:22:23.082844 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.083313 19832 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:23.087110 19210 leader_election.cc:336] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Timed out: RequestConsensusVote RPC to 127.16.240.130:37079 timed out after 1.954s (SENT)
I20260709 12:22:23.090683 18494 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:23.093010 19210 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:23.084470 18678 rpcz_store.cc:269] 0709 12:22:21.295455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.299106 (+  3651us) service_pool.cc:224] Handling call
0709 12:22:23.080867 (+1781761us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:23.100822 19919 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:23.096061 19931 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:23.103107 19931 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:23.107084 19931 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:23.108520 19931 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:23.101593 19919 raft_consensus.cc:697] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:23.115483 19826 raft_consensus.cc:3055] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:23.149930 19826 raft_consensus.cc:740] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:23.151253 19826 consensus_queue.cc:260] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:23.101835 18530 rpcz_store.cc:276] 0709 12:22:21.077497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.918347 (+1840850us) service_pool.cc:224] Handling call
0709 12:22:23.070625 (+152278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:23.071651 (+  1026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:23.071695 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:23.071782 (+    87us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:23.071817 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:23.071899 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:23.073716 (+  1817us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b5400336650. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:23.073861 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351087616}
I20260709 12:22:23.157713 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.159300 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.121196 19919 consensus_queue.cc:237] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:23.122949 18671 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.815s	user 0.003s	sys 0.019s
I20260709 12:22:23.154318 19826 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.124416 19891 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:23.110817 19931 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:23.178234 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.181357 19891 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:23.130944 18522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1067) took 3194 ms (client timeout 2134 ms). Trace:
W20260709 12:22:23.184458 18522 rpcz_store.cc:269] 0709 12:22:19.936685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.130699 (+3194014us) service_pool.cc:211] Skipping call since client already timed out
0709 12:22:23.130867 (+   168us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:22:23.168159 18676 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
W20260709 12:22:23.193744 18671 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.886s	user 0.005s	sys 0.021s
I20260709 12:22:23.194041 19864 consensus_queue.cc:1048] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:23.194891 18671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1021) took 1911 ms. Trace:
I20260709 12:22:23.195278 18671 rpcz_store.cc:276] 0709 12:22:21.283631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.283812 (+   181us) service_pool.cc:224] Handling call
0709 12:22:21.284259 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:21.284845 (+   586us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.284889 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:21.307719 (+ 22830us) log.cc:844] Serialized 26 byte log entry
0709 12:22:23.194477 (+1886758us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:23.194532 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:23.194623 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:23.194675 (+    52us) raft_consensus.cc:1685] finished
0709 12:22:23.194694 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:23.194826 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1639,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":132,"thread_start_us":1886242,"threads_started":1,"wal-append.queue_time_us":144130,"wal-append.run_cpu_time_us":16899,"wal-append.run_wall_time_us":1182211}
I20260709 12:22:23.197487 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.198267 18671 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:23.199317 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.201617 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.203019 18680 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:23.207769 18602 raft_consensus.cc:1240] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:23.209035 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:23.201301 19864 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:22:23.330871 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:23.211150 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.223018 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:23.362879 18604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40948 (request call id 1145) took 2133 ms (client timeout 2080 ms). Trace:
I20260709 12:22:23.215606 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:22:23.225502 18600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40948 (request call id 1124) took 3387 ms (client timeout 1974 ms). Trace:
I20260709 12:22:23.144937 19855 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:23.212221 19891 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:23.234916 18603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1132) took 2023 ms. Trace:
I20260709 12:22:21.203449 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:23.325945 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:23.326413 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:23.394610 18603 rpcz_store.cc:276] 0709 12:22:21.211778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.237693 (+ 25915us) service_pool.cc:224] Handling call
0709 12:22:23.229518 (+1991825us) spinlock_profiling.cc:243] Waited 7.19 ms on lock 0x7b5800102f98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793baf8c 00007efc793baef6 000000000036eb39 00007efc8142e1e0 00007efc814f70c4 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:23.229772 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:23.233408 (+  3636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:23.233444 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:23.233516 (+    72us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:23.233551 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:23.233614 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:23.233770 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16554112}
I20260709 12:22:23.226316 18570 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:23.265726 18677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1022) took 1971 ms. Trace:
I20260709 12:22:23.267133 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:22:23.270378 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 1.93095e+06us
I20260709 12:22:23.341789 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:23.205340 19928 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.242012 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:22:23.363502 18604 rpcz_store.cc:269] 0709 12:22:21.229787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.229964 (+   177us) service_pool.cc:224] Handling call
0709 12:22:23.222850 (+1992886us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b5800102f98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:22:23.362794 (+139944us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6465408}
W20260709 12:22:23.373456 18644 connection.cc:256] RPC call timeout handler was delayed by -1.7838676029998624s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
I20260709 12:22:23.304147 19722 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:23.312048 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:23.401543 18644 connection.cc:256] RPC call timeout handler was delayed by -1.7838676029998624s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
I20260709 12:22:23.299237 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:23.328610 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:23.291936 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.321970 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:23.404350 18529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1095) took 2534 ms (client timeout 1929 ms). Trace:
I20260709 12:22:23.405256 18527 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:23.246655 18551 debug-util.cc:398] Leaking SignalData structure 0x7b08000ec000 after lost signal to thread 17346
I20260709 12:22:23.237982 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:23.432492 19248 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:22:23.263341 19970 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:23.396960 18677 rpcz_store.cc:276] 0709 12:22:21.294704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.295609 (+   905us) service_pool.cc:224] Handling call
0709 12:22:21.296039 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:21.296448 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.296477 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:21.297022 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:22:21.374225 (+ 77203us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:21.374286 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.374399 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:23.265455 (+1891056us) raft_consensus.cc:1685] finished
0709 12:22:23.265490 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:23.265656 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7738,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"thread_start_us":76812,"threads_started":1,"wal-append.queue_time_us":107787,"wal-append.run_cpu_time_us":3437,"wal-append.run_wall_time_us":1836825}
I20260709 12:22:23.413476 18528 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:23.305492 18599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40948 (request call id 1133) took 2093 ms. Trace:
I20260709 12:22:23.446077 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.446135 18599 rpcz_store.cc:276] 0709 12:22:21.212101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.226889 (+ 14788us) service_pool.cc:224] Handling call
0709 12:22:23.305219 (+2078330us) spinlock_profiling.cc:243] Waited 9.29 ms on lock 0x7b54002b8ed4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:23.305415 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21377792}
I20260709 12:22:23.447198 18673 raft_consensus.cc:2393] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 3: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
W20260709 12:22:23.437543 18551 debug-util.cc:398] Leaking SignalData structure 0x7b08001ebe00 after lost signal to thread 17349
I20260709 12:22:23.450099 19832 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:23.452095 18551 debug-util.cc:398] Leaking SignalData structure 0x7b08001d26c0 after lost signal to thread 18461
I20260709 12:22:23.444584 18530 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.456408 18679 raft_consensus.cc:1240] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:23.423503 18672 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:23.457755 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.458700 18675 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:23.408912 19928 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:23.418540 18605 raft_consensus.cc:1240] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:23.245635 19929 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:23.460271 19929 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:23.460562 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.460668 19929 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.461098 19928 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:23.442566 18522 raft_consensus.cc:2468] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:22:23.415839 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:23.464783 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.465569 18676 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:22:23.463376 18572 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:23.409847 18644 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.240.132:45879 timed out after 1.789s (SENT) [suppressed 44 similar messages]
I20260709 12:22:23.394093 19855 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:23.469156 19855 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:23.469283 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 59781.8us
I20260709 12:22:23.423089 19722 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:23.385155 18600 rpcz_store.cc:269] 0709 12:22:19.838423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.843279 (+  4856us) service_pool.cc:224] Handling call
0709 12:22:23.225191 (+3381912us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400310454. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:23.225396 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2891837824}
I20260709 12:22:23.424638 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:23.424844 19986 raft_consensus.cc:2804] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:23.426301 18529 rpcz_store.cc:269] 0709 12:22:20.860242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.203150 (+342908us) service_pool.cc:224] Handling call
0709 12:22:23.395013 (+2191863us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:23.415205 18525 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 1.
I20260709 12:22:23.243248 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:23.427428 19246 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:22:23.443869 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:23.444067 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:23.444563 19241 raft_consensus.cc:2410] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:22:23.459220 18675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 1026) took 2153 ms (client timeout 1932 ms). Trace:
W20260709 12:22:23.535166 18675 rpcz_store.cc:269] 0709 12:22:21.305326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.305480 (+   154us) service_pool.cc:224] Handling call
0709 12:22:23.457581 (+2152101us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:22:23.459144 (+  1563us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5941632}
I20260709 12:22:23.536819 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.538483 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.539290 18675 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:22:23.470469 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.540083 19242 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
W20260709 12:22:23.540122 18551 debug-util.cc:398] Leaking SignalData structure 0x7b0800394e20 after lost signal to thread 18554
I20260709 12:22:23.419426 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.482460 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.250576 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:23.486357 18524 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 1.
I20260709 12:22:23.486850 19986 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:23.416608 18671 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:23.504092 19689 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:23.270112 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:23.515947 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:23.470115 18644 connection.cc:256] RPC call timeout handler was delayed by -1.7298676030000024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
W20260709 12:22:23.541345 18551 debug-util.cc:398] Leaking SignalData structure 0x7b0800394de0 after lost signal to thread 18555
I20260709 12:22:23.556643 18572 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:23.483086 19243 raft_consensus.cc:1813] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Handling vote request from an unknown peer 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:23.467351 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:23.560220 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 334423us
I20260709 12:22:23.563449 18601 raft_consensus.cc:1240] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
W20260709 12:22:23.564659 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 475061us
I20260709 12:22:23.564680 18527 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4.
I20260709 12:22:23.575532 18528 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:22:23.581321 18605 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:22:23.582326 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.586440 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:23.591097 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 370710us
I20260709 12:22:23.596323 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.562898 19986 raft_consensus.cc:3060] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.590243 19240 raft_consensus.cc:2393] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 4: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:22:23.584172 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.582141 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.585081 19945 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:23.574117 19689 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:23.602751 18530 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 2.
I20260709 12:22:23.535482 19248 raft_consensus.cc:2955] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:23.627357 19689 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.593811 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:23.628213 18601 raft_consensus.cc:2393] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 2: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:23.580531 19931 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:23.629628 19931 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:23.631246 19757 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:23.633802 18646 connection.cc:256] RPC call timeout handler was delayed by -1.8254316869999911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
W20260709 12:22:23.634608 18646 connection.cc:256] RPC call timeout handler was delayed by -1.8124453400000675s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
W20260709 12:22:23.634949 18646 connection.cc:256] RPC call timeout handler was delayed by -1.7551247779999812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
W20260709 12:22:23.635233 18646 connection.cc:256] RPC call timeout handler was delayed by -1.724211288999868s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 12:22:23.635862 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:23.636368 18646 connection.cc:256] RPC call timeout handler was delayed by -1.7072648189998745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
I20260709 12:22:23.636615 18494 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
W20260709 12:22:23.636935 18646 connection.cc:256] RPC call timeout handler was delayed by -1.6839505019997887s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2577s for a response
W20260709 12:22:23.637356 18646 connection.cc:256] RPC call timeout handler was delayed by -1.6666417669998737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
W20260709 12:22:23.621807 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 65296us
I20260709 12:22:23.604501 18677 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:23.583580 19244 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
W20260709 12:22:23.637903 18646 connection.cc:256] RPC call timeout handler was delayed by -1.6598316869999508s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
I20260709 12:22:23.604873 19247 raft_consensus.cc:2393] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 2: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
W20260709 12:22:23.637421 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 46058.2us
I20260709 12:22:23.638983 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:23.641671 18601 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.637898 19243 raft_consensus.cc:2410] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 12:22:23.639957 18646 connection.cc:256] RPC call timeout handler was delayed by -1.5745710099999997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
I20260709 12:22:23.598848 19212 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
W20260709 12:22:23.638211 18551 debug-util.cc:398] Leaking SignalData structure 0x7b08001be9c0 after lost signal to thread 18630
I20260709 12:22:23.646900 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.622628 19928 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:23.621018 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.648625 18494 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:23.637774 19832 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:23.643949 18646 connection.cc:256] RPC call timeout handler was delayed by -1.4489957159998994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2036s for a response
I20260709 12:22:23.639400 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.670974 18599 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:23.672084 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.673440 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.673575 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:23.674226 18599 raft_consensus.cc:2393] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:23.674297 19243 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:23.675261 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.675683 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:23.676126 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:23.676535 19247 raft_consensus.cc:1240] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:23.677342 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:23.678045 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.678125 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:23.678860 19243 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:23.676339 19245 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.679270 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.679291 19242 raft_consensus.cc:1240] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:23.649572 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.683064 18678 raft_consensus.cc:1813] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Handling vote request from an unknown peer 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:23.670023 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 30ca83d13be54a41b9c5aaebfc89de05 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:23.670234 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.676435 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.662184 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.681361 19994 raft_consensus.cc:2764] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 12:22:23.667527 18646 connection.cc:256] RPC call timeout handler was delayed by -1.4063054329999432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
W20260709 12:22:23.685123 18646 connection.cc:256] RPC call timeout handler was delayed by -1.3718316869999398s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
W20260709 12:22:23.685702 18646 connection.cc:256] RPC call timeout handler was delayed by -1.3151316870000755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
W20260709 12:22:23.686286 18646 connection.cc:256] RPC call timeout handler was delayed by -1.3007316870000523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
W20260709 12:22:23.686669 18646 connection.cc:256] RPC call timeout handler was delayed by -1.2683316869999999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
I20260709 12:22:23.682408 18494 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:23.690968 19245 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:23.692217 18680 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:22:23.684478 18677 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
W20260709 12:22:23.642040 18674 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.027s	sys 0.046s
I20260709 12:22:23.685523 18572 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:23.649471 19987 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:23.646373 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.700564 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:23.649696 18551 debug-util.cc:398] Leaking SignalData structure 0x7b0800364500 after lost signal to thread 18631
W20260709 12:22:23.705255 18646 leader_election.cc:336] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.512s (SENT)
I20260709 12:22:23.709358 19988 raft_consensus.cc:2804] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:23.709838 19757 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:23.709990 18677 raft_consensus.cc:2393] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 4: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:23.683838 19906 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:23.651073 19928 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:23.712430 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:23.696439 18674 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.027s	sys 0.048s
W20260709 12:22:23.660669 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 70022.8us
I20260709 12:22:23.716372 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.717303 18604 raft_consensus.cc:2393] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 5: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:23.646325 18673 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:22:23.718469 18494 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:23.693096 19832 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:23.724979 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:23.730208 18570 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:23.702459 19931 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:23.730224 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.730355 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.708467 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.733981 19832 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:23.735821 18676 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:23.737622 19832 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:23.740067 18646 leader_election.cc:336] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.567s (SENT)
W20260709 12:22:23.732671 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 71728.7us
I20260709 12:22:23.740509 18646 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:23.741142 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.728686 18678 raft_consensus.cc:2410] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:22:23.713002 19906 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:23.750252 18572 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:23.716650 19928 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:23.747995 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 50021.4us
I20260709 12:22:23.702972 19987 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:23.752996 18494 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:23.753300 18602 raft_consensus.cc:1240] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:23.712844 19988 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:23.757747 18676 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:23.760422 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:23.766259 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.750473 19757 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:23.752425 19906 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.734391 18675 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
W20260709 12:22:23.772025 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 46863.6us
W20260709 12:22:23.762960 18551 debug-util.cc:398] Leaking SignalData structure 0x7b080028b8c0 after lost signal to thread 18705
I20260709 12:22:23.758467 19832 raft_consensus.cc:2749] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:23.759413 19988 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.758692 19722 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:23.775167 18572 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:23.759604 19987 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.763638 19945 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:23.767970 19994 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:23.776821 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:23.788574 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:23.789041 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:23.774667 18551 debug-util.cc:398] Leaking SignalData structure 0x7b0800344960 after lost signal to thread 18706
I20260709 12:22:23.769768 19774 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:23.790549 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 50528.6us
I20260709 12:22:23.755892 19929 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:23.792850 18680 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:22:23.792855 18528 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 1.
I20260709 12:22:23.798588 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:23.789276 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:23.799232 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.802073 18602 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:23.803107 18679 raft_consensus.cc:2393] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 2: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:23.803198 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:23.804440 19873 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:23.777948 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.804912 18572 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:23.763317 19986 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:23.771848 19919 consensus_queue.cc:1059] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:22:23.804023 18527 raft_consensus.cc:2376] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 2. Re-sending same reply.
I20260709 12:22:23.780691 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.796969 19994 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:23.791491 19945 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:23.820539 18677 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.820670 19945 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.799154 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.824491 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.799695 19774 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:22:23.827435 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 50696us
W20260709 12:22:23.827545 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 149982us
I20260709 12:22:23.829487 18530 raft_consensus.cc:2393] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 2: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:23.804894 19873 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:23.826829 19757 raft_consensus.cc:2804] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:23.838079 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.829366 19774 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.824739 19994 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:23.834908 18551 debug-util.cc:398] Leaking SignalData structure 0x7b0800308700 after lost signal to thread 19274
W20260709 12:22:23.846946 18646 leader_election.cc:336] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.751s (SENT)
I20260709 12:22:23.832418 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.835620 19873 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.850514 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:23.820065 19785 consensus_queue.cc:1059] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:22:23.856735 18677 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:23.833459 18599 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 1.
I20260709 12:22:23.852747 18676 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.846127 18426 catalog_manager.cc:5697] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 1 to 3, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 3 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:23.915019 18644 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:23.914801 18426 catalog_manager.cc:5697] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index 3 to 4, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New cstate: current_term: 1 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:23.915851 19681 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:23.916254 19681 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:23.916812 19681 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.917538 18426 catalog_manager.cc:5697] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:22:23.861883 19689 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:23.840663 19757 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:23.920069 19757 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.920300 18600 raft_consensus.cc:1240] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
W20260709 12:22:23.848224 18551 debug-util.cc:398] Leaking SignalData structure 0x7b080028d120 after lost signal to thread 19275
W20260709 12:22:23.922837 18551 debug-util.cc:398] Leaking SignalData structure 0x7b0800336ea0 after lost signal to thread 19921
W20260709 12:22:23.923251 18551 debug-util.cc:398] Leaking SignalData structure 0x7b0800302800 after lost signal to thread 19941
W20260709 12:22:23.923595 18551 debug-util.cc:398] Leaking SignalData structure 0x7b0800361840 after lost signal to thread 19958
W20260709 12:22:23.923914 18551 debug-util.cc:398] Leaking SignalData structure 0x7b0800361980 after lost signal to thread 19962
W20260709 12:22:23.924203 18551 debug-util.cc:398] Leaking SignalData structure 0x7b0800361a20 after lost signal to thread 19971
W20260709 12:22:23.924434 18551 debug-util.cc:398] Leaking SignalData structure 0x7b0800361ee0 after lost signal to thread 19973
W20260709 12:22:23.924664 18551 debug-util.cc:398] Leaking SignalData structure 0x7b0800361a80 after lost signal to thread 19975
W20260709 12:22:23.924876 18551 debug-util.cc:398] Leaking SignalData structure 0x7b0800361b00 after lost signal to thread 19976
W20260709 12:22:23.925132 18551 debug-util.cc:398] Leaking SignalData structure 0x7b0800361b40 after lost signal to thread 19977
W20260709 12:22:23.925352 18551 debug-util.cc:398] Leaking SignalData structure 0x7b0800361c60 after lost signal to thread 19978
I20260709 12:22:23.925282 19681 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:23.856047 19985 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:23.927995 19985 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:23.928108 19681 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:23.881583 18572 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:23.928529 19985 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:23.929140 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 47703.8us
I20260709 12:22:23.930263 19773 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:23.930649 19773 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:23.931016 19773 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:23.931311 18572 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:23.892282 19855 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:23.894937 18679 raft_consensus.cc:1240] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:23.935004 19689 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:23.935956 19855 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:23.935098 19679 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:23.936995 19679 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.937345 19679 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:23.940762 19773 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:23.943162 18676 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:23.896231 18427 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47714 (request call id 190) took 10335 ms. Trace:
I20260709 12:22:23.919730 18426 catalog_manager.cc:5697] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 1 to 2, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 2 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:22:23.899340 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:23.899981 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 50192.9us
I20260709 12:22:23.945050 18527 raft_consensus.cc:2468] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:22:23.900717 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:23.945245 18426 catalog_manager.cc:5697] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 1 to 3, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 3 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:23.946043 18528 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 1.
I20260709 12:22:23.901504 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:23.946853 18524 raft_consensus.cc:2376] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4. Re-sending same reply.
I20260709 12:22:23.902531 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:23.947151 18570 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:23.903692 19945 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:23.906137 19212 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:23.948853 19773 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:23.906997 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:23.949645 18530 raft_consensus.cc:2376] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3. Re-sending same reply.
I20260709 12:22:23.866619 18671 raft_consensus.cc:1240] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:23.873189 19832 raft_consensus.cc:3055] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:23.863732 19988 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:23.874228 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.881090 19774 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:23.870662 18646 leader_election.cc:336] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.929s (SENT)
I20260709 12:22:23.872190 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.962473 18646 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:23.872526 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.873482 18494 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:23.875087 19986 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:23.867456 19929 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:23.873852 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:23.874814 19906 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:23.913393 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 76722.2us
I20260709 12:22:23.927806 19757 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:23.863698 18601 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:23.933307 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:23.933636 19991 consensus_queue.cc:1048] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:23.883302 19785 raft_consensus.cc:3055] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:22:23.957980 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 51928.3us
I20260709 12:22:23.979358 19991 consensus_queue.cc:1243] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer 2f9872512f1646bc835906bd0e98c6a7 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:22:23.907569 19928 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:23.954424 19826 consensus_queue.cc:1059] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:23.971020 19919 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:23.977010 19773 raft_consensus.cc:2804] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:23.944305 18427 rpcz_store.cc:276] 0709 12:22:13.560695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.563158 (+  2463us) service_pool.cc:224] Handling call
0709 12:22:14.583508 (+1020350us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54002175d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c449090 00007efc7c4e7f3a 00007efc8229de9c 00007efc8239c04e 00007efc8085d2a4 00007efc8085d232 00007efc8085d161 00007efc8085d0dc 00007efc8085c392 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:23.896003 (+9312495us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:16.418146 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:16.448663 (+ 30517us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:16.448721 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:22:16.448754 (+    33us) tablet.cc:662] Decoding operations
0709 12:22:16.810139 (+361385us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:16.817057 (+  6918us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:16.824481 (+  7424us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:22:16.992174 (+167693us) tablet.cc:701] Row locks acquired
0709 12:22:16.993445 (+  1271us) write_op.cc:260] PREPARE: finished
0709 12:22:17.007820 (+ 14375us) write_op.cc:270] Start()
0709 12:22:17.009470 (+  1650us) write_op.cc:276] Timestamp: P: 1783599737004535 usec, L: 0
0709 12:22:17.010065 (+   595us) op_driver.cc:348] REPLICATION: starting
0709 12:22:17.037523 (+ 27458us) log.cc:844] Serialized 2885 byte log entry
0709 12:22:18.881593 (+1844070us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b18001eb440. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793f23f3 00007efc793f47c1 00007efc793f4779 00007efc793f4709 00007efc793f46d1 00007efc793f39cd 0000000000388634 0000000000388479 00007efc793d583a
0709 12:22:19.896406 (+1014813us) op_driver.cc:464] REPLICATION: finished
0709 12:22:21.305554 (+1409148us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b18001eb440. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793f23f3 00007efc793f47c1 00007efc793f4779 00007efc793f4709 00007efc793f46d1 00007efc793f39cd 0000000000388634 0000000000388479 00007efc793d583a
0709 12:22:21.312243 (+  6689us) write_op.cc:301] APPLY: starting
0709 12:22:21.312598 (+   355us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:21.313064 (+   466us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:21.313143 (+    79us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:21.320303 (+  7160us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:21.320720 (+   417us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:22:21.320816 (+    96us) write_op.cc:312] APPLY: finished
0709 12:22:21.321428 (+   612us) log.cc:844] Serialized 58 byte log entry
0709 12:22:21.379892 (+ 58464us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:21.391686 (+ 11794us) write_op.cc:454] Released schema lock
0709 12:22:21.391789 (+   103us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:21.392370 (+   581us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:21.392406 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":880223,"reported_tablets":11,"spinlock_wait_cycles":301042048,"child_traces":[["op",{"apply.queue_time_us":1110262,"apply.run_cpu_time_us":8563,"apply.run_wall_time_us":86516,"num_ops":7,"prepare.queue_time_us":262889,"prepare.run_cpu_time_us":229519,"prepare.run_wall_time_us":1435059,"raft.queue_time_us":996400,"raft.run_cpu_time_us":29079,"raft.run_wall_time_us":1131003,"replication_time_us":2884624,"spinlock_wait_cycles":18642688,"thread_start_us":3214833,"threads_started":5,"wal-append.queue_time_us":932626,"wal-append.run_cpu_time_us":57999,"wal-append.run_wall_time_us":3478233}]]}
I20260709 12:22:23.979730 19212 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:23.993487 19757 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:23.994508 19212 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:23.955400 19945 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:23.979367 18600 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.997098 19931 raft_consensus.cc:2804] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:23.997555 19931 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:23.959542 19832 raft_consensus.cc:740] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:23.981536 19928 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:23.998090 19931 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.982218 19826 raft_consensus.cc:3055] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:23.999249 19826 raft_consensus.cc:740] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:23.998833 19832 consensus_queue.cc:260] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:23.895560 19987 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:24.000244 19832 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.000159 19826 consensus_queue.cc:260] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:24.001463 19826 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.001600 19987 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:22:23.971336 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 100698us
I20260709 12:22:23.977144 18525 raft_consensus.cc:2393] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 2: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
W20260709 12:22:24.002703 18646 leader_election.cc:336] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.940s (SENT)
I20260709 12:22:24.003094 18646 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:23.946931 18426 catalog_manager.cc:5697] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:23.978721 19785 raft_consensus.cc:740] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:23.913084 19873 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:24.004494 19785 consensus_queue.cc:260] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:24.005612 18600 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:24.005786 19785 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:23.898977 19994 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:24.008190 18646 leader_election.cc:336] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.974s (SENT)
I20260709 12:22:24.008641 18646 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:24.009246 19994 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:23.956153 20008 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:24.009176 19988 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:22:23.984333 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 134932us
I20260709 12:22:24.009550 19919 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:23.995486 19722 raft_consensus.cc:2804] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:23.955075 19985 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:23.992128 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:23.989833 18644 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:23.997458 19212 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:24.049898 19894 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:24.049898 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 60129.2us
I20260709 12:22:24.050616 19894 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:24.051072 19894 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.986873 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:24.010093 20008 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:24.051941 18677 raft_consensus.cc:2393] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 2: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:24.052083 20008 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.051275 19878 consensus_queue.cc:1059] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:22:23.984510 19855 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:23.980955 19774 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:23.986634 18598 raft_consensus.cc:2393] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 3: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:23.986641 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:24.005793 19873 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:23.983824 19906 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:24.011512 19210 connection.cc:256] RPC call timeout handler was delayed by -2.6943028230000436s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2263s for a response
W20260709 12:22:24.022912 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 82519.5us
W20260709 12:22:24.055680 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 92518.4us
I20260709 12:22:23.983676 19773 raft_consensus.cc:697] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:24.059703 18570 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:24.022616 19681 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:24.067185 19210 leader_election.cc:336] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Timed out: RequestConsensusVote RPC to 127.16.240.130:37079 timed out after 1.561s (SENT)
I20260709 12:22:24.067804 19210 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:24.065521 18646 leader_election.cc:336] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.996s (SENT)
I20260709 12:22:24.069294 18646 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:24.021838 19994 consensus_queue.cc:1048] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:22:23.982502 19679 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:24.066591 19855 raft_consensus.cc:697] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:24.073786 19985 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:24.073573 19773 consensus_queue.cc:237] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:24.075414 19643 raft_consensus.cc:2804] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:24.075517 18570 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:24.077527 18494 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:24.078228 19929 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:24.056634 19945 consensus_queue.cc:1059] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
W20260709 12:22:24.080536 18646 leader_election.cc:336] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.036s (SENT)
I20260709 12:22:24.094153 18646 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:24.081362 19878 raft_consensus.cc:3055] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:24.082203 19992 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:24.082664 19906 raft_consensus.cc:2804] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:24.087272 19894 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:24.109822 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 46632us
I20260709 12:22:24.089846 19643 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:24.112675 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 61082.8us
I20260709 12:22:24.113770 18644 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:24.116798 19855 consensus_queue.cc:237] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:24.117290 19894 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:24.113508 19643 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:24.123883 20017 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:24.096822 19878 raft_consensus.cc:740] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:24.096235 19906 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:22:24.124346 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.125797 18494 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:24.129128 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 48646.2us
W20260709 12:22:24.095495 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 98113.6us
I20260709 12:22:24.134927 19931 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:24.135885 19212 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:24.135953 20008 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:24.111909 19985 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:24.133747 19878 consensus_queue.cc:260] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:24.134341 19681 consensus_queue.cc:1059] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:22:24.131278 18644 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:24.139052 18570 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:24.141242 18525 raft_consensus.cc:1240] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:24.141746 20008 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:24.141816 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:24.142541 18527 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:24.142685 19878 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:24.143134 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:24.143456 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:24.143764 18521 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:24.145013 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:24.128114 19832 raft_consensus.cc:2804] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:24.145187 19643 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:24.145673 19832 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:24.146066 19832 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.146242 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:24.138738 19985 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:24.148288 19985 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:24.147557 19643 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:24.125370 19826 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:24.155717 19679 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:24.155943 19929 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:24.151764 18570 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:24.153220 19873 raft_consensus.cc:2804] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:24.153748 19987 raft_consensus.cc:3055] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:22:24.159680 18646 leader_election.cc:336] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.071s (SENT)
I20260709 12:22:24.160200 18646 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:24.155004 18494 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:24.157473 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:24.137465 19906 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.153816 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:24.162292 19210 connection.cc:256] RPC call timeout handler was delayed by -1.0870850820001579s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1844s for a response
I20260709 12:22:24.163599 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:24.164431 18525 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:24.173939 20024 raft_consensus.cc:2804] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:24.175290 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:22:24.178037 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 50211.5us
I20260709 12:22:24.179936 19210 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:24.178257 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:24.181116 18528 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:24.160005 19987 raft_consensus.cc:740] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:24.196363 18525 raft_consensus.cc:1240] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:24.182600 19774 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:24.204202 19931 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:24.204444 19774 raft_consensus.cc:697] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:24.204809 18598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "8c29c312e4544452b1162d7f81a58cb4"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:22:24.205274 18603 raft_consensus.cc:1240] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:24.205618 18598 raft_consensus.cc:606] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Received request to transfer leadership to TS 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:24.205513 19774 consensus_queue.cc:237] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:24.191687 19992 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:24.179597 19873 raft_consensus.cc:697] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:22:24.182199 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 46396.1us
I20260709 12:22:24.192054 20019 consensus_queue.cc:1059] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:22:24.183027 19785 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:24.212879 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:24.164353 19722 raft_consensus.cc:697] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 2 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:24.213135 18494 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:24.175165 19994 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:24.208475 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.203799 18527 raft_consensus.cc:1240] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:24.210641 20023 raft_consensus.cc:3055] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:24.211300 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:24.211824 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:24.212030 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:24.224463 18524 raft_consensus.cc:1240] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:24.211130 19873 consensus_queue.cc:237] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:24.211375 19987 consensus_queue.cc:260] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:24.163106 20017 raft_consensus.cc:697] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:24.232023 18644 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:24.216416 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:24.217160 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:24.196467 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:24.218899 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:24.229116 19929 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:24.233634 19929 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:24.234019 19929 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.234067 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:24.225466 18604 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 1.
W20260709 12:22:24.226567 18646 leader_election.cc:336] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.134s (SENT)
I20260709 12:22:24.235271 18646 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:24.208029 20008 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:24.228237 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:24.236927 18646 leader_election.cc:336] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.150s (SENT)
I20260709 12:22:24.211242 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:24.229031 19928 raft_consensus.cc:3055] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:24.216441 20023 raft_consensus.cc:740] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:24.229627 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:24.237368 18646 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:24.238564 18527 raft_consensus.cc:1240] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:24.254750 18644 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:24.209005 20024 raft_consensus.cc:697] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 4 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:24.216380 19994 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:24.259637 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:24.262274 18677 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:24.263862 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:24.264459 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:24.264492 18524 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:24.265147 18494 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:24.237262 19970 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:24.254067 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:24.256681 18600 raft_consensus.cc:1240] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:24.275995 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:24.276417 19987 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:24.277386 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:24.278003 18672 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:24.280257 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:24.259609 19894 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:24.281639 19894 raft_consensus.cc:697] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:24.282581 19894 consensus_queue.cc:237] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:24.284461 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:24.284603 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:24.285528 18676 raft_consensus.cc:2393] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 4: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:24.256732 19928 raft_consensus.cc:740] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:24.264602 20022 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:24.296582 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:24.266294 19994 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:24.316903 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 80026us
I20260709 12:22:24.237689 19212 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:24.254341 19945 consensus_queue.cc:1059] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:22:24.273226 19988 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:24.330806 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:24.284174 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:24.299006 19681 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:24.332412 20022 raft_consensus.cc:697] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:22:24.333324 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 67179.6us
I20260709 12:22:24.348999 18570 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:24.338660 18527 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:24.351397 18646 leader_election.cc:336] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.186s (SENT)
I20260709 12:22:24.354235 18646 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:24.334959 19988 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:24.358024 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 140613us
I20260709 12:22:24.358376 18528 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:24.337296 19785 raft_consensus.cc:697] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:24.363373 18494 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:24.363941 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:24.332021 20021 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:24.366940 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:22:24.344534 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 112329us
I20260709 12:22:24.333164 19919 consensus_queue.cc:1059] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:22:24.354323 19774 raft_consensus.cc:2804] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:24.421312 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:24.423671 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:24.424297 18677 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:24.426014 18528 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.362425 19988 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:24.345186 20028 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:24.361289 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
W20260709 12:22:24.431557 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 67669.6us
I20260709 12:22:24.444260 19210 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:24.425148 18530 pending_rounds.cc:85] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 4
I20260709 12:22:24.416918 19945 raft_consensus.cc:2764] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 12:22:24.452610 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 114454us
I20260709 12:22:24.422950 19681 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:24.421825 19774 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:24.445997 18530 pending_rounds.cc:107] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:22:24.459635 18530 raft_consensus.cc:2889] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:24.428742 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:24.343535 19722 consensus_queue.cc:237] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:24.463845 19210 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:24.347388 20023 consensus_queue.cc:260] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:24.446784 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:24.442763 20008 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:24.491533 18598 raft_consensus.cc:1240] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:24.492792 19832 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:24.453220 19931 raft_consensus.cc:2764] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:22:24.461730 19774 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:24.495877 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:24.504346 20029 log.cc:927] Time spent T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
W20260709 12:22:24.505256 20036 log.cc:927] Time spent T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:22:24.489503 20022 consensus_queue.cc:237] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:24.508739 18646 leader_election.cc:336] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.816s (SENT)
I20260709 12:22:24.509055 20021 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:24.509698 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 45922.7us
I20260709 12:22:24.541265 18646 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:24.426250 19985 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:24.514721 18677 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:24.367112 19928 consensus_queue.cc:260] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:24.462352 20028 raft_consensus.cc:697] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:24.364553 20024 consensus_queue.cc:237] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:24.561023 19832 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:24.562599 20023 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.549307 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:24.567212 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:24.568734 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:24.570153 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:24.576356 19832 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:24.533402 18527 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:24.362552 20017 consensus_queue.cc:237] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:24.541831 19210 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:24.512903 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:24.545723 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:24.525564 18600 raft_consensus.cc:1240] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:24.557988 18680 raft_consensus.cc:1240] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:24.631031 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:24.558759 19242 raft_consensus.cc:1240] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:24.558979 20035 consensus_queue.cc:1059] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
W20260709 12:22:24.576831 20030 log.cc:927] Time spent T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:22:24.522202 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:24.545272 19785 consensus_queue.cc:237] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:24.539529 19244 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.623193 18528 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:24.629330 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:24.632573 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 90802.9us
I20260709 12:22:24.643877 18527 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:24.644341 19210 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:24.586797 20028 consensus_queue.cc:237] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:24.638955 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 130239us
I20260709 12:22:24.640230 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:24.702414 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:24.704118 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:24.704758 18528 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:24.701149 18522 raft_consensus.cc:2393] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 3: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:24.636475 18523 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.636973 20021 raft_consensus.cc:3060] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.622406 18521 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:24.629343 18672 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
W20260709 12:22:24.713255 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 69026.1us
I20260709 12:22:24.715063 19210 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:24.713320 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:24.629092 19929 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:24.732399 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:24.738489 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:24.739897 18524 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.704185 19928 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.742048 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:24.745925 18528 raft_consensus.cc:2393] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:24.636508 19906 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:24.748059 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:24.643996 19919 consensus_queue.cc:1059] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
W20260709 12:22:24.754542 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 46952.4us
W20260709 12:22:24.754786 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.757289 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:24.760824 18527 raft_consensus.cc:2393] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 2: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:24.760692 19210 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:24.731278 20008 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.731372 19931 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:24.775357 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:24.775221 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:24.777275 18570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.764670 18525 raft_consensus.cc:2393] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 2: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:24.778926 19245 raft_consensus.cc:1240] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:24.781437 18529 raft_consensus.cc:2410] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:24.797256 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:24.812594 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:24.815673 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:24.816480 18527 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:24.788856 19985 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:24.791438 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:24.806210 19891 raft_consensus.cc:3055] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:24.831431 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:24.810655 19931 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:24.846942 18527 raft_consensus.cc:2468] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4.
I20260709 12:22:24.850441 18524 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 2.
I20260709 12:22:24.858417 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:24.859479 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:24.859537 18524 raft_consensus.cc:2393] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
W20260709 12:22:24.863399 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 84082.5us
I20260709 12:22:24.864630 18524 raft_consensus.cc:1240] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:24.865643 18570 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:24.866782 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 106190us
I20260709 12:22:24.866765 18570 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:24.833880 19891 raft_consensus.cc:740] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:24.875990 18527 raft_consensus.cc:2410] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:22:24.867496 19987 consensus_meta.cc:287] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.591s	user 0.004s	sys 0.009s
I20260709 12:22:24.842641 19919 consensus_queue.cc:1048] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 12:22:24.879323 18674 consensus_meta.cc:287] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.000s
W20260709 12:22:24.871949 18675 consensus_meta.cc:287] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.591s	user 0.004s	sys 0.009s
I20260709 12:22:24.823829 19212 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:24.889820 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:24.844930 19774 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:24.901903 19245 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.902326 18528 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:24.903506 19906 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:24.903679 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 95110us
I20260709 12:22:24.892594 20017 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:24.890710 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:24.923880 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:24.901417 18675 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:24.900838 20058 raft_consensus.cc:2804] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:24.909575 20024 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:24.926968 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:24.909273 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:24.944617 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:24.928841 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:24.949402 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:24.925833 18530 raft_consensus.cc:1240] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:24.897640 18674 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:24.926683 20017 raft_consensus.cc:697] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:24.960685 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:24.960785 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:24.964284 18679 raft_consensus.cc:2393] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 4: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
W20260709 12:22:24.961236 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 169056us
I20260709 12:22:24.964707 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:24.927549 18605 raft_consensus.cc:1240] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:24.966531 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:24.966823 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:24.967909 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:24.968169 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:24.969211 19940 raft_consensus.cc:993] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 8c29c312e4544452b1162d7f81a58cb4 to start an election
I20260709 12:22:24.969103 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:24.951704 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:24.970130 19940 raft_consensus.cc:1081] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Signalling peer 8c29c312e4544452b1162d7f81a58cb4 to start an election
I20260709 12:22:24.972461 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:24.973390 19240 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.973577 18672 raft_consensus.cc:1240] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:24.961923 19245 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:25.037519 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:25.038904 18530 raft_consensus.cc:1240] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
W20260709 12:22:25.038961 18494 connection.cc:256] RPC call timeout handler was delayed by -2.1308391719999236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
I20260709 12:22:24.970157 19242 raft_consensus.cc:2393] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 2: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
W20260709 12:22:25.039575 18494 connection.cc:256] RPC call timeout handler was delayed by -2.09303917200009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
W20260709 12:22:25.041779 18494 connection.cc:256] RPC call timeout handler was delayed by -2.0453391720000127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
W20260709 12:22:25.042240 18494 connection.cc:256] RPC call timeout handler was delayed by -2.0048391719999472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
W20260709 12:22:25.042624 18494 connection.cc:256] RPC call timeout handler was delayed by -1.9679391719998875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
W20260709 12:22:25.043081 18494 connection.cc:256] RPC call timeout handler was delayed by -1.9679391719998875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
W20260709 12:22:25.043640 18494 connection.cc:256] RPC call timeout handler was delayed by -1.9634391719998803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
W20260709 12:22:25.044104 18494 connection.cc:256] RPC call timeout handler was delayed by -1.9616391719998774s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
W20260709 12:22:25.044492 18494 connection.cc:256] RPC call timeout handler was delayed by -1.9562391719998686s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
W20260709 12:22:25.044853 18494 connection.cc:256] RPC call timeout handler was delayed by -1.9355391720000625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
W20260709 12:22:25.045217 18494 connection.cc:256] RPC call timeout handler was delayed by -1.9355391720000625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
W20260709 12:22:25.045580 18494 connection.cc:256] RPC call timeout handler was delayed by -1.9355391720000625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
W20260709 12:22:25.045943 18494 connection.cc:256] RPC call timeout handler was delayed by -1.9319391720000567s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
W20260709 12:22:25.046314 18494 connection.cc:256] RPC call timeout handler was delayed by -1.8860391719999825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260709 12:22:25.046677 18494 connection.cc:256] RPC call timeout handler was delayed by -1.8707391719999578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
W20260709 12:22:25.047043 18494 connection.cc:256] RPC call timeout handler was delayed by -1.8491391719999228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
W20260709 12:22:25.047413 18494 connection.cc:256] RPC call timeout handler was delayed by -1.8113391720000891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
W20260709 12:22:25.052279 18494 connection.cc:256] RPC call timeout handler was delayed by -1.7258391719999508s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
W20260709 12:22:25.053346 18494 connection.cc:256] RPC call timeout handler was delayed by -1.7258391719999508s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
W20260709 12:22:25.054312 18494 connection.cc:256] RPC call timeout handler was delayed by -1.6844391719998839s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2098s for a response
W20260709 12:22:25.055236 18494 connection.cc:256] RPC call timeout handler was delayed by -1.6151391719999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
W20260709 12:22:25.056221 18494 connection.cc:256] RPC call timeout handler was delayed by -1.5998391719999745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21920000000000003s for a response
W20260709 12:22:25.040395 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 132450us
W20260709 12:22:25.058276 18494 connection.cc:256] RPC call timeout handler was delayed by -1.5233391720000782s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2277s for a response
I20260709 12:22:24.962438 20058 raft_consensus.cc:697] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:22:25.060506 18494 connection.cc:256] RPC call timeout handler was delayed by -1.5233391720000782s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2277s for a response
W20260709 12:22:25.061489 18494 connection.cc:256] RPC call timeout handler was delayed by -1.3415391720000116s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2479s for a response
W20260709 12:22:25.064002 18494 connection.cc:256] RPC call timeout handler was delayed by -1.2191391720000411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2615s for a response
I20260709 12:22:25.064860 18679 raft_consensus.cc:1240] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:25.065783 18494 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:25.068135 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:25.040231 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:25.058272 18597 raft_consensus.cc:1240] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:25.042541 19987 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:25.057276 19774 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:24.975077 19212 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:25.086463 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:25.089404 18679 raft_consensus.cc:2368] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4.
I20260709 12:22:25.090088 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:25.071424 18570 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:25.093739 19774 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:25.094404 19774 raft_consensus.cc:697] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:25.106791 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:25.108481 18494 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:25.105911 18572 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:25.111658 18598 raft_consensus.cc:1240] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:22:25.111990 19768 consensus_queue.cc:1059] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:22:25.112545 19774 consensus_queue.cc:237] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.098682 19986 raft_consensus.cc:2749] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:25.116199 19986 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:25.116668 19986 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:25.117098 19986 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:25.121398 18523 raft_consensus.cc:2468] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:25.098855 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:25.084420 19987 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.102638 19722 raft_consensus.cc:2804] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:25.129163 18644 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:25.111584 18675 raft_consensus.cc:1240] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:25.136030 18572 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:25.108274 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 146752us
I20260709 12:22:25.140002 19242 raft_consensus.cc:1240] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
W20260709 12:22:25.140506 20044 log.cc:927] Time spent T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 12:22:25.141465 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:22:25.141924 20060 log.cc:927] Time spent T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:22:25.140225 19212 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:25.159628 18572 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:25.162293 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 53903.4us
I20260709 12:22:25.163472 18494 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:25.159399 20021 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:25.140038 20042 log.cc:927] Time spent T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 12:22:25.140173 20064 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:25.137035 20022 raft_consensus.cc:2804] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:25.138121 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:25.145321 18675 raft_consensus.cc:1240] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:25.158035 19878 raft_consensus.cc:3055] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:25.183387 18572 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:25.146100 20059 log.cc:927] Time spent T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:22:25.115072 20058 consensus_queue.cc:237] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.134934 19785 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:22:25.108589 20017 consensus_queue.cc:237] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.133175 19970 consensus_queue.cc:1059] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:22:25.170977 20064 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:25.165087 20008 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:25.184582 18494 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:25.186301 18646 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:25.139140 19722 raft_consensus.cc:697] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:25.165659 19931 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:25.203725 19931 raft_consensus.cc:697] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
W20260709 12:22:25.204432 19988 consensus_meta.cc:287] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.748s	user 0.011s	sys 0.000s
I20260709 12:22:25.204766 19931 consensus_queue.cc:237] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:25.189388 18572 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:25.167492 18598 raft_consensus.cc:1240] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:25.173552 19945 raft_consensus.cc:2804] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:25.192054 18673 raft_consensus.cc:1240] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:25.139997 20056 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 12:22:25.185710 18523 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.221210 19945 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:25.221812 19945 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:25.222594 19240 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
W20260709 12:22:25.202191 20062 log.cc:927] Time spent T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:22:25.202052 20069 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:25.224313 20069 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:25.224565 19970 raft_consensus.cc:3055] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:25.224781 20069 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:25.225023 19970 raft_consensus.cc:740] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:25.202642 20047 raft_consensus.cc:2749] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:25.185127 20022 raft_consensus.cc:697] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:25.228312 19992 consensus_queue.cc:1059] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:22:25.203107 20066 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:25.233253 20022 consensus_queue.cc:237] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:25.234292 19722 consensus_queue.cc:237] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:25.181957 19878 raft_consensus.cc:740] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:25.196484 20064 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.217463 18679 raft_consensus.cc:1240] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:22:25.191362 19243 raft_consensus.cc:1240] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:25.232672 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 48147.2us
I20260709 12:22:25.232029 19768 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:25.237354 18523 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 2.
I20260709 12:22:25.238255 20066 consensus_queue.cc:1059] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:22:25.242092 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 55827.6us
I20260709 12:22:25.239598 20047 consensus_queue.cc:1059] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:22:25.246986 18494 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:25.247714 18646 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:25.260854 20039 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:22:25.248422 20023 consensus_meta.cc:287] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.685s	user 0.010s	sys 0.002s
I20260709 12:22:25.225394 19986 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.267441 18677 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 2.
I20260709 12:22:25.204846 19988 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.264480 18494 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:25.254508 19773 consensus_queue.cc:1059] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:22:25.266112 19873 raft_consensus.cc:3055] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:22:25.266480 20074 log.cc:927] Time spent T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:22:25.265911 19878 consensus_queue.cc:260] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.266661 20075 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:25.272397 19873 raft_consensus.cc:740] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:25.262203 19985 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:25.322237 18646 connection.cc:256] RPC call timeout handler was delayed by -1.5149501190001047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2923s for a response
I20260709 12:22:25.266803 20024 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:25.324380 18526 raft_consensus.cc:2368] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5.
W20260709 12:22:25.334367 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 70911.2us
I20260709 12:22:25.336300 20041 raft_consensus.cc:3055] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:25.336656 18597 raft_consensus.cc:1240] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:25.336808 20041 raft_consensus.cc:740] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:25.338115 18605 raft_consensus.cc:1240] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:25.319048 19878 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.317402 20023 raft_consensus.cc:2804] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:25.319859 19681 raft_consensus.cc:3055] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:25.318109 19987 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:25.349678 18572 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:25.317657 20075 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:25.356060 20075 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:25.338258 18521 raft_consensus.cc:1275] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:25.367067 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1056) took 1116 ms. Trace:
I20260709 12:22:25.268904 19970 consensus_queue.cc:260] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:25.361057 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 96697.7us
I20260709 12:22:25.347293 19985 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:25.367624 18680 rpcz_store.cc:276] 0709 12:22:24.251007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.328180 (+ 77173us) service_pool.cc:224] Handling call
0709 12:22:24.342584 (+ 14404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:24.631508 (+288924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.366748 (+735240us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b5400291dd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:25.366988 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470147456}
I20260709 12:22:25.344389 20047 consensus_queue.cc:1059] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 12:22:25.369105 20049 log.cc:927] Time spent T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:22:25.374874 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.375876 19970 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:25.376189 20072 log.cc:927] Time spent T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:22:25.376669 18677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50938 (request call id 70) took 1028 ms. Trace:
W20260709 12:22:25.360976 19928 consensus_meta.cc:287] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.003s
W20260709 12:22:25.361240 19994 consensus_meta.cc:287] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 1.024s	user 0.013s	sys 0.000s
I20260709 12:22:25.383265 19245 raft_consensus.cc:1240] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:25.377065 18677 rpcz_store.cc:276] 0709 12:22:24.348783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.545448 (+196665us) service_pool.cc:224] Handling call
0709 12:22:25.376499 (+831051us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b54003f2fd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:25.376608 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1469699456}
I20260709 12:22:25.350522 20023 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:25.378854 18525 raft_consensus.cc:1275] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:25.353722 19681 raft_consensus.cc:740] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:25.386278 18494 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:25.337936 20024 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:25.369963 19987 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.390349 18572 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:25.373137 20058 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:25.373096 19985 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:25.400386 19940 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:25.400996 19940 raft_consensus.cc:697] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:25.401280 19239 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf"
dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
 from {username='slave'} at 127.0.0.1:33388
I20260709 12:22:25.402094 19239 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:25.401886 19681 consensus_queue.cc:260] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.402150 19940 consensus_queue.cc:237] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.403635 19246 raft_consensus.cc:1240] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:25.402678 19239 raft_consensus.cc:3060] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:25.388432 20023 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:25.407833 19928 raft_consensus.cc:3055] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:25.386435 19994 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.373751 20041 consensus_queue.cc:260] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:25.403533 19985 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.409206 20084 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:25.420322 20084 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:25.420686 20084 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.422818 20050 raft_consensus.cc:3055] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:25.423238 20050 raft_consensus.cc:740] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:25.415597 19928 raft_consensus.cc:740] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:25.424098 20050 consensus_queue.cc:260] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:25.425215 20050 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.416316 20046 raft_consensus.cc:3055] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:25.426059 20046 raft_consensus.cc:740] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:25.388856 18671 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:25.427580 18494 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:25.424803 19928 consensus_queue.cc:260] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:25.399852 19987 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:25.436582 20047 consensus_queue.cc:1059] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:25.361574 19873 consensus_queue.cc:260] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:25.407655 19681 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.428934 19986 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:25.419441 19991 raft_consensus.cc:3055] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:25.418721 20041 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.417929 19994 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:25.461887 18572 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:25.463667 18572 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:25.408484 20017 consensus_queue.cc:1059] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:22:25.459731 19986 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:25.461045 20076 log.cc:927] Time spent T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.186s	user 0.000s	sys 0.002s
I20260709 12:22:25.467605 19643 raft_consensus.cc:2804] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:25.439954 18671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 1044) took 1196 ms. Trace:
I20260709 12:22:25.441205 20047 raft_consensus.cc:3055] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:22:25.479583 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 52106.3us
I20260709 12:22:25.485314 18677 raft_consensus.cc:1275] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:25.465971 19928 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.461210 19991 raft_consensus.cc:740] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:25.436004 20069 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.487535 18494 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:25.438421 19945 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.491323 19785 consensus_queue.cc:1059] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:25.491909 20015 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:25.491792 19239 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:25.493393 20024 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:25.494096 19239 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:25.494277 19785 raft_consensus.cc:3055] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:25.494686 19785 raft_consensus.cc:740] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:25.495682 19785 consensus_queue.cc:260] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.497104 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:25.497375 19785 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.497736 18525 raft_consensus.cc:3060] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:25.498734 20087 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:25.499222 20087 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:25.499727 20087 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:25.480266 19244 consensus_meta.cc:287] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.736s	user 0.009s	sys 0.004s
I20260709 12:22:25.480566 19873 raft_consensus.cc:3060] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.504354 19239 raft_consensus.cc:1240] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:25.478192 20035 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.509438 20035 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:25.510365 19929 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:25.459957 20046 consensus_queue.cc:260] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.507839 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:25.512364 18677 raft_consensus.cc:2393] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 2: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:25.512321 18601 raft_consensus.cc:1240] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:25.461491 19773 consensus_queue.cc:1059] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:22:25.462227 19774 consensus_queue.cc:1059] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:22:25.471913 19988 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:25.506677 18599 raft_consensus.cc:1275] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:25.506052 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:25.484371 20047 raft_consensus.cc:740] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:25.490669 19643 raft_consensus.cc:697] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:25.520783 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:25.523269 18494 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:25.505348 20069 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:25.521714 20039 consensus_queue.cc:1059] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:22:25.530380 18605 raft_consensus.cc:2393] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 2: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:25.533915 19210 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:25.544401 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.540251 20021 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.518158 19244 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:25.563644 18494 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:25.565470 19248 raft_consensus.cc:1240] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:25.485822 18671 rpcz_store.cc:276] 0709 12:22:24.241901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.254528 (+ 12627us) service_pool.cc:224] Handling call
0709 12:22:24.906762 (+652234us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baeee 000000000036eb39 00007efc8142e1e0 00007efc814f70c4 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:22:25.438007 (+531245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29376768}
W20260709 12:22:25.569432 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 105839us
W20260709 12:22:25.569670 18646 leader_election.cc:336] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.923s (SENT)
I20260709 12:22:25.569917 18494 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:25.570119 18646 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:25.570485 18572 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:25.516569 20064 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.540321 20039 consensus_queue.cc:1243] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer 8c29c312e4544452b1162d7f81a58cb4 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:25.577884 18494 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:25.580574 18527 raft_consensus.cc:1275] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:25.581593 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:25.582159 18527 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:25.518796 20028 consensus_queue.cc:1048] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:22:25.571812 19244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 291) took 1206 ms. Trace:
I20260709 12:22:25.586742 19986 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:25.587019 19244 rpcz_store.cc:276] 0709 12:22:24.361111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.362297 (+  1186us) service_pool.cc:224] Handling call
0709 12:22:25.567009 (+1204712us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.587805 19986 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:25.568126 19988 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:25.567941 19929 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:25.588251 19986 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.571247 20058 raft_consensus.cc:3055] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:25.599730 20016 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.576994 20019 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:25.601495 20058 raft_consensus.cc:740] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:25.589298 19994 raft_consensus.cc:2804] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:25.619570 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57384 (request call id 1148) took 1176 ms. Trace:
I20260709 12:22:25.591616 20039 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:25.623219 18644 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:25.624305 18526 rpcz_store.cc:276] 0709 12:22:24.443270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.490822 (+ 47552us) service_pool.cc:224] Handling call
0709 12:22:25.605443 (+1114621us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b54003f25d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:25.619496 (+ 14053us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1563103488}
I20260709 12:22:25.592978 19988 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:25.526350 19991 consensus_queue.cc:260] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:25.624107 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:25.598014 19987 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:25.630388 20089 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.630966 20089 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:25.626240 19643 consensus_queue.cc:237] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.618813 20035 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:22:25.646103 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 57224.5us
I20260709 12:22:25.575910 20075 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.640957 19991 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:25.651427 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 59876.8us
W20260709 12:22:25.650913 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 81269.3us
I20260709 12:22:25.626456 18521 raft_consensus.cc:1275] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:25.623992 19994 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:25.635504 19988 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:25.646867 18494 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:25.659368 18572 leader_election.cc:400] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5.
I20260709 12:22:25.659847 18572 leader_election.cc:403] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:22:25.664399 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:25.665046 18526 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:25.624902 19929 consensus_queue.cc:1059] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:22:25.619942 20016 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.637006 20069 consensus_queue.cc:1048] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:22:25.657033 19994 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:25.679136 18527 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:25.677716 18494 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:25.668313 18522 raft_consensus.cc:1275] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:25.691157 18572 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:25.694135 18527 raft_consensus.cc:3055] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:25.668478 19945 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:25.710973 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.695950 18527 raft_consensus.cc:740] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:25.698387 20021 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:25.698006 20023 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:25.698733 18606 raft_consensus.cc:3060] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:25.698993 20084 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.699877 20061 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:25.724056 20061 raft_consensus.cc:697] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:22:25.725536 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.725085 20061 consensus_queue.cc:237] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:25.700115 20089 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:25.672844 20032 consensus_queue.cc:1048] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.131s
I20260709 12:22:25.728412 20056 raft_consensus.cc:3055] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:25.728850 20056 raft_consensus.cc:740] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:25.718320 20092 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:25.730650 20092 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:25.731051 20092 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.732134 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:25.732856 18674 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.712781 18599 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:25.735950 18527 consensus_queue.cc:260] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.736948 18527 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:25.737564 20035 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:25.716823 20069 raft_consensus.cc:2804] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:25.740589 19243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33388 (request call id 241) took 1103 ms. Trace:
I20260709 12:22:25.740998 19243 rpcz_store.cc:276] 0709 12:22:24.704766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.720146 (+ 15380us) service_pool.cc:224] Handling call
0709 12:22:24.775578 (+ 55432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.251981 (+476403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.740352 (+488371us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54005c12d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:25.740528 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":934145280}
I20260709 12:22:25.744752 20066 raft_consensus.cc:3055] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:25.745317 20066 raft_consensus.cc:740] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:25.746917 18680 raft_consensus.cc:1275] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:25.746512 20066 consensus_queue.cc:260] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:25.748492 18672 raft_consensus.cc:1240] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:25.752586 18527 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 12:22:25.753080 18527 pending_rounds.cc:85] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 1
I20260709 12:22:25.753353 18527 pending_rounds.cc:107] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:22:25.753631 18527 raft_consensus.cc:2889] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:25.704478 20016 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:25.706689 19985 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.707242 18525 raft_consensus.cc:2468] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:22:25.708882 20075 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:25.617201 20047 consensus_queue.cc:260] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.709508 18521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2586476710143e281df940fcb3d3238"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
mode: GRACEFUL
new_leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:33498
I20260709 12:22:25.715507 18494 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:25.672500 19768 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:25.786329 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.786710 18524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1151) took 1242 ms. Trace:
I20260709 12:22:25.795193 18677 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:25.698807 19987 raft_consensus.cc:3055] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:25.720541 19929 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:25.722098 20073 log.cc:927] Time spent T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.562s	user 0.003s	sys 0.001s
I20260709 12:22:25.722249 20084 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:25.723090 20064 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:25.709502 20085 log.cc:927] Time spent T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:22:25.802675 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:25.761067 19757 consensus_queue.cc:1048] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:25.803375 18672 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:25.808030 20092 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.811116 18522 raft_consensus.cc:1240] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:25.811990 20092 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:25.814548 18528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1122) took 1100 ms. Trace:
I20260709 12:22:25.814985 18528 rpcz_store.cc:276] 0709 12:22:24.714313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.772281 (+ 57968us) service_pool.cc:224] Handling call
0709 12:22:25.814328 (+1042047us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b5400286254. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:25.814448 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239654784}
I20260709 12:22:25.815647 18530 raft_consensus.cc:1275] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:25.816283 18528 raft_consensus.cc:1240] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:25.788946 18525 raft_consensus.cc:1240] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
W20260709 12:22:25.817734 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.825794 18529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1149) took 1365 ms. Trace:
I20260709 12:22:25.827771 18525 raft_consensus.cc:1240] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:25.787444 18526 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:25.796685 18570 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:25.786955 20066 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.795246 18524 rpcz_store.cc:276] 0709 12:22:24.544829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.865585 (+320756us) service_pool.cc:224] Handling call
0709 12:22:24.876960 (+ 11375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:24.877352 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:24.877800 (+   448us) log.cc:844] Serialized 14 byte log entry
0709 12:22:25.020192 (+142392us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.020273 (+    81us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:25.020343 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.020440 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.786532 (+766092us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b54000825d0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:25.786644 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":240,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":119246,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":17653,"spinlock_wait_cycles":25054464,"thread_start_us":42692,"threads_started":1,"wal-append.queue_time_us":84819}
W20260709 12:22:25.782650 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.800400 19246 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:25.793044 19986 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.801362 20017 raft_consensus.cc:3055] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:25.788867 18521 raft_consensus.cc:606] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Received request to transfer leadership to TS c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:25.799362 19987 raft_consensus.cc:740] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:25.834743 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:25.804394 19240 raft_consensus.cc:1240] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:25.793195 20069 raft_consensus.cc:697] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:25.804773 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:25.785641 19212 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:25.806105 20019 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:25.783715 19891 consensus_queue.cc:260] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:25.790159 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.754298 18680 raft_consensus.cc:1275] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:22:25.835633 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.830677 18572 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:25.837467 18524 raft_consensus.cc:1240] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:25.837631 18570 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:25.671965 20058 consensus_queue.cc:260] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:25.826573 18529 rpcz_store.cc:276] 0709 12:22:24.460293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.870424 (+410131us) service_pool.cc:224] Handling call
0709 12:22:24.891795 (+ 21371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:24.894300 (+  2505us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:24.904894 (+ 10594us) log.cc:844] Serialized 14 byte log entry
0709 12:22:25.691538 (+786644us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b180036a960. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793d4e07 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793f1c02 00007efc7c07920b 00007efc7c07ed23 00007efc7c07f23a 00007efc7c4e9a2a
0709 12:22:25.825467 (+133929us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.825528 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:25.825569 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.825633 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.825737 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25306,"prepare.queue_time_us":9829,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"spinlock_wait_cycles":4500864,"thread_start_us":108368,"threads_started":1,"wal-append.queue_time_us":892643}
I20260709 12:22:25.841074 18525 raft_consensus.cc:2393] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 2: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:25.838249 19929 raft_consensus.cc:2804] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:25.862722 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.847895 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:25.842427 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 127010us
I20260709 12:22:25.837040 20050 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:25.864934 18494 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:25.887708 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.838757 20017 raft_consensus.cc:740] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:25.891590 20026 raft_consensus.cc:2804] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:25.968665 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:25.891535 20096 consensus_queue.cc:1059] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:22:25.892795 18529 raft_consensus.cc:1275] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:22:25.968555 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 103749us
I20260709 12:22:25.972570 18494 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:25.973145 18529 raft_consensus.cc:3055] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:22:25.973270 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 139871us
I20260709 12:22:25.973733 18529 raft_consensus.cc:740] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:22:25.977144 18646 leader_election.cc:336] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.118s (SENT)
I20260709 12:22:25.977754 18646 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:25.974757 18529 consensus_queue.cc:260] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.979003 18529 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:25.984542 18494 leader_election.cc:400] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4.
I20260709 12:22:25.984992 18494 leader_election.cc:403] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:22:25.983317 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:25.992875 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:25.855324 19239 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:25.863056 19929 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:25.865254 20032 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:25.975010 19891 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.843770 19988 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:25.976819 19945 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:25.992820 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:25.978776 20075 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:25.979652 19985 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:25.863718 20063 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.134s
W20260709 12:22:25.977497 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 186761us
I20260709 12:22:25.997040 20026 raft_consensus.cc:697] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:26.001359 19929 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:26.000317 20035 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:26.036397 18525 raft_consensus.cc:1240] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:26.032922 18605 raft_consensus.cc:1275] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:26.018935 18606 raft_consensus.cc:2468] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:22:26.072671 18529 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:22:26.000896 20092 consensus_queue.cc:1059] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:22:26.006336 20069 consensus_queue.cc:237] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:26.084864 19212 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:26.085356 20023 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:26.085943 19722 consensus_queue.cc:1048] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:26.000752 20084 consensus_queue.cc:1059] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:22:26.009792 19945 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:26.086593 20028 consensus_queue.cc:1048] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:22:26.080493 19241 raft_consensus.cc:1240] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:26.091960 20024 raft_consensus.cc:2804] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:26.092103 19241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33388 (request call id 239) took 1560 ms. Trace:
I20260709 12:22:26.092670 20024 raft_consensus.cc:697] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:26.092555 19241 rpcz_store.cc:276] 0709 12:22:24.547303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.557168 (+  9865us) service_pool.cc:224] Handling call
0709 12:22:26.001416 (+1444248us) spinlock_profiling.cc:243] Waited 6.99 ms on lock 0x7b5800003c98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:26.071374 (+ 69958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.091780 (+ 20406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.092009 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16085888}
I20260709 12:22:26.093662 20024 consensus_queue.cc:237] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:26.094494 18674 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:26.095036 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40800 (request call id 1226) took 1075 ms. Trace:
I20260709 12:22:26.095407 18674 rpcz_store.cc:276] 0709 12:22:25.020064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.052855 (+ 32791us) service_pool.cc:224] Handling call
0709 12:22:25.732005 (+679150us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baeee 000000000036eb39 00007efc8142e1e0 00007efc814f70c4 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:22:26.094970 (+362965us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7072000}
I20260709 12:22:26.033191 20051 raft_consensus.cc:3055] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:26.005453 20032 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:26.080421 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1048) took 1837 ms. Trace:
I20260709 12:22:26.082849 19931 consensus_queue.cc:1048] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:26.102409 18680 raft_consensus.cc:1275] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:26.105074 19241 raft_consensus.cc:1275] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:26.104751 20026 consensus_queue.cc:237] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:26.106117 20028 consensus_queue.cc:1059] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:26.078265 18529 pending_rounds.cc:85] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 1
I20260709 12:22:26.114280 18529 pending_rounds.cc:107] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:22:26.114712 18529 raft_consensus.cc:2889] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:26.117841 18529 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:26.101261 19945 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:26.012620 19987 consensus_queue.cc:260] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:26.108057 20087 consensus_meta.cc:287] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.608s	user 0.012s	sys 0.002s
I20260709 12:22:26.107234 20028 raft_consensus.cc:3055] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:26.060062 20018 consensus_queue.cc:1059] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.271s
W20260709 12:22:26.110772 19928 consensus_meta.cc:287] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.003s
I20260709 12:22:26.107884 20051 raft_consensus.cc:740] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:26.142017 19248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33388 (request call id 240) took 1577 ms. Trace:
I20260709 12:22:26.120960 18675 raft_consensus.cc:1240] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:26.129590 19986 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:26.152134 19248 rpcz_store.cc:276] 0709 12:22:24.564342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.620728 (+ 56386us) service_pool.cc:224] Handling call
0709 12:22:25.565290 (+944562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.565914 (+   624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.141709 (+575795us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b54004533d0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:26.141932 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2122026240}
W20260709 12:22:26.175827 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.089592 20017 consensus_queue.cc:260] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:26.097114 20056 consensus_queue.cc:260] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:26.121189 20035 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:22:26.147861 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:26.144596 20028 raft_consensus.cc:740] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:26.167984 19239 raft_consensus.cc:1240] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:26.180452 19987 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:26.140831 20087 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:26.201766 18672 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:26.209347 18672 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
W20260709 12:22:26.177246 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 92478us
I20260709 12:22:26.193272 20056 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:26.212975 19988 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:26.194465 20017 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:26.190279 20110 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4.
I20260709 12:22:26.227630 20028 consensus_queue.cc:260] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:26.220829 18523 raft_consensus.cc:1240] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:26.233705 20111 log.cc:927] Time spent T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.158s	user 0.003s	sys 0.000s
I20260709 12:22:26.107481 18678 rpcz_store.cc:276] 0709 12:22:24.243216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.254033 (+ 10817us) service_pool.cc:224] Handling call
0709 12:22:25.082755 (+828722us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:25.742364 (+659609us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bae9c 00007efc793baa5b 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:25.742548 (+   184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.742747 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:25.841688 (+ 98941us) log.cc:844] Serialized 14 byte log entry
0709 12:22:26.076111 (+234423us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:26.076174 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:26.078367 (+  2193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.078460 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:26.080352 (+  1892us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":264455,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":131,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":108,"spinlock_wait_cycles":57453440,"thread_start_us":264483,"threads_started":2,"wal-append.queue_time_us":235801}
I20260709 12:22:26.229171 18675 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:26.244488 18673 raft_consensus.cc:1275] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:26.244499 18530 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:26.194654 19994 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:26.229200 20028 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:26.254717 20032 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:26.261996 18528 raft_consensus.cc:1240] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
W20260709 12:22:26.272511 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.249867 18678 raft_consensus.cc:1275] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:22:26.316473 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.325980 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.328696 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.335824 18679 raft_consensus.cc:1240] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
W20260709 12:22:26.338410 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.339581 18522 raft_consensus.cc:1275] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:26.273413 20087 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:26.347640 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.351380 20092 consensus_queue.cc:1243] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer a0dee333a83a45f1ab0c1bb6d094afd1 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:22:26.358006 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 527358us
W20260709 12:22:26.358806 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 521221us
I20260709 12:22:26.359364 20088 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:26.359850 20016 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:26.366083 20050 raft_consensus.cc:697] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:26.368446 18599 raft_consensus.cc:1240] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:26.368896 20018 raft_consensus.cc:3055] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:26.369879 18606 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:26.371222 18600 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:22:26.372433 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.377728 19945 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:26.403694 20026 consensus_queue.cc:1048] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:22:26.352806 20075 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:26.388156 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.424454 19970 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:26.425068 19970 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:26.427193 19970 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:26.397694 18570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.401397 20088 raft_consensus.cc:697] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:22:26.428273 18570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.428710 20088 consensus_queue.cc:237] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:26.430277 19929 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:26.402544 20016 raft_consensus.cc:697] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:26.414377 20018 raft_consensus.cc:740] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:26.431417 18521 raft_consensus.cc:1240] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:26.432204 20016 consensus_queue.cc:237] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:26.432369 20018 consensus_queue.cc:260] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:26.433265 19929 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:26.433845 20018 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:26.403185 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 418778us
I20260709 12:22:26.403462 20021 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:26.403551 20050 consensus_queue.cc:237] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:26.420639 19768 consensus_meta.cc:287] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.000s
I20260709 12:22:26.423470 19945 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:26.381935 20099 log.cc:927] Time spent T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.368s	user 0.001s	sys 0.007s
W20260709 12:22:26.394196 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.441552 18494 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:26.458367 19643 consensus_queue.cc:1048] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:22:26.470798 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.478102 20117 log.cc:927] Time spent T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:22:26.449926 19994 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:26.479197 19986 raft_consensus.cc:3055] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:26.490543 19986 raft_consensus.cc:740] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:26.494789 20015 consensus_queue.cc:1048] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:26.495398 19689 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:26.497689 20015 consensus_queue.cc:1059] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:26.498342 19991 consensus_queue.cc:1048] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:26.499185 19774 raft_consensus.cc:3055] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:26.499571 19774 raft_consensus.cc:740] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:26.499761 19991 consensus_queue.cc:1059] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:26.491446 19986 consensus_queue.cc:260] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:26.500491 19774 consensus_queue.cc:260] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:26.501355 19986 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:26.502058 19774 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:26.452260 19768 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5.
I20260709 12:22:26.448544 19970 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.504417 19970 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:26.506825 19970 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:26.476688 20017 consensus_queue.cc:1048] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:22:26.480697 20122 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:26.449613 20075 consensus_queue.cc:1059] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:22:26.509598 20075 consensus_queue.cc:1243] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer a0dee333a83a45f1ab0c1bb6d094afd1 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:22:26.510098 20075 raft_consensus.cc:3055] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:26.510413 20075 raft_consensus.cc:740] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:22:26.489682 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.500765 19991 raft_consensus.cc:3055] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:22:26.512825 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.515506 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.528517 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:26.533888 18525 raft_consensus.cc:1240] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:26.535511 18525 raft_consensus.cc:1240] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:26.538902 18525 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:26.540277 18525 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:26.543193 18525 raft_consensus.cc:1240] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:26.507644 20046 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:26.480041 18494 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:26.511713 20120 log.cc:927] Time spent T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.170s	user 0.002s	sys 0.000s
I20260709 12:22:26.551647 19994 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:26.518494 20113 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:22:26.513887 20075 consensus_queue.cc:260] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:26.517666 20021 consensus_queue.cc:1048] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:22:26.523183 18599 raft_consensus.cc:3055] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:26.559018 18525 raft_consensus.cc:1240] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:26.559203 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:26.523604 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:26.537439 19991 raft_consensus.cc:740] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:22:26.593338 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.691113 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.701215 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 221249us
I20260709 12:22:26.702023 18494 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:26.569759 20063 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.676666 19774 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.570209 18599 raft_consensus.cc:740] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:26.711292 20023 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.737365 20023 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:26.739220 20124 log.cc:927] Time spent T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.322s	user 0.002s	sys 0.000s
I20260709 12:22:26.723881 19919 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.677282 20039 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:26.681553 20095 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:26.520853 20051 consensus_queue.cc:260] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:26.752127 18528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1172) took 1082 ms. Trace:
I20260709 12:22:26.723058 20075 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:26.759367 18528 rpcz_store.cc:276] 0709 12:22:25.669359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.817115 (+147756us) service_pool.cc:224] Handling call
0709 12:22:25.817409 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.262466 (+445057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.744619 (+482153us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54000820d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:26.752047 (+  7428us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1022008576}
I20260709 12:22:26.727176 19994 raft_consensus.cc:2764] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:22:26.762171 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1158) took 1185 ms. Trace:
I20260709 12:22:26.764755 18679 raft_consensus.cc:1275] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 12:22:26.741883 20115 log.cc:927] Time spent T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.405s	user 0.000s	sys 0.011s
W20260709 12:22:26.742493 20098 log.cc:927] Time spent T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.750s	user 0.001s	sys 0.001s
I20260709 12:22:26.740805 19919 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:26.740515 20106 raft_consensus.cc:3055] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:26.775305 19991 consensus_queue.cc:260] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:26.776129 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 74164.2us
I20260709 12:22:26.778059 18673 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:26.778412 20017 consensus_queue.cc:1059] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:26.781339 18676 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:26.742995 20050 consensus_queue.cc:1059] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:22:26.782130 18525 raft_consensus.cc:1275] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:22:26.817090 18525 pending_rounds.cc:85] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 1
I20260709 12:22:26.817409 18525 pending_rounds.cc:107] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:22:26.817700 18525 raft_consensus.cc:2889] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:26.782985 18646 leader_election.cc:336] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.500s (SENT)
I20260709 12:22:26.818526 18646 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:26.783509 20105 log.cc:927] Time spent T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.757s	user 0.000s	sys 0.011s
I20260709 12:22:26.739713 20023 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:26.759003 18522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
mode: GRACEFUL
new_leader_uuid: "8c29c312e4544452b1162d7f81a58cb4"
 from {username='slave'} at 127.0.0.1:33498
I20260709 12:22:26.815725 19768 consensus_queue.cc:1059] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:22:26.770949 18523 rpcz_store.cc:276] 0709 12:22:25.576521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.590901 (+ 14380us) service_pool.cc:224] Handling call
0709 12:22:25.624668 (+ 33767us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.229741 (+605073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.724806 (+495065us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b54003b4054. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:26.754562 (+ 29756us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1346542464}
I20260709 12:22:26.743856 20063 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:26.848140 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.812471 20061 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:26.882738 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.810827 20051 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:26.811868 20106 raft_consensus.cc:740] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:22:26.880947 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.770026 20016 consensus_queue.cc:1059] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:22:26.753049 19774 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:26.888355 20118 log.cc:927] Time spent T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.396s	user 0.000s	sys 0.002s
I20260709 12:22:26.838167 20015 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:22:26.879609 19940 consensus_queue.cc:1059] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:22:26.767575 20095 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:26.881842 19986 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.891585 19928 consensus_queue.cc:1059] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:22:26.845036 18522 raft_consensus.cc:606] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Received request to transfer leadership to TS 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:26.770283 20039 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:26.924247 20123 log.cc:927] Time spent T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 12:22:26.924649 20039 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:26.889951 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 106994us
W20260709 12:22:26.925881 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.884819 18678 raft_consensus.cc:1240] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:26.927204 20058 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:26.927572 20127 log.cc:927] Time spent T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 12:22:26.927977 20119 log.cc:927] Time spent T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.552s	user 0.003s	sys 0.000s
I20260709 12:22:26.893867 20050 raft_consensus.cc:3055] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:26.832762 20088 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:22:26.837915 20089 consensus_queue.cc:1059] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:22:26.879904 20023 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:26.917910 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1180) took 1091 ms. Trace:
I20260709 12:22:26.913304 19994 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.920113 18522 raft_consensus.cc:614] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:26.921088 19940 raft_consensus.cc:3055] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:22:26.921480 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.895644 19768 raft_consensus.cc:3055] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:26.892056 20061 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:26.913771 18494 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:26.981503 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 166194us
W20260709 12:22:26.937230 20018 consensus_meta.cc:287] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.006s
I20260709 12:22:26.942034 18526 rpcz_store.cc:276] 0709 12:22:25.826207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.972517 (+146310us) service_pool.cc:224] Handling call
0709 12:22:25.995038 (+ 22521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:26.099606 (+104568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:26.099643 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:26.103938 (+  4295us) log.cc:844] Serialized 26 byte log entry
0709 12:22:26.189701 (+ 85763us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:26.189737 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.189818 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:26.741292 (+551474us) spinlock_profiling.cc:243] Waited 8 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:22:26.915175 (+173883us) raft_consensus.cc:1685] finished
0709 12:22:26.915208 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:26.917845 (+  2637us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30543,"raft.queue_time_us":81876,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":10228,"spinlock_wait_cycles":18400640,"thread_start_us":155265,"threads_started":2,"wal-append.queue_time_us":117221}
I20260709 12:22:26.885303 18599 consensus_queue.cc:260] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:26.917281 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.915033 20113 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:26.892508 20035 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.899909 19991 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:26.950146 19940 raft_consensus.cc:740] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:26.950374 19768 raft_consensus.cc:740] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:26.953423 18678 raft_consensus.cc:1275] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:26.954995 18522 raft_consensus.cc:1275] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:26.932344 19986 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:26.937673 20050 raft_consensus.cc:740] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:22:27.008632 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:27.018132 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 473332us
W20260709 12:22:27.062454 18527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.000s	sys 0.048s
W20260709 12:22:27.112658 18527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.000s	sys 0.052s
I20260709 12:22:26.983646 18494 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
W20260709 12:22:27.116111 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.984807 20128 log.cc:927] Time spent T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
W20260709 12:22:27.031016 20112 log.cc:927] Time spent T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:22:27.116655 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 133113us
I20260709 12:22:27.114190 18599 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:26.950856 19994 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:27.126613 18426 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47728 (request call id 207) took 9540 ms. Trace:
I20260709 12:22:27.127405 19994 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:27.127887 18526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
mode: GRACEFUL
new_leader_uuid: "8c29c312e4544452b1162d7f81a58cb4"
 from {username='slave'} at 127.0.0.1:33498
I20260709 12:22:27.128604 18526 raft_consensus.cc:606] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Received request to transfer leadership to TS 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:27.129110 18526 raft_consensus.cc:614] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:22:27.129195 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:27.129668 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.041236 20063 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:27.132164 18512 tablet_service.cc:1558] Processing DeleteTablet for tablet c3c52474787041b099fe01aa8c862c04 with delete_type TABLET_DATA_TOMBSTONED (TS 2f9872512f1646bc835906bd0e98c6a7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57364
I20260709 12:22:27.135524 20028 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:27.136593 20125 log.cc:927] Time spent T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 12:22:26.984532 20122 raft_consensus.cc:2749] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:27.140902 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1080) took 1334 ms. Trace:
I20260709 12:22:27.136214 20028 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:27.141436 18674 rpcz_store.cc:276] 0709 12:22:25.809224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.105584 (+296360us) service_pool.cc:224] Handling call
0709 12:22:26.105872 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.166639 (+ 60767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:26.167474 (+   835us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:26.176758 (+  9284us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:26.183214 (+  6456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.140580 (+957366us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b54000578d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:27.140641 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:27.140826 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78861184}
I20260709 12:22:27.142423 19774 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:27.143241 20028 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:27.143469 18526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
mode: GRACEFUL
new_leader_uuid: "8c29c312e4544452b1162d7f81a58cb4"
 from {username='slave'} at 127.0.0.1:33498
I20260709 12:22:27.143633 19986 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:27.143810 20028 consensus_queue.cc:1048] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:27.109488 20110 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.150017 18603 raft_consensus.cc:1240] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:27.144096 18526 raft_consensus.cc:606] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Received request to transfer leadership to TS 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:27.153900 18526 raft_consensus.cc:614] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:27.116197 18527 raft_consensus.cc:2955] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:27.158457 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:27.126993 18426 rpcz_store.cc:276] 0709 12:22:17.586124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.586347 (+   223us) service_pool.cc:224] Handling call
0709 12:22:19.234625 (+1648278us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54002175d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c449090 00007efc7c4e7f3a 00007efc8229de9c 00007efc8239c04e 00007efc8085d2a4 00007efc8085d232 00007efc8085d161 00007efc8085d0dc 00007efc8085c392 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:27.126545 (+7891920us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:24.193667 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:24.194555 (+   888us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:24.194614 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:22:24.194641 (+    27us) tablet.cc:662] Decoding operations
0709 12:22:24.208485 (+ 13844us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:24.232502 (+ 24017us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:24.237624 (+  5122us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:22:24.453825 (+216201us) tablet.cc:701] Row locks acquired
0709 12:22:24.468156 (+ 14331us) write_op.cc:260] PREPARE: finished
0709 12:22:24.509612 (+ 41456us) write_op.cc:270] Start()
0709 12:22:24.509785 (+   173us) write_op.cc:276] Timestamp: P: 1783599744509516 usec, L: 0
0709 12:22:24.509807 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:22:24.564657 (+ 54850us) log.cc:844] Serialized 2480 byte log entry
0709 12:22:24.949253 (+384596us) op_driver.cc:464] REPLICATION: finished
0709 12:22:25.124011 (+174758us) write_op.cc:301] APPLY: starting
0709 12:22:25.124101 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:25.124315 (+   214us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:25.161922 (+ 37607us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:25.232200 (+ 70278us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:25.244080 (+ 11880us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:22:25.245847 (+  1767us) write_op.cc:312] APPLY: finished
0709 12:22:25.246152 (+   305us) log.cc:844] Serialized 52 byte log entry
0709 12:22:25.257941 (+ 11789us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:25.263622 (+  5681us) write_op.cc:454] Released schema lock
0709 12:22:25.268526 (+  4904us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:25.344308 (+ 75782us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:25.346766 (+  2458us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":81036,"reported_tablets":12,"spinlock_wait_cycles":539747200,"child_traces":[["op",{"apply.queue_time_us":157448,"apply.run_cpu_time_us":4198,"apply.run_wall_time_us":199365,"num_ops":6,"prepare.queue_time_us":165017,"prepare.run_cpu_time_us":29605,"prepare.run_wall_time_us":583483,"raft.queue_time_us":134728,"raft.run_cpu_time_us":80840,"raft.run_wall_time_us":176138,"replication_time_us":406764,"thread_start_us":421180,"threads_started":4,"wal-append.queue_time_us":147478,"wal-append.run_cpu_time_us":20178,"wal-append.run_wall_time_us":1614263}]]}
I20260709 12:22:27.122202 19985 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:27.164618 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:27.167563 18605 raft_consensus.cc:1240] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:27.165825 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:27.170068 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:27.170320 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:27.171293 18601 raft_consensus.cc:2393] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 2: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:27.174813 18603 raft_consensus.cc:2393] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 2: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
W20260709 12:22:27.158536 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.118907 20046 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:22:27.185112 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:27.043797 20106 consensus_queue.cc:260] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:27.171619 20039 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:27.174860 20017 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.123153 20035 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:27.172165 19919 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:27.184755 19681 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.160679 20110 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:27.158824 20063 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:22:27.222607 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:27.123329 20113 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:27.184340 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:27.160243 20135 consensus_queue.cc:1059] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:22:27.228192 18600 raft_consensus.cc:1240] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 1. Current term is 2. Ops: []
W20260709 12:22:27.275002 18570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.220494 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:22:27.232273 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.177994 19985 raft_consensus.cc:697] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:27.224869 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:27.187800 20061 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:27.162388 19768 consensus_queue.cc:260] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:27.217330 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:27.221040 20134 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.142467 19940 consensus_queue.cc:260] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:27.187424 20022 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.252105 18424 catalog_manager.cc:5697] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 1 to 3, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 3 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:27.256239 20106 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:27.287220 18676 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
W20260709 12:22:27.225872 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 292443us
W20260709 12:22:27.290493 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.284205 20032 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.227632 20017 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:27.305357 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:22:27.309252 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:27.256692 19681 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:27.307262 18494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:27.344388 18494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:27.344897 18494 connection.cc:256] RPC call timeout handler was delayed by -1.005173281999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
W20260709 12:22:27.291253 18570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.259014 20039 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:27.322526 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:27.358300 18526 raft_consensus.cc:1275] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:27.315605 19928 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.288314 20026 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.368283 20026 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:27.371155 20026 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:27.309742 20113 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:27.328052 20061 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.372586 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:27.376853 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 270515us
I20260709 12:22:27.345357 19768 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:27.353014 19929 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:27.338915 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:27.345335 18494 connection.cc:256] RPC call timeout handler was delayed by -1.005173281999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
W20260709 12:22:27.387416 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.340253 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:27.389523 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:27.390597 18525 raft_consensus.cc:2393] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 2: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:27.307793 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:27.363176 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:27.367429 18570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.326368 18602 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:27.316251 20134 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:27.323632 18646 leader_election.cc:336] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.675s (SENT)
I20260709 12:22:27.402139 18646 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:27.191275 20050 consensus_queue.cc:260] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:27.320441 20022 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:27.394611 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.397872 18570 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:27.398811 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.333425 20032 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:27.305009 20024 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.017s	sys 0.014s
I20260709 12:22:27.410495 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:27.399307 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:27.414233 18525 raft_consensus.cc:2393] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 2: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:27.415315 18570 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:27.377640 20147 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:27.386433 20021 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.378639 19928 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:27.386456 20113 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:27.377830 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:27.420156 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 96635.2us
W20260709 12:22:27.430819 18646 leader_election.cc:336] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.675s (SENT)
I20260709 12:22:27.431161 18646 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:27.431545 18604 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
W20260709 12:22:27.425288 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:27.435256 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:27.435693 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.418115 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:27.446352 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:27.419030 20021 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:27.454779 20110 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:27.423307 19689 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:27.456143 20160 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.456543 20021 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:27.456656 20160 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:27.418589 19241 raft_consensus.cc:1275] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:22:27.423307 20133 log.cc:927] Time spent T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 12:22:27.459059 20160 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:27.454922 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:27.459609 20140 log.cc:927] Time spent T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:22:27.381837 20061 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:27.420403 20063 raft_consensus.cc:2749] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:27.461401 20022 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:27.461562 20139 log.cc:927] Time spent T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:22:27.461651 20061 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:27.424727 20134 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:27.451414 18671 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:27.463683 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:27.464134 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:27.465057 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:27.425518 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:22:27.465454 18646 leader_election.cc:336] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.745s (SENT)
I20260709 12:22:27.465873 18646 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:27.466138 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:27.466732 18677 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:27.467070 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.422041 20089 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:27.467912 20056 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:27.468643 20056 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:27.469038 19970 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:27.469647 20142 log.cc:927] Time spent T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:22:27.469589 19970 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:27.471773 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:27.472324 18679 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:27.474972 18677 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:27.458623 20050 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:27.477451 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:22:27.463574 20144 log.cc:927] Time spent T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:22:27.586690 18527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 88) took 1145 ms. Trace:
I20260709 12:22:27.584878 18679 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:27.588452 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:27.587113 18527 rpcz_store.cc:276] 0709 12:22:26.440979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.441136 (+   157us) service_pool.cc:224] Handling call
0709 12:22:26.441658 (+   522us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:26.458573 (+ 16915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:26.458624 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:26.460123 (+  1499us) log.cc:844] Serialized 534 byte log entry
0709 12:22:26.537838 (+ 77715us) spinlock_profiling.cc:243] Waited 9.04 ms on lock 0x7b18002d3d00. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793d4e07 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793f1c02 00007efc7c07920b 00007efc7c07ed23 00007efc7c07f0d1 00007efc7c49aa0f
0709 12:22:27.114383 (+576545us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:27.198689 (+ 84306us) log.cc:844] Serialized 14 byte log entry
0709 12:22:27.236007 (+ 37318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.236120 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:27.479678 (+243558us) raft_consensus.cc:1685] finished
0709 12:22:27.586461 (+106783us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:27.586628 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":44868,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":13807,"spinlock_wait_cycles":20788480,"thread_start_us":576329,"threads_started":1,"wal-append.queue_time_us":708107}
I20260709 12:22:27.589862 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:27.422210 20075 consensus_meta.cc:287] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.653s	user 0.006s	sys 0.002s
W20260709 12:22:27.417227 20136 log.cc:927] Time spent T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 12:22:27.416724 20024 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.018s	sys 0.014s
W20260709 12:22:27.509707 18646 leader_election.cc:336] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.908s (SENT)
W20260709 12:22:27.603029 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.603098 18646 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:27.516903 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:27.604568 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.547851 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:27.586061 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 95158.4us
I20260709 12:22:27.421054 20039 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:27.594292 18677 raft_consensus.cc:1217] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Deduplicated request from leader. Original: 2.1->[4.2-4.2]   Dedup: 4.2->[]
I20260709 12:22:27.478868 19970 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:27.595080 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:27.595419 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:27.417759 19643 raft_consensus.cc:3055] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:27.600171 18599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1191) took 1071 ms. Trace:
I20260709 12:22:27.421340 19681 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:27.425550 19928 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:27.417850 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:27.440510 20046 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:27.604061 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.401957 19929 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:27.707156 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.592438 20153 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.610144 20152 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:27.611785 18677 raft_consensus.cc:1240] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:22:27.594287 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:22:27.613706 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 104034us
I20260709 12:22:27.611459 20021 consensus_queue.cc:1048] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
W20260709 12:22:27.653074 20126 log.cc:927] Time spent T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.469s	user 0.003s	sys 0.000s
I20260709 12:22:27.461863 18522 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:27.658638 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:27.493031 20063 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.663142 18525 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:27.591394 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:27.425997 20113 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:27.602662 20035 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:27.673172 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:27.607420 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:27.607288 20016 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:27.595587 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 118447us
W20260709 12:22:27.756510 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.410742 19985 consensus_queue.cc:237] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:27.649367 20056 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:27.703833 18530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.050s	sys 0.084s
W20260709 12:22:27.788364 18530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.050s	sys 0.084s
I20260709 12:22:27.704036 20145 consensus_queue.cc:1059] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:22:27.788698 19239 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:27.788802 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:27.657657 20039 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.789630 20016 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:27.789909 20039 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:27.790992 20113 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:27.728125 20032 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:27.791771 20016 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:27.786013 20063 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:27.791977 20039 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:27.792133 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:27.792340 20016 raft_consensus.cc:3055] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:27.792742 20016 raft_consensus.cc:740] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:27.793080 20047 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:27.793854 20063 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:27.715013 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:27.813086 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.722033 20146 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:22:27.683324 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1195) took 1047 ms. Trace:
W20260709 12:22:27.618607 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.726248 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:27.726300 18646 leader_election.cc:336] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.103s (SENT)
I20260709 12:22:27.665822 19643 raft_consensus.cc:740] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:27.732869 18527 raft_consensus.cc:2393] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 2: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:27.734030 20152 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:27.735080 19774 consensus_queue.cc:1048] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:27.738080 18602 raft_consensus.cc:1240] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:27.739084 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:27.740708 20088 raft_consensus.cc:3055] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:27.741729 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:27.742779 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:27.743528 18672 raft_consensus.cc:1240] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:27.749063 19919 raft_consensus.cc:3055] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:27.750470 20066 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.752663 19940 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:27.754918 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:22:27.723119 20151 log.cc:927] Time spent T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 12:22:27.755426 19757 raft_consensus.cc:3055] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:27.718323 18673 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:27.785605 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:27.858180 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:27.793622 20016 consensus_queue.cc:260] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:27.799113 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:27.800391 18679 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:27.789667 18522 raft_consensus.cc:2393] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:27.781772 20153 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:27.810271 20159 tablet_replica.cc:333] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:22:27.684590 20096 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.103s
I20260709 12:22:27.417573 20147 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:27.811391 18528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1194) took 1263 ms. Trace:
W20260709 12:22:27.815851 18494 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:57374 dropped due to backpressure: service queue is full with 50 items
I20260709 12:22:27.817191 18646 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:27.857839 19757 raft_consensus.cc:740] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:27.816926 18523 rpcz_store.cc:276] 0709 12:22:26.635708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.897161 (+261453us) service_pool.cc:224] Handling call
0709 12:22:26.920524 (+ 23363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:26.920893 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:26.920932 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:26.921422 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:22:27.187892 (+266470us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:27.195218 (+  7326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.223398 (+ 28180us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:27.657872 (+434474us) raft_consensus.cc:1685] finished
0709 12:22:27.662901 (+  5029us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:27.680039 (+ 17138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1537,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":93,"thread_start_us":250968,"threads_started":1,"wal-append.queue_time_us":398647}
I20260709 12:22:27.820926 19643 consensus_queue.cc:260] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:27.821367 20018 raft_consensus.cc:3055] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:27.717973 20046 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:27.823132 20095 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:27.823405 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:27.908330 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:27.908540 18521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1184) took 1378 ms. Trace:
W20260709 12:22:27.788364 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.909169 18521 rpcz_store.cc:276] 0709 12:22:26.530138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.537161 (+  7023us) service_pool.cc:224] Handling call
0709 12:22:26.728770 (+191609us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:26.791794 (+ 63024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:26.795254 (+  3460us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:26.892128 (+ 96874us) log.cc:844] Serialized 26 byte log entry
0709 12:22:27.305858 (+413730us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:27.311043 (+  5185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.327808 (+ 16765us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:27.908011 (+580203us) raft_consensus.cc:1685] finished
0709 12:22:27.908059 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:27.908422 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4994,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":23870,"thread_start_us":342099,"threads_started":1,"wal-append.queue_time_us":465331}
I20260709 12:22:27.832690 18680 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:27.782757 20017 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:27.844748 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.911828 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:27.834630 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 236331us
I20260709 12:22:27.912932 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:27.913472 18524 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:27.914631 18572 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:27.756596 20058 consensus_meta.cc:287] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.806s	user 0.008s	sys 0.003s
I20260709 12:22:27.836702 20063 consensus_queue.cc:1048] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:22:27.917570 20058 consensus_queue.cc:1048] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:27.918181 20063 consensus_queue.cc:1059] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:27.918989 20063 consensus_queue.cc:1243] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:22:27.858315 18603 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:27.822461 18493 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:43124 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1144)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1155)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1146)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1124)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1132)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43124 (request call id 92)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1134)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1161)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1163)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43124 (request call id 94)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1160)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1123)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43124 (request call id 96)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1159)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1149)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1203)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1204)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1205)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1206)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1207)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1208)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 90)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1125)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1137)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1138)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1139)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1140)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1142)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1143)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1145)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 93)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 95)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 97)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 98)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 99)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1154)
I20260709 12:22:27.859231 18602 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:27.799628 18674 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:27.921623 20153 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:27.922523 18674 raft_consensus.cc:1275] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:27.836300 18678 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:27.923378 19643 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:27.924008 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:27.924755 18527 raft_consensus.cc:2393] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 2: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:27.925487 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:27.926030 18527 raft_consensus.cc:2376] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2. Re-sending same reply.
I20260709 12:22:27.926668 20075 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:27.926777 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:27.834223 20088 raft_consensus.cc:740] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:27.927244 20075 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:27.928244 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:27.929371 20075 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:27.929435 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:27.843133 19919 raft_consensus.cc:740] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:27.930704 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:27.882213 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.931352 18603 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:27.883987 18529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 87) took 1458 ms. Trace:
I20260709 12:22:27.892489 20016 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:27.888013 18528 rpcz_store.cc:276] 0709 12:22:26.548311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.769487 (+221176us) service_pool.cc:224] Handling call
0709 12:22:26.769786 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:26.793411 (+ 23625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:26.793459 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:26.823292 (+ 29833us) log.cc:844] Serialized 26 byte log entry
0709 12:22:27.106527 (+283235us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:27.106568 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.106635 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:27.811146 (+704511us) raft_consensus.cc:1685] finished
0709 12:22:27.811166 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:27.811331 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41561,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":20563,"thread_start_us":282819,"threads_started":1,"wal-append.queue_time_us":894438}
W20260709 12:22:27.895316 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 169053us
W20260709 12:22:27.945021 18646 leader_election.cc:336] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.115s (SENT)
W20260709 12:22:27.946020 18646 leader_election.cc:336] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.246s (SENT)
I20260709 12:22:27.946486 18646 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:27.816783 20056 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.672293 18599 rpcz_store.cc:276] 0709 12:22:26.521986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.522547 (+   561us) service_pool.cc:224] Handling call
0709 12:22:26.522940 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:27.476868 (+953928us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.476905 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:27.476954 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:27.476987 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.477066 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:27.593285 (+116219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5393,"raft.queue_time_us":1193,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":103845}
I20260709 12:22:27.899499 20035 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:27.910831 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.918859 20058 consensus_queue.cc:1048] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:27.863511 18525 raft_consensus.cc:2393] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:27.975214 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:27.919956 19768 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:27.619190 20089 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.922434 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:27.927979 20088 consensus_queue.cc:260] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:28.026834 20088 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:27.988186 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 67641.9us
I20260709 12:22:28.031884 19757 consensus_queue.cc:260] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:28.033277 20032 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:27.933940 18644 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:28.033926 20032 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:27.930795 19919 consensus_queue.cc:260] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:28.036163 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:28.036341 20032 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:28.036468 19919 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.036854 18603 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:28.036945 20032 raft_consensus.cc:2764] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:22:27.928274 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:27.934810 18527 raft_consensus.cc:2376] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2. Re-sending same reply.
I20260709 12:22:28.037792 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:28.038406 18671 consensus_meta.cc:287] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.000s
I20260709 12:22:28.038530 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.038796 18671 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:28.039171 18527 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:28.040048 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.040580 18527 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4.
I20260709 12:22:28.041477 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.042548 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.043073 18527 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:27.882712 18601 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
W20260709 12:22:27.863847 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 183074us
I20260709 12:22:27.971808 20056 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:28.045624 20056 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:28.018827 20017 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:28.046607 20017 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:27.876825 18679 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:28.048098 20096 consensus_queue.cc:1048] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:28.048727 20017 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:27.886369 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:28.050321 18675 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:22:28.050830 20166 consensus_queue.cc:1048] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:27.931895 18529 rpcz_store.cc:276] 0709 12:22:26.425485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.425634 (+   149us) service_pool.cc:224] Handling call
0709 12:22:26.425959 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:26.426308 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:26.426337 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:26.426903 (+   566us) log.cc:844] Serialized 52 byte log entry
0709 12:22:26.529507 (+102604us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:26.545722 (+ 16215us) log.cc:844] Serialized 14 byte log entry
0709 12:22:26.545951 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.546031 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:27.144982 (+598951us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b18002d3ca0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793f23f3 00007efc793f47c1 00007efc793f4779 00007efc793f4709 00007efc793f46d1 00007efc793f39cd 0000000000388634 0000000000388479 00007efc793d583a
0709 12:22:27.476534 (+331552us) spinlock_profiling.cc:243] Waited 84.2 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:22:27.883722 (+407188us) raft_consensus.cc:1685] finished
0709 12:22:27.883762 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:27.883925 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20125,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":4250,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":215,"spinlock_wait_cycles":238688384,"thread_start_us":101981,"threads_started":1,"wal-append.queue_time_us":487520}
I20260709 12:22:27.955587 18680 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:28.052536 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.053447 18529 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:28.053505 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.054204 18527 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:27.951295 18524 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:28.055022 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.055548 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.056172 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.056411 18524 raft_consensus.cc:2410] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:22:28.057585 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.057983 18527 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 2.
I20260709 12:22:28.058439 18524 raft_consensus.cc:2393] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 2: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:28.057152 19212 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:27.856621 20066 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:27.949885 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.020380 19768 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.033387 19757 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.049561 20096 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:28.050199 20170 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:28.056265 20147 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:28.040453 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:27.905427 20018 raft_consensus.cc:740] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:22:28.021236 20165 log.cc:927] Time spent T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
W20260709 12:22:28.034169 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 100316us
W20260709 12:22:28.025840 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:28.060319 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.975862 18525 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:28.038547 18603 raft_consensus.cc:2393] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 5: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:28.054509 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.069680 18530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1196) took 1352 ms. Trace:
I20260709 12:22:28.072639 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.073455 18525 raft_consensus.cc:2393] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:28.060425 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:28.061868 18646 leader_election.cc:336] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.577s (SENT)
I20260709 12:22:28.076126 18646 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:28.077278 18604 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:28.077932 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.078853 18525 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:22:28.059217 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.073246 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.081935 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.082527 18529 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:28.049350 20017 consensus_queue.cc:1048] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:28.072772 18530 rpcz_store.cc:276] 0709 12:22:26.717016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.925746 (+208730us) service_pool.cc:224] Handling call
0709 12:22:26.926108 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:27.144478 (+218370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.144511 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:27.145022 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:22:27.788817 (+643795us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:27.788856 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.825504 (+ 36648us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400286254. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:27.825572 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:28.069260 (+243688us) raft_consensus.cc:1685] finished
0709 12:22:28.069293 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.069594 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":871,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":56,"spinlock_wait_cycles":501421696,"thread_start_us":643404,"threads_started":1,"wal-append.queue_time_us":707256}
I20260709 12:22:28.070389 18644 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:28.024124 20168 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.091593 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.092937 18530 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 2.
I20260709 12:22:28.095127 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.096431 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:28.098515 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:27.984330 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.086794 18527 raft_consensus.cc:2393] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:28.101166 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.101907 18527 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:28.103034 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:28.059718 20106 consensus_meta.cc:287] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.732s	user 0.007s	sys 0.001s
I20260709 12:22:28.087057 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.088213 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.082743 18525 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:28.107170 18524 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
W20260709 12:22:28.080891 20051 consensus_meta.cc:287] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 1.190s	user 0.006s	sys 0.006s
W20260709 12:22:28.105868 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.061632 19768 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:28.092476 19210 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:22:28.115790 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 53956.8us
W20260709 12:22:28.116436 18646 leader_election.cc:336] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.584s (SENT)
I20260709 12:22:28.116786 18646 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:28.108222 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:27.957383 20063 raft_consensus.cc:2749] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:28.104351 18527 raft_consensus.cc:2393] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:28.061308 20066 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:28.037045 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.059886 19931 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:27.955788 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.105299 20032 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:28.113224 20039 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:28.141903 20039 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.113761 20159 raft_consensus.cc:2243] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:28.143289 20159 raft_consensus.cc:2272] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:28.145809 20023 raft_consensus.cc:3055] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:28.063613 20046 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:28.066519 18599 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:28.146378 20023 raft_consensus.cc:740] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:28.079821 18678 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:28.118943 18529 raft_consensus.cc:1240] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:28.148615 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:28.119390 18524 raft_consensus.cc:1275] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:28.150506 18524 raft_consensus.cc:1240] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:28.152559 18524 raft_consensus.cc:1240] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:28.124651 20026 raft_consensus.cc:2804] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:28.153266 20026 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.119851 18530 raft_consensus.cc:1240] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:28.153751 20026 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:28.152571 18523 raft_consensus.cc:1217] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4]   Dedup: 1.4->[]
I20260709 12:22:28.111809 20035 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:28.119854 19970 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:28.146329 20159 ts_tablet_manager.cc:1916] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:28.060003 19212 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
W20260709 12:22:28.157063 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 97142.4us
I20260709 12:22:28.157687 20157 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:28.158138 20157 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.158461 20157 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:28.158990 19212 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:28.160384 20156 raft_consensus.cc:2804] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:28.160754 20156 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.160818 20152 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:28.161147 20156 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:28.106348 19929 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:28.122606 19991 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.164227 19991 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:28.131827 19931 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:28.166059 19931 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:28.147564 20023 consensus_queue.cc:260] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:28.131292 18605 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:28.131984 18606 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:28.134280 18597 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:28.109905 20168 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:28.114820 18672 raft_consensus.cc:1275] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:28.142320 20039 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:28.059867 20089 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:28.155468 18523 raft_consensus.cc:1240] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: [1.4-1.4]
I20260709 12:22:28.133483 20018 consensus_queue.cc:260] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:28.259688 20089 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:28.262579 18598 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:27.972276 20146 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:28.211855 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 164187us
I20260709 12:22:28.131138 18673 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:28.237293 20145 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.264129 18673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40800 (request call id 1241) took 1046 ms. Trace:
I20260709 12:22:28.264175 20145 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:28.264671 18673 rpcz_store.cc:276] 0709 12:22:27.217940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.404620 (+186680us) service_pool.cc:224] Handling call
0709 12:22:28.264060 (+859440us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:28.242198 18524 raft_consensus.cc:1240] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:28.156188 20035 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.266141 20035 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:28.245862 18601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1199) took 1028 ms. Trace:
I20260709 12:22:28.268168 18601 rpcz_store.cc:276] 0709 12:22:27.216995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.169024 (+952029us) service_pool.cc:224] Handling call
0709 12:22:28.245216 (+ 76192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.245436 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.245470 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:28.245527 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:28.245572 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.245644 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.245788 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:28.269121 18522 raft_consensus.cc:1275] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:28.269421 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:28.269762 20157 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:28.272691 20157 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:28.237514 20026 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:28.273157 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:28.274055 19243 raft_consensus.cc:2393] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 3: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:22:28.250636 20156 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:28.298522 19931 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:28.299649 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:28.300420 20156 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:28.301245 19931 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:28.251399 20023 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:28.252846 19768 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:28.304142 19768 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:28.304382 19239 raft_consensus.cc:1240] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:28.244182 20046 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.305047 20046 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:28.270239 19248 raft_consensus.cc:1275] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:28.308195 18601 raft_consensus.cc:2368] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 2. Current term is 3.
I20260709 12:22:28.308719 20046 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:22:28.309787 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:28.311336 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:27.971316 20153 consensus_queue.cc:1048] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.151s
I20260709 12:22:28.313592 18598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40954 (request call id 1255) took 1146 ms. Trace:
I20260709 12:22:28.314105 18598 rpcz_store.cc:276] 0709 12:22:27.167421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.170210 (+  2789us) service_pool.cc:224] Handling call
0709 12:22:27.742601 (+572391us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b5800102f98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:22:28.313368 (+570767us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b54001270d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:28.313515 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1035818112}
I20260709 12:22:28.316035 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:28.316905 18598 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 2.
I20260709 12:22:28.318328 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:28.236075 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 114885us
I20260709 12:22:28.282572 18602 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:28.283715 20018 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:28.284022 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:28.285836 20022 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:28.292815 20169 log.cc:927] Time spent T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 12:22:28.293872 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:28.290510 20176 log.cc:927] Time spent T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638: Append to log took a long time: real 0.262s	user 0.000s	sys 0.002s
W20260709 12:22:28.296041 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.296778 20168 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:28.297099 18495 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:57384 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1154)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1210)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1211)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1213)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 102)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 103)
I20260709 12:22:28.298179 18673 raft_consensus.cc:1275] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:28.274812 20026 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:28.301877 18605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40954 (request call id 1258) took 1125 ms. Trace:
W20260709 12:22:28.340238 20177 log.cc:927] Time spent T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:22:28.386607 18605 rpcz_store.cc:276] 0709 12:22:27.176230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.191914 (+ 15684us) service_pool.cc:224] Handling call
0709 12:22:28.301693 (+1109779us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b54001261d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:28.301813 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1927136128}
W20260709 12:22:28.322656 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:28.388535 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:28.389163 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.326189 18644 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:28.390763 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 64653.9us
W20260709 12:22:28.332157 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.336197 18676 raft_consensus.cc:1240] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
W20260709 12:22:28.393143 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:28.393889 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:28.394335 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.361917 18530 raft_consensus.cc:1275] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:28.396693 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:27.896010 18494 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:57374 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1155)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1146)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1124)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1132)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43124 (request call id 92)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1134)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1161)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1163)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43124 (request call id 94)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1160)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1123)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43124 (request call id 96)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1159)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1149)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1203)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1204)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1205)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1206)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1207)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1208)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 90)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1125)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1137)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1138)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1139)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1140)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1142)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1143)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1145)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 93)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 95)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 97)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 98)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 99)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1154)
I20260709 12:22:28.357829 20157 consensus_queue.cc:1048] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:22:28.366055 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:28.365861 20035 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:28.366515 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:22:28.367272 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.368039 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:28.368744 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:28.370929 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40800 (request call id 1242) took 1113 ms. Trace:
I20260709 12:22:28.416800 18679 rpcz_store.cc:276] 0709 12:22:27.257759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.593779 (+336020us) service_pool.cc:224] Handling call
0709 12:22:28.370712 (+776933us) spinlock_profiling.cc:243] Waited 75.5 ms on lock 0x7b5400404cd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:28.370852 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173576064}
I20260709 12:22:28.372730 18527 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:28.345685 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:28.400563 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:28.402380 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:28.402143 18606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40948 (request call id 1193) took 1874 ms (client timeout 1507 ms). Trace:
I20260709 12:22:28.405606 18644 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:28.397528 18530 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:28.328786 20016 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:28.364493 18599 raft_consensus.cc:1275] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:28.340049 19919 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:28.442404 20035 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:28.442718 19919 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:28.444101 18646 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.662s (SENT) [suppressed 29 similar messages]
I20260709 12:22:28.444900 19919 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:28.358141 19240 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
W20260709 12:22:28.446417 20169 log.cc:927] Time spent T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 12:22:28.447312 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 101752us
I20260709 12:22:28.450282 18675 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:28.452756 18677 raft_consensus.cc:2393] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 4: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:28.454618 20152 consensus_queue.cc:1059] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:28.456532 20152 consensus_queue.cc:1048] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:28.459542 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:28.414489 18602 raft_consensus.cc:1240] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:28.461194 18494 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:28.421787 18606 rpcz_store.cc:269] 0709 12:22:26.527501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.528211 (+   710us) service_pool.cc:224] Handling call
0709 12:22:28.401905 (+1873694us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b540010c054. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:28.402049 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3676758912}
I20260709 12:22:28.420746 18525 raft_consensus.cc:2393] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 2: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:28.422868 18530 raft_consensus.cc:1240] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:28.462898 18494 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:28.430142 18644 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:28.419320 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.434542 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:28.415251 20162 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:28.436949 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:28.380471 20146 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:28.441648 20016 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:28.464453 18527 raft_consensus.cc:2393] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 5: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:28.457901 20058 raft_consensus.cc:3055] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:28.502012 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.464387 18494 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:28.502892 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.503991 18525 raft_consensus.cc:2393] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 2: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:28.464581 18605 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:28.463615 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.425896 18678 raft_consensus.cc:1240] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:28.388974 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:28.480089 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:28.469228 19919 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:28.480962 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1202) took 1143 ms. Trace:
I20260709 12:22:28.481477 18529 raft_consensus.cc:1240] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:28.471067 20162 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.486261 18680 raft_consensus.cc:1275] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:28.487195 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:28.532891 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:28.533336 18602 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:28.489295 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.491022 19210 leader_election.cc:400] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 2. Current term is 3.
I20260709 12:22:28.535729 19210 leader_election.cc:403] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:28.491631 20153 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.493599 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
W20260709 12:22:28.496887 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.499836 18604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40954 (request call id 1261) took 1062 ms. Trace:
W20260709 12:22:28.541458 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.541328 18604 rpcz_store.cc:276] 0709 12:22:27.437321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.609341 (+172020us) service_pool.cc:224] Handling call
0709 12:22:28.499572 (+890231us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b5400123ed4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:28.499704 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705218432}
I20260709 12:22:28.509462 20035 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:28.505441 18530 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:28.344898 20022 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:28.455559 19991 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:28.426079 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:28.513453 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.470399 19929 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:28.469404 20032 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:28.470602 20106 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:28.520187 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:28.581130 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.522346 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:28.582296 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:28.525105 18526 rpcz_store.cc:276] 0709 12:22:27.337715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.359364 (+ 21649us) service_pool.cc:224] Handling call
0709 12:22:27.359719 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:27.756885 (+397166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.756931 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:27.784988 (+ 28057us) log.cc:844] Serialized 26 byte log entry
0709 12:22:27.895208 (+110220us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:27.895261 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.294280 (+399019us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b5400442ad4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:28.294333 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:28.480631 (+186298us) raft_consensus.cc:1685] finished
0709 12:22:28.480652 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.480891 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":595,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":27777,"spinlock_wait_cycles":912326912,"thread_start_us":59700,"threads_started":1,"wal-append.queue_time_us":292701}
I20260709 12:22:28.583886 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.584666 18526 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:28.585728 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.586390 18526 raft_consensus.cc:2376] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2. Re-sending same reply.
W20260709 12:22:28.540395 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 49719.8us
W20260709 12:22:28.500308 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.538291 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.589212 18525 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:28.590067 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:28.590583 18525 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:28.590291 19210 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:28.506821 20058 raft_consensus.cc:740] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:28.587361 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.542177 19985 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:28.514111 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:28.546234 20035 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.564478 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.613536 18525 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:28.614540 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.615176 18525 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:28.571964 20032 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:28.536196 20162 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:28.616165 20032 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:28.537052 18598 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 2.
I20260709 12:22:28.573585 18674 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:28.522380 20039 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:28.577499 20146 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:28.577306 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:28.597420 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:28.536415 19919 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:28.602974 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.650833 18605 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:28.549499 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.560149 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:22:28.652817 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.534415 20159 ts_tablet_manager.cc:1929] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:28.563802 19240 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:28.617465 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.617924 18602 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:28.619889 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:28.600914 20157 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:28.602031 18646 leader_election.cc:336] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 3.250s (SENT)
I20260709 12:22:28.663138 18646 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:28.653301 18527 raft_consensus.cc:2376] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3. Re-sending same reply.
I20260709 12:22:28.654626 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:28.608887 20098 log.cc:927] Time spent T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:22:28.659518 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:28.666231 18602 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:28.659037 18530 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:28.550956 20153 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:28.717527 20153 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:28.653369 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.618957 20035 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:28.669989 18527 raft_consensus.cc:1240] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:28.670854 18600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1196) took 1484 ms. Trace:
I20260709 12:22:28.675877 20159 log.cc:1199] T c3c52474787041b099fe01aa8c862c04 P 2f9872512f1646bc835906bd0e98c6a7: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-0-root/wals/c3c52474787041b099fe01aa8c862c04
I20260709 12:22:28.676504 18605 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:22:28.676853 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:28.731437 19985 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:28.732096 19985 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:28.732767 20159 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57364 (request call id 68) took 1601 ms. Trace:
I20260709 12:22:28.733227 20106 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:28.733675 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:28.733754 20106 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:28.734496 18605 raft_consensus.cc:2393] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 2: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:28.734548 19919 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:28.735132 19241 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:28.736327 18605 raft_consensus.cc:1275] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:28.736157 20026 consensus_queue.cc:1048] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:28.681605 20039 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:28.684391 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:28.661449 18671 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:28.748543 18525 raft_consensus.cc:2410] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:22:28.749431 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:28.749967 18525 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:28.688347 20017 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:28.690248 18672 raft_consensus.cc:1240] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:28.709024 18521 raft_consensus.cc:1275] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:28.754273 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:28.755930 19985 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:28.756856 19212 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:28.711090 20022 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:28.711295 18597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1204) took 1284 ms. Trace:
I20260709 12:22:28.711696 20058 consensus_queue.cc:260] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:28.713807 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:28.714675 18601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1205) took 1287 ms. Trace:
I20260709 12:22:28.726260 18600 rpcz_store.cc:276] 0709 12:22:27.186697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.066034 (+879337us) service_pool.cc:224] Handling call
0709 12:22:28.066493 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.066761 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:28.433241 (+366480us) log.cc:844] Serialized 14 byte log entry
0709 12:22:28.664043 (+230802us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:28.665773 (+  1730us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:28.670583 (+  4810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.670665 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.670796 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9231,"prepare.queue_time_us":369320,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":45330,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":33516,"thread_start_us":523516,"threads_started":2}
I20260709 12:22:28.732653 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:28.677970 18526 raft_consensus.cc:1240] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:28.759707 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:28.738610 18529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1137) took 1345 ms. Trace:
I20260709 12:22:28.760386 18527 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:28.760355 18529 rpcz_store.cc:276] 0709 12:22:27.392810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.149296 (+756486us) service_pool.cc:224] Handling call
0709 12:22:28.481305 (+332009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.533279 (+ 51974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.738449 (+205170us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b5400442ad0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:28.738554 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":762850688}
I20260709 12:22:28.740388 20106 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:28.733222 20159 rpcz_store.cc:276] 0709 12:22:27.131680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.131889 (+   209us) service_pool.cc:224] Handling call
0709 12:22:27.809815 (+677926us) ts_tablet_manager.cc:1151] Deleting tablet c3c52474787041b099fe01aa8c862c04
0709 12:22:27.809917 (+   102us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:22:28.257084 (+447167us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:28.514391 (+257307us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:28.732675 (+218284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":195598,"tablet-delete.queue_time_us":623055,"thread_start_us":275829,"threads_started":1}
I20260709 12:22:28.736276 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:28.759225 18601 rpcz_store.cc:276] 0709 12:22:27.426990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.323642 (+896652us) service_pool.cc:224] Handling call
0709 12:22:28.324296 (+   654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:28.368892 (+ 44596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.368921 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:28.385414 (+ 16493us) log.cc:844] Serialized 26 byte log entry
0709 12:22:28.538067 (+152653us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:28.538133 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.538249 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:28.714466 (+176217us) raft_consensus.cc:1685] finished
0709 12:22:28.714485 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.714618 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44178,"raft.queue_time_us":58498,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":16137,"thread_start_us":152187,"threads_started":1,"wal-append.queue_time_us":327338}
W20260709 12:22:28.774507 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 172497us
I20260709 12:22:28.775246 18525 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4.
I20260709 12:22:28.789240 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:28.832077 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.790666 18603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1197) took 1603 ms. Trace:
W20260709 12:22:28.811594 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.829254 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:28.836608 18529 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:28.822310 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 357992us
W20260709 12:22:28.833159 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:28.796638 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.832580 18602 raft_consensus.cc:2393] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 2: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:28.838176 18494 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:28.843294 18526 raft_consensus.cc:1240] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:28.843618 18527 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:22:28.772580 20153 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:28.834666 18603 rpcz_store.cc:276] 0709 12:22:27.186930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.076685 (+889755us) service_pool.cc:224] Handling call
0709 12:22:28.105674 (+ 28989us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.105890 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:28.469815 (+363925us) log.cc:844] Serialized 14 byte log entry
0709 12:22:28.788598 (+318783us) log.cc:844] Serialized 14 byte log entry
0709 12:22:28.790242 (+  1644us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:28.790303 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:28.790360 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.790447 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.790597 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":331177,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":68,"raft.queue_time_us":1235,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":9542,"spinlock_wait_cycles":82976000,"thread_start_us":665397,"threads_started":2}
I20260709 12:22:28.869473 18494 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:28.871253 18494 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:28.920312 18525 raft_consensus.cc:1240] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:28.921357 18529 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:22:28.845229 20058 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:28.907819 20126 log.cc:927] Time spent T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:22:28.783625 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:28.935001 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 354215us
W20260709 12:22:28.937108 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.946879 18413 catalog_manager.cc:5028] TS 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): tablet c3c52474787041b099fe01aa8c862c04 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
W20260709 12:22:28.947674 18413 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 104987us
I20260709 12:22:28.948001 19212 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:28.949003 19212 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:28.949368 20026 raft_consensus.cc:2804] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:28.946985 19929 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:28.952188 18572 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:28.919337 20106 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:28.966543 18572 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:28.970726 18572 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:28.985263 19768 raft_consensus.cc:2764] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:22:28.995570 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.949892 19212 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:28.937726 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 93) took 1136 ms. Trace:
I20260709 12:22:28.969936 20171 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:28.962867 20153 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:22:29.009613 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.018059 20153 raft_consensus.cc:697] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:29.019382 20153 consensus_queue.cc:237] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:29.003027 18523 rpcz_store.cc:276] 0709 12:22:27.798635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.258771 (+460136us) service_pool.cc:224] Handling call
0709 12:22:28.259233 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.259447 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:28.548104 (+288657us) log.cc:844] Serialized 14 byte log entry
0709 12:22:28.839077 (+290973us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:28.842693 (+  3616us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:28.907929 (+ 65236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.921857 (+ 13928us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.935251 (+ 13394us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45440,"prepare.queue_time_us":360957,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":3447,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":16754,"thread_start_us":493457,"threads_started":2}
W20260709 12:22:29.014125 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 64294us
I20260709 12:22:29.024602 20145 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:29.039883 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.040565 20016 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:29.008507 19768 raft_consensus.cc:2764] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:22:29.056835 20157 raft_consensus.cc:2804] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:29.061883 20162 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:29.068676 18680 raft_consensus.cc:1240] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
W20260709 12:22:29.075632 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.077180 18644 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:29.078919 18644 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:29.080981 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 65588.1us
I20260709 12:22:29.082628 18572 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:29.083638 18644 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:29.084353 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:29.087852 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:29.089520 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:29.093145 18524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.007s	sys 0.034s
W20260709 12:22:29.093175 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:29.093628 18524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.007s	sys 0.034s
I20260709 12:22:29.008080 20171 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:29.104662 18570 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:29.103730 18524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 99) took 1300 ms. Trace:
W20260709 12:22:29.123185 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.092149 19681 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:29.112131 18524 rpcz_store.cc:276] 0709 12:22:27.803272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.273930 (+470658us) service_pool.cc:224] Handling call
0709 12:22:28.274198 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.274487 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:28.516131 (+241644us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.102740 (+586609us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.102962 (+   222us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:29.103236 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.103322 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.103671 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52550,"prepare.queue_time_us":384343,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":94,"thread_start_us":827490,"threads_started":2}
I20260709 12:22:29.094079 20022 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:22:29.134099 18646 leader_election.cc:336] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.650s (SENT)
W20260709 12:22:29.141340 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 270205us
I20260709 12:22:29.165827 18494 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:29.106163 20023 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:29.099905 19768 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:29.107169 20171 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:29.133294 20096 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:29.180910 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 66553us
I20260709 12:22:29.109403 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:29.139739 19681 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:29.093720 19991 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:22:29.179345 20023 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.200110 20023 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:29.201789 18599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1198) took 2014 ms. Trace:
I20260709 12:22:28.772763 18597 rpcz_store.cc:276] 0709 12:22:27.426673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.247775 (+821102us) service_pool.cc:224] Handling call
0709 12:22:28.248284 (+   509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:28.248760 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.248819 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:28.249512 (+   693us) log.cc:844] Serialized 26 byte log entry
0709 12:22:28.431229 (+181717us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:28.490000 (+ 58771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.490104 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:28.709862 (+219758us) spinlock_profiling.cc:243] Waited 6.55 ms on lock 0x7b5400212120. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c454dbe 00007efc7c45f930 00007efc7c45f8d8 00007efc7c45f858 00007efc7c45f813 00007efc7c45ea9c 00007efc8234a2f6 00007efc82344aa8 00007efc7c49b7cb 00007efc7c49e2c0
0709 12:22:28.710862 (+  1000us) raft_consensus.cc:1685] finished
0709 12:22:28.710900 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.711207 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11820,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":134,"spinlock_wait_cycles":15064320,"thread_start_us":157982,"threads_started":1,"wal-append.queue_time_us":173264}
I20260709 12:22:29.183461 20022 raft_consensus.cc:697] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:22:29.135002 20032 consensus_meta.cc:287] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.000s
I20260709 12:22:29.176752 20149 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:29.183480 18530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 102) took 1151 ms. Trace:
I20260709 12:22:29.246379 18530 rpcz_store.cc:276] 0709 12:22:28.032062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.667222 (+635160us) service_pool.cc:224] Handling call
0709 12:22:28.667582 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.667860 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:28.745203 (+ 77343us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.183110 (+437907us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.183173 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:29.183216 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.183280 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.183423 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45455,"prepare.queue_time_us":87805,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":46214,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":4426,"thread_start_us":391938,"threads_started":1}
W20260709 12:22:29.233270 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.193444 20096 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.185418 18494 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:29.190016 20199 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:22:29.255369 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 70042.1us
I20260709 12:22:29.260668 19985 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:29.190841 18572 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:29.198282 19681 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:29.279299 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 88566.4us
I20260709 12:22:29.280712 18572 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:29.285935 20160 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:29.286458 20160 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:29.286845 20160 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:29.252561 19240 consensus_meta.cc:287] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.000s
I20260709 12:22:29.246186 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:29.301935 18572 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:29.240026 20017 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:29.189939 19768 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:29.270793 18671 consensus_meta.cc:287] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.002s
I20260709 12:22:29.087666 19929 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:29.270984 20096 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:29.254001 20149 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
W20260709 12:22:29.314193 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 49320.6us
I20260709 12:22:29.234440 20146 consensus_queue.cc:1048] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:22:29.308895 20145 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:29.202296 18599 rpcz_store.cc:276] 0709 12:22:27.187168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.147090 (+959922us) service_pool.cc:224] Handling call
0709 12:22:28.147431 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.432749 (+285318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.201490 (+768741us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b540041d554. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:29.201707 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53108992}
I20260709 12:22:29.254292 20032 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:29.332607 19929 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:29.312225 20017 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:29.318732 20149 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:29.310412 18671 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4.
I20260709 12:22:29.308945 20168 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:29.302158 19240 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:29.333482 20181 consensus_queue.cc:1059] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:22:29.333457 20018 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:29.349349 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 153003us
I20260709 12:22:29.334705 20145 raft_consensus.cc:697] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:29.335412 20022 consensus_queue.cc:237] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:29.379201 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:29.380883 20035 consensus_meta.cc:287] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.001s
W20260709 12:22:29.365341 20196 log.cc:927] Time spent T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.112s	user 0.001s	sys 0.001s
I20260709 12:22:29.381685 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:29.319813 18494 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:29.374800 20171 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:29.418993 18528 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.007s	sys 0.010s
W20260709 12:22:29.419979 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:29.454973 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.454979 18570 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:29.418633 18674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.011s	sys 0.006s
I20260709 12:22:29.402953 20021 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 2. Current term is 3.
I20260709 12:22:29.411465 20026 raft_consensus.cc:697] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 4 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
W20260709 12:22:29.493045 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:29.484663 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 165020us
I20260709 12:22:29.531198 18494 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:29.516657 18528 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.015s	sys 0.010s
I20260709 12:22:29.420059 20046 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:29.525694 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 70922.9us
I20260709 12:22:29.394358 19929 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:29.563408 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.417063 20018 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:29.525112 18674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.014s	sys 0.006s
W20260709 12:22:29.553349 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.524492 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:29.568583 18495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.030s	sys 0.076s
I20260709 12:22:29.574260 18494 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:29.568194 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.485349 20015 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:29.591953 18526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.023s	sys 0.028s
W20260709 12:22:29.561053 18646 leader_election.cc:336] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.799s (SENT)
I20260709 12:22:29.525976 20056 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.592764 18646 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:22:29.579998 18677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.005s	sys 0.047s
I20260709 12:22:29.456779 20035 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:29.529110 20168 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:29.569898 20146 raft_consensus.cc:3055] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:29.500712 20214 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:22:29.589601 18495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.030s	sys 0.076s
I20260709 12:22:29.595440 18494 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:29.597077 18494 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:29.597877 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:29.592375 18526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.023s	sys 0.028s
W20260709 12:22:29.593580 18677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.005s	sys 0.048s
I20260709 12:22:29.588881 18570 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:29.594899 18527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.017s	sys 0.010s
I20260709 12:22:29.586153 19985 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:29.598526 18494 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:29.600740 18527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.017s	sys 0.010s
W20260709 12:22:29.655494 18529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.000s	sys 0.029s
W20260709 12:22:29.658138 18529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.000s	sys 0.030s
W20260709 12:22:29.603298 18678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.012s	sys 0.041s
I20260709 12:22:29.594122 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:29.623557 20153 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.004s	sys 0.025s
I20260709 12:22:29.594648 20032 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:29.595726 20197 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:29.597798 20199 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:29.595943 20146 raft_consensus.cc:740] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:29.588114 20016 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:22:29.621546 19970 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:29.635797 20162 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:29.602653 20015 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:29.637064 18522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 98) took 1827 ms. Trace:
I20260709 12:22:29.596005 20056 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:29.682380 18525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.023s	sys 0.027s
I20260709 12:22:29.587644 20145 consensus_queue.cc:237] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:29.635059 19212 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.000s	sys 0.029s
W20260709 12:22:29.679404 20198 log.cc:927] Time spent T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.431s	user 0.006s	sys 0.001s
I20260709 12:22:29.637837 20168 consensus_queue.cc:1059] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:22:29.594751 20046 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:29.673722 20170 consensus_queue.cc:1059] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 12:22:29.695569 18678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.012s	sys 0.041s
W20260709 12:22:29.721913 20207 log.cc:927] Time spent T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
W20260709 12:22:29.696064 20153 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.004s	sys 0.025s
W20260709 12:22:29.722404 19212 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.000s	sys 0.029s
W20260709 12:22:29.701611 18644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.010s	sys 0.013s
W20260709 12:22:29.742606 18644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.010s	sys 0.013s
W20260709 12:22:29.696123 18675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.023s	sys 0.021s
W20260709 12:22:29.715891 18525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.023s	sys 0.027s
W20260709 12:22:29.743144 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 635847us
I20260709 12:22:29.698161 19768 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:29.669045 20026 consensus_queue.cc:237] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:29.722571 20211 log.cc:927] Time spent T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
W20260709 12:22:29.727080 20210 log.cc:927] Time spent T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:22:29.702888 18599 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 2.
W20260709 12:22:29.684764 20157 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.015s	sys 0.009s
W20260709 12:22:29.853397 20160 consensus_meta.cc:287] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.004s
W20260709 12:22:29.853538 20157 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.015s	sys 0.009s
I20260709 12:22:29.798542 20170 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:29.853863 20160 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:29.854388 20157 raft_consensus.cc:697] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:29.854627 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1116) took 1420 ms. Trace:
I20260709 12:22:29.742880 18677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1119) took 1308 ms. Trace:
I20260709 12:22:29.856061 18677 rpcz_store.cc:276] 0709 12:22:28.434501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.936699 (+502198us) service_pool.cc:224] Handling call
0709 12:22:28.953370 (+ 16671us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:28.953741 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.953767 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:28.967993 (+ 14226us) log.cc:844] Serialized 52 byte log entry
0709 12:22:29.613785 (+645792us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:29.659264 (+ 45479us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.659737 (+   473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.659921 (+   184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.705613 (+ 45692us) spinlock_profiling.cc:243] Waited 6.44 ms on lock 0x7b18003cade0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793f23f3 00007efc793f47c1 00007efc793f4779 00007efc793f4709 00007efc793f46d1 00007efc793f39cd 0000000000388634 0000000000388479 00007efc793d583a
0709 12:22:29.728803 (+ 23190us) raft_consensus.cc:1685] finished
0709 12:22:29.742547 (+ 13744us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.742796 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":48465,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2589,"raft.queue_time_us":14786,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":37021,"spinlock_wait_cycles":14818688,"thread_start_us":599025,"threads_started":1,"wal-append.queue_time_us":719155}
W20260709 12:22:29.858734 20058 consensus_meta.cc:287] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.921s	user 0.012s	sys 0.000s
W20260709 12:22:29.831281 18521 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.006s	sys 0.014s
I20260709 12:22:29.733037 18673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1110) took 1393 ms. Trace:
I20260709 12:22:29.842337 19929 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:29.869364 19929 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:29.869944 19929 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:29.868296 18673 rpcz_store.cc:276] 0709 12:22:28.337630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.476831 (+139201us) service_pool.cc:224] Handling call
0709 12:22:28.477297 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:28.810039 (+332742us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.826299 (+ 16260us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:28.946077 (+119778us) log.cc:844] Serialized 26 byte log entry
0709 12:22:29.382654 (+436577us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:29.391208 (+  8554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.393315 (+  2107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.727531 (+334216us) raft_consensus.cc:1685] finished
0709 12:22:29.727560 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.730739 (+  3179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":703,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"thread_start_us":723947,"threads_started":2,"wal-append.queue_time_us":740564}
I20260709 12:22:29.870333 19929 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:29.824767 18646 leader_election.cc:336] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.507s (SENT)
W20260709 12:22:29.834406 19991 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.003s	sys 0.012s
W20260709 12:22:29.813405 18572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.009s	sys 0.007s
W20260709 12:22:29.872354 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 47637.8us
W20260709 12:22:29.872722 18572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.009s	sys 0.007s
W20260709 12:22:29.873020 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 567171us
W20260709 12:22:29.873080 18646 leader_election.cc:336] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.802s (SENT)
I20260709 12:22:29.873478 18646 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:22:29.871376 18521 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.006s	sys 0.015s
I20260709 12:22:29.875967 20230 raft_consensus.cc:2749] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:29.875955 20170 consensus_queue.cc:1048] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:29.877596 20226 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:29.877592 18604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1223) took 1274 ms. Trace:
W20260709 12:22:29.746789 20063 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.007s	sys 0.011s
W20260709 12:22:29.778079 18675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.023s	sys 0.022s
W20260709 12:22:29.754082 20023 consensus_meta.cc:287] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.006s
I20260709 12:22:29.859189 20016 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.860880 20015 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:29.854988 18676 rpcz_store.cc:276] 0709 12:22:28.433775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.758600 (+324825us) service_pool.cc:224] Handling call
0709 12:22:28.758906 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:28.823054 (+ 64148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.823100 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:28.856294 (+ 33194us) log.cc:844] Serialized 26 byte log entry
0709 12:22:29.070403 (+214109us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b480018c258. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc81408aa1 00007efc813ffb37 00007efc813ff9ca 00007efc814f726f 00007efc814f6f37 00007efc8150b55c 00007efc8150b508 00007efc8150b488 00007efc8150b443 00007efc8150a6ec 00007efc80434a96
0709 12:22:29.454911 (+384508us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:29.454965 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.455037 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.854148 (+399111us) raft_consensus.cc:1685] finished
0709 12:22:29.854171 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.854563 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29370,"raft.queue_time_us":70760,"raft.run_cpu_time_us":1143,"raft.run_wall_time_us":238968,"spinlock_wait_cycles":5772672,"thread_start_us":469445,"threads_started":1,"wal-append.queue_time_us":804490}
I20260709 12:22:29.744284 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:29.747256 19210 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.011s	sys 0.010s
W20260709 12:22:29.861977 20096 consensus_meta.cc:287] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.004s
I20260709 12:22:29.878328 18604 rpcz_store.cc:276] 0709 12:22:28.603568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.737205 (+133637us) service_pool.cc:224] Handling call
0709 12:22:28.737467 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:28.737638 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.737665 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:28.738024 (+   359us) log.cc:844] Serialized 26 byte log entry
0709 12:22:29.108983 (+370959us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:29.109053 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.109135 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.877376 (+768241us) raft_consensus.cc:1685] finished
0709 12:22:29.877401 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.877533 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":370348,"threads_started":1,"wal-append.queue_time_us":717037}
I20260709 12:22:29.889720 20170 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.890235 19991 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.890425 20171 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:29.890646 19768 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:29.896396 20212 log.cc:927] Time spent T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.327s	user 0.002s	sys 0.000s
I20260709 12:22:29.847608 20213 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.878346 20226 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:29.908538 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.750404 20222 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:22:29.939107 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 340670us
I20260709 12:22:29.848701 20018 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:29.904337 20035 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:29.876765 20221 log.cc:927] Time spent T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:22:29.730896 20218 consensus_queue.cc:1048] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.132s
W20260709 12:22:29.910965 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 322331us
W20260709 12:22:29.913149 19210 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.014s	sys 0.012s
W20260709 12:22:29.913234 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 169056us
I20260709 12:22:29.913347 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1109) took 1576 ms. Trace:
I20260709 12:22:29.952556 18570 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:29.918355 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1115) took 1502 ms. Trace:
I20260709 12:22:29.917305 19970 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:29.918354 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 96) took 1374 ms. Trace:
I20260709 12:22:29.957474 18676 rpcz_store.cc:276] 0709 12:22:28.543740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.917348 (+1373608us) service_pool.cc:224] Handling call
0709 12:22:29.917698 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.917927 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:29.917967 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.918025 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:29.918068 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.918137 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.918283 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:29.905918 19681 consensus_meta.cc:287] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.001s
W20260709 12:22:29.929806 18680 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.858s	user 0.018s	sys 0.033s
W20260709 12:22:29.961506 18680 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.018s	sys 0.033s
W20260709 12:22:29.910696 20063 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.008s	sys 0.012s
I20260709 12:22:29.934954 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:29.919263 19991 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:29.900544 20056 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:29.937966 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:30.010022 18524 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:30.011433 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:30.011868 18528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 90) took 2662 ms. Trace:
I20260709 12:22:29.855403 20157 consensus_queue.cc:237] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:29.933705 20162 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:30.013091 18572 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:29.919942 20016 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:29.788547 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 765134us
I20260709 12:22:29.953037 18679 rpcz_store.cc:276] 0709 12:22:28.337321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.716672 (+379351us) service_pool.cc:224] Handling call
0709 12:22:28.717085 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:28.717466 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.717493 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:28.718039 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 12:22:29.109915 (+391876us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:29.109974 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.110063 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.913044 (+802981us) raft_consensus.cc:1685] finished
0709 12:22:29.913073 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.913269 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10004,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":111,"thread_start_us":380063,"threads_started":1,"wal-append.queue_time_us":672489}
I20260709 12:22:29.920614 20096 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:29.952994 18527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1219) took 1541 ms. Trace:
I20260709 12:22:29.959359 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 97) took 1408 ms. Trace:
I20260709 12:22:30.026350 18676 rpcz_store.cc:276] 0709 12:22:28.550489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.958509 (+1408020us) service_pool.cc:224] Handling call
0709 12:22:29.958836 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.959014 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:29.959040 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.959081 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:29.959107 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.959161 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.959296 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:29.964015 20236 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.964166 19681 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:29.907455 20231 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:29.909677 20146 consensus_queue.cc:260] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:29.991788 18570 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:29.941391 20015 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.992969 20018 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.993381 20171 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:29.824733 20168 raft_consensus.cc:3055] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:29.948222 20181 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.045301 20168 raft_consensus.cc:740] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:30.045526 20181 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.046481 20168 consensus_queue.cc:260] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:29.950110 18494 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:30.048190 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 98175.1us
I20260709 12:22:30.047827 20018 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.048861 18494 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:30.049183 20016 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:29.935604 20205 log.cc:927] Time spent T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.274s	user 0.001s	sys 0.001s
W20260709 12:22:30.015686 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:30.052284 18646 leader_election.cc:336] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.077s (SENT)
I20260709 12:22:29.914827 20023 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.053273 18672 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
W20260709 12:22:29.955658 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 881836us
I20260709 12:22:30.054325 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1111) took 1716 ms. Trace:
I20260709 12:22:29.952631 20222 raft_consensus.cc:697] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:29.952265 20160 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:29.929484 20170 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.054728 18674 rpcz_store.cc:276] 0709 12:22:28.337922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.722351 (+384429us) service_pool.cc:224] Handling call
0709 12:22:28.742494 (+ 20143us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:28.756648 (+ 14154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.756688 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:28.757262 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 12:22:29.595292 (+838030us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:29.597206 (+  1914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.621621 (+ 24415us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:30.054099 (+432478us) raft_consensus.cc:1685] finished
0709 12:22:30.054128 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:30.054261 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14128,"raft.queue_time_us":14926,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":16708,"thread_start_us":820567,"threads_started":1,"wal-append.queue_time_us":957303}
I20260709 12:22:30.055922 19991 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:30.057612 20170 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:29.941756 20213 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.028395 18527 rpcz_store.cc:276] 0709 12:22:28.411357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.844602 (+433245us) service_pool.cc:224] Handling call
0709 12:22:28.844994 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.845175 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:28.931930 (+ 86755us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.952634 (+1020704us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.952690 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:29.952739 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.952805 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.952921 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":86768,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":364453,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":138,"thread_start_us":1019079,"threads_started":2,"wal-append.queue_time_us":801015}
I20260709 12:22:29.939441 19768 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:29.991978 18530 raft_consensus.cc:2393] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 3: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:22:30.062747 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:30.063400 18530 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.009320 20199 raft_consensus.cc:697] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:30.035133 20063 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:22:30.039117 20015 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:29.941474 19985 raft_consensus.cc:697] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:30.015076 20238 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:30.022398 18528 rpcz_store.cc:276] 0709 12:22:27.349538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.141588 (+792050us) service_pool.cc:224] Handling call
0709 12:22:28.142008 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.142269 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:28.505474 (+363205us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.554135 (+1048661us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:22:30.011288 (+457153us) log.cc:844] Serialized 14 byte log entry
0709 12:22:30.011492 (+   204us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:30.011550 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:30.011593 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.011665 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:30.011810 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":244,"prepare.queue_time_us":458068,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":3177,"raft.queue_time_us":155205,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":58,"spinlock_wait_cycles":58964864,"thread_start_us":1833810,"threads_started":4,"wal-append.queue_time_us":678556}
I20260709 12:22:30.023512 20162 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.044091 20146 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:30.044847 20171 raft_consensus.cc:2804] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:30.032001 20212 log.cc:927] Time spent T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:22:30.071780 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:30.044152 20215 log.cc:927] Time spent T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:22:30.042191 20231 raft_consensus.cc:697] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:30.084208 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:30.049736 20016 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:30.092603 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:30.093468 18528 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:30.086658 18527 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:30.096477 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:30.065761 20181 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:30.078871 20168 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:30.104375 18529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1224) took 1588 ms. Trace:
I20260709 12:22:30.121557 18530 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
W20260709 12:22:30.126868 18646 leader_election.cc:336] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.662s (SENT)
I20260709 12:22:30.130424 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:30.130771 18646 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:30.131219 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:29.715207 18522 rpcz_store.cc:276] 0709 12:22:27.800175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.270807 (+470632us) service_pool.cc:224] Handling call
0709 12:22:28.271092 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:28.271449 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.271478 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:28.296753 (+ 25275us) log.cc:844] Serialized 26 byte log entry
0709 12:22:28.457958 (+161205us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b18002d40c0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793d4e07 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793f1c02 00007efc7c07920b 00007efc7c07ed23 00007efc7c07f0d1 00007efc7c49aa0f
0709 12:22:28.943226 (+485268us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:28.946758 (+  3532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.946852 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.588336 (+641484us) raft_consensus.cc:1685] finished
0709 12:22:29.591811 (+  3475us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.627105 (+ 35294us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3998,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":16352,"spinlock_wait_cycles":65187712,"thread_start_us":465172,"threads_started":1,"wal-append.queue_time_us":879271}
I20260709 12:22:30.131860 18530 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:30.131249 18527 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:30.033500 20236 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.085945 20171 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:30.090755 20046 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:30.133672 20229 log.cc:927] Time spent T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 12:22:30.139232 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.098613 20235 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.139856 20214 raft_consensus.cc:697] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:30.158114 20214 consensus_queue.cc:237] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.158841 20162 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:30.136943 20224 log.cc:927] Time spent T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
W20260709 12:22:30.143040 20149 consensus_meta.cc:287] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.740s	user 0.006s	sys 0.006s
I20260709 12:22:30.089555 20234 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:30.098666 20016 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.142732 20171 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.136081 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:30.192081 18527 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:30.101116 20106 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:30.148840 18605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39798 (request call id 78) took 1883 ms. Trace:
I20260709 12:22:30.195726 18605 rpcz_store.cc:276] 0709 12:22:28.265554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.737013 (+471459us) service_pool.cc:224] Handling call
0709 12:22:28.737273 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:28.737576 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.737604 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:28.738024 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 12:22:29.143080 (+405056us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:29.186792 (+ 43712us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.226660 (+ 39868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.226767 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.350633 (+123866us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b1800333b80. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793f23f3 00007efc793f47c1 00007efc793f4779 00007efc793f4709 00007efc793f46d1 00007efc793f39cd 0000000000388634 0000000000388479 00007efc793d583a
0709 12:22:29.730811 (+380178us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:22:30.148528 (+417717us) raft_consensus.cc:1685] finished
0709 12:22:30.148550 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:30.148709 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39537,"prepare.queue_time_us":30645,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":55043,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":219,"spinlock_wait_cycles":37340928,"thread_start_us":404668,"threads_started":1,"wal-append.queue_time_us":678237}
I20260709 12:22:30.173676 18528 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:30.175942 20231 consensus_queue.cc:237] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.199738 20250 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:30.200341 20250 raft_consensus.cc:697] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:30.200742 19929 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:30.201238 20250 consensus_queue.cc:237] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:30.177892 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.202960 19929 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:30.180452 19768 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:30.170426 20199 consensus_queue.cc:237] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.204051 20242 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:30.204671 20242 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:30.183364 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1220) took 1754 ms. Trace:
I20260709 12:22:30.206987 20242 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:30.207044 18526 rpcz_store.cc:276] 0709 12:22:28.429283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.919638 (+490355us) service_pool.cc:224] Handling call
0709 12:22:28.937962 (+ 18324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:28.938381 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.938420 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:28.938975 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 12:22:29.600390 (+661415us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:29.601178 (+   788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.601253 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:30.183138 (+581885us) raft_consensus.cc:1685] finished
0709 12:22:30.183167 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:30.183302 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126333,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"thread_start_us":601390,"threads_started":1,"wal-append.queue_time_us":765195}
I20260709 12:22:30.213406 18675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1113) took 1843 ms. Trace:
I20260709 12:22:30.203547 19929 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:30.135859 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:30.189775 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.215837 18530 raft_consensus.cc:1813] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Handling vote request from an unknown peer c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:30.160331 20018 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:30.183943 18525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1228) took 1637 ms. Trace:
I20260709 12:22:30.217666 18525 rpcz_store.cc:276] 0709 12:22:28.546600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.940585 (+393985us) service_pool.cc:224] Handling call
0709 12:22:28.964655 (+ 24070us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:29.743457 (+778802us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:29.743488 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:29.743976 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 12:22:30.095497 (+351521us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:30.095546 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.095628 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:30.183707 (+ 88079us) raft_consensus.cc:1685] finished
0709 12:22:30.183726 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:30.183879 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100081,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":60,"thread_start_us":1009366,"threads_started":2,"wal-append.queue_time_us":354575}
W20260709 12:22:30.221393 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.216712 18530 raft_consensus.cc:2393] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 2: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:22:30.062165 20222 consensus_queue.cc:237] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.172482 20226 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:30.085767 20238 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:30.245258 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:30.245908 18525 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:30.246794 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:30.190207 20016 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:30.234316 18572 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:30.236275 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 244607us
W20260709 12:22:30.221545 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 190676us
I20260709 12:22:30.251813 19210 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:30.143663 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 93) took 1608 ms. Trace:
I20260709 12:22:30.258467 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:30.255204 18680 rpcz_store.cc:276] 0709 12:22:28.535107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.070493 (+535386us) service_pool.cc:224] Handling call
0709 12:22:29.070968 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.071269 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:29.961962 (+890693us) log.cc:844] Serialized 14 byte log entry
0709 12:22:30.139835 (+177873us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:30.139890 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:30.139939 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.140005 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:30.142386 (+  2381us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4468,"prepare.queue_time_us":457509,"prepare.run_cpu_time_us":256,"prepare.run_wall_time_us":1125,"raft.queue_time_us":1667,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":20042,"thread_start_us":1067752,"threads_started":2}
I20260709 12:22:30.260778 18606 raft_consensus.cc:1240] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:30.220158 20219 log.cc:927] Time spent T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 12:22:30.261389 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:30.267712 18572 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:30.268251 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:30.268432 18570 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:30.241539 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 192589us
I20260709 12:22:30.268745 18601 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:30.269366 18494 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:30.219738 20032 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:30.259614 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.283929 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:30.271473 18494 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:30.263648 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:30.284765 18604 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:30.265982 18680 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:30.286899 18494 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:30.287187 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:30.274765 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1124) took 1178 ms. Trace:
I20260709 12:22:30.214869 19929 raft_consensus.cc:697] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:30.291610 20241 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:30.302222 18572 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:30.309032 18494 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:30.310819 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:30.235373 20046 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:30.243806 20162 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.311892 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:30.320129 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:30.320760 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.321971 18680 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:30.324035 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:30.270417 20226 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:30.271284 20056 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:30.338385 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:30.262019 20026 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:30.327193 18494 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:30.288246 19768 raft_consensus.cc:2804] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:30.218429 20106 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.194126 20149 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.165856 20235 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.296314 19991 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.195962 19985 consensus_queue.cc:237] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:30.327061 20251 log.cc:927] Time spent T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:22:30.371454 18604 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:30.334352 20242 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:30.297500 20246 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:30.319142 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:30.334235 20226 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.314311 20248 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:30.317422 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:30.355234 19768 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.215539 20234 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:30.324333 20096 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:30.314064 20032 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:30.397534 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 136849us
W20260709 12:22:30.414429 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.371479 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:30.360950 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:30.443897 18605 raft_consensus.cc:2393] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:30.327437 20253 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:30.444980 18646 leader_election.cc:336] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.631s (SENT)
I20260709 12:22:30.214012 18675 rpcz_store.cc:276] 0709 12:22:28.369631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.025816 (+656185us) service_pool.cc:224] Handling call
0709 12:22:29.026325 (+   509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:29.026797 (+   472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:29.026842 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:29.027456 (+   614us) log.cc:844] Serialized 26 byte log entry
0709 12:22:29.351971 (+324515us) spinlock_profiling.cc:243] Waited 57.1 ms on lock 0x7b18003ca720. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793f23f3 00007efc793f47c1 00007efc793f4779 00007efc793f4709 00007efc793f46d1 00007efc793f39cd 0000000000388634 0000000000388479 00007efc793d583a
0709 12:22:29.935822 (+583851us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:29.940674 (+  4852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.950754 (+ 10080us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:30.213094 (+262340us) raft_consensus.cc:1685] finished
0709 12:22:30.213112 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:30.213336 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2443,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":6509,"spinlock_wait_cycles":131371904,"thread_start_us":836203,"threads_started":1,"wal-append.queue_time_us":909734}
I20260709 12:22:30.445937 18599 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:30.325801 20162 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.390506 18494 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:30.325901 20046 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:29.957263 18678 rpcz_store.cc:276] 0709 12:22:28.416025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.744586 (+328561us) service_pool.cc:224] Handling call
0709 12:22:28.746671 (+  2085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:28.823684 (+ 77013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.830027 (+  6343us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:28.951248 (+121221us) log.cc:844] Serialized 26 byte log entry
0709 12:22:29.743279 (+792031us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:29.917198 (+173919us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.917867 (+   669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.917997 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.918058 (+    61us) raft_consensus.cc:1685] finished
0709 12:22:29.918082 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.918270 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31871,"prepare.queue_time_us":86173,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":68711,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":11429,"thread_start_us":739576,"threads_started":1,"wal-append.queue_time_us":869437}
I20260709 12:22:30.455412 20199 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:30.445333 20226 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:30.469036 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 178335us
I20260709 12:22:30.441668 20015 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:30.458722 19768 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.467554 18646 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:30.397243 19991 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.380604 20026 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:30.479038 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 88628.1us
I20260709 12:22:30.502385 18494 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:30.462811 20246 raft_consensus.cc:697] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:30.462375 20213 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:30.465227 20248 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:30.495972 18680 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:30.299466 18674 rpcz_store.cc:276] 0709 12:22:29.095877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.056514 (+960637us) service_pool.cc:224] Handling call
0709 12:22:30.056873 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:30.135562 (+ 78689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:30.136825 (+  1263us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:30.140648 (+  3823us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:30.143243 (+  2595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.274350 (+131107us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b5400357fd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:30.274413 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:30.274588 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95476480}
I20260709 12:22:30.470916 18597 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:30.519167 20273 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:30.520031 20231 raft_consensus.cc:2804] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:30.520857 20231 raft_consensus.cc:697] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:30.530795 20261 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:30.530907 20231 consensus_queue.cc:237] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.531515 20261 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:30.534379 20261 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:22:30.515223 20245 log.cc:927] Time spent T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
I20260709 12:22:30.504753 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:30.538153 20058 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:30.538830 20255 log.cc:927] Time spent T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:22:30.513389 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:30.548352 20249 log.cc:927] Time spent T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 12:22:30.484835 19929 consensus_queue.cc:237] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.529632 20015 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:30.516261 20236 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:30.577462 20262 log.cc:927] Time spent T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 12:22:30.578845 20259 log.cc:927] Time spent T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:22:30.577543 19991 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:30.561488 18675 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:30.567303 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:30.584744 20234 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:30.570992 18678 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:30.516508 20248 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:30.609364 20269 log.cc:927] Time spent T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:22:30.571269 20232 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:30.574098 20015 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:30.578894 19243 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33388 (request call id 261) took 1512 ms (client timeout 1550 ms). Trace:
I20260709 12:22:30.561678 20058 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:30.608724 20257 log.cc:927] Time spent T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:22:30.599151 20236 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:30.624742 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 122448us
I20260709 12:22:30.628631 18494 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:30.630609 20032 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:30.612681 20162 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:30.613099 20149 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:30.617439 18674 raft_consensus.cc:1813] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Handling vote request from an unknown peer c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:30.645893 18494 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:30.648371 18494 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:30.652151 20253 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:30.652804 20253 raft_consensus.cc:697] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:30.653862 20253 consensus_queue.cc:237] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.655943 20261 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:30.656492 20261 raft_consensus.cc:697] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:30.657168 20058 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:30.657415 20261 consensus_queue.cc:237] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.664182 18494 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:30.674714 20250 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:30.677731 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:30.678859 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:30.684216 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:30.688246 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:30.627066 20015 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:30.675509 20250 raft_consensus.cc:697] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:30.637646 20213 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:30.643451 20199 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:30.628873 20232 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:30.734681 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 99) took 2132 ms. Trace:
I20260709 12:22:30.735077 18679 rpcz_store.cc:276] 0709 12:22:28.601860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.022850 (+1420990us) service_pool.cc:224] Handling call
0709 12:22:30.023208 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:30.030819 (+  7611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:30.030862 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:30.031456 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 12:22:30.182865 (+151409us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b480018c258. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc81408aa1 00007efc813ffb37 00007efc813ff9ca 00007efc814f726f 00007efc814f6f37 00007efc8150b55c 00007efc8150b508 00007efc8150b488 00007efc8150b443 00007efc8150a6ec 00007efc80434a96
0709 12:22:30.221279 (+ 38414us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:30.247971 (+ 26692us) log.cc:844] Serialized 14 byte log entry
0709 12:22:30.248336 (+   365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.248445 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:30.730234 (+481789us) raft_consensus.cc:1685] finished
0709 12:22:30.734460 (+  4226us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:30.734619 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15695,"prepare.queue_time_us":19602,"prepare.run_wall_time_us":37,"raft.queue_time_us":21985,"raft.run_cpu_time_us":3615,"raft.run_wall_time_us":156881,"spinlock_wait_cycles":66874624,"thread_start_us":189493,"threads_started":1,"wal-append.queue_time_us":437088}
I20260709 12:22:30.717329 20241 raft_consensus.cc:697] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:30.717149 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:30.733544 20017 consensus_meta.cc:287] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 1.334s	user 0.004s	sys 0.011s
I20260709 12:22:30.726507 20046 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:30.643198 20236 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:30.627341 19243 rpcz_store.cc:269] 0709 12:22:29.066367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.087141 (+ 20774us) service_pool.cc:224] Handling call
0709 12:22:30.578655 (+1491514us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540059e554. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:30.578827 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2584387456}
I20260709 12:22:30.740281 18674 raft_consensus.cc:2410] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 2 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:22:30.736379 20213 raft_consensus.cc:697] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:30.748903 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1123) took 1653 ms. Trace:
I20260709 12:22:30.726886 20235 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:30.770117 18676 rpcz_store.cc:276] 0709 12:22:29.095544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.145026 (+1049482us) service_pool.cc:224] Handling call
0709 12:22:30.166617 (+ 21591us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:30.172957 (+  6340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:30.173007 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:30.198722 (+ 25715us) log.cc:844] Serialized 26 byte log entry
0709 12:22:30.460356 (+261634us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:30.460396 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.460476 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:30.748510 (+288034us) raft_consensus.cc:1685] finished
0709 12:22:30.748543 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:30.748725 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5757,"raft.queue_time_us":7546,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":9838,"thread_start_us":196115,"threads_started":1,"wal-append.queue_time_us":416634}
I20260709 12:22:30.765693 20244 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:30.745395 20017 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:30.774933 18602 raft_consensus.cc:2393] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 3: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:30.776641 20017 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:30.780184 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1125) took 1684 ms. Trace:
I20260709 12:22:30.780787 18678 rpcz_store.cc:276] 0709 12:22:29.096160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.669251 (+1573091us) service_pool.cc:224] Handling call
0709 12:22:30.736955 (+ 67704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:30.743401 (+  6446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:30.745987 (+  2586us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:30.748754 (+  2767us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:30.770657 (+ 21903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.779890 (+  9233us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:30.780088 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:30.784591 20236 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:30.610821 20246 consensus_queue.cc:237] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.741106 20026 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:30.744300 20023 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:30.824625 20241 consensus_queue.cc:237] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.826062 20243 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:30.744042 18675 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:30.828676 18597 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
W20260709 12:22:30.880963 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.881111 19970 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:30.881757 19970 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.884212 19970 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:30.865708 20146 consensus_meta.cc:287] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.776s	user 0.012s	sys 0.000s
I20260709 12:22:30.899958 20015 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.903069 20015 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:30.130143 18529 rpcz_store.cc:276] 0709 12:22:28.516041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.923078 (+407037us) service_pool.cc:224] Handling call
0709 12:22:28.942746 (+ 19668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.942989 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:28.968288 (+ 25299us) log.cc:844] Serialized 14 byte log entry
0709 12:22:30.100818 (+1132530us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:30.100891 (+    73us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:30.100961 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.104126 (+  3165us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:30.104303 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25616,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":1018,"raft.queue_time_us":429447,"thread_start_us":1132024,"threads_started":2,"wal-append.queue_time_us":952524}
W20260709 12:22:30.876029 20171 consensus_meta.cc:287] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.657s	user 0.012s	sys 0.000s
I20260709 12:22:30.929162 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:30.929769 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:30.854791 20232 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:30.931654 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:30.933118 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:30.933617 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.934391 20171 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:30.949144 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 504339us
W20260709 12:22:30.883641 20016 consensus_meta.cc:287] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.597s	user 0.008s	sys 0.000s
I20260709 12:22:30.952472 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:30.947865 20248 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:30.953856 20197 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:30.830184 20244 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:30.955231 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.835551 20250 consensus_queue.cc:237] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:30.839350 20243 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:30.965394 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 470618us
W20260709 12:22:30.966847 18528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.013s	sys 0.028s
W20260709 12:22:30.990517 18523 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.003s	sys 0.043s
W20260709 12:22:31.020998 18526 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.000s	sys 0.042s
W20260709 12:22:31.024261 18528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.014s	sys 0.028s
W20260709 12:22:30.953084 20168 consensus_meta.cc:287] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.820s	user 0.006s	sys 0.007s
W20260709 12:22:31.019194 18572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.021s	sys 0.013s
W20260709 12:22:31.024818 18526 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.001s	sys 0.042s
W20260709 12:22:31.025579 18572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.022s	sys 0.013s
W20260709 12:22:31.027611 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 725447us
W20260709 12:22:31.031018 18523 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.004s	sys 0.043s
I20260709 12:22:31.031380 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:30.991423 20018 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.005s	sys 0.028s
I20260709 12:22:31.028576 18572 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:31.035851 18646 leader_election.cc:336] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 4.513s (SENT)
I20260709 12:22:30.875150 20213 consensus_queue.cc:237] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:31.031941 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1231) took 1093 ms. Trace:
W20260709 12:22:31.037693 20018 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.005s	sys 0.028s
I20260709 12:22:31.032114 18599 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:31.024398 20222 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:31.070708 20222 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:31.072386 19768 consensus_meta.cc:287] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.000s
I20260709 12:22:31.072964 19768 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:31.073664 20222 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:31.077492 20244 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:31.048437 18646 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:31.046682 20226 consensus_meta.cc:287] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.549s	user 0.007s	sys 0.004s
I20260709 12:22:31.039495 20088 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.038578 20096 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:30.999621 20016 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:31.050979 18572 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:31.047864 20263 log.cc:927] Time spent T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.623s	user 0.004s	sys 0.001s
W20260709 12:22:31.079403 18522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.008s	sys 0.057s
I20260709 12:22:31.048772 20238 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:31.056378 20168 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:31.098858 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 63149.4us
W20260709 12:22:31.107131 18646 leader_election.cc:336] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 4.733s (SENT)
W20260709 12:22:31.107189 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 57294.2us
I20260709 12:22:31.107658 18646 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:31.108790 18572 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:31.079239 19681 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:31.122562 18572 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:31.125227 20017 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:31.106304 20168 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.125994 20197 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:31.108385 18522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.008s	sys 0.058s
I20260709 12:22:31.098459 20046 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:31.099570 19768 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:31.157827 19211 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.025s	sys 0.051s
I20260709 12:22:31.162375 18572 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:31.126471 20146 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:31.172299 19211 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.025s	sys 0.051s
I20260709 12:22:31.141697 20238 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.176994 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:31.156478 20168 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:31.099078 20226 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:31.185547 20226 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:31.186012 18530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1240) took 1244 ms. Trace:
I20260709 12:22:31.104017 20088 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:31.107458 20096 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:31.186509 18530 rpcz_store.cc:276] 0709 12:22:29.941506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.791155 (+849649us) service_pool.cc:224] Handling call
0709 12:22:30.791485 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:30.791700 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:30.812310 (+ 20610us) log.cc:844] Serialized 14 byte log entry
0709 12:22:31.185657 (+373347us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:31.185707 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:31.185741 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.185806 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.185937 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":241,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":1017,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":371471,"threads_started":1}
I20260709 12:22:31.174737 20146 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.174428 20017 raft_consensus.cc:697] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:31.174503 18597 raft_consensus.cc:1240] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:31.231644 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 71515.3us
I20260709 12:22:31.179977 20235 raft_consensus.cc:2804] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:31.263545 20235 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.264150 20235 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:31.196285 20145 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:31.183591 20157 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.039s	sys 0.054s
W20260709 12:22:31.235719 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 55021.6us
W20260709 12:22:31.229734 20254 log.cc:927] Time spent T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.558s	user 0.004s	sys 0.002s
W20260709 12:22:31.188234 19209 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.015s	sys 0.032s
I20260709 12:22:31.277122 18646 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:31.168123 20197 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:31.237236 20146 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:31.235015 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:31.282997 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:31.234754 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:31.299286 18646 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:31.278457 20157 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.042s	sys 0.054s
W20260709 12:22:31.287211 20290 log.cc:927] Time spent T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.050s	user 0.001s	sys 0.001s
I20260709 12:22:31.272317 20171 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:31.190519 20238 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:31.283649 19209 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.016s	sys 0.032s
I20260709 12:22:31.505533 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1132) took 1255 ms. Trace:
I20260709 12:22:31.505812 20016 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:22:31.326808 18679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.013s	sys 0.055s
W20260709 12:22:31.508349 18679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.013s	sys 0.055s
I20260709 12:22:31.509608 20016 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.510012 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1127) took 2413 ms. Trace:
I20260709 12:22:31.246101 18522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1232) took 1296 ms. Trace:
I20260709 12:22:31.512147 18522 rpcz_store.cc:276] 0709 12:22:29.939367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.143585 (+204218us) service_pool.cc:224] Handling call
0709 12:22:30.180356 (+ 36771us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:30.180607 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:30.283119 (+102512us) log.cc:844] Serialized 14 byte log entry
0709 12:22:31.175093 (+891974us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:31.177665 (+  2572us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:31.183098 (+  5433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.198821 (+ 15723us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.235599 (+ 36778us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":89561,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":5469,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":5457,"thread_start_us":978927,"threads_started":2,"wal-append.queue_time_us":1088068}
I20260709 12:22:31.495700 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1235) took 1555 ms. Trace:
W20260709 12:22:31.496928 18529 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.009s	sys 0.025s
I20260709 12:22:31.515977 18526 rpcz_store.cc:276] 0709 12:22:29.940194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.209151 (+268957us) service_pool.cc:224] Handling call
0709 12:22:30.209807 (+   656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:30.210158 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:31.026971 (+816813us) log.cc:844] Serialized 14 byte log entry
0709 12:22:31.494716 (+467745us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:31.494823 (+   107us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:31.494963 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.495097 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.495441 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28862,"prepare.queue_time_us":181008,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"thread_start_us":1229242,"threads_started":2}
W20260709 12:22:31.298110 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.518667 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:31.278849 19681 consensus_queue.cc:1048] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:22:31.520818 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
W20260709 12:22:31.310194 19985 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.005s	sys 0.012s
W20260709 12:22:31.522385 19985 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.005s	sys 0.013s
I20260709 12:22:31.522269 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:31.325901 18680 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
W20260709 12:22:31.500591 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 199854us
I20260709 12:22:31.523615 19241 raft_consensus.cc:2393] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 5: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:22:31.524215 18522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 110) took 1464 ms. Trace:
I20260709 12:22:31.519340 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 111) took 1420 ms. Trace:
I20260709 12:22:31.524780 19985 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.525676 19985 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:31.525267 18526 rpcz_store.cc:276] 0709 12:22:30.099354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.517874 (+1418520us) service_pool.cc:224] Handling call
0709 12:22:31.518479 (+   605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:31.518890 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:31.518940 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:31.519016 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:31.519060 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.519122 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.519250 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:31.260018 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:31.527374 19240 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:31.503648 18675 raft_consensus.cc:2393] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 3: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:31.529846 18526 raft_consensus.cc:1240] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:31.530033 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:31.530339 20015 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.530647 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 112) took 1082 ms. Trace:
W20260709 12:22:31.504077 18673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.010s	sys 0.008s
I20260709 12:22:31.057714 18523 rpcz_store.cc:276] 0709 12:22:29.938846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.939004 (+   158us) service_pool.cc:224] Handling call
0709 12:22:29.992122 (+ 53118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.992348 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:30.376775 (+384427us) log.cc:844] Serialized 14 byte log entry
0709 12:22:31.031545 (+654770us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:31.031607 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:31.031655 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.031734 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.031887 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3002,"prepare.queue_time_us":197465,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":962,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5864,"thread_start_us":971003,"threads_started":2,"wal-append.queue_time_us":786997}
W20260709 12:22:31.531394 18673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.010s	sys 0.009s
I20260709 12:22:31.524718 18522 rpcz_store.cc:276] 0709 12:22:30.059677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.515200 (+1455523us) service_pool.cc:224] Handling call
0709 12:22:31.523211 (+  8011us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:31.523662 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:31.523713 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:31.523830 (+   117us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:31.523885 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.523985 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.524132 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:31.533242 18523 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:31.533298 18673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1122) took 2438 ms. Trace:
W20260709 12:22:31.500380 18644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.005s	sys 0.011s
W20260709 12:22:31.538280 18644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.006s	sys 0.011s
I20260709 12:22:31.329654 20230 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:31.286708 20039 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:22:31.541829 20230 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:31.289671 20046 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:31.536808 19929 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.534994 20018 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:31.356369 20017 consensus_queue.cc:237] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:31.343022 20243 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:31.502684 18601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1237) took 1227 ms. Trace:
I20260709 12:22:31.535770 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:22:31.286475 20253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.020s	sys 0.037s
W20260709 12:22:31.439774 20264 log.cc:927] Time spent T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.972s	user 0.005s	sys 0.000s
I20260709 12:22:31.609210 20018 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:31.445237 20272 log.cc:927] Time spent T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.310s	user 0.000s	sys 0.002s
I20260709 12:22:31.283416 20275 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:31.624536 20275 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:31.373436 20276 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:31.510710 20016 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:31.444190 20307 log.cc:927] Time spent T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.350s	user 0.002s	sys 0.000s
W20260709 12:22:31.435093 20296 log.cc:927] Time spent T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.160s	user 0.006s	sys 0.006s
W20260709 12:22:31.445902 20300 log.cc:927] Time spent T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.067s	user 0.000s	sys 0.003s
W20260709 12:22:31.435577 20301 log.cc:927] Time spent T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.094s	user 0.000s	sys 0.009s
I20260709 12:22:31.531101 18526 rpcz_store.cc:276] 0709 12:22:30.448198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.527608 (+1079410us) service_pool.cc:224] Handling call
0709 12:22:31.528215 (+   607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:31.530368 (+  2153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.530552 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:31.531113 18675 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:31.510514 18679 rpcz_store.cc:276] 0709 12:22:29.096717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.737728 (+1641011us) service_pool.cc:224] Handling call
0709 12:22:30.738048 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:30.738254 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:30.738923 (+   669us) log.cc:844] Serialized 14 byte log entry
0709 12:22:31.509343 (+770420us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:31.509462 (+   119us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:31.509637 (+   175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.509746 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.509944 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1871,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"thread_start_us":769647,"threads_started":1,"wal-append.queue_time_us":708383}
I20260709 12:22:31.577898 20063 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:31.642758 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:31.542948 20230 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:31.643697 18679 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:31.644506 20018 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:31.644991 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:31.645623 20230 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:31.531211 20015 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:31.645982 18679 raft_consensus.cc:2393] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 4: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:31.645879 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1130) took 2059 ms. Trace:
W20260709 12:22:31.560408 18646 leader_election.cc:336] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.711s (SENT)
I20260709 12:22:31.646456 18676 rpcz_store.cc:276] 0709 12:22:29.586673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.798047 (+1211374us) service_pool.cc:224] Handling call
0709 12:22:30.798557 (+   510us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:30.996722 (+198165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:30.996769 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:31.026135 (+ 29366us) log.cc:844] Serialized 26 byte log entry
0709 12:22:31.499907 (+473772us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:31.500036 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.500239 (+   203us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:31.645516 (+145277us) raft_consensus.cc:1685] finished
0709 12:22:31.645539 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.645706 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":159158,"raft.queue_time_us":220330,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":12959,"thread_start_us":451687,"threads_started":1,"wal-append.queue_time_us":573680}
W20260709 12:22:31.648216 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 121741us
I20260709 12:22:31.648934 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:22:31.649144 18646 leader_election.cc:336] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.796s (SENT)
I20260709 12:22:31.506242 18678 rpcz_store.cc:276] 0709 12:22:30.250099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.782116 (+532017us) service_pool.cc:224] Handling call
0709 12:22:30.782582 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:30.918891 (+136309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:30.918926 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:30.919458 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 12:22:31.280859 (+361401us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:31.284846 (+  3987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.292815 (+  7969us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:31.504786 (+211971us) raft_consensus.cc:1685] finished
0709 12:22:31.504851 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.505246 (+   395us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":196516,"raft.queue_time_us":137929,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":8625,"thread_start_us":317030,"threads_started":1,"wal-append.queue_time_us":455726}
I20260709 12:22:31.649700 18646 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:31.440774 20238 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:31.647090 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:31.591603 19681 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:31.594456 20289 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.651819 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:31.652554 20016 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:31.652247 20289 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:31.653236 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:31.538014 18673 rpcz_store.cc:276] 0709 12:22:29.095202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.036817 (+941615us) service_pool.cc:224] Handling call
0709 12:22:30.044791 (+  7974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:30.045043 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:30.058531 (+ 13488us) log.cc:844] Serialized 14 byte log entry
0709 12:22:30.580975 (+522444us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:22:30.861418 (+280443us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b18003cad80. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc7936cc0a 00007efc82aac219 00007efc793f4a40 00007efc793ef4e4 00007efc793ef455 00007efc7c4d7060 00007efc7c4e9716 00007efc7c4fa287 00007efc7c4fa208
0709 12:22:30.956048 (+ 94630us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b2400241b98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc792789c4 00007efc79276acb 00007efc79431dc9 00007efc79431a55 00007efc7943109d 00007efc7c06310e 00007efc7c07a88c 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221
0709 12:22:31.532455 (+576407us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:31.532629 (+   174us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:31.532782 (+   153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.532936 (+   154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.533192 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29441,"prepare.queue_time_us":13708,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":4959,"raft.queue_time_us":568325,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":53419008,"thread_start_us":895517,"threads_started":2,"wal-append.queue_time_us":274490}
I20260709 12:22:31.654058 18679 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:31.660770 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:31.662019 18527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57384 (request call id 1254) took 1421 ms. Trace:
I20260709 12:22:31.662454 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:31.592082 20032 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:31.591858 20228 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.596768 20197 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:31.614974 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:31.616843 19241 raft_consensus.cc:1275] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:30.533746 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:31.619416 20088 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:31.576026 18601 rpcz_store.cc:276] 0709 12:22:30.272254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.272390 (+   136us) service_pool.cc:224] Handling call
0709 12:22:30.272720 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:30.467848 (+195128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:30.467881 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:30.475004 (+  7123us) log.cc:844] Serialized 26 byte log entry
0709 12:22:31.141834 (+666830us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:31.175001 (+ 33167us) log.cc:844] Serialized 14 byte log entry
0709 12:22:31.189212 (+ 14211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.189313 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:31.499206 (+309893us) raft_consensus.cc:1685] finished
0709 12:22:31.499257 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.499665 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77870,"prepare.queue_time_us":34940,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":252875,"raft.run_cpu_time_us":414,"raft.run_wall_time_us":42339,"thread_start_us":643147,"threads_started":2,"wal-append.queue_time_us":934018}
W20260709 12:22:31.621114 20253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.020s	sys 0.038s
I20260709 12:22:31.627664 20275 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:31.640512 18677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 98) took 3047 ms. Trace:
I20260709 12:22:31.642514 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:31.684737 18675 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:31.541882 20096 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:31.660856 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:31.648238 20015 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:31.690722 20230 raft_consensus.cc:2749] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:31.614002 18521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 109) took 2857 ms. Trace:
I20260709 12:22:31.692163 18521 rpcz_store.cc:276] 0709 12:22:28.756397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.949122 (+192725us) service_pool.cc:224] Handling call
0709 12:22:28.949502 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:29.874566 (+925064us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:29.874611 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:30.279978 (+405367us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b2c00058ff8. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7add8a11 00007efc7ade8372 00007efc7c51aa01 00007efc7c4df43a 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2
0709 12:22:30.280577 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 12:22:30.639530 (+358953us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:30.668922 (+ 29392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.723118 (+ 54196us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:31.443081 (+719963us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:22:31.613321 (+170240us) raft_consensus.cc:1685] finished
0709 12:22:31.613382 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.613720 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115093,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"spinlock_wait_cycles":58551040,"thread_start_us":1267845,"threads_started":2,"wal-append.queue_time_us":759768}
I20260709 12:22:31.696208 18570 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:31.663568 20032 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:31.599103 18494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.008s	sys 0.021s
I20260709 12:22:31.662505 18527 rpcz_store.cc:276] 0709 12:22:30.233455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.360592 (+127137us) service_pool.cc:224] Handling call
0709 12:22:31.626536 (+1265944us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b5400432454. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:31.654485 (+ 27949us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1882186112}
W20260709 12:22:31.700268 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 51230.5us
W20260709 12:22:31.698887 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.675732 18604 raft_consensus.cc:1240] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:31.650326 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:31.681181 20289 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:31.664143 20228 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:31.700309 18494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.009s	sys 0.021s
I20260709 12:22:31.702466 18676 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:22:31.701176 18646 leader_election.cc:336] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.130s (SENT)
I20260709 12:22:31.651448 19681 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:31.592315 19929 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:31.703202 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:31.718531 18646 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:31.702186 20032 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:31.713342 19985 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:31.728561 20088 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:31.728947 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:31.684173 18677 rpcz_store.cc:276] 0709 12:22:28.593202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.962991 (+1369789us) service_pool.cc:224] Handling call
0709 12:22:30.017288 (+ 54297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:30.026273 (+  8985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:30.026301 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:30.026731 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 12:22:30.268764 (+242033us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:30.268801 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.268868 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:31.438979 (+1170111us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:22:31.639981 (+201002us) raft_consensus.cc:1685] finished
0709 12:22:31.640031 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.640327 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8513,"raft.queue_time_us":10920,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":4884,"spinlock_wait_cycles":6260480,"thread_start_us":207195,"threads_started":1,"wal-append.queue_time_us":319686}
I20260709 12:22:31.726747 19240 raft_consensus.cc:2393] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 3: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:22:31.745653 20032 raft_consensus.cc:2749] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:31.746416 18494 connection.cc:256] RPC call timeout handler was delayed by -2.1380393069998718s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
W20260709 12:22:31.747076 18494 connection.cc:256] RPC call timeout handler was delayed by -1.4425617909998891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:22:31.732610 20088 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.705755 20146 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:31.732766 20230 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:31.753711 20088 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:31.755658 18570 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:22:31.767436 20311 log.cc:927] Time spent T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:22:31.773262 20235 consensus_meta.cc:287] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.508s	user 0.014s	sys 0.005s
I20260709 12:22:31.780172 20318 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:31.780834 20235 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:31.776261 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:31.784349 18644 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:31.785059 18601 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:31.785764 18644 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:31.786531 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:31.777206 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:31.789422 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:31.781111 20318 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:31.782351 18530 raft_consensus.cc:1240] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:31.787415 18601 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
W20260709 12:22:31.775274 20168 consensus_meta.cc:287] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.576s	user 0.013s	sys 0.001s
W20260709 12:22:31.784559 18672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 1128) took 2687 ms (client timeout 2145 ms). Trace:
I20260709 12:22:31.760605 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:31.778775 20250 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:31.756687 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:31.793816 20291 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.791735 18527 raft_consensus.cc:1275] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:31.802992 20046 consensus_queue.cc:1059] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:31.803520 20197 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:31.804351 20305 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:31.795869 20168 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:31.793128 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:31.827643 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:31.828462 18601 raft_consensus.cc:2393] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:31.830210 18604 raft_consensus.cc:2393] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:31.793267 18530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1247) took 1824 ms. Trace:
W20260709 12:22:31.800254 18672 rpcz_store.cc:269] 0709 12:22:29.097016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.344563 (+247547us) service_pool.cc:224] Handling call
0709 12:22:31.784191 (+2439628us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54004042d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:31.784371 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1250976000}
I20260709 12:22:31.833462 18672 raft_consensus.cc:1275] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:31.830904 18530 rpcz_store.cc:276] 0709 12:22:29.968504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.233913 (+1265409us) service_pool.cc:224] Handling call
0709 12:22:31.234460 (+   547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:31.791438 (+556978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.792963 (+  1525us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b54000825d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:31.793195 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1108551936}
I20260709 12:22:31.806524 19681 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:31.764532 18521 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:31.753120 19985 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:31.836001 20153 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:22:31.757454 18678 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:31.838603 19985 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:31.809639 18529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1246) took 1862 ms. Trace:
I20260709 12:22:31.757535 20253 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:31.809783 19929 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:31.836424 20157 consensus_queue.cc:1059] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:22:31.840169 20253 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:31.841415 20153 raft_consensus.cc:3055] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:31.839735 18529 rpcz_store.cc:276] 0709 12:22:29.947706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.932883 (+985177us) service_pool.cc:224] Handling call
0709 12:22:30.933316 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:31.517124 (+583808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:31.517187 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:31.518292 (+  1105us) log.cc:844] Serialized 26 byte log entry
0709 12:22:31.561687 (+ 43395us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:31.561742 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.570742 (+  9000us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:31.809406 (+238664us) raft_consensus.cc:1685] finished
0709 12:22:31.809428 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.809578 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26674,"raft.queue_time_us":64182,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":10699,"thread_start_us":599209,"threads_started":2,"wal-append.queue_time_us":212275}
I20260709 12:22:31.834411 20106 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:31.827699 20168 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:31.824446 20305 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:31.835727 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 114132us
I20260709 12:22:31.845978 20305 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:31.844987 20235 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:31.857048 18644 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:31.844542 20046 raft_consensus.cc:3055] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:31.843484 19985 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:31.842636 20017 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:22:31.866739 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 165620us
I20260709 12:22:31.841850 20153 raft_consensus.cc:740] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
W20260709 12:22:31.869091 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 45575.5us
I20260709 12:22:31.848703 20197 raft_consensus.cc:697] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:31.825058 20230 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:31.843608 20291 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:31.865809 20046 raft_consensus.cc:740] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:31.836174 20250 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:31.884754 20153 consensus_queue.cc:260] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:31.885885 18524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57384 (request call id 1242) took 1943 ms (client timeout 1620 ms). Trace:
I20260709 12:22:31.886050 20032 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:22:31.886384 18524 rpcz_store.cc:269] 0709 12:22:29.942110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.011055 (+ 68945us) service_pool.cc:224] Handling call
0709 12:22:31.885524 (+1874469us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400256554. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:31.885708 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3406065408}
I20260709 12:22:31.886992 18570 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:22:31.888599 18525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57384 (request call id 1252) took 1661 ms (client timeout 2054 ms). Trace:
W20260709 12:22:31.889050 18525 rpcz_store.cc:269] 0709 12:22:30.227221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.246558 (+ 19337us) service_pool.cc:224] Handling call
0709 12:22:31.888241 (+1641683us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b540009a1d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:31.888436 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1791838976}
W20260709 12:22:31.892314 18424 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60812 (request call id 102) took 15398 ms (client timeout 15000 ms). Trace:
I20260709 12:22:31.895506 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:31.896200 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:31.897215 18529 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:31.898006 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:31.898204 20228 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:31.872834 20017 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.912499 20017 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:31.910948 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 152565us
I20260709 12:22:31.907091 18671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 94) took 3371 ms. Trace:
I20260709 12:22:31.908164 18600 raft_consensus.cc:1240] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:31.908350 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:31.908288 18602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39798 (request call id 85) took 1640 ms (client timeout 1885 ms). Trace:
W20260709 12:22:31.906934 18605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40948 (request call id 1229) took 1649 ms (client timeout 1981 ms). Trace:
I20260709 12:22:31.917419 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:31.909801 20032 raft_consensus.cc:697] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:31.920414 20197 consensus_queue.cc:237] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:31.921535 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:31.892802 18424 rpcz_store.cc:269] 0709 12:22:16.493666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.493839 (+   173us) service_pool.cc:224] Handling call
0709 12:22:16.991611 (+497772us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b5400270010. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bb640 00007efc82292846 00007efc8239c90e 00007efc8085d2a4 00007efc8085d232 00007efc8085d161 00007efc8085d0dc 00007efc8085c392 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:31.891970 (+14900359us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:27.785164 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:27.807233 (+ 22069us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:27.807268 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:22:27.807286 (+    18us) tablet.cc:662] Decoding operations
0709 12:22:27.807617 (+   331us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:27.807678 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:27.807708 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:22:27.807985 (+   277us) tablet.cc:701] Row locks acquired
0709 12:22:27.808013 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:22:27.808198 (+   185us) write_op.cc:270] Start()
0709 12:22:27.809061 (+   863us) write_op.cc:276] Timestamp: P: 1783599747808147 usec, L: 0
0709 12:22:27.809087 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:22:27.809770 (+   683us) log.cc:844] Serialized 538 byte log entry
0709 12:22:28.289842 (+480072us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:22:28.704151 (+414309us) op_driver.cc:464] REPLICATION: finished
0709 12:22:29.679430 (+975279us) write_op.cc:301] APPLY: starting
0709 12:22:29.682868 (+  3438us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:29.695822 (+ 12954us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:29.698063 (+  2241us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:29.727676 (+ 29613us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:29.727879 (+   203us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:22:29.727931 (+    52us) write_op.cc:312] APPLY: finished
0709 12:22:29.728137 (+   206us) log.cc:844] Serialized 22 byte log entry
0709 12:22:30.079576 (+351439us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:30.088550 (+  8974us) write_op.cc:454] Released schema lock
0709 12:22:30.088669 (+   119us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:30.157660 (+ 68991us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:30.157690 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1160847,"reported_tablets":4,"spinlock_wait_cycles":13210880,"child_traces":[["op",{"apply.queue_time_us":959847,"apply.run_cpu_time_us":21052,"apply.run_wall_time_us":468950,"num_ops":1,"prepare.queue_time_us":325213,"prepare.run_cpu_time_us":16700,"prepare.run_wall_time_us":169306,"raft.queue_time_us":262565,"raft.run_cpu_time_us":28485,"raft.run_wall_time_us":520338,"replication_time_us":894902,"spinlock_wait_cycles":90665600,"thread_start_us":1133687,"threads_started":5,"wal-append.queue_time_us":719184,"wal-append.run_cpu_time_us":34848,"wal-append.run_wall_time_us":2924320}]]}
I20260709 12:22:31.924607 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:31.928767 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:31.936323 18606 raft_consensus.cc:1240] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:31.908691 20275 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:31.961632 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:31.952042 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:22:31.978133 18602 rpcz_store.cc:269] 0709 12:22:30.267798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.267967 (+   169us) service_pool.cc:224] Handling call
0709 12:22:31.907929 (+1639962us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b54000f0d54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:31.908122 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1163447040}
W20260709 12:22:31.943429 20317 log.cc:927] Time spent T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 12:22:31.934944 18603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40954 (request call id 1269) took 1257 ms. Trace:
W20260709 12:22:31.977664 18605 rpcz_store.cc:269] 0709 12:22:30.256939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.258229 (+  1290us) service_pool.cc:224] Handling call
0709 12:22:31.906467 (+1648238us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54001257d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:31.906700 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424205184}
I20260709 12:22:31.911320 20235 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:22:31.999105 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 112248us
I20260709 12:22:31.997001 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:31.943081 20286 log.cc:927] Time spent T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.816s	user 0.004s	sys 0.000s
I20260709 12:22:32.000590 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:31.927245 20318 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:31.949430 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:31.929486 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:31.928367 20230 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:31.928193 20276 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:32.000661 18529 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:31.989817 20275 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.941977 18597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 1271) took 1014 ms. Trace:
I20260709 12:22:31.997279 18603 rpcz_store.cc:276] 0709 12:22:30.677629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.679804 (+  2175us) service_pool.cc:224] Handling call
0709 12:22:31.934470 (+1254666us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b540010f754. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:31.934719 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2096518400}
I20260709 12:22:32.000484 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:32.015923 18524 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:31.929845 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:32.029233 18570 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:32.015013 20146 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:32.017910 20275 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:32.036784 18604 raft_consensus.cc:2368] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:22:32.035605 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:32.043397 18601 raft_consensus.cc:2368] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3.
I20260709 12:22:31.931391 20046 consensus_queue.cc:260] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:32.043497 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.034372 18523 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:32.053300 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:32.056537 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.051250 18678 raft_consensus.cc:2393] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 3: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
W20260709 12:22:32.060511 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 181922us
I20260709 12:22:32.061267 18603 raft_consensus.cc:2393] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:32.028050 20235 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:32.043008 18521 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:32.051959 20250 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:32.079965 18604 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:32.080850 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.076689 18644 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:32.055827 20291 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:32.082659 18605 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:32.092180 18602 raft_consensus.cc:1240] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:32.017002 18597 rpcz_store.cc:276] 0709 12:22:30.927423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.933680 (+  6257us) service_pool.cc:224] Handling call
0709 12:22:30.934071 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:31.269139 (+335068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.941309 (+672170us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b5400310e54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:31.941729 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":513270144}
I20260709 12:22:32.072746 20230 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.070497 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:32.092176 18672 raft_consensus.cc:2410] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:22:32.103906 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:32.089882 20096 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:32.106411 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:32.095522 20253 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:32.114380 18527 raft_consensus.cc:1275] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:32.123382 18677 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:32.107106 20096 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:32.112772 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 222600us
I20260709 12:22:32.137513 20096 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:32.142736 19275 heartbeater.cc:646] Failed to heartbeat to 127.16.240.190:43515 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.16.240.190:43515 timed out after 15.000s (SENT)
I20260709 12:22:32.143983 18598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1233) took 1866 ms. Trace:
I20260709 12:22:32.144441 18598 rpcz_store.cc:276] 0709 12:22:30.259476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.265030 (+  5554us) service_pool.cc:224] Handling call
0709 12:22:31.893965 (+1628935us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b5800102f98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baeee 000000000036eb39 00007efc8142e1e0 00007efc814f70c4 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:31.894206 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:31.894601 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:31.895026 (+   425us) log.cc:844] Serialized 14 byte log entry
0709 12:22:32.106865 (+211839us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:32.108638 (+  1773us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:32.112775 (+  4137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.112874 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:32.123282 (+ 10408us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7537,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":7254,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":11726,"spinlock_wait_cycles":7775488,"thread_start_us":195645,"threads_started":1}
I20260709 12:22:32.145668 20017 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:32.146417 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.174135 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:32.127506 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:32.211637 20235 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:32.177081 20056 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:32.181842 18600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 1275) took 1253 ms. Trace:
I20260709 12:22:32.184700 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.190135 20017 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:32.193583 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.201083 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 1143) took 1024 ms. Trace:
I20260709 12:22:32.204018 18672 raft_consensus.cc:1240] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:32.204222 18528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1236) took 2263 ms. Trace:
I20260709 12:22:32.089823 20032 consensus_queue.cc:237] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:32.112978 20039 consensus_queue.cc:1059] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.142s
I20260709 12:22:31.919171 18671 rpcz_store.cc:276] 0709 12:22:28.535493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.679099 (+1143606us) service_pool.cc:224] Handling call
0709 12:22:29.699588 (+ 20489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.726033 (+ 26445us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:29.745896 (+ 19863us) log.cc:844] Serialized 14 byte log entry
0709 12:22:30.183926 (+438030us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b1800381d00. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793d4e07 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793f1c02 00007efc7c07920b 00007efc7c07ed23 00007efc7c07f23a 00007efc7c4e9a2a
0709 12:22:30.880490 (+696564us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:30.880552 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:30.880605 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.906565 (+1025960us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b54001f2054. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:31.906647 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.906869 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":492156,"prepare.queue_time_us":4654,"prepare.run_cpu_time_us":6527,"prepare.run_wall_time_us":84747,"raft.queue_time_us":437916,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":58350080,"thread_start_us":215368,"threads_started":1,"wal-append.queue_time_us":701937,"wal-append.run_cpu_time_us":1404,"wal-append.run_wall_time_us":1042777}
W20260709 12:22:32.204763 18646 leader_election.cc:336] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.721s (SENT)
I20260709 12:22:32.205322 20021 consensus_queue.cc:1048] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:32.239089 18646 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:32.240052 20039 raft_consensus.cc:3055] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:32.240437 20039 raft_consensus.cc:740] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:32.241103 20162 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:32.241539 20039 consensus_queue.cc:260] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:32.242897 20039 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.207075 18572 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:32.206509 20336 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.247980 20235 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:32.248603 20235 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.248970 20235 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:32.221692 18676 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
W20260709 12:22:32.251699 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 80352.4us
I20260709 12:22:32.126483 20230 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:32.222625 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.253077 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:32.254480 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.220233 18529 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:32.255818 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.256443 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.256561 18521 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:32.257571 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.258822 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.259699 18524 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:32.260187 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.221534 20056 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.260598 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.260978 18529 raft_consensus.cc:2410] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:32.223578 18600 rpcz_store.cc:276] 0709 12:22:30.928863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.934830 (+  5967us) service_pool.cc:224] Handling call
0709 12:22:31.907691 (+972861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:31.998630 (+ 90939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.181613 (+182983us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b54001257d0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:32.181772 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2236168960}
I20260709 12:22:32.261909 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:32.262542 18529 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:32.262487 20096 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:32.246603 18425 catalog_manager.cc:5697] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.264993 20088 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:32.266428 18425 catalog_manager.cc:5697] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:32.240478 18646 leader_election.cc:336] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.767s (SENT)
I20260709 12:22:32.257583 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.272207 18646 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:32.273691 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.274089 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.274645 19681 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:32.274959 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:32.248041 20336 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:32.275369 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.232414 18680 rpcz_store.cc:276] 0709 12:22:31.176554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.176714 (+   160us) service_pool.cc:224] Handling call
0709 12:22:32.200690 (+1023976us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54000bdbd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:32.200874 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296182016}
I20260709 12:22:32.260914 20056 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:32.261689 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:32.264428 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:22:32.215368 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 142977us
I20260709 12:22:32.283917 18644 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:32.286653 18644 leader_election.cc:400] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:22:32.286372 20305 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:32.286984 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:32.287010 18644 leader_election.cc:403] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:32.276077 18425 catalog_manager.cc:5697] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.290550 18644 leader_election.cc:400] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3.
I20260709 12:22:32.291388 18644 leader_election.cc:403] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:22:32.282799 18529 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:32.289176 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:22:32.293224 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 52800.5us
I20260709 12:22:32.267526 20088 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:32.289033 20304 raft_consensus.cc:2804] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:32.232630 18528 rpcz_store.cc:276] 0709 12:22:29.940487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.212331 (+271844us) service_pool.cc:224] Handling call
0709 12:22:30.212827 (+   496us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:30.213489 (+   662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:30.213519 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:30.214342 (+   823us) log.cc:844] Serialized 52 byte log entry
0709 12:22:31.025047 (+810705us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:31.039030 (+ 13983us) log.cc:844] Serialized 14 byte log entry
0709 12:22:31.039294 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.039392 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:31.441407 (+402015us) spinlock_profiling.cc:243] Waited 7.21 ms on lock 0x7b180036a180. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793f23f3 00007efc793f47c1 00007efc793f4779 00007efc793f4709 00007efc793f46d1 00007efc793f39cd 0000000000388634 0000000000388479 00007efc793d583a
0709 12:22:31.845323 (+403916us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b180036a180. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793f23f3 00007efc793f47c1 00007efc793f4779 00007efc793f4709 00007efc793f46d1 00007efc793f39cd 0000000000388634 0000000000388479 00007efc793d583a
0709 12:22:31.940513 (+ 95190us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:22:32.203780 (+263267us) raft_consensus.cc:1685] finished
0709 12:22:32.203814 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:32.204028 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16221,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":65,"raft.queue_time_us":580,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":232,"spinlock_wait_cycles":67761536,"thread_start_us":810232,"threads_started":1,"wal-append.queue_time_us":823530}
I20260709 12:22:32.295895 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.290544 20253 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:32.296320 19681 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
W20260709 12:22:32.308725 18646 leader_election.cc:336] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.819s (SENT)
I20260709 12:22:32.310540 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.306915 20096 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:32.311867 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:32.312212 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.301043 20304 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:32.315702 18644 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:32.317914 18572 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:32.317425 20162 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:22:32.323736 20337 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:32.326092 20162 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:32.326682 20162 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:32.327101 20162 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.328195 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.329063 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:32.330068 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.331313 18524 raft_consensus.cc:2410] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:22:32.332873 18646 leader_election.cc:336] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.979s (SENT)
I20260709 12:22:32.333321 18646 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:32.334865 18646 leader_election.cc:336] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.985s (SENT)
I20260709 12:22:32.335263 18646 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:32.335575 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.336935 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.336956 20280 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:32.337673 18526 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:32.338066 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.338402 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.338856 18529 raft_consensus.cc:2410] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:32.339146 18525 raft_consensus.cc:2393] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 2: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:32.339730 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.326092 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:32.340981 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.341682 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.342037 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.343070 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:32.343993 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:32.345121 18679 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:32.346189 20230 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:32.343986 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:32.346427 20280 raft_consensus.cc:2749] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:32.347556 18528 raft_consensus.cc:2410] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:32.347975 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.348524 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.348630 18527 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:32.349007 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.348539 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:22:32.350610 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 48325.8us
W20260709 12:22:32.353693 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 84661.3us
I20260709 12:22:32.355248 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.357324 18528 raft_consensus.cc:2368] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3.
I20260709 12:22:32.371363 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:32.317782 20304 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:32.374147 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.375278 18525 raft_consensus.cc:2410] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:32.339552 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.306946 20253 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:32.384066 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.386183 18524 raft_consensus.cc:2393] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:32.385473 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.358889 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:32.380417 18570 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:32.395372 18527 raft_consensus.cc:2393] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 4: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:32.397739 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:32.398594 18528 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:32.355726 20096 raft_consensus.cc:2804] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:32.411093 19209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.412081 20145 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:32.417729 18572 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:32.385486 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 204480us
I20260709 12:22:32.414018 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:32.403218 20096 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:32.430143 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 75690.7us
I20260709 12:22:32.435163 18529 raft_consensus.cc:1275] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:32.409548 20305 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:32.442865 18646 leader_election.cc:336] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.090s (SENT)
I20260709 12:22:32.456494 18646 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:32.445394 18524 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:32.413285 20026 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:32.443277 18680 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:32.499789 20026 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:32.447445 20157 consensus_queue.cc:1048] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:22:32.502604 20026 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:32.506270 18572 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:32.433590 18523 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:32.492427 20153 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:32.439193 20336 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:32.463063 18570 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:32.517019 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:32.516918 20235 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:32.517390 19681 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:32.518042 20145 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:32.518276 20337 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3.
I20260709 12:22:32.443670 20149 consensus_queue.cc:1048] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:22:32.432344 20096 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:32.519233 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:32.516111 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.490684 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:32.525355 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 105933us
I20260709 12:22:32.523087 20017 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:32.497547 20275 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:32.538702 18572 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:32.534771 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 219163us
I20260709 12:22:32.538599 18525 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4.
I20260709 12:22:32.514297 20056 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:32.544894 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:32.560113 18530 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:22:32.529434 20145 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.542945 18679 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
W20260709 12:22:32.549446 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 86504.1us
I20260709 12:22:32.558344 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:32.561031 20145 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:32.563886 18570 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:32.564653 20276 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:32.566710 20145 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:32.443670 20162 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:32.545432 20088 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:32.570660 18646 leader_election.cc:336] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.145s (SENT)
I20260709 12:22:32.576138 18646 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:32.546684 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:32.572963 18525 raft_consensus.cc:1217] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[3.5-3.5]   Dedup: 3.5->[]
I20260709 12:22:32.578963 18525 raft_consensus.cc:1240] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:22:32.569439 20015 raft_consensus.cc:2804] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:32.581429 18524 raft_consensus.cc:1240] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:22:32.551867 18672 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:32.614600 18525 raft_consensus.cc:1240] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:32.616377 18524 raft_consensus.cc:1240] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:32.575850 20088 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:32.618986 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 171348us
I20260709 12:22:32.627904 20088 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:32.637143 20056 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:32.646344 20088 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:32.647696 20235 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:32.614811 20253 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:32.583091 19681 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:32.585554 18523 raft_consensus.cc:3055] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:32.660897 18680 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.659868 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:32.661870 18528 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:32.579818 20338 consensus_queue.cc:1059] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:22:32.649080 20145 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:22:32.689311 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 118689us
I20260709 12:22:32.661051 18523 raft_consensus.cc:740] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:32.721969 18525 raft_consensus.cc:1275] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:22:32.724867 18646 leader_election.cc:336] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.174s (SENT)
W20260709 12:22:32.728229 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 161141us
I20260709 12:22:32.738458 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:32.735457 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 44591.6us
W20260709 12:22:32.742578 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 106702us
W20260709 12:22:32.754984 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.755686 18679 raft_consensus.cc:1240] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:32.701476 19681 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:32.757117 18606 raft_consensus.cc:1240] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:32.744714 20162 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:32.760248 18676 raft_consensus.cc:1275] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:32.760320 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:32.761883 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:32.762198 18600 raft_consensus.cc:1275] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:32.764683 20145 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:32.765455 20275 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:32.766122 20343 log.cc:927] Time spent T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:22:32.772030 19681 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:32.772816 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:32.773464 18606 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:32.774374 19681 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:32.775826 18606 raft_consensus.cc:1240] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:32.776822 18572 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:32.777835 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:32.746966 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:32.778887 18672 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
W20260709 12:22:32.785701 20342 log.cc:927] Time spent T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:22:32.787259 20337 raft_consensus.cc:3055] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:32.787676 20337 raft_consensus.cc:740] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:32.787843 18597 raft_consensus.cc:1240] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:32.788621 20337 consensus_queue.cc:260] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:32.789969 18673 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:32.790236 20337 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:32.794335 20046 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:32.804867 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:32.807200 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:32.808225 19241 raft_consensus.cc:2410] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:22:32.809407 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:22:32.813148 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 111538us
W20260709 12:22:32.820448 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 70523.5us
I20260709 12:22:32.831184 18572 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:32.833303 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:32.842689 18646 leader_election.cc:336] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.697s (SENT)
I20260709 12:22:32.843564 18646 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:32.744508 20015 raft_consensus.cc:697] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:22:32.848328 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.825500 20275 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:32.803853 19212 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:32.747939 20338 consensus_queue.cc:1059] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.099s
I20260709 12:22:32.866350 18679 raft_consensus.cc:1240] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:32.831097 20088 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:32.876015 20281 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:32.849318 20145 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:32.884387 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.881541 18572 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:32.844791 20017 raft_consensus.cc:697] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:32.898463 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:32.864816 20275 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.878568 20056 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:32.905103 18572 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:32.849639 20276 consensus_queue.cc:1048] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
W20260709 12:22:32.904040 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 61510.9us
I20260709 12:22:32.744719 18523 consensus_queue.cc:260] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:32.894883 20145 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:32.947515 18606 raft_consensus.cc:1240] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:32.949892 18646 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:32.953469 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 48472.4us
I20260709 12:22:32.957049 18677 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.910650 20275 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:32.970084 18679 raft_consensus.cc:1240] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:32.953410 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:32.972262 19243 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:32.974076 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:32.975103 18671 raft_consensus.cc:2468] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:32.975813 18598 raft_consensus.cc:1240] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:32.976719 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:32.977622 18671 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:32.978996 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:32.979852 18523 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:32.980060 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:32.984234 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:32.961999 20088 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:32.986833 20088 raft_consensus.cc:697] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:32.988112 20088 consensus_queue.cc:237] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:32.991842 18600 raft_consensus.cc:1240] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:32.993309 19209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.994609 18674 raft_consensus.cc:1240] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:32.933961 20336 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:32.996811 18674 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:32.996752 20336 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:32.998330 20015 consensus_queue.cc:237] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:32.913425 20338 consensus_queue.cc:1243] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:22:32.914806 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 170745us
I20260709 12:22:33.000669 20353 raft_consensus.cc:2804] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:33.001279 19212 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:33.001535 20017 consensus_queue.cc:237] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:33.003971 20026 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:33.004530 20026 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.004976 20026 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:33.005177 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:33.005934 18521 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:22:33.008103 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:33.008656 20153 consensus_queue.cc:1048] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:33.009857 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:33.011332 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:33.013296 18675 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:32.948320 20304 consensus_meta.cc:287] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.002s
I20260709 12:22:32.946568 20145 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:32.985927 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:33.030762 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:33.034391 18530 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:32.917098 20291 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:33.034391 18680 raft_consensus.cc:1275] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.001300 20353 raft_consensus.cc:697] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:33.038841 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:33.039904 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:33.037197 20291 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.046837 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:33.028398 20304 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:33.045360 20291 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:33.075917 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.080888 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:33.039328 20353 consensus_queue.cc:237] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:33.040759 18671 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:33.078760 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:33.084771 18603 raft_consensus.cc:2410] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:22:33.080953 18523 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:22:33.094638 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:33.097055 18601 raft_consensus.cc:2368] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3.
I20260709 12:22:33.097548 20345 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:33.099334 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:33.077747 18600 raft_consensus.cc:1240] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:33.103648 18605 raft_consensus.cc:2393] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:33.078320 20149 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:33.083959 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:33.096616 18523 pending_rounds.cc:85] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 2
I20260709 12:22:33.113524 18606 raft_consensus.cc:1275] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:33.128430 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:33.132754 20096 consensus_meta.cc:287] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.004s
I20260709 12:22:33.103945 20162 raft_consensus.cc:3055] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:33.181372 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:33.186041 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 339241us
I20260709 12:22:33.186802 18570 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:33.113219 20039 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.110987 20336 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:33.197081 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:33.206984 18644 leader_election.cc:400] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3.
I20260709 12:22:33.207335 18644 leader_election.cc:403] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:22:33.135205 18523 pending_rounds.cc:107] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:22:33.177003 20338 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:33.183564 20162 raft_consensus.cc:740] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:33.214722 20336 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.214269 18523 raft_consensus.cc:2889] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:33.183959 20096 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:33.241384 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 197278us
I20260709 12:22:33.137217 20149 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:33.218792 19681 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:33.197095 20039 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:33.288650 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 338844us
I20260709 12:22:33.219867 20338 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:33.296617 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:33.297832 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.301784 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:33.301435 20304 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:33.297339 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1209) took 1002 ms. Trace:
W20260709 12:22:33.334245 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 147478us
I20260709 12:22:33.338516 20350 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:33.339087 20350 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.339457 20350 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:33.313998 20162 consensus_queue.cc:260] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:33.344341 20356 log.cc:927] Time spent T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:22:33.347576 20026 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:33.348791 20096 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:33.354099 18646 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:33.304021 20275 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:33.365546 18646 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:33.360736 18675 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.369202 18677 raft_consensus.cc:1275] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.338500 20039 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:33.361384 20026 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:33.384284 18646 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:33.375571 20063 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:33.375636 20153 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.377342 20304 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:33.334257 18523 rpcz_store.cc:276] 0709 12:22:32.292757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.541184 (+248427us) service_pool.cc:224] Handling call
0709 12:22:32.572265 (+ 31081us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:33.270307 (+698042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:33.294868 (+ 24561us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:33.399317 20358 log.cc:927] Time spent T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:22:33.391629 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:33.405831 20056 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:33.404124 20039 raft_consensus.cc:2749] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:33.406437 20056 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:33.403954 20063 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:33.408597 20063 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:33.409740 18530 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:33.403687 18597 raft_consensus.cc:2393] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 4: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:33.396967 20153 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:33.420287 18522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1214) took 1083 ms. Trace:
I20260709 12:22:33.410739 20063 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:33.445190 18570 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:22:33.445241 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 202343us
I20260709 12:22:33.450028 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:33.450551 20056 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:33.420708 18522 rpcz_store.cc:276] 0709 12:22:32.336499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.573541 (+237042us) service_pool.cc:224] Handling call
0709 12:22:32.657510 (+ 83969us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:32.683732 (+ 26222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:32.684236 (+   504us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:32.751688 (+ 67452us) log.cc:844] Serialized 26 byte log entry
0709 12:22:33.057666 (+305978us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:33.064411 (+  6745us) log.cc:844] Serialized 14 byte log entry
0709 12:22:33.239997 (+175586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:33.240202 (+   205us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:33.419310 (+179108us) raft_consensus.cc:1685] finished
0709 12:22:33.420003 (+   693us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:33.420189 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":278,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":207426,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":13988,"thread_start_us":455514,"threads_started":2,"wal-append.queue_time_us":450952}
W20260709 12:22:33.452018 19209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.452651 20046 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.453159 20046 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:33.453632 20145 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:33.455233 20046 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:33.455953 18603 raft_consensus.cc:1240] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6. Ops: []
W20260709 12:22:33.460618 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 251887us
I20260709 12:22:33.461380 20349 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:33.418674 20149 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:33.458542 20145 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:33.487874 20349 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.488696 20349 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.463377 18527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 126) took 1013 ms. Trace:
I20260709 12:22:33.470952 20338 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:22:33.472370 20275 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:33.476487 20153 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:33.496747 18527 rpcz_store.cc:276] 0709 12:22:32.450351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.665136 (+214785us) service_pool.cc:224] Handling call
0709 12:22:32.695525 (+ 30389us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b5800002798. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:32.695709 (+   184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:32.721640 (+ 25931us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:33.057940 (+336300us) log.cc:844] Serialized 14 byte log entry
0709 12:22:33.463052 (+405112us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:33.463107 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:33.463158 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:33.463222 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:33.463324 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18856,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"spinlock_wait_cycles":2533248,"thread_start_us":686778,"threads_started":3,"wal-append.queue_time_us":281946}
W20260709 12:22:33.573369 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:33.569082 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 45116.3us
I20260709 12:22:33.455513 20291 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:33.580067 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:22:33.592592 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:33.594753 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 173406us
I20260709 12:22:33.595788 18603 raft_consensus.cc:2368] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:22:33.594738 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:33.597376 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:33.612656 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 101295us
W20260709 12:22:33.615501 18646 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.173s (SENT) [suppressed 31 similar messages]
I20260709 12:22:33.522975 20338 consensus_queue.cc:1048] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 12:22:33.595261 20046 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:33.611886 18521 consensus_meta.cc:287] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.605s	user 0.012s	sys 0.001s
I20260709 12:22:33.581207 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:33.633499 20039 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.579578 20385 consensus_queue.cc:1059] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 12:22:33.635192 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:33.641561 20336 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3.
W20260709 12:22:33.661350 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 45879.8us
I20260709 12:22:33.648577 18521 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:33.648355 20046 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:33.664981 20039 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:33.674507 20039 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:33.670800 18646 leader_election.cc:336] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.114s (SENT)
I20260709 12:22:33.670682 18570 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:33.659658 18522 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4.
W20260709 12:22:33.684532 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.687326 20046 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:33.688681 20353 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.688890 18570 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:33.690063 20149 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:33.693125 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:33.695072 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:33.695598 20291 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:33.696650 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:33.696897 20353 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:33.688930 20377 consensus_queue.cc:1048] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:22:33.697441 19243 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:33.661201 20350 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:33.700721 20350 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:33.707651 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:33.708884 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:33.709214 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:33.709591 18671 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.709909 19241 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:33.710363 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:33.710983 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:33.711351 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:33.711740 18679 raft_consensus.cc:2393] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 3: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:33.711994 18675 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:33.712980 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:33.713629 18678 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.714190 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:33.715051 19243 raft_consensus.cc:2393] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 6: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:22:33.710985 18677 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:33.712782 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:22:33.720052 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.724375 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:33.725559 18675 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:33.724265 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:33.728796 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:33.730274 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:33.734930 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 68934us
W20260709 12:22:33.736152 18646 leader_election.cc:336] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.135s (SENT)
I20260709 12:22:33.736744 18646 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:33.737944 20385 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:33.726723 18673 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:33.744451 18679 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:33.745159 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:33.751832 18671 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
W20260709 12:22:33.750697 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 132169us
I20260709 12:22:33.753445 20349 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:33.758855 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1284) took 1559 ms. Trace:
I20260709 12:22:33.749650 18675 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:33.764042 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:33.774152 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:33.774296 18676 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.767495 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:33.775128 18679 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.771554 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:33.776135 18530 raft_consensus.cc:2393] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 6: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:33.768625 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:33.776949 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:33.777688 18677 raft_consensus.cc:2393] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 4: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:33.772310 19212 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:33.778090 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:33.772284 18526 rpcz_store.cc:276] 0709 12:22:32.199085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.648124 (+449039us) service_pool.cc:224] Handling call
0709 12:22:32.656853 (+  8729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:32.657047 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:32.682412 (+ 25365us) log.cc:844] Serialized 14 byte log entry
0709 12:22:33.758400 (+1075988us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b18003696a0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc7c0874bc 00007efc793d548b 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793ef455 00007efc7c4d7060 00007efc7c4e9716 00007efc7c4fa287
0709 12:22:33.758513 (+   113us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:33.758572 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:33.758614 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:33.758680 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:33.758792 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14262,"prepare.queue_time_us":23675,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":182902,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":15757,"spinlock_wait_cycles":46893568,"thread_start_us":556170,"threads_started":2,"wal-append.queue_time_us":522830}
W20260709 12:22:33.760686 20365 log.cc:927] Time spent T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638: Append to log took a long time: real 0.369s	user 0.000s	sys 0.003s
I20260709 12:22:33.755700 20349 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:33.792462 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:33.793351 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:33.763468 18673 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:33.815605 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:33.816790 18675 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:33.818717 20353 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.821846 20353 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:33.825680 20353 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:33.794180 20354 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.826364 20354 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:33.828153 20354 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:33.830210 20304 raft_consensus.cc:3055] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:33.830669 20304 raft_consensus.cc:740] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:33.832134 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:33.783363 20026 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:33.845420 18676 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:33.859979 20162 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:33.860831 18673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:22:33.861706 18673 raft_consensus.cc:606] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:33.862116 18673 raft_consensus.cc:614] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:33.867070 18572 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:33.868489 18678 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:33.870858 18678 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:33.872334 18572 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:33.873265 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:33.874559 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:33.875197 18526 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:33.874747 18602 raft_consensus.cc:2393] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:33.878109 18644 leader_election.cc:400] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:22:33.882876 18644 leader_election.cc:403] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:22:33.873173 20026 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.888281 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:33.889765 20304 consensus_queue.cc:260] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:33.890899 18646 leader_election.cc:336] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.891s (SENT)
I20260709 12:22:33.884202 20276 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:33.892037 20026 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:33.892071 20017 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.892874 18494 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:33.891388 20304 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:33.904572 18602 raft_consensus.cc:1240] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:22:33.909808 18680 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:33.910998 18680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "8c29c312e4544452b1162d7f81a58cb4"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:22:33.911970 18680 raft_consensus.cc:606] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Received request to transfer leadership to TS 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:33.912971 18680 raft_consensus.cc:614] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:33.922151 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:33.925215 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:33.926008 18606 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:22:33.935070 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:33.936825 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:33.938725 18675 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
W20260709 12:22:33.941684 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:33.943145 20398 log.cc:927] Time spent T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:22:33.943854 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:33.945060 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:33.946221 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:33.950817 18522 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:33.953063 18677 raft_consensus.cc:1275] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.919019 20146 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:33.919303 20276 raft_consensus.cc:697] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:22:33.987607 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.994591 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:22:33.997499 18646 leader_election.cc:336] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.648s (SENT)
I20260709 12:22:33.939388 19681 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:22:34.005731 18602 raft_consensus.cc:2393] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 3: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:33.919205 20017 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:34.013300 18602 raft_consensus.cc:1275] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:33.993817 20397 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.992921 20371 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.996630 20146 raft_consensus.cc:697] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:34.005790 20370 raft_consensus.cc:2804] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:34.020295 18529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1301) took 1053 ms. Trace:
I20260709 12:22:34.002823 20336 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:34.021509 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:34.023535 18529 rpcz_store.cc:276] 0709 12:22:32.966929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.317672 (+350743us) service_pool.cc:224] Handling call
0709 12:22:33.336744 (+ 19072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:33.368067 (+ 31323us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:33.378204 (+ 10137us) log.cc:844] Serialized 14 byte log entry
0709 12:22:34.019952 (+641748us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:34.020004 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:34.020059 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:34.020127 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:34.020238 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":447309,"prepare.queue_time_us":18333,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"thread_start_us":176254,"threads_started":1,"wal-append.queue_time_us":234132}
W20260709 12:22:34.022120 19209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:34.044135 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.024320 20384 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.103107 20384 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:34.105530 20384 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:34.098323 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:34.107602 20146 consensus_queue.cc:237] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:34.100330 20404 log.cc:927] Time spent T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:22:34.101110 20402 log.cc:927] Time spent T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:22:34.024739 20370 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:22:34.139072 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:34.147171 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.069013 20276 consensus_queue.cc:237] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:34.022802 20397 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:34.032183 20336 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:34.023097 20371 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:34.160154 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:34.162038 20017 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:34.165463 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:34.165973 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:34.167132 20336 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:34.183214 18679 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:34.185606 18604 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:34.209434 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:34.146659 20370 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:34.197861 18646 leader_election.cc:336] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.843s (SENT)
I20260709 12:22:34.211333 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:34.211532 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:34.213348 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 320523us
I20260709 12:22:34.213658 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:34.288426 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:34.301357 18528 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
W20260709 12:22:34.303218 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 105423us
I20260709 12:22:34.304173 18603 raft_consensus.cc:2393] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 3: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:34.211891 19243 raft_consensus.cc:1240] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:22:34.312171 18526 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:34.260177 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:34.266325 20336 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:22:34.288308 20374 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:34.316188 18570 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:34.323685 18570 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:34.325289 20015 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:34.325743 20015 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:34.326139 20015 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:34.306867 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:34.312899 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:34.354768 18570 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:34.340790 20349 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:34.354768 18678 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:34.358760 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1302) took 1299 ms. Trace:
I20260709 12:22:34.366663 18523 rpcz_store.cc:276] 0709 12:22:33.059672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.400579 (+340907us) service_pool.cc:224] Handling call
0709 12:22:33.400996 (+   417us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:33.893786 (+492790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:33.893821 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:33.917954 (+ 24133us) log.cc:844] Serialized 52 byte log entry
0709 12:22:34.155419 (+237465us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:34.311117 (+155698us) log.cc:844] Serialized 14 byte log entry
0709 12:22:34.318934 (+  7817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:34.333584 (+ 14650us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:34.340601 (+  7017us) raft_consensus.cc:1685] finished
0709 12:22:34.344413 (+  3812us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:34.357789 (+ 13376us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":492270,"prepare.queue_time_us":97044,"raft.queue_time_us":495747,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":27572,"spinlock_wait_cycles":30159616,"thread_start_us":189437,"threads_started":1,"wal-append.queue_time_us":350429}
W20260709 12:22:34.367738 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 44714us
I20260709 12:22:34.380635 20397 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:34.382695 20371 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:34.382894 20145 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:34.383303 20015 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:34.383528 18494 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:34.384310 18524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 130) took 1348 ms. Trace:
I20260709 12:22:34.379207 20377 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:34.384526 20370 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:34.399516 20397 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.400123 20397 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:34.393899 20026 consensus_meta.cc:287] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.000s
I20260709 12:22:34.394101 20410 raft_consensus.cc:2749] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:34.386718 18524 rpcz_store.cc:276] 0709 12:22:33.036060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.394129 (+358069us) service_pool.cc:224] Handling call
0709 12:22:33.404598 (+ 10469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:33.993280 (+588682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:33.993309 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:34.015252 (+ 21943us) log.cc:844] Serialized 26 byte log entry
0709 12:22:34.279347 (+264095us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:34.279380 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:34.279491 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:34.384059 (+104568us) raft_consensus.cc:1685] finished
0709 12:22:34.384079 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:34.384239 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":593101,"raft.queue_time_us":586058,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":6070,"thread_start_us":217053,"threads_started":1,"wal-append.queue_time_us":291746}
I20260709 12:22:34.344340 20374 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:34.397008 20371 consensus_queue.cc:1059] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:34.388329 18570 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:34.404234 18678 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:34.398221 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:34.386502 18525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1303) took 1319 ms. Trace:
I20260709 12:22:34.401320 20370 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:34.401999 18529 raft_consensus.cc:1240] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:34.402434 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.365104 20349 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.431269 20349 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:34.387115 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 595843us
I20260709 12:22:34.406325 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:34.433152 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.401898 20026 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:34.408033 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:34.413528 18570 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:34.441288 18570 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:34.414463 20088 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:34.407719 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:34.443260 18680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "8c29c312e4544452b1162d7f81a58cb4"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:22:34.443450 18570 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:34.443918 18680 raft_consensus.cc:606] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Received request to transfer leadership to TS 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:34.444224 20353 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:34.420972 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:34.421648 20410 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:34.422513 18494 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:34.405200 18525 rpcz_store.cc:276] 0709 12:22:33.067016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.400920 (+333904us) service_pool.cc:224] Handling call
0709 12:22:33.401293 (+   373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:33.904414 (+503121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:33.904447 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:33.920660 (+ 16213us) log.cc:844] Serialized 52 byte log entry
0709 12:22:34.173928 (+253268us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:34.173971 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:34.174041 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:34.386268 (+212227us) raft_consensus.cc:1685] finished
0709 12:22:34.386296 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:34.386441 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":555977,"raft.queue_time_us":512721,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":6084,"thread_start_us":179032,"threads_started":1,"wal-append.queue_time_us":381066}
I20260709 12:22:34.438613 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:34.402127 20397 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:34.446746 18603 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:34.402665 20015 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:34.440822 19210 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:34.445393 18570 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:34.448637 18570 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:34.451830 20370 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:34.452384 20370 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:34.446295 20017 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:34.452823 20370 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:34.453166 20145 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:34.453807 18494 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:34.453886 20146 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:34.455861 18570 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:34.457438 18644 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:34.447067 20410 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:34.458376 20017 raft_consensus.cc:697] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:34.458755 20410 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:34.459229 18494 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:34.460557 20384 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:34.461001 20384 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:34.461510 20384 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:34.461041 20382 raft_consensus.cc:2804] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:34.460490 18494 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:34.444681 20368 consensus_queue.cc:1059] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:22:34.446161 20362 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:34.448514 20088 raft_consensus.cc:697] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:34.473196 20420 raft_consensus.cc:2804] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:34.475106 20420 raft_consensus.cc:697] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:34.474969 20088 consensus_queue.cc:237] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:34.476404 20420 consensus_queue.cc:237] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:34.447266 18674 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:34.464778 20416 consensus_queue.cc:1048] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:22:34.480765 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:34.486888 18525 raft_consensus.cc:1275] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:34.492637 18570 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:34.457737 20228 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:34.502086 20424 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:34.503788 20424 consensus_queue.cc:1059] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:34.472568 20026 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:34.482102 20397 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:34.481793 20382 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:34.488236 20253 raft_consensus.cc:2804] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:34.459488 20017 consensus_queue.cc:237] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:34.511451 18671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:22:34.511323 20397 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.505998 20146 raft_consensus.cc:697] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:34.530646 19681 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.526705 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:34.552573 18521 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:34.520673 20235 consensus_queue.cc:1048] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 12:22:34.563922 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.535917 20352 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:22:34.538448 18671 raft_consensus.cc:606] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:34.524796 20397 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:34.546425 20410 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:34.522080 20382 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:34.484815 20371 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:22:34.508718 20353 raft_consensus.cc:2804] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:22:34.565421 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 63411.8us
I20260709 12:22:34.521590 20253 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:34.568514 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 56027.6us
I20260709 12:22:34.567857 20145 raft_consensus.cc:697] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:34.576862 18570 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:34.526481 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:22:34.571316 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 73855.7us
I20260709 12:22:34.552429 19681 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:34.581903 19243 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:34.582230 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:34.583205 18598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40948 (request call id 1267) took 1062 ms. Trace:
I20260709 12:22:34.583698 18598 rpcz_store.cc:276] 0709 12:22:33.521061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.594263 (+ 73202us) service_pool.cc:224] Handling call
0709 12:22:34.582023 (+987760us) spinlock_profiling.cc:243] Waited 7.76 ms on lock 0x7b5800102f98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:22:34.583130 (+  1107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17846144}
I20260709 12:22:34.585487 20275 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:34.570182 18671 raft_consensus.cc:614] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:34.588230 18570 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:34.578446 20253 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:34.605450 19209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.566938 20384 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:34.580361 20353 raft_consensus.cc:697] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:34.629807 20145 consensus_queue.cc:237] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:34.616966 20426 raft_consensus.cc:3055] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:22:34.641335 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 53193.4us
I20260709 12:22:34.646502 20336 raft_consensus.cc:993] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1: : Instructing follower 8c29c312e4544452b1162d7f81a58cb4 to start an election
I20260709 12:22:34.624868 20146 consensus_queue.cc:237] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:34.653435 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:34.654663 18646 leader_election.cc:336] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.981s (SENT)
I20260709 12:22:34.678535 18646 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:34.644718 20353 consensus_queue.cc:237] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:34.629220 20088 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:34.659456 18570 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:34.636665 20426 raft_consensus.cc:740] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:22:34.682879 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 109649us
I20260709 12:22:34.684321 18494 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:22:34.691013 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.690907 18570 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:34.690905 18675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:22:34.680348 20410 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:34.682561 20063 raft_consensus.cc:1081] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Signalling peer 8c29c312e4544452b1162d7f81a58cb4 to start an election
I20260709 12:22:34.692376 18675 raft_consensus.cc:606] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:34.695541 18570 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:34.697640 18675 raft_consensus.cc:614] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:34.686609 20354 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.694022 18494 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:34.698699 18572 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:34.703476 18570 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:34.680220 20370 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:34.691165 20337 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:34.686436 20371 consensus_queue.cc:1059] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:22:34.714411 20371 consensus_queue.cc:1243] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer a0dee333a83a45f1ab0c1bb6d094afd1 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:22:34.714975 20371 raft_consensus.cc:2764] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:22:34.715646 20371 raft_consensus.cc:3055] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:34.715808 20423 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:34.716068 20371 raft_consensus.cc:740] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:34.716259 20423 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:34.716670 20423 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:34.716774 20046 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.692521 20088 raft_consensus.cc:697] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:34.695963 20275 raft_consensus.cc:697] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:34.696436 20418 raft_consensus.cc:3055] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:34.717043 20371 consensus_queue.cc:260] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:34.725661 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.727125 18530 raft_consensus.cc:1275] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:34.727298 18525 raft_consensus.cc:1275] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:34.717882 20410 raft_consensus.cc:2804] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:34.721261 20235 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:34.722890 20418 raft_consensus.cc:740] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:34.719520 20434 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:34.738624 20374 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:34.721607 20046 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:34.735970 18570 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:34.730891 20377 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:34.744274 20437 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:34.746702 20397 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:34.748463 20370 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:34.749801 20275 consensus_queue.cc:237] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:34.704484 20354 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:34.738896 19681 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:34.763970 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:34.767189 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.732985 20410 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:34.768788 20410 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:34.770653 20354 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:34.771270 20432 consensus_queue.cc:1059] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:22:34.772411 20432 raft_consensus.cc:3055] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:34.772884 20432 raft_consensus.cc:740] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:34.773635 20397 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:22:34.776814 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 56097.8us
I20260709 12:22:34.776633 19243 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7"
dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
 from {username='slave'} at 127.0.0.1:33382
I20260709 12:22:34.784147 19243 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:34.784719 19243 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:34.785058 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:34.785490 18521 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 5.
I20260709 12:22:34.785772 19244 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:22:34.786700 20434 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:34.786882 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 51004.5us
I20260709 12:22:34.787689 18570 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:34.788004 20418 consensus_queue.cc:260] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:34.789984 20418 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:34.790390 18675 raft_consensus.cc:1275] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:34.740525 20371 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:34.799052 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 105276us
I20260709 12:22:34.792484 19212 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:34.773846 20432 consensus_queue.cc:260] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:34.793324 20377 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.795189 19210 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:34.740898 20384 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:34.730127 20349 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:34.804874 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:34.809132 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:34.812526 19210 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:34.805933 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:34.806185 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:34.778272 20429 log.cc:927] Time spent T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:22:34.715672 20426 consensus_queue.cc:260] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:34.817000 19210 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:34.800172 20235 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:34.793241 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:34.821425 18494 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:34.822978 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:34.870627 19240 raft_consensus.cc:1275] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:34.874462 18606 raft_consensus.cc:2368] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 3. Current term is 4.
I20260709 12:22:34.881019 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:34.900895 20349 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:34.905386 20439 consensus_queue.cc:1059] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.096s
I20260709 12:22:34.882761 20432 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:34.822269 20374 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:22:34.879930 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:34.819319 20017 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:22:34.899075 20427 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:34.793198 20088 consensus_queue.cc:237] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:34.865334 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:34.825222 18671 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:34.900520 18674 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:34.962450 20442 raft_consensus.cc:2804] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:34.867025 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 50098.3us
W20260709 12:22:34.873962 18646 leader_election.cc:336] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.849s (SENT)
I20260709 12:22:34.817129 20377 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:34.959336 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 138008us
W20260709 12:22:34.961831 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 137457us
I20260709 12:22:34.908638 20436 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.136s
I20260709 12:22:34.942312 20410 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:34.963981 20026 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:34.974278 20430 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:22:34.981163 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 107252us
I20260709 12:22:34.982578 18572 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:34.974494 18599 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:34.983251 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 110086us
I20260709 12:22:34.996755 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:34.997463 18677 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:34.999889 19244 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:35.001654 20410 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:35.002328 20410 consensus_queue.cc:1048] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:34.998420 20447 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:35.003633 20447 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:35.004035 20447 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:35.009063 19243 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:35.009692 18529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 141) took 1224 ms. Trace:
I20260709 12:22:35.010291 20368 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:35.012149 20384 raft_consensus.cc:3055] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:35.012042 20253 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:35.012593 20384 raft_consensus.cc:740] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:35.013195 20420 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.013732 20420 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:35.014317 20253 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:35.014046 20384 consensus_queue.cc:260] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:34.986490 20439 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:22:35.016848 18570 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:35.017479 20017 consensus_queue.cc:1048] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:35.017983 20420 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:35.018568 20420 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:35.019035 20420 raft_consensus.cc:697] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:35.019893 20420 consensus_queue.cc:237] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:35.021090 20382 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:35.026865 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:35.027508 18679 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:35.030449 18570 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:35.031976 20149 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:34.980512 20442 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:35.032225 18671 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:35.032397 20149 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.033110 20149 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:35.033437 18570 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:35.035976 20017 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:35.036466 20017 raft_consensus.cc:697] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:35.036716 18525 raft_consensus.cc:1240] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:35.037353 20017 consensus_queue.cc:237] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:35.037909 18530 raft_consensus.cc:1240] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:35.038664 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:35.039260 19244 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:22:34.998842 20354 consensus_queue.cc:1048] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:22:35.046859 19244 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:35.049911 18570 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:35.032589 20442 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:35.051342 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 59750.7us
I20260709 12:22:35.052421 18570 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:35.052734 20353 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:35.011528 19243 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:35.056362 20433 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:35.056900 20433 raft_consensus.cc:697] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:22:35.056694 18646 leader_election.cc:336] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.234s (SENT)
I20260709 12:22:35.057807 18646 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:35.058045 20433 consensus_queue.cc:237] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:35.059414 20063 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:35.059875 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 61806.8us
I20260709 12:22:35.061764 20250 raft_consensus.cc:3055] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:35.062172 20250 raft_consensus.cc:740] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:22:35.067852 18646 leader_election.cc:336] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.106s (SENT)
I20260709 12:22:35.010102 18529 rpcz_store.cc:276] 0709 12:22:33.785584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.068881 (+283297us) service_pool.cc:224] Handling call
0709 12:22:34.122122 (+ 53241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:34.410850 (+288728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:35.009406 (+598556us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b5400287154. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:35.009609 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643184384}
I20260709 12:22:35.068379 18646 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:35.071010 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 85885.5us
I20260709 12:22:35.072510 19210 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:34.982277 20427 raft_consensus.cc:697] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 5 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
W20260709 12:22:35.077209 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.988511 20046 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:35.023590 20382 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:35.097080 18677 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:35.117779 20426 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:35.118228 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:35.118790 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.063129 20250 consensus_queue.cc:260] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:35.124884 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 52463.3us
W20260709 12:22:35.127974 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 55233.2us
W20260709 12:22:35.131815 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.080384 20063 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:35.131204 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:35.081245 20228 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:35.127661 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 141741us
I20260709 12:22:35.084070 20416 consensus_queue.cc:1059] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:22:35.160267 18494 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:35.090029 20351 consensus_queue.cc:1048] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:22:35.162672 19210 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:35.124727 20291 consensus_queue.cc:1059] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:22:35.173753 20384 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:35.175043 20450 consensus_queue.cc:1059] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 12:22:35.186756 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:35.196144 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.205230 18644 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:22:35.211977 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 62253.1us
I20260709 12:22:35.192340 20250 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:35.216210 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:35.218299 18677 raft_consensus.cc:3055] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:35.218719 18677 raft_consensus.cc:740] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:35.169297 20455 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:35.230176 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.231810 18494 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:35.201946 20253 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:35.240285 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 108246us
I20260709 12:22:35.243673 18599 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:35.237118 18677 consensus_queue.cc:260] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:35.227387 20063 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:35.228804 20026 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:35.236497 20304 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.272897 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:35.277315 18494 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:35.299666 18524 raft_consensus.cc:1240] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:35.217401 20440 consensus_queue.cc:1048] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:22:35.249728 20253 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:35.303287 18528 raft_consensus.cc:3055] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:35.308017 18528 raft_consensus.cc:740] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:35.229276 20447 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:35.166460 20427 consensus_queue.cc:237] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:35.265774 20337 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:35.270160 20063 raft_consensus.cc:697] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:35.309201 20457 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:35.275965 20377 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:35.246520 20362 consensus_queue.cc:1048] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:22:35.317688 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:35.320204 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 50717.4us
I20260709 12:22:35.331704 18494 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:35.277386 20304 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:35.320914 18528 consensus_queue.cc:260] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:35.315922 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:35.346370 18494 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:35.346751 18528 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:35.336678 18597 raft_consensus.cc:1240] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 3. Current term is 4. Ops: []
W20260709 12:22:35.357497 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.317121 20337 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:35.370870 20304 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:35.371795 20459 log.cc:927] Time spent T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 12:22:35.373296 20460 log.cc:927] Time spent T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
W20260709 12:22:35.375986 20458 log.cc:927] Time spent T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:22:35.389775 20418 raft_consensus.cc:3055] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:35.390434 20418 raft_consensus.cc:740] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:35.391582 20153 raft_consensus.cc:3055] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:35.392215 20153 raft_consensus.cc:740] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:35.393316 20153 consensus_queue.cc:260] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:35.394989 20153 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:35.400274 20063 consensus_queue.cc:237] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:35.407188 18529 raft_consensus.cc:2410] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:22:35.408524 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.344527 20336 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:35.364372 20371 consensus_meta.cc:287] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.003s
I20260709 12:22:35.347254 20456 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:35.453727 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 107459us
W20260709 12:22:35.445638 20423 consensus_meta.cc:287] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.728s	user 0.010s	sys 0.003s
I20260709 12:22:35.449127 18680 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:35.441408 20253 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:35.472446 18494 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:35.452688 20384 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.477805 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:35.479244 18679 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:35.483983 18494 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:35.484509 20447 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:35.484884 20253 raft_consensus.cc:2749] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:35.485003 20371 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:35.456063 20336 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:35.485232 18494 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:35.486487 20456 raft_consensus.cc:2764] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:22:35.487478 20336 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:35.487771 18494 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:35.488613 20456 raft_consensus.cc:2749] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:35.488270 20384 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:35.490849 20384 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:35.492306 20426 consensus_queue.cc:1059] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:35.493498 20384 raft_consensus.cc:3055] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:35.493736 20337 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:35.493904 20384 raft_consensus.cc:740] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:35.495846 18680 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:35.391533 20418 consensus_queue.cc:260] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:35.504133 18606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "8c29c312e4544452b1162d7f81a58cb4"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:22:35.512243 18606 raft_consensus.cc:606] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Received request to transfer leadership to TS 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:35.512614 18606 raft_consensus.cc:614] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:35.494962 20384 consensus_queue.cc:260] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:35.518498 18522 raft_consensus.cc:3055] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:35.519763 18522 raft_consensus.cc:740] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:35.520449 18673 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:35.520567 18522 consensus_queue.cc:260] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:35.454964 20442 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:35.521772 18522 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:35.523248 20442 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:35.524097 20149 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:35.526161 20149 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:35.526711 20149 consensus_queue.cc:1059] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:35.528191 20145 raft_consensus.cc:3055] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:35.528541 20145 raft_consensus.cc:740] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:35.479221 20423 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:35.529377 20145 consensus_queue.cc:260] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:35.530625 20145 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:35.519210 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.531446 20423 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:35.512650 18528 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:22:35.540035 18528 pending_rounds.cc:85] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 2
I20260709 12:22:35.540481 18528 pending_rounds.cc:107] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:22:35.540882 18528 raft_consensus.cc:2889] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:35.532874 18570 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:35.551304 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.563424 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:35.564352 18528 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:35.546689 20447 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:22:35.571017 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 12:22:35.581457 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.595407 18494 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:35.656044 20456 consensus_queue.cc:1059] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:35.657111 20456 raft_consensus.cc:3055] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:35.657414 20456 raft_consensus.cc:740] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:35.658241 20456 consensus_queue.cc:260] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:35.659490 20456 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:35.580039 20418 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:35.577592 20423 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:35.580593 20442 consensus_queue.cc:1048] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
W20260709 12:22:35.673174 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 116580us
I20260709 12:22:35.678960 18528 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
W20260709 12:22:35.686800 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:35.704087 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 108795us
I20260709 12:22:35.774827 18522 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:22:35.775524 18522 pending_rounds.cc:85] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 2
I20260709 12:22:35.775928 18522 pending_rounds.cc:107] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:22:35.776077 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:35.776367 18522 raft_consensus.cc:2889] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:35.777221 18528 raft_consensus.cc:2368] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5.
I20260709 12:22:35.778003 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:22:35.780939 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.557991 20384 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:35.779927 20371 consensus_queue.cc:1059] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:22:35.807643 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:35.765353 20063 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.555822 20475 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.228s
I20260709 12:22:35.810711 18528 raft_consensus.cc:1240] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:35.764743 20423 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.767064 20426 raft_consensus.cc:2804] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:35.819516 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:35.830153 18606 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:35.820832 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:35.842258 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:35.843227 18671 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:35.837386 20423 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:35.827345 20371 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:35.868862 18672 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:35.869555 18528 raft_consensus.cc:3055] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:35.835788 20063 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:35.837556 20426 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:22:35.879705 19211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.882452 18673 raft_consensus.cc:1275] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:35.812050 20457 consensus_queue.cc:1059] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
W20260709 12:22:35.908982 20479 log.cc:927] Time spent T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.354s	user 0.001s	sys 0.000s
I20260709 12:22:35.909554 20063 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:35.911347 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
W20260709 12:22:35.913106 20453 log.cc:927] Time spent T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.761s	user 0.004s	sys 0.004s
I20260709 12:22:35.914261 18672 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:22:35.896245 20250 consensus_meta.cc:287] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.661s	user 0.010s	sys 0.000s
W20260709 12:22:35.886425 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 308402us
I20260709 12:22:35.888068 18528 raft_consensus.cc:740] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:35.808573 20420 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
W20260709 12:22:35.931697 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.895462 20426 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:35.937749 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 130185us
I20260709 12:22:35.939045 18494 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:35.954648 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1208) took 1154 ms. Trace:
I20260709 12:22:35.875401 18671 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:35.955221 18678 rpcz_store.cc:276] 0709 12:22:34.800147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.800373 (+   226us) service_pool.cc:224] Handling call
0709 12:22:34.800712 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:34.800934 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:34.800960 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:34.806254 (+  5294us) log.cc:844] Serialized 26 byte log entry
0709 12:22:34.967072 (+160818us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:34.967127 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:34.967230 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:35.912413 (+945183us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:22:35.926093 (+ 13680us) raft_consensus.cc:1685] finished
0709 12:22:35.926119 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:35.954558 (+ 28439us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25122048,"thread_start_us":58630,"threads_started":1,"wal-append.queue_time_us":268211}
I20260709 12:22:35.959326 18677 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:35.959584 18606 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:22:35.967109 18604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39798 (request call id 106) took 1094 ms. Trace:
I20260709 12:22:35.975683 18677 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
W20260709 12:22:35.984866 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 45960.8us
I20260709 12:22:35.967722 18604 rpcz_store.cc:276] 0709 12:22:34.872475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.873270 (+   795us) service_pool.cc:224] Handling call
0709 12:22:34.873690 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:34.973686 (+ 99996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:34.973733 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:34.980378 (+  6645us) log.cc:844] Serialized 26 byte log entry
0709 12:22:35.151190 (+170812us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:35.575447 (+424257us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b18002c8960. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc7c0874bc 00007efc793d548b 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793ef455 00007efc7fed73c7 00007efc7c4e99a7 00007efc7c4f90bf
0709 12:22:35.575664 (+   217us) log.cc:844] Serialized 14 byte log entry
0709 12:22:35.932569 (+356905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:35.932676 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:35.932737 (+    61us) raft_consensus.cc:1685] finished
0709 12:22:35.966823 (+ 34086us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:35.967022 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137730,"prepare.queue_time_us":121907,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":2277,"raft.queue_time_us":241574,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":22380,"spinlock_wait_cycles":4674944,"thread_start_us":542122,"threads_started":4,"wal-append.queue_time_us":224789}
I20260709 12:22:36.015506 18528 consensus_queue.cc:260] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:35.966217 18521 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
W20260709 12:22:36.018221 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 55350.8us
W20260709 12:22:36.023593 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.024958 18528 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:35.983721 20149 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:22:35.990690 20464 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
W20260709 12:22:36.059636 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.036762 20447 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.072263 18528 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:22:36.115378 18528 pending_rounds.cc:85] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 1
I20260709 12:22:36.124472 18528 pending_rounds.cc:107] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:22:36.060688 19244 raft_consensus.cc:1275] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:36.134846 18529 raft_consensus.cc:1240] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:36.126849 18528 raft_consensus.cc:2889] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:36.063848 20499 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:36.085634 20447 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:36.121956 20480 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 12:22:36.174639 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:36.171849 19243 raft_consensus.cc:1240] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:36.174124 20457 raft_consensus.cc:2749] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:36.147521 20499 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:36.208468 18675 raft_consensus.cc:1275] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:36.186702 20503 raft_consensus.cc:3055] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:36.218058 18572 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:36.226658 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:36.211804 20490 log.cc:927] Time spent T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:22:36.209506 20508 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:36.249200 18528 raft_consensus.cc:3055] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:36.251060 18528 raft_consensus.cc:740] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:36.212898 20503 raft_consensus.cc:740] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:36.193831 20276 consensus_queue.cc:1048] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 12:22:36.261014 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.264766 18572 leader_election.cc:400] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5.
I20260709 12:22:36.265159 18572 leader_election.cc:403] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:22:36.266872 18494 connection.cc:256] RPC call timeout handler was delayed by -2.1539763570001469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
W20260709 12:22:36.267382 18494 connection.cc:256] RPC call timeout handler was delayed by -1.9514763570000468s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
W20260709 12:22:36.267706 18494 connection.cc:256] RPC call timeout handler was delayed by -1.9496763570000439s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
W20260709 12:22:36.268018 18494 connection.cc:256] RPC call timeout handler was delayed by -1.6778763570000592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
W20260709 12:22:36.268339 18494 connection.cc:256] RPC call timeout handler was delayed by -1.5662763570001061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23330000000000004s for a response
I20260709 12:22:36.269984 18494 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:36.270601 20494 log.cc:927] Time spent T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:22:36.278303 20430 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:36.279037 20430 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:36.281764 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:36.283663 20430 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:36.284533 20503 consensus_queue.cc:260] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:36.286007 20503 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:36.287688 20447 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:36.289460 20500 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:36.290151 20500 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:36.291245 20153 consensus_meta.cc:287] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.896s	user 0.008s	sys 0.004s
W20260709 12:22:36.265492 20493 log.cc:927] Time spent T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.220s	user 0.000s	sys 0.002s
I20260709 12:22:36.297183 18528 consensus_queue.cc:260] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:36.301255 20506 log.cc:927] Time spent T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:22:36.302500 18525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1349) took 1043 ms. Trace:
I20260709 12:22:36.302911 18525 rpcz_store.cc:276] 0709 12:22:35.259449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.508281 (+248832us) service_pool.cc:224] Handling call
0709 12:22:35.508568 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:35.509042 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:35.509071 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:35.537509 (+ 28438us) log.cc:844] Serialized 26 byte log entry
0709 12:22:35.889487 (+351978us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:35.889535 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:35.889599 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:36.302178 (+412579us) raft_consensus.cc:1685] finished
0709 12:22:36.302206 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.302412 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23248,"raft.queue_time_us":5072,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":112,"thread_start_us":227261,"threads_started":1,"wal-append.queue_time_us":416410}
I20260709 12:22:36.305116 18525 raft_consensus.cc:1240] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:36.306516 18528 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:36.271848 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:36.256912 20508 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:36.305758 20480 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:36.328815 18597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1295) took 1245 ms. Trace:
I20260709 12:22:36.329370 18597 rpcz_store.cc:276] 0709 12:22:35.083275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.090326 (+  7051us) service_pool.cc:224] Handling call
0709 12:22:35.141119 (+ 50793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:35.369816 (+228697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.328474 (+958658us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54000d7854. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:36.328730 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":404744960}
I20260709 12:22:36.332353 20501 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:36.333598 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.328118 20499 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:36.334919 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:36.338752 20500 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:36.318356 20145 consensus_meta.cc:287] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.787s	user 0.010s	sys 0.003s
I20260709 12:22:36.293068 20352 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
W20260709 12:22:36.345774 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.337517 18524 raft_consensus.cc:1275] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:36.348246 18528 raft_consensus.cc:1275] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:22:36.348636 18528 pending_rounds.cc:85] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 1
I20260709 12:22:36.349982 18521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57384 (request call id 1340) took 1099 ms. Trace:
I20260709 12:22:36.350162 20508 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:36.351104 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:36.353052 20153 consensus_queue.cc:1048] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:36.351482 20430 consensus_queue.cc:1059] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:22:36.355504 19681 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:36.356429 19681 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:36.357764 20456 consensus_meta.cc:287] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.576s	user 0.006s	sys 0.004s
W20260709 12:22:36.326840 20384 consensus_meta.cc:287] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.541s	user 0.005s	sys 0.003s
I20260709 12:22:36.358553 19239 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:36.349040 18524 raft_consensus.cc:3055] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:36.307778 20448 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:36.314459 20467 consensus_queue.cc:1059] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:22:36.323112 20426 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:36.355631 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:36.315984 18527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1346) took 1057 ms. Trace:
I20260709 12:22:36.359724 19681 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:36.367399 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:36.368324 18522 raft_consensus.cc:1240] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:36.368990 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:36.360042 18524 raft_consensus.cc:740] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:36.373279 20153 consensus_queue.cc:1059] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:36.374271 20153 raft_consensus.cc:3055] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:36.313930 20423 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:36.374706 20153 raft_consensus.cc:740] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:36.350524 18521 rpcz_store.cc:276] 0709 12:22:35.250391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.259906 (+  9515us) service_pool.cc:224] Handling call
0709 12:22:36.349747 (+1089841us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b54002c6854. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:36.349895 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1347366784}
I20260709 12:22:36.376408 20423 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:36.376055 20153 consensus_queue.cc:260] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:36.378062 18521 raft_consensus.cc:3055] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:36.378166 18522 raft_consensus.cc:1275] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:36.378634 18521 raft_consensus.cc:740] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:36.368153 18424 catalog_manager.cc:5697] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 3 to 4, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 4 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.348888 18528 pending_rounds.cc:107] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:22:36.373893 18524 consensus_queue.cc:260] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:36.327996 18646 leader_election.cc:336] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.617s (SENT)
I20260709 12:22:36.385957 18646 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:22:36.381136 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 111192us
I20260709 12:22:36.366813 18527 rpcz_store.cc:276] 0709 12:22:35.258488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.258600 (+   112us) service_pool.cc:224] Handling call
0709 12:22:35.299233 (+ 40633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:35.316247 (+ 17014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:35.316281 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:35.316320 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:35.316352 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.315628 (+999276us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b5400442ad4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:36.315692 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.315906 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38624000}
I20260709 12:22:36.383109 18604 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:36.385722 18602 raft_consensus.cc:1240] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:36.384008 18606 raft_consensus.cc:1240] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:36.388512 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:22:36.387275 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.382661 18528 raft_consensus.cc:2889] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:36.393286 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:36.393877 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:36.394753 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:36.396504 18524 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:36.397905 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:36.398106 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:36.398757 18602 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:36.399173 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:36.366153 18597 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:22:36.365422 20467 raft_consensus.cc:3055] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:36.400178 20467 raft_consensus.cc:740] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:36.401316 18605 raft_consensus.cc:1240] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:36.405062 18599 raft_consensus.cc:1240] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:36.405301 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:36.363292 20512 log.cc:927] Time spent T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:22:36.404564 20426 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:36.402211 20046 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:36.410959 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 83017.7us
I20260709 12:22:36.387158 20153 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:36.415447 18494 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:36.363832 20448 raft_consensus.cc:697] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:22:36.410483 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 135374us
I20260709 12:22:36.416603 18494 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:36.420680 18606 raft_consensus.cc:2468] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:36.423583 18524 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:22:36.424394 18524 pending_rounds.cc:85] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 2
I20260709 12:22:36.424881 18524 pending_rounds.cc:107] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:22:36.425004 18527 raft_consensus.cc:1240] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:36.425160 18524 raft_consensus.cc:2889] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:36.401008 20467 consensus_queue.cc:260] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:36.430658 20480 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5.
I20260709 12:22:36.432300 18494 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:36.435988 20353 consensus_queue.cc:1059] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:36.437671 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:36.438162 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.438953 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.440418 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.423943 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:36.441358 18524 raft_consensus.cc:2368] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3.
I20260709 12:22:36.436162 20349 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:36.423698 20384 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:36.443384 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:36.453536 18524 raft_consensus.cc:2410] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:22:36.449476 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.444830 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:36.454541 18646 leader_election.cc:336] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.717s (SENT)
I20260709 12:22:36.443432 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:36.445739 20368 consensus_queue.cc:1059] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:22:36.446213 20456 raft_consensus.cc:2804] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:36.458027 20456 raft_consensus.cc:697] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:36.450965 20430 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.459113 20456 consensus_queue.cc:237] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:36.459218 20430 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:36.461246 19243 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:36.379724 18521 consensus_queue.cc:260] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:36.471205 18521 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:36.462195 20430 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:36.467011 20467 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:36.467857 20063 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:36.451113 20384 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:36.446887 20046 consensus_queue.cc:1059] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 12:22:36.499460 19211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.483083 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.441159 20426 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:36.484124 18494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:36.504436 18494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:36.505100 18494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:36.505538 18494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:36.486994 20253 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
W20260709 12:22:36.507543 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 95025.7us
I20260709 12:22:36.487805 20353 raft_consensus.cc:3055] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:36.488408 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:36.485283 20503 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:36.472959 18424 catalog_manager.cc:5697] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 3 to 4, term changed from 1 to 2, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132), VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New cstate: current_term: 2 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.516454 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.495296 18521 raft_consensus.cc:1275] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:22:36.497298 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.517947 18521 pending_rounds.cc:85] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 2
I20260709 12:22:36.484673 20423 consensus_queue.cc:1048] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:22:36.482460 19681 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:36.511296 18494 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
W20260709 12:22:36.515020 19211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.524713 18526 raft_consensus.cc:1240] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:36.493407 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.525744 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1361) took 1015 ms. Trace:
I20260709 12:22:36.526088 18526 rpcz_store.cc:276] 0709 12:22:35.509821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.124785 (+614964us) service_pool.cc:224] Handling call
0709 12:22:36.524341 (+399556us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b5800002798. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:36.524548 (+   207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:36.525497 (+   949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.525691 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9043712}
I20260709 12:22:36.499214 20384 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:36.518443 18521 pending_rounds.cc:107] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:22:36.530099 18521 raft_consensus.cc:2889] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:36.518183 18527 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:36.498935 20063 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:36.516994 20253 consensus_queue.cc:1059] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:22:36.519479 20503 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:36.522154 20468 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:36.516232 20046 raft_consensus.cc:3055] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:36.522725 20235 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.524672 18524 raft_consensus.cc:2393] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:36.526726 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.540649 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:36.541787 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.503793 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:36.541908 20063 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:36.533196 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:36.545603 18526 raft_consensus.cc:2410] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:22:36.528115 18424 catalog_manager.cc:5697] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 1 to 3, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 3 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.536181 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.522274 20228 raft_consensus.cc:3055] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:36.510365 20353 raft_consensus.cc:740] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:36.448589 20448 consensus_queue.cc:237] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:36.530797 18425 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47708 (request call id 170) took 20779 ms (client timeout 15000 ms). Trace:
I20260709 12:22:36.548810 18521 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:36.549098 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.544162 20253 consensus_queue.cc:1243] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:22:36.543242 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.532127 20457 raft_consensus.cc:2804] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:36.546746 18424 catalog_manager.cc:5697] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 3 to 4, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 4 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.574127 18424 catalog_manager.cc:5697] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 1 to 2, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 2 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.537881 20046 raft_consensus.cc:740] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:36.536330 19681 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:36.576202 20525 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:22:36.579052 20353 consensus_queue.cc:260] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:36.579556 19681 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:36.548606 20228 raft_consensus.cc:740] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:36.580374 20353 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:36.580873 20228 consensus_queue.cc:260] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:36.582566 20228 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:36.545118 20235 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:36.576462 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.576606 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.576817 18424 catalog_manager.cc:5697] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 1 to 2, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:36.587023 20457 raft_consensus.cc:697] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:36.587270 20046 consensus_queue.cc:260] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:36.588522 20046 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:36.588155 20457 consensus_queue.cc:237] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:36.590380 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.586500 18424 catalog_manager.cc:5697] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 1 to 2, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 2 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.592680 20063 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:36.593335 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:36.593739 20489 log.cc:927] Time spent T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.696s	user 0.002s	sys 0.003s
W20260709 12:22:36.594908 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.593839 18424 catalog_manager.cc:5697] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.598613 20235 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:36.599236 20503 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:36.603021 19210 leader_election.cc:400] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 3. Current term is 4.
I20260709 12:22:36.603410 19210 leader_election.cc:403] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:36.604068 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.604776 18522 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:36.605715 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.606730 20427 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 3. Current term is 4.
I20260709 12:22:36.608893 20427 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.609437 20427 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:36.609397 18424 catalog_manager.cc:5697] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 1 to 3, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 3 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.608577 19210 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:36.576128 18646 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:36.613153 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 101278us
I20260709 12:22:36.613827 18644 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:36.611078 18424 catalog_manager.cc:5697] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 1 to 2, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
W20260709 12:22:36.566310 18425 rpcz_store.cc:269] 0709 12:22:15.745087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.745252 (+   165us) service_pool.cc:224] Handling call
0709 12:22:36.524084 (+20778832us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:32.737121 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:32.816454 (+ 79333us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:32.816523 (+    69us) write_op.cc:435] Acquired schema lock
0709 12:22:32.816537 (+    14us) tablet.cc:662] Decoding operations
0709 12:22:32.817149 (+   612us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:32.817243 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:32.817274 (+    31us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:22:32.817755 (+   481us) tablet.cc:701] Row locks acquired
0709 12:22:32.817814 (+    59us) write_op.cc:260] PREPARE: finished
0709 12:22:32.817999 (+   185us) write_op.cc:270] Start()
0709 12:22:32.818179 (+   180us) write_op.cc:276] Timestamp: P: 1783599752817923 usec, L: 0
0709 12:22:32.818215 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:22:32.818941 (+   726us) log.cc:844] Serialized 1325 byte log entry
0709 12:22:33.748385 (+929444us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:22:34.332107 (+583722us) op_driver.cc:464] REPLICATION: finished
0709 12:22:34.387383 (+ 55276us) write_op.cc:301] APPLY: starting
0709 12:22:34.387522 (+   139us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:34.387716 (+   194us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:34.387808 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:34.388599 (+   791us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:34.389165 (+   566us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:22:34.389363 (+   198us) write_op.cc:312] APPLY: finished
0709 12:22:34.389779 (+   416us) log.cc:844] Serialized 34 byte log entry
0709 12:22:34.389994 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:34.390099 (+   105us) write_op.cc:454] Released schema lock
0709 12:22:34.390156 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:34.390558 (+   402us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:34.390583 (+    25us) write_op.cc:454] Released schema lock
0709 12:22:35.316260 (+925677us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b54002175d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dc32a 00007efc7c461f14 00007efc7c461ec3 00007efc7c461e38 00007efc7c461df3 00007efc7c4610dc 00007efc7c48ae16 00007efc7c472cbb 00007efc7c45d39d 00007efc7c460d75
Metrics: {"mutex_wait_us":187055,"reported_tablets":13,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":54955,"apply.run_cpu_time_us":3146,"apply.run_wall_time_us":3168,"num_ops":3,"prepare.queue_time_us":335127,"prepare.run_cpu_time_us":23700,"prepare.run_wall_time_us":572129,"raft.queue_time_us":302472,"raft.run_cpu_time_us":23139,"raft.run_wall_time_us":1001343,"replication_time_us":1513695,"spinlock_wait_cycles":9166464,"thread_start_us":856220,"threads_started":4,"wal-append.queue_time_us":538835,"wal-append.run_cpu_time_us":32003,"wal-append.run_wall_time_us":2029263}]]}
I20260709 12:22:36.617281 18424 catalog_manager.cc:5697] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 1 to 2, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:36.618952 18646 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:36.622200 20451 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:36.622303 20063 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:36.622954 20063 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.623361 20063 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:36.620244 18424 catalog_manager.cc:5697] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 1 to 2, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:36.623807 19240 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:36.626067 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:36.626825 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:36.622956 20451 raft_consensus.cc:697] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:36.625140 20529 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:36.544006 20468 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:36.628170 20451 consensus_queue.cc:237] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:36.629563 20427 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:36.626940 18424 catalog_manager.cc:5697] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 1 to 3, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 3 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.630271 20468 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:36.634089 18646 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:36.636178 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:36.638373 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:36.639452 19240 raft_consensus.cc:2393] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:36.641121 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:36.641942 18528 raft_consensus.cc:2410] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:36.642355 20426 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:36.642766 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:36.643425 18528 raft_consensus.cc:2368] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 3. Current term is 4.
I20260709 12:22:36.606829 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.652282 20529 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:36.657292 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.644840 20046 raft_consensus.cc:2749] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:36.650164 18646 leader_election.cc:336] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.748s (SENT)
I20260709 12:22:36.659266 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.661273 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.662961 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.660779 20468 consensus_queue.cc:1059] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:22:36.665484 20468 raft_consensus.cc:3055] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:36.665820 20468 raft_consensus.cc:740] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:36.666611 20468 consensus_queue.cc:260] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:36.669059 20486 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:22:36.661211 18522 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:36.680310 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:36.656376 20448 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:22:36.682992 19241 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:36.669787 20146 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:22:36.686041 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:36.688622 20382 raft_consensus.cc:3055] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:36.689215 20382 raft_consensus.cc:740] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:36.690353 20382 consensus_queue.cc:260] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:36.654265 20456 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.684265 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.644866 20384 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:36.691531 20382 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:36.702515 18528 raft_consensus.cc:2410] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:22:36.667737 20468 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:36.704142 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 54028.8us
W20260709 12:22:36.708582 18646 leader_election.cc:336] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.173s (SENT)
I20260709 12:22:36.709038 18646 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:36.710798 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.711576 18526 raft_consensus.cc:2393] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 4: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:36.703729 20427 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.718369 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:36.700970 20046 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:22:36.723380 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.726768 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.732506 18528 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:36.734347 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.702844 20456 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:36.734974 18528 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:36.735630 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.738734 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.738390 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:36.739409 18528 raft_consensus.cc:2410] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:22:36.740288 19246 raft_consensus.cc:1240] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:36.743942 19244 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:36.743623 20063 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:36.747236 20063 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:36.749109 20063 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:36.751935 20063 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.750774 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.754202 18528 raft_consensus.cc:2410] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:36.756313 18672 raft_consensus.cc:1275] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:36.765789 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1221) took 1314 ms. Trace:
I20260709 12:22:36.766235 18676 rpcz_store.cc:276] 0709 12:22:35.450937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.451092 (+   155us) service_pool.cc:224] Handling call
0709 12:22:35.451416 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:35.496067 (+ 44651us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:35.496094 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:35.496139 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:35.496167 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.765568 (+1269401us) spinlock_profiling.cc:243] Waited 44.5 ms on lock 0x7b540038b154. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:36.765616 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.765734 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102258048}
I20260709 12:22:36.758881 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:36.774991 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:36.775602 18676 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:36.776347 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:36.781401 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1357) took 1272 ms. Trace:
I20260709 12:22:36.781840 18523 rpcz_store.cc:276] 0709 12:22:35.508918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.039440 (+530522us) service_pool.cc:224] Handling call
0709 12:22:36.055028 (+ 15588us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:36.608954 (+553926us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b1800369d60. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc7c0874bc 00007efc793d548b 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793ef455 00007efc7c4d7060 00007efc7c4d7bfb 00007efc7c4e264b
0709 12:22:36.609112 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:36.609141 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:36.609639 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 12:22:36.647095 (+ 37456us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:36.647138 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.647202 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:36.781117 (+133915us) raft_consensus.cc:1685] finished
0709 12:22:36.781137 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.781333 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2033,"raft.queue_time_us":130055,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":22928,"spinlock_wait_cycles":5368192,"thread_start_us":195882,"threads_started":2,"wal-append.queue_time_us":99502}
I20260709 12:22:36.783811 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.784829 18523 raft_consensus.cc:2410] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:22:36.785633 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.786226 18523 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4.
I20260709 12:22:36.786849 20456 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:36.787371 19212 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:36.788218 20451 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:36.788606 20451 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.789105 20451 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:36.789278 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.789665 20384 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:36.790135 18523 raft_consensus.cc:2410] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:22:36.790468 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 81918.1us
W20260709 12:22:36.791656 18646 leader_election.cc:336] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.244s (SENT)
I20260709 12:22:36.793998 18676 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:36.805217 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:36.805320 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:36.808145 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:36.752635 20063 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:36.727422 20427 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:36.813613 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:36.809623 18522 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:36.772688 20426 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.814486 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.815613 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.815625 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:36.817546 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:36.829732 18676 raft_consensus.cc:1240] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:22:36.831447 18676 raft_consensus.cc:1240] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:22:36.819072 18646 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:36.832433 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.833171 18646 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:36.822590 19681 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.818567 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:36.842078 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:36.843060 19244 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:36.847226 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.827800 18523 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:36.850286 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:36.855973 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.857245 18646 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:36.863091 18646 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:36.838225 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.864234 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.837489 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:22:36.886693 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 142678us
W20260709 12:22:36.887976 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.886116 18525 raft_consensus.cc:2410] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:22:36.890304 18646 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:36.890689 18644 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:36.895191 18570 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:36.896318 18646 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:36.895498 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.908965 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.895361 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:36.910964 18676 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:36.853066 20336 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:36.921653 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:36.923811 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:36.839248 19681 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:36.924412 18606 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:22:36.924579 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:36.925061 18570 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:36.925259 18605 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4.
I20260709 12:22:36.922063 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:36.847529 20498 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.922446 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:36.930438 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:36.933377 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.933890 19210 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:22:36.934258 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.935371 19210 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:36.936931 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:36.885756 20447 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:36.948674 18524 raft_consensus.cc:1275] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:22:36.977722 18524 pending_rounds.cc:85] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 1
I20260709 12:22:36.978044 18524 pending_rounds.cc:107] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:22:36.978350 18524 raft_consensus.cc:2889] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:36.978494 18680 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:36.941944 18525 raft_consensus.cc:2368] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:22:36.919945 20235 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:36.848417 20426 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:36.983052 18680 raft_consensus.cc:1240] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:36.851231 20537 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:36.986683 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:36.907192 20015 consensus_queue.cc:1048] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 12:22:36.970299 20153 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:36.988443 20153 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.990341 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:36.927649 20432 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:36.988914 20153 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:36.970523 20368 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:36.928699 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:36.976012 18672 raft_consensus.cc:1240] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:22:36.975920 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:36.980324 20529 raft_consensus.cc:2764] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:22:36.976303 20250 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.003322 18523 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:36.938309 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:36.984597 20336 raft_consensus.cc:2764] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:22:37.001401 18524 raft_consensus.cc:1240] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 3. Current term is 4. Ops: []
W20260709 12:22:37.019665 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.971035 20536 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:36.976585 20017 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:36.988487 20496 consensus_queue.cc:1048] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:22:36.970824 20534 raft_consensus.cc:2749] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:36.997033 20432 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.039614 18525 raft_consensus.cc:1275] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:22:37.050490 18525 pending_rounds.cc:85] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 1
I20260709 12:22:37.050765 18525 pending_rounds.cc:107] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:22:37.051285 18525 raft_consensus.cc:2889] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:37.025501 18678 raft_consensus.cc:1240] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:36.985430 20447 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:37.048025 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:37.048128 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:37.054066 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 163560us
I20260709 12:22:37.039373 18598 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:37.065160 18523 raft_consensus.cc:2410] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:37.034940 20384 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:37.008692 18522 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:37.039202 20537 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:37.065218 18676 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:37.079667 18680 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
W20260709 12:22:37.086635 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.010088 20235 raft_consensus.cc:697] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:22:37.088800 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.090137 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:37.091301 18676 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:37.079221 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:37.096580 20438 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:37.052978 20432 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:37.103446 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.092160 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:37.111830 18676 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:37.041637 20250 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:37.074628 20336 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:37.097671 20534 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:37.124727 19681 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:37.121407 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 225175us
I20260709 12:22:37.052742 20017 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:37.099426 20063 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:37.097747 20353 consensus_queue.cc:1048] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:22:37.114164 20362 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.101807 20529 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:37.134128 20451 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:37.133514 18646 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:37.102591 20427 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:37.079347 20384 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:37.173328 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:37.175477 18646 leader_election.cc:336] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.240s (SENT)
I20260709 12:22:37.177065 18646 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:37.160794 20457 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.941743 20498 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:37.129571 20336 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:37.252241 20539 log.cc:927] Time spent T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
W20260709 12:22:37.263998 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.188978 19240 raft_consensus.cc:2393] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 5: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:22:37.266763 18523 raft_consensus.cc:1240] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:37.172596 20426 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:37.272133 18676 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:37.133615 20534 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:37.277695 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.178113 20536 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:37.186797 19681 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:37.287029 18529 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:22:37.287516 18529 pending_rounds.cc:85] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 1
I20260709 12:22:37.188380 20384 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:37.287811 18529 pending_rounds.cc:107] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:22:37.295186 18529 raft_consensus.cc:2889] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:37.260607 18522 raft_consensus.cc:1275] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:22:37.292142 18671 raft_consensus.cc:1275] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:37.170532 20362 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:37.168891 20529 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:37.266726 20063 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:37.320451 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:37.321142 18521 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:37.320972 20063 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:37.286872 20426 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:37.309449 18522 pending_rounds.cc:85] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 1
I20260709 12:22:37.284488 20536 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:37.300005 20456 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.333702 20534 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:37.317757 20250 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:37.337211 20017 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:37.338840 20451 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:37.341717 20541 log.cc:927] Time spent T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:22:37.345686 20543 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.243729 20457 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:37.302073 18672 raft_consensus.cc:1240] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:37.279331 20146 consensus_queue.cc:1059] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:22:37.181567 20235 consensus_queue.cc:237] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:37.376120 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:37.357110 18522 pending_rounds.cc:107] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:22:37.358126 20536 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:37.378647 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:37.374305 20250 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:37.379617 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:37.375622 18646 leader_election.cc:336] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.046s (SENT)
I20260709 12:22:37.385278 18676 raft_consensus.cc:1275] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:37.385293 18646 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:37.389966 18599 raft_consensus.cc:1275] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:37.390589 18521 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 5.
I20260709 12:22:37.392036 19212 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
W20260709 12:22:37.394830 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.360952 20456 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:37.363125 20426 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:37.381489 18522 raft_consensus.cc:2889] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:37.395581 20368 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:37.416069 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:37.420493 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.371447 20543 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:37.394934 20544 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:37.410368 20384 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.391713 20250 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:37.436540 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:37.437232 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.414256 20451 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:37.416045 20368 raft_consensus.cc:697] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:37.451411 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:37.452353 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:37.452714 20438 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:37.454190 18600 raft_consensus.cc:1240] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:37.454813 20438 consensus_queue.cc:1048] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:37.456197 20250 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:37.457680 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:37.451416 18606 raft_consensus.cc:1240] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:22:37.451767 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:37.458179 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:37.461961 18601 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:37.432178 20336 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:37.489014 18646 leader_election.cc:336] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 3.082s (SENT)
W20260709 12:22:37.490223 18646 leader_election.cc:336] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 3.102s (SENT)
I20260709 12:22:37.490684 18646 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:37.495976 20534 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.496590 20534 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:37.498107 20551 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:37.498736 20534 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:37.456928 20250 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.499622 20529 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:37.500108 20250 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:37.510761 20368 consensus_queue.cc:237] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:37.517020 20457 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:37.440236 20384 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:37.521770 20384 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:37.462064 20451 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:37.537698 20451 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:37.541461 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.541640 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:37.464700 18598 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:22:37.546505 20063 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:37.549299 20456 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:37.553308 18672 raft_consensus.cc:1275] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:37.528249 20525 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.594213 18527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1247) took 1129 ms. Trace:
I20260709 12:22:37.594817 18527 rpcz_store.cc:276] 0709 12:22:36.464558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.539155 (+ 74597us) service_pool.cc:224] Handling call
0709 12:22:37.580790 (+1041635us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b5400333e54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:37.594119 (+ 13329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":572995456}
I20260709 12:22:37.607554 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:37.651644 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:37.658411 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:37.661176 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:37.662995 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.603085 20543 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:37.565282 20525 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:37.572589 20432 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:37.680893 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:37.683028 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.689340 18524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1375) took 1176 ms. Trace:
I20260709 12:22:37.693187 18601 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:37.689785 18524 rpcz_store.cc:276] 0709 12:22:36.512930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.043541 (+530611us) service_pool.cc:224] Handling call
0709 12:22:37.053673 (+ 10132us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:37.053869 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:37.313270 (+259401us) log.cc:844] Serialized 14 byte log entry
0709 12:22:37.688993 (+375723us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:37.689044 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:37.689084 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.689151 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:37.689279 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":404860,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"thread_start_us":626253,"threads_started":2}
I20260709 12:22:37.668610 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:37.648888 20548 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:37.702358 20457 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:37.709900 20457 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:37.707597 20548 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:37.747287 20250 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:37.777129 18646 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:37.779191 18646 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:37.781265 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:37.781591 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:37.781101 18646 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:37.786849 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:37.788471 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:37.788937 18601 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:37.789381 18606 raft_consensus.cc:2393] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 4: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
W20260709 12:22:37.791230 18494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.791329 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:37.791971 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:37.793460 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:37.796762 18604 raft_consensus.cc:2393] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 4: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:37.800537 18646 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:37.760007 20457 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:37.805140 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:37.808149 20336 consensus_queue.cc:1048] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:37.808573 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:37.802696 20529 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:37.813215 18494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.797808 20554 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.828220 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:37.828673 20554 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:37.829483 19239 raft_consensus.cc:2393] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 4: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:22:37.829988 20432 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:37.806840 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:37.830906 20554 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:37.803778 20528 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:37.799217 20538 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:37.831650 20153 consensus_meta.cc:287] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.822s	user 0.008s	sys 0.005s
I20260709 12:22:37.832087 20153 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:37.833312 19243 raft_consensus.cc:2393] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 4: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:22:37.831562 20528 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:37.836220 20528 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:37.831395 19244 raft_consensus.cc:2393] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 4: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:37.838762 18494 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:37.841548 18494 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:37.843147 20250 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:37.843668 20250 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:37.802433 20543 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:37.845755 20250 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:37.846544 20561 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:37.850931 20525 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:37.856884 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:37.858304 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:37.859333 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:37.850764 20457 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:37.861526 20447 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:37.861636 20384 raft_consensus.cc:2804] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:37.862366 20384 raft_consensus.cc:697] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:37.863207 18525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1377) took 1349 ms. Trace:
I20260709 12:22:37.863330 20384 consensus_queue.cc:237] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:37.863593 18525 rpcz_store.cc:276] 0709 12:22:36.513487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.065997 (+552510us) service_pool.cc:224] Handling call
0709 12:22:37.075318 (+  9321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:37.076627 (+  1309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:37.076692 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:37.077558 (+   866us) log.cc:844] Serialized 26 byte log entry
0709 12:22:37.429389 (+351831us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:37.429492 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.429585 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:37.722207 (+292622us) raft_consensus.cc:1685] finished
0709 12:22:37.722229 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:37.862964 (+140735us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b5400256550. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:37.863150 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":391,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":18939,"spinlock_wait_cycles":11610496,"thread_start_us":304412,"threads_started":1,"wal-append.queue_time_us":519214}
I20260709 12:22:37.865424 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:37.853057 20559 raft_consensus.cc:2804] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:37.868484 20559 raft_consensus.cc:697] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:37.869644 20559 consensus_queue.cc:237] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:37.866631 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:37.872354 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1291) took 1019 ms. Trace:
I20260709 12:22:37.872746 18678 rpcz_store.cc:276] 0709 12:22:36.853562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.853773 (+   211us) service_pool.cc:224] Handling call
0709 12:22:36.854339 (+   566us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:37.052182 (+197843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.872094 (+819912us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54000578d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:37.872293 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392772864}
I20260709 12:22:37.873700 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:37.873997 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:37.874302 18677 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:37.874557 18678 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:37.875345 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:37.875393 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:37.880327 18525 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:37.882186 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:37.885614 18572 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:37.886620 20447 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:37.887024 20447 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.887359 20447 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:37.814924 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:37.893184 18677 raft_consensus.cc:2393] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 4: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:37.894593 20563 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:37.851589 20153 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:37.861583 20561 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:37.900260 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:37.900689 20498 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:37.847294 20250 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.902788 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:37.903191 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:37.938764 18677 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
W20260709 12:22:37.899163 20536 consensus_meta.cc:287] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.000s
I20260709 12:22:37.905678 18525 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:37.933090 18530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 166) took 1330 ms. Trace:
I20260709 12:22:37.940503 18530 rpcz_store.cc:276] 0709 12:22:36.602378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.291379 (+689001us) service_pool.cc:224] Handling call
0709 12:22:37.322561 (+ 31182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:37.322763 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:37.619379 (+296616us) log.cc:844] Serialized 14 byte log entry
0709 12:22:37.932607 (+313228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:37.932685 (+    78us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:37.932748 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.932840 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:37.933012 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":240047,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"thread_start_us":572070,"threads_started":2}
I20260709 12:22:37.931864 20235 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.861518 20457 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:37.972909 20538 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:37.991602 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:37.991514 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 150017us
I20260709 12:22:37.993590 18494 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:37.942569 20250 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:37.976754 20456 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:37.946376 20536 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:38.017975 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.931468 20563 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:38.060544 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:38.063565 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.009485 20418 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.084547 18530 raft_consensus.cc:2410] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:22:38.084547 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1382) took 1557 ms. Trace:
W20260709 12:22:38.085131 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.085264 18678 raft_consensus.cc:1240] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:38.088030 18523 rpcz_store.cc:276] 0709 12:22:36.527347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.270158 (+742811us) service_pool.cc:224] Handling call
0709 12:22:37.270423 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:37.270632 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:37.763771 (+493139us) log.cc:844] Serialized 14 byte log entry
0709 12:22:38.084196 (+320425us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:38.084253 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:38.084300 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.084366 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.084493 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":257226,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"thread_start_us":754743,"threads_started":3,"wal-append.queue_time_us":228098}
I20260709 12:22:38.090693 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:38.104506 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 170) took 1315 ms. Trace:
I20260709 12:22:38.105098 18523 rpcz_store.cc:276] 0709 12:22:36.788823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.103365 (+1314542us) service_pool.cc:224] Handling call
0709 12:22:38.103661 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:38.104219 (+   558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:38.104243 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:38.104280 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:38.104307 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.104356 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.104453 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:38.116677 20561 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:38.117378 20542 log.cc:927] Time spent T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.848s	user 0.004s	sys 0.000s
I20260709 12:22:38.119021 19241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33388 (request call id 286) took 1277 ms. Trace:
I20260709 12:22:38.120400 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:38.119525 19241 rpcz_store.cc:276] 0709 12:22:36.841490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.843989 (+  2499us) service_pool.cc:224] Handling call
0709 12:22:36.844510 (+   521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:36.845062 (+   552us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:36.845105 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:36.845804 (+   699us) log.cc:844] Serialized 26 byte log entry
0709 12:22:37.056993 (+211189us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:37.069624 (+ 12631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.079803 (+ 10179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:38.116713 (+1036910us) spinlock_profiling.cc:243] Waited 8.07 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:22:38.118564 (+  1851us) raft_consensus.cc:1685] finished
0709 12:22:38.118590 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.118899 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1272,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":18552192,"thread_start_us":199250,"threads_started":1,"wal-append.queue_time_us":321101}
I20260709 12:22:37.983464 20235 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:38.124544 18679 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:38.076974 20157 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.133658 18679 raft_consensus.cc:1275] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:22:38.136103 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 142596us
I20260709 12:22:38.028568 20447 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:38.021118 20456 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:38.107684 20418 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:38.147110 18524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1393) took 1423 ms. Trace:
I20260709 12:22:38.163268 18524 rpcz_store.cc:276] 0709 12:22:36.723455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.768114 (+1044659us) service_pool.cc:224] Handling call
0709 12:22:37.768480 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:37.771831 (+  3351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:37.771861 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:37.772728 (+   867us) log.cc:844] Serialized 26 byte log entry
0709 12:22:37.989606 (+216878us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:37.989660 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.989753 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:38.146865 (+157112us) raft_consensus.cc:1685] finished
0709 12:22:38.146889 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.147042 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6658,"raft.queue_time_us":13687,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":2866,"thread_start_us":178706,"threads_started":1,"wal-append.queue_time_us":347154}
I20260709 12:22:38.149672 18672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1272) took 1029 ms. Trace:
I20260709 12:22:38.135969 20538 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.154793 20457 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:38.170042 18494 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.137862 20157 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:38.152885 18528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1385) took 1458 ms. Trace:
W20260709 12:22:38.157998 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.153204 20250 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:38.167573 18525 raft_consensus.cc:2410] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:22:38.165721 18672 rpcz_store.cc:276] 0709 12:22:37.120122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.557237 (+437115us) service_pool.cc:224] Handling call
0709 12:22:37.557715 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:37.559082 (+  1367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:37.559261 (+   179us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:37.563788 (+  4527us) log.cc:844] Serialized 26 byte log entry
0709 12:22:37.904995 (+341207us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:37.905049 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.905143 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:38.149321 (+244178us) raft_consensus.cc:1685] finished
0709 12:22:38.149355 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.149569 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":315,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":3052,"thread_start_us":300370,"threads_started":1,"wal-append.queue_time_us":568638}
I20260709 12:22:38.173105 18528 rpcz_store.cc:276] 0709 12:22:36.694189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.419012 (+724823us) service_pool.cc:224] Handling call
0709 12:22:37.419319 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:37.759329 (+340010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:37.759368 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:37.766688 (+  7320us) log.cc:844] Serialized 26 byte log entry
0709 12:22:37.976046 (+209358us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:37.976126 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.976928 (+   802us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:38.152589 (+175661us) raft_consensus.cc:1685] finished
0709 12:22:38.152629 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.152804 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89147,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":493790,"threads_started":2,"wal-append.queue_time_us":358458}
I20260709 12:22:38.166281 18673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1250) took 1440 ms. Trace:
I20260709 12:22:38.181819 18494 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:38.174567 18522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1390) took 1470 ms. Trace:
I20260709 12:22:38.184828 18494 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:38.188285 18525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1397) took 1152 ms. Trace:
I20260709 12:22:38.188614 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.188853 18525 rpcz_store.cc:276] 0709 12:22:37.035912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.187171 (+1151259us) service_pool.cc:224] Handling call
0709 12:22:38.187583 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:38.187859 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:38.187899 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:38.187966 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:38.188012 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.188085 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.188214 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:38.189579 18494 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.184500 18522 rpcz_store.cc:276] 0709 12:22:36.704223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.454296 (+750073us) service_pool.cc:224] Handling call
0709 12:22:37.454646 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:37.561762 (+107116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:37.563000 (+  1238us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:37.648768 (+ 85768us) log.cc:844] Serialized 26 byte log entry
0709 12:22:37.988417 (+339649us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:37.990151 (+  1734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.121447 (+131296us) spinlock_profiling.cc:243] Waited 69 ms on lock 0x7b54002d5ad4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:38.121510 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:38.170127 (+ 48617us) raft_consensus.cc:1685] finished
0709 12:22:38.170147 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.174497 (+  4350us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":159,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":2547,"spinlock_wait_cycles":158728576,"thread_start_us":270286,"threads_started":1,"wal-append.queue_time_us":479124}
I20260709 12:22:38.165498 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1273) took 1045 ms. Trace:
I20260709 12:22:38.192333 18525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1398) took 1066 ms. Trace:
I20260709 12:22:38.196782 18525 rpcz_store.cc:276] 0709 12:22:37.126087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.191247 (+1065160us) service_pool.cc:224] Handling call
0709 12:22:38.191665 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:38.191922 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:38.191961 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:38.192019 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:38.192063 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.192133 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.192262 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:38.180855 20457 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:38.168079 20529 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.194773 18522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1399) took 1042 ms. Trace:
W20260709 12:22:38.199338 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.207351 18522 rpcz_store.cc:276] 0709 12:22:37.152286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.193931 (+1041645us) service_pool.cc:224] Handling call
0709 12:22:38.194313 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:38.194502 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:38.194526 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:38.194567 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:38.194595 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.194646 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.194732 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:38.212536 20564 log.cc:927] Time spent T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 12:22:38.213032 20536 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:38.213034 20157 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:38.218477 20578 log.cc:927] Time spent T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:22:38.183789 20561 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:38.221036 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.173034 20538 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:38.215446 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1391) took 1506 ms. Trace:
I20260709 12:22:38.198014 20250 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:38.224889 18526 rpcz_store.cc:276] 0709 12:22:36.708682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.501471 (+792789us) service_pool.cc:224] Handling call
0709 12:22:37.501848 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:37.502045 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:37.771467 (+269422us) log.cc:844] Serialized 14 byte log entry
0709 12:22:38.214992 (+443525us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b1800368e60. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc7c0874bc 00007efc793d548b 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793ef455 00007efc7c4d7060 00007efc7c4e9716 00007efc7c4fa287
0709 12:22:38.215100 (+   108us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:38.215152 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:38.215198 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.215269 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.215387 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":71855,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":182149,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":3297,"spinlock_wait_cycles":2639744,"thread_start_us":668292,"threads_started":3,"wal-append.queue_time_us":452597}
I20260709 12:22:38.223564 20594 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:22:38.238440 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.210146 20457 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:38.249145 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 59601.2us
I20260709 12:22:38.220541 20529 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:38.258798 18494 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.243516 20591 raft_consensus.cc:2749] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:38.267151 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.185012 18673 rpcz_store.cc:276] 0709 12:22:36.726359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.731641 (+  5282us) service_pool.cc:224] Handling call
0709 12:22:37.547297 (+815656us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:37.547581 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:37.547895 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:37.814203 (+266308us) log.cc:844] Serialized 14 byte log entry
0709 12:22:38.098574 (+284371us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:38.108067 (+  9493us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:38.124847 (+ 16780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.159844 (+ 34997us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.166216 (+  6372us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":404156,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":8316,"raft.queue_time_us":6346,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":16468,"spinlock_wait_cycles":36609280,"thread_start_us":411203,"threads_started":2,"wal-append.queue_time_us":305466}
W20260709 12:22:38.269151 20567 log.cc:927] Time spent T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:22:38.196626 18674 rpcz_store.cc:276] 0709 12:22:37.120542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.600507 (+479965us) service_pool.cc:224] Handling call
0709 12:22:37.668740 (+ 68233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:37.692493 (+ 23753us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:37.974338 (+281845us) log.cc:844] Serialized 14 byte log entry
0709 12:22:38.114757 (+140419us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:38.125491 (+ 10734us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:38.135831 (+ 10340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.143368 (+  7537us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.163162 (+ 19794us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":290557,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":58,"raft.queue_time_us":26543,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":4083,"thread_start_us":337630,"threads_started":2,"wal-append.queue_time_us":216607}
I20260709 12:22:38.269721 20529 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:22:38.263039 20572 log.cc:927] Time spent T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:22:38.271021 18521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1384) took 1577 ms. Trace:
I20260709 12:22:38.271481 20538 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:38.255209 20586 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:38.271440 18521 rpcz_store.cc:276] 0709 12:22:36.693880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.398891 (+705011us) service_pool.cc:224] Handling call
0709 12:22:37.399343 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:37.417046 (+ 17703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:37.417086 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:37.417588 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 12:22:37.770091 (+352503us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:37.770162 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.270657 (+500495us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b540009a1d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:38.270703 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:38.270749 (+    46us) raft_consensus.cc:1685] finished
0709 12:22:38.270761 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.270960 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":40849,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":37282176,"thread_start_us":328012,"threads_started":1,"wal-append.queue_time_us":514871}
I20260709 12:22:38.231990 20528 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:38.273635 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:38.256570 20250 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:38.278419 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.261807 20563 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:38.283785 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1266) took 1209 ms. Trace:
I20260709 12:22:38.284369 18680 rpcz_store.cc:276] 0709 12:22:37.073840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.421831 (+347991us) service_pool.cc:224] Handling call
0709 12:22:37.422123 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:37.493778 (+ 71655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:37.493813 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:37.494341 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 12:22:37.750784 (+256443us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:37.750835 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.750906 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:38.283460 (+532554us) raft_consensus.cc:1685] finished
0709 12:22:38.283493 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.283666 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71233,"raft.queue_time_us":73225,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":165,"thread_start_us":256074,"threads_started":1,"wal-append.queue_time_us":690300}
W20260709 12:22:38.278066 20570 log.cc:927] Time spent T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 12:22:38.288965 20571 log.cc:927] Time spent T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 12:22:38.293967 20573 log.cc:927] Time spent T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:22:38.289358 20418 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:38.291955 20447 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:38.299595 20563 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:38.315565 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 56817.2us
W20260709 12:22:38.316727 20590 log.cc:927] Time spent T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:22:38.317169 18494 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.294181 20561 raft_consensus.cc:697] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:22:38.322468 20592 log.cc:927] Time spent T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 12:22:38.324077 20593 log.cc:927] Time spent T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:22:38.326071 20528 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:38.327040 18528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1396) took 1431 ms. Trace:
I20260709 12:22:38.327198 20235 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:38.327486 18528 rpcz_store.cc:276] 0709 12:22:36.895326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.197252 (+1301926us) service_pool.cc:224] Handling call
0709 12:22:38.197581 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:38.232529 (+ 34948us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:38.232562 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:38.232617 (+    55us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:38.232646 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.326775 (+ 94129us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b54002e3954. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:38.326827 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.326978 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79902592}
I20260709 12:22:38.328385 18677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1275) took 1163 ms. Trace:
I20260709 12:22:38.329151 18529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1274) took 1676 ms. Trace:
I20260709 12:22:38.328934 18677 rpcz_store.cc:276] 0709 12:22:37.165031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.943878 (+778847us) service_pool.cc:224] Handling call
0709 12:22:37.944270 (+   392us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:37.944659 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:37.944687 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:37.945350 (+   663us) log.cc:844] Serialized 52 byte log entry
0709 12:22:38.171203 (+225853us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:38.171259 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.171356 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:38.324718 (+153362us) raft_consensus.cc:1685] finished
0709 12:22:38.324751 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.328304 (+  3553us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3029,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":12203,"thread_start_us":183095,"threads_started":1,"wal-append.queue_time_us":247230}
I20260709 12:22:38.329704 18529 rpcz_store.cc:276] 0709 12:22:36.652841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.298983 (+646142us) service_pool.cc:224] Handling call
0709 12:22:37.299350 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:37.697735 (+398385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:37.697781 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:37.698382 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 12:22:37.904307 (+205925us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:37.942383 (+ 38076us) log.cc:844] Serialized 14 byte log entry
0709 12:22:37.942613 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.942688 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:38.328969 (+386281us) raft_consensus.cc:1685] finished
0709 12:22:38.328987 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.329098 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44208,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":8420,"raft.queue_time_us":188425,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":8476,"spinlock_wait_cycles":44540288,"thread_start_us":603404,"threads_started":2,"wal-append.queue_time_us":429781}
I20260709 12:22:38.332432 18524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1395) took 1522 ms. Trace:
I20260709 12:22:38.309468 20591 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:38.334192 18524 rpcz_store.cc:276] 0709 12:22:36.810529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.164916 (+1354387us) service_pool.cc:224] Handling call
0709 12:22:38.165241 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:38.165442 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:38.174306 (+  8864us) log.cc:844] Serialized 14 byte log entry
0709 12:22:38.332119 (+157813us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:38.332176 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:38.332210 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.332299 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.332390 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17231,"prepare.queue_time_us":16248,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":55903,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":9394,"thread_start_us":152512,"threads_started":2,"wal-append.queue_time_us":97808}
I20260709 12:22:38.336580 18527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1392) took 1621 ms. Trace:
I20260709 12:22:38.313539 20594 raft_consensus.cc:697] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:38.337049 18527 rpcz_store.cc:276] 0709 12:22:36.715087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.602314 (+887227us) service_pool.cc:224] Handling call
0709 12:22:37.647607 (+ 45293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:37.648043 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:37.648087 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:37.668053 (+ 19966us) log.cc:844] Serialized 26 byte log entry
0709 12:22:37.939664 (+271611us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:37.939726 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.939840 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:38.336362 (+396522us) raft_consensus.cc:1685] finished
0709 12:22:38.336381 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.336525 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9732,"raft.queue_time_us":20572,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":6726,"thread_start_us":271175,"threads_started":1,"wal-append.queue_time_us":456115}
I20260709 12:22:38.342185 18494 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.344671 20596 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:38.338788 20591 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:38.346311 18494 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.347185 20596 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:38.348352 18527 raft_consensus.cc:1240] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:38.350124 20235 consensus_queue.cc:1059] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:38.350224 20561 consensus_queue.cc:237] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:38.352922 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1258) took 1281 ms. Trace:
I20260709 12:22:38.353175 18522 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:38.348860 18494 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.353334 18676 rpcz_store.cc:276] 0709 12:22:37.071705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.273636 (+201931us) service_pool.cc:224] Handling call
0709 12:22:37.384992 (+111356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:37.385698 (+   706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.352740 (+967042us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54001f2a50. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:38.352867 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255064448}
I20260709 12:22:38.383261 18494 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.386574 18494 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.396193 20457 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:38.397709 18646 leader_election.cc:336] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.591s (SENT)
I20260709 12:22:38.398351 18646 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.401408 18494 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:38.355283 20563 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:38.397397 20603 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:38.406234 20600 raft_consensus.cc:2749] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:38.407078 18494 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.409453 20603 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:38.409889 20603 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:38.410290 20603 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:38.412456 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.380314 20596 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:38.411188 18494 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.427703 18494 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.428329 20603 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:38.431373 20603 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:38.401454 20604 raft_consensus.cc:2804] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:38.437747 18644 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:38.402115 19681 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:38.443343 18494 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:38.340404 20594 consensus_queue.cc:237] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:38.440021 20600 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:38.441496 20017 raft_consensus.cc:3055] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:38.404333 20088 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:22:38.474161 20528 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:38.473872 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:38.477342 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:38.478376 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:38.458595 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:38.510445 18676 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:38.511732 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:38.512502 18676 raft_consensus.cc:1813] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Handling vote request from an unknown peer c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.513092 18676 raft_consensus.cc:2393] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 3: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:38.443173 20604 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:38.485656 18494 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.460052 20589 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:38.518955 20589 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:38.519384 20589 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:38.519789 20600 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:38.521176 20604 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:38.514189 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:38.526383 20362 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:38.527285 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:38.499213 18671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1262) took 1426 ms. Trace:
I20260709 12:22:38.527951 20362 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:38.527984 18671 rpcz_store.cc:276] 0709 12:22:37.072837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.320135 (+247298us) service_pool.cc:224] Handling call
0709 12:22:37.320463 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:37.361127 (+ 40664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:37.361156 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:37.361199 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:37.361224 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.498966 (+1137742us) spinlock_profiling.cc:243] Waited 40.4 ms on lock 0x7b54002913d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:38.499023 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.499154 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93024640}
I20260709 12:22:38.528846 20362 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:38.483899 20017 raft_consensus.cc:740] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:38.530275 20017 consensus_queue.cc:260] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:38.531268 20591 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:38.531440 20017 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:38.527940 19248 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:38.531234 20362 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:38.508401 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 77483.2us
I20260709 12:22:38.496840 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:38.517349 18494 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.543239 19248 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:38.535559 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:38.523397 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:38.547977 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:38.566403 18606 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:38.505841 20598 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:38.569695 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:38.552882 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:38.572050 18599 raft_consensus.cc:2393] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:38.539374 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 128) took 1158 ms. Trace:
I20260709 12:22:38.547580 18494 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:38.572597 18678 rpcz_store.cc:276] 0709 12:22:37.381756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.947620 (+565864us) service_pool.cc:224] Handling call
0709 12:22:37.947969 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:38.088667 (+140698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.539125 (+450458us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54003f34d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:38.539307 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315325184}
I20260709 12:22:38.573405 18494 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.576488 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:38.577109 18524 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:22:38.568435 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 171060us
I20260709 12:22:38.579074 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:38.518426 20528 raft_consensus.cc:697] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:38.537292 20456 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:38.588111 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:38.588122 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.586311 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:38.591375 19244 raft_consensus.cc:1813] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Handling vote request from an unknown peer c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.591188 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:38.575037 20420 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:38.592494 19244 raft_consensus.cc:2410] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:22:38.593254 19240 raft_consensus.cc:2393] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 4: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:22:38.592710 20420 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:38.570254 20598 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:38.596122 20598 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:38.596532 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.598340 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.599287 18529 raft_consensus.cc:2393] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 5: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
W20260709 12:22:38.600023 18646 leader_election.cc:336] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.793s (SENT)
I20260709 12:22:38.600471 18646 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.601523 19681 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:38.603695 20548 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:38.581285 20586 consensus_queue.cc:1048] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:22:38.580518 20582 raft_consensus.cc:2749] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:38.608793 20548 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.609498 20548 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:38.610328 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:38.570853 20600 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:38.611718 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:38.613528 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.615581 18494 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.633770 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:38.636230 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:38.636036 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:38.636977 18676 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:38.636104 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:38.580701 20457 raft_consensus.cc:2804] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:38.640285 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.641242 18570 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:38.640647 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:38.637810 18524 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:22:38.642629 18570 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:38.643685 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.645937 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.647001 18524 raft_consensus.cc:2393] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 5: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:38.648010 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.649035 18524 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:38.650245 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.651727 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.653692 18570 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:38.653761 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.656838 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.658049 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.658425 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.659402 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.660655 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:38.661504 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.612926 20420 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:38.671219 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:38.668396 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:38.670337 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:38.619207 20548 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:22:38.713466 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 59864.9us
I20260709 12:22:38.713811 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:38.714200 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:38.710386 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1394) took 1919 ms. Trace:
I20260709 12:22:38.714387 18524 raft_consensus.cc:2376] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7. Re-sending same reply.
I20260709 12:22:38.714397 18570 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:38.715330 18646 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.716435 18570 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:38.716565 18646 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.715209 18523 rpcz_store.cc:276] 0709 12:22:36.791350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.106541 (+1315191us) service_pool.cc:224] Handling call
0709 12:22:38.106843 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:38.107032 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:38.138593 (+ 31561us) log.cc:844] Serialized 14 byte log entry
0709 12:22:38.617135 (+478542us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b1800368f80. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793d4e07 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793f1c02 00007efc7c07920b 00007efc7c07ed23 00007efc7c07f23a 00007efc7c4e9a2a
0709 12:22:38.710030 (+ 92895us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:38.710087 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:38.710134 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.710201 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.710330 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31363,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":98,"spinlock_wait_cycles":9159552,"thread_start_us":55761,"threads_started":1}
I20260709 12:22:38.713016 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.720149 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:38.710125 18671 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:38.638621 20456 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:38.720459 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:38.719236 18606 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:38.717948 18646 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.724141 18494 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:38.656940 20017 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.656713 20088 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:38.664045 20610 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:38.736917 20548 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:38.641041 20457 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:38.729041 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:38.727121 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.733922 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:38.732509 18494 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:38.734042 18646 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:38.708730 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:38.744630 18646 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.712953 20591 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:38.746275 18646 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.747041 19681 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:38.748189 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.748031 18644 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:38.719966 20063 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:38.726226 20420 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:38.722579 20544 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:38.752233 18646 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:38.755154 18674 raft_consensus.cc:1275] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:38.721863 20538 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:38.728825 20582 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:38.730629 20235 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:38.742311 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:38.762625 19681 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:38.771611 19681 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:38.772152 19681 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:38.726881 20612 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:38.742060 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:38.748953 20457 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:38.639057 20600 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:38.753659 20548 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:38.750150 20561 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:38.757962 20153 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.758888 18597 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:38.793813 18529 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:38.740751 20017 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:38.780949 18602 raft_consensus.cc:2393] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 4: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:38.798302 20017 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:38.760077 20529 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:38.783205 19246 raft_consensus.cc:1275] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:38.740231 20528 consensus_queue.cc:237] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:38.767925 19240 raft_consensus.cc:1275] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:38.785048 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:38.768432 20582 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:38.790422 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 69724.5us
I20260709 12:22:38.821004 18570 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:38.789672 20548 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:38.805442 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 83219.9us
I20260709 12:22:38.768283 20538 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:38.813030 18672 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:38.789943 20536 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:38.792521 18494 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:38.829216 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 77069.6us
I20260709 12:22:38.788604 20589 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:38.791039 20561 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:38.870311 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 122190us
I20260709 12:22:38.827401 20582 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:38.841818 18494 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.843873 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:38.844163 18672 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:38.820761 20420 raft_consensus.cc:697] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:38.877803 18644 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.800253 20600 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:38.828102 20418 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.830664 20529 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.830307 20548 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:38.830070 20599 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.836443 18646 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.800688 20153 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:38.800304 20457 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:38.845928 20384 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:38.868671 20561 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:38.889029 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.881953 18494 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:38.897408 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 61088.3us
I20260709 12:22:38.898720 18646 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.867899 20456 consensus_queue.cc:1048] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 12:22:38.895713 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 50169.8us
I20260709 12:22:38.880683 20632 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:38.911919 20538 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:38.912369 20632 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:38.915118 20632 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:38.916494 20617 log.cc:927] Time spent T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:22:38.883993 20563 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:38.903391 20603 consensus_queue.cc:1048] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:22:38.903612 20046 raft_consensus.cc:2749] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:38.900765 20464 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:22:38.910077 20153 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:38.911185 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.881229 20497 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:22:38.931381 20615 log.cc:927] Time spent T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:22:38.925956 20635 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:38.903981 20586 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:38.887887 20418 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:38.892793 20599 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:38.951157 20633 log.cc:927] Time spent T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:22:38.888144 20529 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:38.947626 20497 raft_consensus.cc:697] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:38.956377 20426 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:38.953164 20420 consensus_queue.cc:237] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:38.950549 20046 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:39.000687 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:39.013978 19246 raft_consensus.cc:1275] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:22:39.005874 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 58977.1us
W20260709 12:22:39.014734 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.001139 19681 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:38.923614 20538 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:39.012763 18674 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:39.019531 18494 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:38.947701 18672 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:38.926172 20632 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:39.004554 20157 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:39.010113 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:39.025404 19681 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:39.026358 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:38.925202 20600 consensus_queue.cc:1048] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 12:22:39.039708 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:39.018244 20046 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:38.971951 20635 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:39.029820 20063 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:39.028227 20610 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:39.016865 20497 consensus_queue.cc:237] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:39.036484 20157 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:39.076534 20598 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:39.077280 20157 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:39.058384 20432 consensus_queue.cc:1048] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:39.078984 20598 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:39.082310 20548 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:39.090580 20548 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:39.091766 18675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1255) took 2362 ms. Trace:
I20260709 12:22:39.105013 18679 raft_consensus.cc:1240] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:39.047194 20632 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:39.107774 20632 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:39.110615 20632 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:39.049387 20603 consensus_queue.cc:1048] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:22:39.119733 20635 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:39.059087 20599 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:39.046018 20426 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:39.120971 20426 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:39.121541 20426 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:39.122010 20589 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:39.053707 20418 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:39.027586 20604 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:39.126901 20604 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:39.062289 20582 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:39.062566 20046 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:39.070130 20610 consensus_queue.cc:1048] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:39.073616 20529 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:39.132167 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:39.132997 18680 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:39.136227 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:22:39.074638 20620 log.cc:927] Time spent T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 12:22:39.075148 20544 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:39.143066 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:39.146044 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:39.146843 18678 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:39.037498 20457 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:39.092320 18675 rpcz_store.cc:276] 0709 12:22:36.729660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.729798 (+   138us) service_pool.cc:224] Handling call
0709 12:22:36.928086 (+198288us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:37.875842 (+947756us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:37.883335 (+  7493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:37.883379 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:37.883970 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 12:22:38.300710 (+416740us) spinlock_profiling.cc:243] Waited 9.57 ms on lock 0x7b18003cb2c0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793d4e07 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793f1c02 00007efc7c07920b 00007efc7c07ed23 00007efc7c07f0d1 00007efc7c49aa0f
0709 12:22:38.316220 (+ 15510us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:38.316256 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.316325 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:38.316368 (+    43us) raft_consensus.cc:1685] finished
0709 12:22:38.316378 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:39.091521 (+775143us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b54000578d0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:39.091666 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3447,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":10220,"spinlock_wait_cycles":2207267200,"thread_start_us":15328,"threads_started":1,"wal-append.queue_time_us":426926}
I20260709 12:22:39.153987 20589 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:39.154636 20589 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:39.164274 18679 raft_consensus.cc:2393] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 5: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:39.167234 18530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57384 (request call id 1404) took 1302 ms. Trace:
I20260709 12:22:39.167783 18530 rpcz_store.cc:276] 0709 12:22:37.864651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.974234 (+109583us) service_pool.cc:224] Handling call
0709 12:22:39.166971 (+1192737us) spinlock_profiling.cc:243] Waited 88.8 ms on lock 0x7b54003b4554. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:39.167160 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204313984}
I20260709 12:22:39.167909 18605 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 5.
I20260709 12:22:39.184166 20544 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:39.184893 20544 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:39.183703 20629 log.cc:927] Time spent T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:22:39.193629 20418 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:39.201308 20153 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:39.201720 20418 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:39.187695 20544 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:39.206998 19244 raft_consensus.cc:1240] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:39.208937 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:39.209860 18679 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:39.218690 18602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:22:39.234449 18602 raft_consensus.cc:606] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:39.239506 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:39.240602 18679 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:39.195007 20631 log.cc:927] Time spent T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
W20260709 12:22:39.245775 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 347102us
I20260709 12:22:39.166275 20589 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:39.246697 18646 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:39.238375 20582 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:39.242125 20612 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.241490 20586 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:39.198194 20157 consensus_queue.cc:1048] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 12:22:39.258054 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 191041us
I20260709 12:22:39.259536 18570 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:39.255167 18646 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:39.198972 20561 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:39.253935 20354 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.254478 20640 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:39.258104 20589 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:39.311334 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 57364.2us
I20260709 12:22:39.316788 18602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:22:39.262590 18680 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:39.315621 18678 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:39.318825 18570 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:39.320469 18646 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:39.325793 18679 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
W20260709 12:22:39.390887 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 72185.3us
W20260709 12:22:39.391057 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 70667.3us
I20260709 12:22:39.392292 18570 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:39.259225 20457 consensus_queue.cc:1059] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:22:39.309885 20418 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:39.310204 20544 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:39.400133 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:39.401788 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:39.403705 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:39.407120 18527 raft_consensus.cc:2393] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 5: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:39.404212 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:39.404644 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:39.409608 18524 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:39.411931 18570 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:39.412081 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:39.403256 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:39.417152 18602 raft_consensus.cc:606] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:39.317467 20063 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:39.258378 20612 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:39.439932 18530 raft_consensus.cc:2393] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 5: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:39.441548 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:39.311044 20354 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:39.446429 20426 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:39.447813 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.447984 20447 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:39.438306 20432 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:39.449401 20354 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:39.453689 20457 raft_consensus.cc:3055] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:39.454259 20457 raft_consensus.cc:740] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:39.456516 18525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1400) took 2252 ms. Trace:
I20260709 12:22:39.456939 18525 rpcz_store.cc:276] 0709 12:22:37.203809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.198284 (+994475us) service_pool.cc:224] Handling call
0709 12:22:38.198712 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:38.199027 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:38.199055 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:39.016723 (+817668us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b2c00058ff8. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7add8a11 00007efc7ade8372 00007efc7c51aa01 00007efc7c4df43a 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2
0709 12:22:39.017090 (+   367us) log.cc:844] Serialized 26 byte log entry
0709 12:22:39.259973 (+242883us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:39.260015 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.260089 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:39.456218 (+196129us) raft_consensus.cc:1685] finished
0709 12:22:39.456237 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:39.456455 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7772,"raft.queue_time_us":61348,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":19569,"spinlock_wait_cycles":2732288,"thread_start_us":242338,"threads_started":1,"wal-append.queue_time_us":245740}
I20260709 12:22:39.460879 20420 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:39.461475 20420 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.461915 20420 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:39.321094 20589 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:39.463974 18524 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:39.466244 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:39.468569 18522 raft_consensus.cc:2393] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:39.312018 20641 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:39.469111 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:39.476790 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 274205us
I20260709 12:22:39.477923 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:39.491333 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:39.481453 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:39.518463 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:39.549369 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:39.512300 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:39.515302 18676 raft_consensus.cc:1240] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:39.550088 18679 raft_consensus.cc:2468] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:39.258993 20586 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:39.440914 20640 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:39.549448 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:39.442498 20046 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:39.491602 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:39.561770 19210 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.240.130:37079 timed out after 1.680s (SENT) [suppressed 28 similar messages]
I20260709 12:22:39.483533 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:39.491631 18603 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:39.557346 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:39.557706 20046 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:39.558532 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:39.544313 20157 consensus_queue.cc:1059] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:22:39.559026 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:39.560873 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:39.560928 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:39.467645 20418 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:39.484357 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:39.819856 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:39.477146 20641 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.455221 20457 consensus_queue.cc:260] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:39.553692 20640 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:39.488749 20420 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:39.585615 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:39.439867 20544 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:39.556645 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:39.655650 18521 raft_consensus.cc:1813] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Handling vote request from an unknown peer c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:39.726452 20432 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:39.747319 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:39.852187 19245 raft_consensus.cc:2376] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5. Re-sending same reply.
I20260709 12:22:39.853142 20604 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:39.853787 20604 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:39.848562 20586 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:39.761512 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:39.629487 20635 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:22:39.739464 20626 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.021s	sys 0.047s
I20260709 12:22:39.856518 18600 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4.
I20260709 12:22:39.812701 18606 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:22:39.808944 20630 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.011s	sys 0.035s
I20260709 12:22:39.822767 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:39.824632 18646 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:39.841396 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:39.858870 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:39.860028 18603 raft_consensus.cc:1240] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:39.836220 20418 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:39.848260 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:39.861142 20544 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:39.848254 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:22:39.744204 20648 log.cc:927] Time spent T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.351s	user 0.000s	sys 0.001s
I20260709 12:22:39.856375 20650 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:39.811951 18605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39798 (request call id 114) took 1093 ms. Trace:
I20260709 12:22:39.856582 20635 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:39.848522 18598 raft_consensus.cc:2368] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7.
W20260709 12:22:39.857019 20626 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.023s	sys 0.058s
I20260709 12:22:39.885871 18672 raft_consensus.cc:1240] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:39.861850 20630 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.011s	sys 0.036s
I20260709 12:22:39.887285 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:39.890647 18605 rpcz_store.cc:276] 0709 12:22:38.718251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.718359 (+   108us) service_pool.cc:224] Handling call
0709 12:22:39.811778 (+1093419us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b5400424354. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:39.811886 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":747515136}
I20260709 12:22:39.835902 20640 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:39.821816 20641 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:39.903203 18676 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:39.907212 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:39.857755 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:39.857911 20457 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:39.906405 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 344631us
I20260709 12:22:39.900350 18597 raft_consensus.cc:2393] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 5: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:39.917335 19210 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:39.920804 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:39.921737 18675 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:39.921993 19210 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:39.883394 20384 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:39.891225 20604 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:39.883211 20644 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:22:39.906157 20619 log.cc:927] Time spent T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.846s	user 0.009s	sys 0.004s
I20260709 12:22:39.899608 20650 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:39.949302 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 138124us
I20260709 12:22:39.952536 19210 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:39.936596 20653 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:39.942943 20432 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.968175 19210 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:39.971349 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:39.972031 18494 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:39.972131 18528 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:39.973909 18494 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:39.945381 20612 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:39.978160 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:39.984254 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:39.986083 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:39.978847 18677 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:40.000029 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:40.002583 18570 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:40.003880 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:39.949520 20644 raft_consensus.cc:697] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:39.949139 20544 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:40.006168 18494 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:40.019277 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:39.950786 20561 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:39.941514 20384 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:39.999706 20432 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:39.967371 20604 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:39.953799 20368 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:39.979667 20591 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:40.035569 18494 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:40.072474 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 44158.7us
I20260709 12:22:40.073414 18494 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:40.000560 20661 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:40.019402 20594 raft_consensus.cc:2749] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:39.954888 20652 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:22:40.023620 20544 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:40.092238 18494 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:40.026062 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:40.070497 20497 raft_consensus.cc:2804] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:40.064152 19242 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:40.132608 18676 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
W20260709 12:22:40.094830 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 89478.5us
W20260709 12:22:40.141614 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 49444.6us
I20260709 12:22:40.062909 20586 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:40.140851 20591 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:40.091523 20661 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:40.073206 20604 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:40.125095 20157 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:40.145255 20651 log.cc:927] Time spent T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 12:22:40.028852 20447 consensus_queue.cc:1059] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.114s
I20260709 12:22:40.200546 18494 leader_election.cc:400] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7.
I20260709 12:22:40.133204 20368 raft_consensus.cc:2804] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:40.150249 20594 raft_consensus.cc:2749] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:40.069458 20626 consensus_queue.cc:1059] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 12:22:40.098301 20456 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:40.222353 18494 leader_election.cc:403] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:40.140630 20497 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.145826 20017 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:40.079118 20561 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:40.244659 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 89214.1us
I20260709 12:22:40.199976 20046 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:40.225975 20418 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:40.225972 20368 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:40.224012 20420 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:40.126194 20666 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.101s
I20260709 12:22:40.271987 20497 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:40.214857 20591 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:40.270931 20456 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7.
I20260709 12:22:40.252117 20635 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:40.273231 20650 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:40.277611 20586 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:40.308665 20368 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:40.307416 20561 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.309543 20594 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.309832 20046 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:40.288175 20017 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:40.335306 20635 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:40.346539 20586 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:40.389420 20628 log.cc:927] Time spent T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 1.377s	user 0.000s	sys 0.020s
I20260709 12:22:40.226306 20644 consensus_queue.cc:237] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:40.355273 20561 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:40.357728 20594 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:40.398896 20432 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:40.359390 20046 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:40.398917 20384 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:40.401362 20673 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:40.384624 20635 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:40.424024 20666 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:40.439647 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 236254us
I20260709 12:22:40.441381 18570 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:40.425690 20456 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:40.480652 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 202360us
W20260709 12:22:40.446610 20457 consensus_meta.cc:287] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
I20260709 12:22:40.442041 19243 raft_consensus.cc:1275] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:22:40.483484 20668 log.cc:927] Time spent T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 12:22:40.445930 20604 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:40.472455 20661 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:40.597198 20591 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:40.599573 20377 consensus_queue.cc:1059] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:22:40.600288 20670 log.cc:927] Time spent T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 12:22:40.600644 20677 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:40.600909 20377 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:40.601207 20677 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:40.602892 20377 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:40.603305 20377 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.439618 20673 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:40.445525 20666 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:40.493330 20456 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:40.603415 20677 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:40.612287 20377 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:40.625092 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 183795us
I20260709 12:22:40.603447 20589 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:40.612991 20684 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:40.642462 18528 raft_consensus.cc:1240] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:40.652818 18522 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:40.632809 20589 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:40.660351 20589 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:40.663303 20589 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:40.628903 20657 raft_consensus.cc:3055] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:40.630759 20591 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:40.634196 20017 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:40.634950 20661 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:40.645064 20586 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:40.670503 18522 raft_consensus.cc:1240] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:40.667002 20657 raft_consensus.cc:740] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:40.651473 20673 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:40.667534 20664 log.cc:927] Time spent T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.320s	user 0.003s	sys 0.007s
W20260709 12:22:40.707186 20641 consensus_meta.cc:287] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.770s	user 0.009s	sys 0.001s
I20260709 12:22:40.667829 20694 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:40.723117 20668 log.cc:927] Time spent T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:22:40.697971 20457 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:40.735963 18529 raft_consensus.cc:1240] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:40.725437 20679 log.cc:927] Time spent T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:22:40.636536 20684 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:40.709256 20594 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:40.737852 18678 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.061s	sys 0.065s
I20260709 12:22:40.697760 20604 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:40.740260 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:40.740542 18599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:22:40.745673 18522 raft_consensus.cc:1240] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 12:22:40.746155 18599 raft_consensus.cc:606] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:40.746703 18599 raft_consensus.cc:614] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:22:40.746155 18678 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.061s	sys 0.065s
I20260709 12:22:40.670673 20683 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.730407 20046 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:40.748777 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1291) took 1238 ms. Trace:
I20260709 12:22:40.738574 20694 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:40.671098 20591 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:40.742475 20586 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.740789 20456 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:40.758558 18678 rpcz_store.cc:276] 0709 12:22:39.510633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.512526 (+  1893us) service_pool.cc:224] Handling call
0709 12:22:39.513228 (+   702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:39.513538 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:39.805458 (+291920us) log.cc:844] Serialized 14 byte log entry
0709 12:22:40.748312 (+942854us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:40.748394 (+    82us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:40.748468 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.748558 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.748693 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35657,"prepare.queue_time_us":427947,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":333029,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":16381,"thread_start_us":1189662,"threads_started":3,"wal-append.queue_time_us":496560}
I20260709 12:22:40.727130 20661 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:40.737778 20641 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:40.777621 18523 raft_consensus.cc:1240] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:40.743083 20457 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:40.769500 20561 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:40.751940 20604 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:40.786337 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 160477us
I20260709 12:22:40.788409 18570 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:40.787708 18678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:22:40.790344 18678 raft_consensus.cc:606] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:40.790787 18678 raft_consensus.cc:614] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:40.758424 20657 consensus_queue.cc:260] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:40.793805 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:40.795384 18523 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:40.797152 20657 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:40.788836 20691 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.798032 20635 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:40.797792 20691 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:40.769244 20586 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:40.782277 20666 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:40.809525 18530 raft_consensus.cc:1240] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:40.815435 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1292) took 1304 ms. Trace:
I20260709 12:22:40.816222 18680 rpcz_store.cc:276] 0709 12:22:39.510979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.513800 (+  2821us) service_pool.cc:224] Handling call
0709 12:22:39.514191 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:39.514430 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:39.805654 (+291224us) log.cc:844] Serialized 14 byte log entry
0709 12:22:40.243609 (+437955us) log.cc:844] Serialized 14 byte log entry
0709 12:22:40.802344 (+558735us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b1800335800. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793d4e07 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793ef455 00007efc7c4d7060 00007efc7c4e9716 00007efc7c4fa287 00007efc7c4fa208
0709 12:22:40.814947 (+ 12603us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:40.815028 (+    81us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:40.815101 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.815195 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.815352 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47338,"prepare.queue_time_us":437782,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":10399,"raft.queue_time_us":257694,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":16304,"spinlock_wait_cycles":6467456,"thread_start_us":687565,"threads_started":4,"wal-append.queue_time_us":322657}
W20260709 12:22:40.796025 20528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.672s	user 0.021s	sys 0.023s
I20260709 12:22:40.824026 18523 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:22:40.807698 20624 log.cc:927] Time spent T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 1.684s	user 0.013s	sys 0.008s
I20260709 12:22:40.828157 20464 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:40.828836 20464 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:40.822968 20528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.701s	user 0.022s	sys 0.023s
I20260709 12:22:40.803117 20692 raft_consensus.cc:2804] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:40.764765 20683 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:40.808313 20635 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:40.841926 18680 raft_consensus.cc:1275] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:22:40.846217 18680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce446d878cef426395147773f6c9a25e"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:22:40.846913 18680 raft_consensus.cc:606] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:40.847358 18680 raft_consensus.cc:614] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:40.848250 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:40.832718 20691 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:40.842782 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 58041.5us
I20260709 12:22:40.843190 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:40.845093 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:40.854337 18671 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:40.855935 18674 raft_consensus.cc:2393] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 5: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:40.841492 20692 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.858476 18671 raft_consensus.cc:1240] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:22:40.861245 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:40.861958 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:40.865918 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 184) took 2288 ms. Trace:
I20260709 12:22:40.866302 18526 rpcz_store.cc:276] 0709 12:22:38.577204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.662079 (+ 84875us) service_pool.cc:224] Handling call
0709 12:22:38.662420 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:38.662625 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:38.662648 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:38.663140 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:22:38.802002 (+138862us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:38.802040 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.802108 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:40.775687 (+1973579us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:22:40.861226 (+ 85539us) raft_consensus.cc:1685] finished
0709 12:22:40.861247 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.865853 (+  4606us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54283264,"thread_start_us":138360,"threads_started":1,"wal-append.queue_time_us":385265}
W20260709 12:22:40.873263 20647 log.cc:927] Time spent T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.969s	user 0.005s	sys 0.000s
I20260709 12:22:40.880133 18646 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:40.881174 20644 raft_consensus.cc:2804] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:40.881609 20644 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:40.887086 20604 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:40.887588 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:40.888262 18523 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:40.889094 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:40.889405 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:40.889787 18523 raft_consensus.cc:2393] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 5: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:40.890012 18525 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:40.890517 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:40.891093 18523 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:40.889963 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:40.892488 18530 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:40.893132 18527 raft_consensus.cc:1240] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:40.888056 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:40.894399 18599 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 2.
I20260709 12:22:40.887245 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:40.881995 20644 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:40.864916 20692 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:40.866351 20586 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:40.853073 20635 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:40.902110 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:40.899276 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:40.900354 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:40.903724 18570 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:40.864920 20662 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:22:40.904520 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:40.905447 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:40.907130 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:40.908344 18678 raft_consensus.cc:1240] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:40.905910 18603 raft_consensus.cc:2376] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 5. Re-sending same reply.
I20260709 12:22:40.910254 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:40.912467 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:40.913554 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:40.913705 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:40.914880 20612 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:40.914805 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:40.916496 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:40.917219 20640 consensus_meta.cc:287] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.993s	user 0.012s	sys 0.001s
I20260709 12:22:40.917613 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:40.917729 20640 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:40.918257 18600 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:40.918562 20694 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:40.908196 20684 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:40.921672 18527 raft_consensus.cc:1275] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:22:40.922043 18527 pending_rounds.cc:85] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 5
I20260709 12:22:40.922256 18527 pending_rounds.cc:107] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:22:40.922474 18527 raft_consensus.cc:2889] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:40.919504 18600 raft_consensus.cc:1240] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:22:40.926203 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 144734us
W20260709 12:22:40.926764 20642 log.cc:927] Time spent T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 1.446s	user 0.011s	sys 0.006s
I20260709 12:22:40.917156 20641 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:40.908669 20661 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:40.927278 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:40.927551 18494 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:40.931788 19210 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:40.932233 18678 raft_consensus.cc:1240] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:40.935530 19248 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:40.936009 19210 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:40.937463 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:40.938143 19245 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:40.918264 20683 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:40.932322 20684 consensus_queue.cc:1048] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:22:40.939670 20662 raft_consensus.cc:2804] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:40.943213 18494 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:40.944890 18494 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:40.927996 20586 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:22:40.949461 18494 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:40.985427 18494 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:40.986574 20447 consensus_queue.cc:1059] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 12:22:40.948541 20497 consensus_meta.cc:287] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.615s	user 0.011s	sys 0.003s
I20260709 12:22:40.948470 20604 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:40.946584 20612 consensus_queue.cc:1059] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:22:40.948069 20661 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:40.954711 20683 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:40.987984 18494 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:40.987972 20368 consensus_meta.cc:287] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.004s
I20260709 12:22:40.990079 20600 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:40.940040 20681 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:40.989768 20561 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:40.946244 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:40.992439 20640 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:40.948117 20641 consensus_queue.cc:1059] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:22:40.982548 20630 consensus_queue.cc:1059] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:22:40.946274 20662 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:40.983791 20691 consensus_queue.cc:1059] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:22:41.007124 20600 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:41.020598 18599 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:40.994938 20497 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.016142 19243 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 1.
I20260709 12:22:41.007315 20368 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:41.015373 19240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33372 (request call id 172) took 2087 ms. Trace:
I20260709 12:22:41.016283 20662 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:41.030090 18606 raft_consensus.cc:1240] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:22:41.033445 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:41.034813 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:41.022704 20600 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:41.037093 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 49212.6us
I20260709 12:22:41.037040 18527 raft_consensus.cc:1275] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:22:41.039777 18527 pending_rounds.cc:85] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 1
I20260709 12:22:41.040051 18527 pending_rounds.cc:107] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:22:41.040287 18527 raft_consensus.cc:2889] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:41.040340 18494 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:41.042652 20561 raft_consensus.cc:697] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:41.041507 20612 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:22:41.043435 20635 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:41.042526 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:41.044215 18529 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:22:41.043936 20561 consensus_queue.cc:237] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.030064 19240 rpcz_store.cc:276] 0709 12:22:38.924254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.926009 (+  1755us) service_pool.cc:224] Handling call
0709 12:22:38.928930 (+  2921us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:39.005449 (+ 76519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:39.007195 (+  1746us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:39.016423 (+  9228us) log.cc:844] Serialized 26 byte log entry
0709 12:22:39.318149 (+301726us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:39.319954 (+  1805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.395651 (+ 75697us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:40.926467 (+1530816us) spinlock_profiling.cc:243] Waited 932 us on lock 0x7b240030bbb8. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc792789c4 00007efc79276acb 00007efc79431dc9 00007efc79431a55 00007efc7943109d 00007efc7c06310e 00007efc7c07a88c 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221
0709 12:22:40.991314 (+ 64847us) raft_consensus.cc:1685] finished
0709 12:22:40.992458 (+  1144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:41.011460 (+ 19002us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":42591,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":3917,"spinlock_wait_cycles":2143104,"thread_start_us":292855,"threads_started":1,"wal-append.queue_time_us":301010}
I20260709 12:22:41.046622 20604 raft_consensus.cc:2804] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:41.049024 18570 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:41.047187 20604 raft_consensus.cc:697] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:41.055303 20698 raft_consensus.cc:2804] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:41.056944 18597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40954 (request call id 1332) took 1575 ms (client timeout 2096 ms). Trace:
I20260709 12:22:41.058598 20612 consensus_queue.cc:1059] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:41.059782 18494 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:41.042858 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:41.114693 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 52270.3us
I20260709 12:22:41.121106 18672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1310) took 1179 ms. Trace:
I20260709 12:22:41.122653 18672 rpcz_store.cc:276] 0709 12:22:39.941731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.941904 (+   173us) service_pool.cc:224] Handling call
0709 12:22:39.942363 (+   459us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:39.950654 (+  8291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:39.950689 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:39.976069 (+ 25380us) log.cc:844] Serialized 52 byte log entry
0709 12:22:40.443175 (+467106us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:40.498384 (+ 55209us) log.cc:844] Serialized 14 byte log entry
0709 12:22:41.062443 (+564059us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b1800384700. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc7936cc0a 00007efc82aac219 00007efc793f4a40 00007efc793ef4e4 00007efc793ef455 00007efc7fed73c7 00007efc7c4e99a7 00007efc7c4f90bf 00007efc7c4f9038
0709 12:22:41.096062 (+ 33619us) log.cc:844] Serialized 14 byte log entry
0709 12:22:41.098678 (+  2616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.098787 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:41.120922 (+ 22135us) raft_consensus.cc:1685] finished
0709 12:22:41.120941 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:41.121053 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":545063,"prepare.queue_time_us":694842,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":80,"raft.queue_time_us":108783,"raft.run_cpu_time_us":397,"raft.run_wall_time_us":21499,"spinlock_wait_cycles":12077696,"thread_start_us":368367,"threads_started":1,"wal-append.queue_time_us":520677}
W20260709 12:22:41.114833 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 60292.8us
I20260709 12:22:41.116402 20604 consensus_queue.cc:237] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:41.118685 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 58998.6us
I20260709 12:22:41.119061 20426 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:41.103330 20635 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:41.097241 20698 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.120402 20594 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:41.101030 20586 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.135174 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:41.038072 20377 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.145260 18527 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:41.142834 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:41.137873 18494 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:41.137012 20698 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:41.149482 20368 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:41.145485 20635 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.127455 20683 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:41.159241 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:41.160578 20666 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:41.171770 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
W20260709 12:22:41.096935 18597 rpcz_store.cc:269] 0709 12:22:39.481811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.545715 (+ 63904us) service_pool.cc:224] Handling call
0709 12:22:41.056723 (+1511008us) spinlock_profiling.cc:243] Waited 88.9 ms on lock 0x7b54002b93d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:41.056865 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204364544}
I20260709 12:22:41.132820 20705 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
W20260709 12:22:41.172987 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:41.172785 19239 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 365) took 1629 ms (client timeout 1621 ms). Trace:
I20260709 12:22:41.144796 20589 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:41.174153 20589 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.177089 20589 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:41.151273 20630 consensus_queue.cc:1059] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:22:41.155429 20586 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:41.178843 20701 raft_consensus.cc:3055] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:41.179481 20701 raft_consensus.cc:740] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:41.180995 20377 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:41.179525 20586 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:41.181828 20701 consensus_queue.cc:260] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.182879 20701 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:41.140992 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:41.155988 20594 raft_consensus.cc:697] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:41.188968 20594 consensus_queue.cc:237] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.190516 18572 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:41.143710 20497 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:41.193224 18572 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:41.192198 20426 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:41.229825 20426 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.230420 20426 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:41.199728 20644 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.238616 20644 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:41.241068 20437 consensus_queue.cc:1048] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:22:41.210044 20649 log.cc:927] Time spent T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 1.657s	user 0.004s	sys 0.007s
I20260709 12:22:41.214838 20600 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.243785 19246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33372 (request call id 174) took 2104 ms. Trace:
I20260709 12:22:41.244699 20600 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:41.245167 18572 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:41.244177 19246 rpcz_store.cc:276] 0709 12:22:39.139178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.139385 (+   207us) service_pool.cc:224] Handling call
0709 12:22:39.139812 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:39.140254 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:39.140295 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:39.140862 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 12:22:39.316472 (+175610us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:39.316513 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.316587 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:41.209446 (+1892859us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:22:41.243466 (+ 34020us) raft_consensus.cc:1685] finished
0709 12:22:41.243487 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:41.243681 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1119,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":6403,"spinlock_wait_cycles":71216512,"thread_start_us":175284,"threads_started":1,"wal-append.queue_time_us":273132}
I20260709 12:22:41.218859 20690 raft_consensus.cc:3055] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:41.247134 20690 raft_consensus.cc:740] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:41.247917 20235 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:41.248390 20235 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.248605 20636 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:41.248950 20235 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:41.197024 20377 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:41.247942 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:41.252451 20662 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:41.253865 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:41.254477 18527 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:41.255986 18529 raft_consensus.cc:1240] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:41.256065 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:41.256678 18523 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:41.220053 18601 raft_consensus.cc:1275] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:41.259033 20662 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:41.225418 20017 raft_consensus.cc:3055] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:41.259991 20017 raft_consensus.cc:740] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:41.261183 20017 consensus_queue.cc:260] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.262681 20017 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:41.226254 20637 raft_consensus.cc:3055] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:41.264221 20637 raft_consensus.cc:740] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:41.264856 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:41.265360 20637 consensus_queue.cc:260] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.191565 20456 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:22:41.240978 20626 consensus_queue.cc:1059] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:41.248358 20690 consensus_queue.cc:260] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.269697 20690 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:41.206960 19241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 367) took 1649 ms. Trace:
I20260709 12:22:41.270826 19241 rpcz_store.cc:276] 0709 12:22:39.557474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.559585 (+  2111us) service_pool.cc:224] Handling call
0709 12:22:39.559965 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:39.896370 (+336405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:39.898451 (+  2081us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:39.907697 (+  9246us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:39.916557 (+  8860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.205486 (+1288929us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b5400530f54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:41.205542 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:41.205703 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":693459712}
W20260709 12:22:41.173571 19239 rpcz_store.cc:269] 0709 12:22:39.543771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.553257 (+  9486us) service_pool.cc:224] Handling call
0709 12:22:41.171563 (+1618306us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b5800003c98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:22:41.172675 (+  1112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5020544}
I20260709 12:22:41.274684 20637 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:41.274892 18644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.353s	user 0.000s	sys 0.027s
W20260709 12:22:41.275322 18644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.354s	user 0.000s	sys 0.028s
I20260709 12:22:41.275585 18601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 1340) took 1764 ms. Trace:
W20260709 12:22:41.275919 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 2.38676e+06us
I20260709 12:22:41.276036 18601 rpcz_store.cc:276] 0709 12:22:39.494843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.562632 (+ 67789us) service_pool.cc:224] Handling call
0709 12:22:41.219414 (+1656782us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b5800102f98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:41.219649 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:41.259416 (+ 39767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.259665 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10162048}
I20260709 12:22:41.277510 20641 raft_consensus.cc:3055] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:41.278072 20641 raft_consensus.cc:740] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:41.278899 20641 consensus_queue.cc:260] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.280303 20654 raft_consensus.cc:3055] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:41.280717 20654 raft_consensus.cc:740] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:41.282011 20654 consensus_queue.cc:260] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:41.283257 20654 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:41.285241 20626 raft_consensus.cc:3055] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:41.199229 20612 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:41.285713 20626 raft_consensus.cc:740] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:41.285811 20612 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:41.286250 20612 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:41.286612 20626 consensus_queue.cc:260] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.287987 20626 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:41.288615 20641 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:41.209677 20635 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:41.290349 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:41.299552 20457 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:41.300001 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:41.291098 20420 raft_consensus.cc:3055] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:41.304045 20420 raft_consensus.cc:740] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:41.305718 20420 consensus_queue.cc:260] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.306967 20420 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:41.277480 18644 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:41.314514 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40800 (request call id 1336) took 1329 ms. Trace:
I20260709 12:22:41.314968 18676 rpcz_store.cc:276] 0709 12:22:39.984639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.985775 (+  1136us) service_pool.cc:224] Handling call
0709 12:22:41.314264 (+1328489us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400404cd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:41.314410 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335124864}
W20260709 12:22:41.316174 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:41.319450 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 153351us
I20260709 12:22:41.321327 18494 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:41.283147 18523 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:41.328533 18494 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:41.329172 18572 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:41.336062 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 58644.2us
I20260709 12:22:41.338102 18646 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:41.319728 20644 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:41.341650 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:41.346029 18599 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:41.342950 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:41.343691 20639 raft_consensus.cc:2804] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:41.389714 20639 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:41.390230 20639 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:41.391741 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 53198.7us
I20260709 12:22:41.394491 20657 consensus_queue.cc:1059] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:41.396065 20657 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:41.396595 20657 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:41.396988 18424 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60812 (request call id 103) took 8519 ms. Trace:
I20260709 12:22:41.397377 20638 raft_consensus.cc:3055] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:41.397794 20638 raft_consensus.cc:740] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:41.401763 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:41.402405 18599 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:41.344178 18494 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:41.425936 18675 raft_consensus.cc:1240] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
W20260709 12:22:41.426874 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 82786us
I20260709 12:22:41.427085 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:41.427965 18677 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:22:41.326143 20698 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.357496 19244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 364) took 1841 ms. Trace:
I20260709 12:22:41.361934 20591 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:41.334867 20604 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:41.372143 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:41.344724 20635 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:41.374559 20711 log.cc:927] Time spent T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.506s	user 0.003s	sys 0.000s
I20260709 12:22:41.377283 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:41.340029 20684 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:41.390849 20464 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:41.456426 18602 raft_consensus.cc:2393] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 6: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:41.453761 19242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33388 (request call id 298) took 1067 ms. Trace:
I20260709 12:22:41.457305 19242 rpcz_store.cc:276] 0709 12:22:40.386169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.388315 (+  2146us) service_pool.cc:224] Handling call
0709 12:22:40.427821 (+ 39506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.444474 (+ 16653us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:40.765743 (+321269us) log.cc:844] Serialized 14 byte log entry
0709 12:22:41.028598 (+262855us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b18001b5080. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793f2522 00007efc793f47c1 00007efc793f4779 00007efc793f4709 00007efc793f46d1 00007efc793f39cd 0000000000388634 0000000000388479 00007efc793d583a
0709 12:22:41.374021 (+345423us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:22:41.452967 (+ 78946us) spinlock_profiling.cc:243] Waited 5.96 ms on lock 0x7b18001b5080. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc7936cc0a 00007efc82aac219 00007efc793f4a40 00007efc793ef4e4 00007efc793ef455 00007efc7fed73c7 00007efc7c4e99a7 00007efc7c4f90bf 00007efc7c4f9038
0709 12:22:41.453161 (+   194us) log.cc:844] Serialized 14 byte log entry
0709 12:22:41.453373 (+   212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:41.453427 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:41.453483 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.453557 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:41.453703 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":633016,"prepare.queue_time_us":987102,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":2772,"raft.queue_time_us":1223,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":4894,"spinlock_wait_cycles":71515520,"thread_start_us":167789,"threads_started":2,"wal-append.queue_time_us":78647}
I20260709 12:22:41.410806 18676 raft_consensus.cc:1240] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:41.461465 18599 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:22:41.330358 20692 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.413674 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:41.414819 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:41.465613 18671 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:41.419445 19210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:41.466176 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 73455.5us
W20260709 12:22:41.466315 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 60780.5us
I20260709 12:22:41.397377 18424 rpcz_store.cc:276] 0709 12:22:32.877896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.878130 (+   234us) service_pool.cc:224] Handling call
0709 12:22:33.486476 (+608346us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54002175d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c449090 00007efc7c4e7f3a 00007efc8229de9c 00007efc8239c04e 00007efc8085d2a4 00007efc8085d232 00007efc8085d161 00007efc8085d0dc 00007efc8085c392 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:33.760405 (+273929us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b5400270010. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bb640 00007efc82292846 00007efc8239c90e 00007efc8085d2a4 00007efc8085d232 00007efc8085d161 00007efc8085d0dc 00007efc8085c392 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:41.396920 (+7636515us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:36.750521 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:36.751312 (+   791us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:36.751359 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:22:36.751383 (+    24us) tablet.cc:662] Decoding operations
0709 12:22:36.752663 (+  1280us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:36.753003 (+   340us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:36.753045 (+    42us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:22:36.788972 (+ 35927us) tablet.cc:701] Row locks acquired
0709 12:22:36.788992 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:22:36.789144 (+   152us) write_op.cc:270] Start()
0709 12:22:36.789259 (+   115us) write_op.cc:276] Timestamp: P: 1783599756789090 usec, L: 0
0709 12:22:36.789280 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:22:36.789916 (+   636us) log.cc:844] Serialized 5171 byte log entry
0709 12:22:37.888032 (+1098116us) op_driver.cc:464] REPLICATION: finished
0709 12:22:38.199192 (+311160us) write_op.cc:301] APPLY: starting
0709 12:22:38.206103 (+  6911us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:38.237963 (+ 31860us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:38.254391 (+ 16428us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:38.317740 (+ 63349us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:38.317983 (+   243us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:22:38.318054 (+    71us) write_op.cc:312] APPLY: finished
0709 12:22:38.318460 (+   406us) log.cc:844] Serialized 94 byte log entry
0709 12:22:38.318710 (+   250us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:38.318912 (+   202us) write_op.cc:454] Released schema lock
0709 12:22:38.318986 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:38.319376 (+   390us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:38.319403 (+    27us) write_op.cc:454] Released schema lock
0709 12:22:38.349361 (+ 29958us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b54002175d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dc32a 00007efc7c461f14 00007efc7c461ec3 00007efc7c461e38 00007efc7c461df3 00007efc7c4610dc 00007efc7c48ae16 00007efc7c472cbb 00007efc7c45d39d 00007efc7c460d75
Metrics: {"mutex_wait_us":1265689,"reported_tablets":16,"spinlock_wait_cycles":551065216,"child_traces":[["op",{"apply.queue_time_us":284380,"apply.run_cpu_time_us":5655,"apply.run_wall_time_us":127636,"num_ops":13,"prepare.queue_time_us":39669,"prepare.run_cpu_time_us":20874,"prepare.run_wall_time_us":169641,"raft.queue_time_us":445094,"raft.run_cpu_time_us":19336,"raft.run_wall_time_us":495405,"replication_time_us":1098589,"spinlock_wait_cycles":39790464,"thread_start_us":596335,"threads_started":4,"wal-append.queue_time_us":383542,"wal-append.run_cpu_time_us":50064,"wal-append.run_wall_time_us":2214708}]]}
I20260709 12:22:41.420353 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1307) took 1518 ms. Trace:
I20260709 12:22:41.468497 18679 rpcz_store.cc:276] 0709 12:22:39.901990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.903619 (+  1629us) service_pool.cc:224] Handling call
0709 12:22:39.903982 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:39.904216 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:39.904250 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:39.918785 (+ 14535us) log.cc:844] Serialized 26 byte log entry
0709 12:22:40.325216 (+406431us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:40.347321 (+ 22105us) log.cc:844] Serialized 14 byte log entry
0709 12:22:40.354125 (+  6804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.354200 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:41.368227 (+1014027us) spinlock_profiling.cc:243] Waited 9.89 ms on lock 0x7b18003a53a0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793c02a6 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793f23f3 00007efc793f47c1
0709 12:22:41.369758 (+  1531us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b18003a53a0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793f23f3 00007efc793f47c1 00007efc793f4779 00007efc793f4709 00007efc793f46d1 00007efc793f39cd 0000000000388634 0000000000388479 00007efc793d583a
0709 12:22:41.420107 (+ 50349us) raft_consensus.cc:1685] finished
0709 12:22:41.420127 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:41.420279 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2571,"prepare.queue_time_us":21807,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":97113,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":12598,"spinlock_wait_cycles":83411200,"thread_start_us":376686,"threads_started":1,"wal-append.queue_time_us":505264}
W20260709 12:22:41.422370 18521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57384 (request call id 1420) took 3138 ms (client timeout 4017 ms). Trace:
W20260709 12:22:41.471347 18521 rpcz_store.cc:269] 0709 12:22:38.269536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.278097 (+  8561us) service_pool.cc:224] Handling call
0709 12:22:41.403952 (+3125855us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54002d55d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:41.404118 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3158515584}
I20260709 12:22:41.425884 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:41.472889 18672 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:41.349185 18644 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:41.430581 18494 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:41.435518 19244 rpcz_store.cc:276] 0709 12:22:39.515838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.547436 (+ 31598us) service_pool.cc:224] Handling call
0709 12:22:41.356570 (+1809134us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b5800003c98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:41.356885 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:41.357118 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:41.357155 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:41.357199 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:41.357240 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.357302 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:41.357424 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4630400}
I20260709 12:22:41.438834 20456 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:41.441792 20561 consensus_queue.cc:1048] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:22:41.453608 20235 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.453737 20639 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:41.454399 20426 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.465480 20612 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.467033 20684 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:41.483894 20638 consensus_queue.cc:260] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.486132 18675 raft_consensus.cc:1240] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:41.545099 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:41.579064 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:41.488211 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:41.507479 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 77006.8us
W20260709 12:22:41.489919 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 140810us
I20260709 12:22:41.528129 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:41.491557 18672 raft_consensus.cc:2468] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:41.573138 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:41.583127 18678 raft_consensus.cc:2393] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 3: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:41.582662 18644 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:41.580816 19246 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
W20260709 12:22:41.582000 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.583989 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:41.588874 18677 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
W20260709 12:22:41.557569 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 90018.9us
I20260709 12:22:41.589833 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:41.590128 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:41.590864 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:41.590945 18672 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:41.557245 18671 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:41.558302 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:41.508253 18572 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:41.596633 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 88466.9us
W20260709 12:22:41.862329 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 272468us
W20260709 12:22:41.863034 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 280430us
I20260709 12:22:41.642164 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:41.863996 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 266363us
W20260709 12:22:41.656762 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.807201 20698 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:41.919319 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:41.888790 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:41.934924 18676 raft_consensus.cc:2393] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 4: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:41.522531 18587 tablet_service.cc:1558] Processing DeleteTablet for tablet 30ca83d13be54a41b9c5aaebfc89de05 with delete_type TABLET_DATA_TOMBSTONED (TS c7bd71f1f37c45f28b52c154e59356b9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40934
I20260709 12:22:41.903443 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:41.939523 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 44308.1us
I20260709 12:22:41.699813 20544 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:41.520524 20725 log.cc:927] Time spent T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:22:41.930543 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:41.521081 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:41.889384 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:41.580209 20684 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:41.513415 20591 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:41.903518 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:41.577095 20456 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:41.944561 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:41.725410 20432 raft_consensus.cc:3055] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:41.957810 18602 raft_consensus.cc:2368] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6.
I20260709 12:22:41.595860 20063 raft_consensus.cc:2764] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:22:41.805814 20730 log.cc:927] Time spent T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:22:41.935196 20641 consensus_meta.cc:287] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.637s	user 0.010s	sys 0.000s
I20260709 12:22:41.513099 20368 consensus_queue.cc:1059] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.440s
I20260709 12:22:41.640875 20680 raft_consensus.cc:2749] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:41.596495 20457 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:41.657897 20638 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:41.955356 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:41.950870 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 360547us
I20260709 12:22:41.640232 20691 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:41.689520 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:41.930122 20639 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:41.974586 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:41.974053 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:41.743324 20692 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:41.673182 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:41.932750 20426 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:41.472573 20635 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.785048 20235 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:41.487267 20644 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:41.957626 20591 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.958662 20456 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:41.957492 20432 raft_consensus.cc:740] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:22:41.972131 20420 consensus_meta.cc:287] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.665s	user 0.013s	sys 0.003s
W20260709 12:22:41.988556 20654 consensus_meta.cc:287] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.705s	user 0.008s	sys 0.008s
I20260709 12:22:41.986404 20691 raft_consensus.cc:697] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:41.991523 20591 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:42.032858 20657 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:22:42.035586 20732 log.cc:927] Time spent T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:22:42.042596 20735 log.cc:927] Time spent T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.075s	user 0.004s	sys 0.000s
I20260709 12:22:42.046972 20691 consensus_queue.cc:237] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:41.601639 18494 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:42.084053 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 482253us
I20260709 12:22:42.101773 18522 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:42.103430 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:42.104823 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:42.106047 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:42.106807 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:42.108556 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:42.109494 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:42.110169 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:42.113088 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:42.115031 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:41.956965 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:42.117512 18597 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
W20260709 12:22:42.118016 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.109532 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:42.120950 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:42.121582 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:42.122413 18603 raft_consensus.cc:2410] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:41.959504 18600 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:42.104957 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:42.124593 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:42.126144 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:42.126989 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:42.126179 18644 connection.cc:256] RPC call timeout handler was delayed by -1.9713888050000605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
W20260709 12:22:42.128464 18644 connection.cc:256] RPC call timeout handler was delayed by -1.9281888049999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
W20260709 12:22:42.128894 18644 connection.cc:256] RPC call timeout handler was delayed by -1.7073384949999308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
I20260709 12:22:42.131381 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:42.132843 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:42.133473 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:42.134049 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:42.134972 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:42.135293 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:22:42.121299 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.136775 18598 raft_consensus.cc:1240] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:42.137744 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:42.138123 18528 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:42.137971 18644 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:42.151281 18599 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:22:42.195025 18599 pending_rounds.cc:85] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9: Aborting all ops after (but not including) 2
W20260709 12:22:42.146435 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 212585us
I20260709 12:22:42.107643 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:42.153743 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:42.154331 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:42.144930 18604 raft_consensus.cc:1240] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:42.153674 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:42.196825 18522 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:42.134100 18524 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:42.164678 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:42.169005 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:42.169303 18674 raft_consensus.cc:1240] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:22:42.170428 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:42.172196 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:42.176509 19242 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:42.177146 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:42.179143 20432 consensus_queue.cc:260] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:41.971251 19239 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.026s	sys 0.047s
I20260709 12:22:42.181982 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:42.144264 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:42.191412 20661 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:42.204181 18528 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:22:42.159550 18605 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:42.208271 18599 pending_rounds.cc:107] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:22:42.257496 18599 raft_consensus.cc:2889] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:42.225939 18604 raft_consensus.cc:1275] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:42.227191 18600 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 5.
I20260709 12:22:42.228071 20639 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.237062 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:42.240762 19247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33388 (request call id 303) took 1309 ms. Trace:
I20260709 12:22:42.253474 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:42.265159 18602 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:42.276235 19239 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.027s	sys 0.048s
I20260709 12:22:42.284353 20680 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.256937 20661 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:42.286031 18524 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:42.289327 18677 raft_consensus.cc:2393] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 5: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:42.289669 20639 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.293578 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:42.294589 18674 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:42.296299 20235 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.297027 20235 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:42.299461 20683 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.300483 20683 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:42.287503 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 114829us
I20260709 12:22:41.993783 20644 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.312223 18606 raft_consensus.cc:1240] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:42.316606 18602 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:22:42.319432 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:42.323983 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 80996.5us
I20260709 12:22:42.303897 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:42.315845 20661 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:42.341166 19241 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:42.354184 20739 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:42.346946 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:42.359117 18606 raft_consensus.cc:2410] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:42.303716 20683 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:42.363144 18674 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:22:42.368158 20432 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:42.368324 20635 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:42.358968 18678 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:42.367233 20457 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:42.383875 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 56800us
I20260709 12:22:42.385159 20612 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:42.385824 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:42.355162 20739 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.405915 20739 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:42.268018 19247 rpcz_store.cc:276] 0709 12:22:40.931104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.941096 (+  9992us) service_pool.cc:224] Handling call
0709 12:22:41.930829 (+989733us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b5800003c98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:22:42.240570 (+309741us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11590016}
I20260709 12:22:42.408179 18679 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:22:42.408679 20684 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.409056 18426 catalog_manager.cc:5697] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:22:42.410871 18426 catalog_manager.cc:5697] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
W20260709 12:22:42.415210 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 76964.5us
I20260709 12:22:42.393400 20457 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:42.313241 20727 consensus_queue.cc:1059] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.144s
I20260709 12:22:42.285243 20680 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.411484 20684 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:42.412755 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 275082us
I20260709 12:22:42.425442 18601 raft_consensus.cc:2393] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 5: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:42.426047 20692 consensus_queue.cc:1059] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
W20260709 12:22:42.430160 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 44454.5us
I20260709 12:22:42.431236 18570 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:42.431474 20017 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:42.441166 20639 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:42.441617 20719 raft_consensus.cc:3055] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:42.442158 20719 raft_consensus.cc:740] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:42.411867 20456 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.417514 18572 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:42.434032 20017 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:42.453387 20017 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:42.443482 20719 consensus_queue.cc:260] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:42.457687 20719 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:42.459177 20612 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.459475 20683 raft_consensus.cc:3055] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:42.484432 20683 raft_consensus.cc:740] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:42.485610 20683 consensus_queue.cc:260] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.432643 18426 catalog_manager.cc:5697] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 2 to 3, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 3 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:42.489063 18426 catalog_manager.cc:5697] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 3, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 3 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:42.471127 20591 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:42.494923 18601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40954 (request call id 1369) took 1156 ms. Trace:
I20260709 12:22:42.495325 18601 rpcz_store.cc:276] 0709 12:22:41.338987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.339369 (+   382us) service_pool.cc:224] Handling call
0709 12:22:42.494665 (+1155296us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b540015bb54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:42.494841 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2232168832}
I20260709 12:22:42.496308 20591 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:22:42.496148 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 115573us
I20260709 12:22:42.496728 18597 raft_consensus.cc:1240] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:42.497201 18572 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:42.497572 20362 raft_consensus.cc:2804] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:42.472405 20747 tablet_replica.cc:333] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:22:42.498319 20362 raft_consensus.cc:697] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:42.498327 18572 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:42.499732 20464 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:42.460951 20644 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:42.500809 20464 raft_consensus.cc:697] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:42.501426 20696 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:42.472026 20235 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:42.502092 20464 consensus_queue.cc:237] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.502221 20696 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:42.500020 20704 raft_consensus.cc:2804] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:42.479987 18644 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:42.467250 18673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1313) took 1630 ms. Trace:
I20260709 12:22:42.487435 20683 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:42.491993 18426 catalog_manager.cc:5697] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 5, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 5 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:42.474573 20456 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:42.472136 20554 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:42.523294 20639 raft_consensus.cc:2749] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:42.509837 20612 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:42.530615 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 50889.3us
I20260709 12:22:42.465008 20692 raft_consensus.cc:3055] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:42.470539 20680 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:42.532308 18644 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:42.532166 20612 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:42.510114 20362 consensus_queue.cc:237] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.521909 20704 raft_consensus.cc:697] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:42.529405 20696 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:42.533151 20554 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:42.536666 20692 raft_consensus.cc:740] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:42.508757 18673 rpcz_store.cc:276] 0709 12:22:40.836525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.836659 (+   134us) service_pool.cc:224] Handling call
0709 12:22:41.315936 (+479277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:41.316218 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:41.324294 (+  8076us) log.cc:844] Serialized 14 byte log entry
0709 12:22:42.281684 (+957390us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:42.284334 (+  2650us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:42.284844 (+   510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:42.285153 (+   309us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:42.466830 (+181677us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b5400404cd0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:42.466989 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7858,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":163307,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":1101247872,"thread_start_us":819527,"threads_started":2,"wal-append.queue_time_us":647014}
W20260709 12:22:42.589567 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 57491.8us
I20260709 12:22:42.597234 19210 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:42.598659 20662 raft_consensus.cc:2804] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:42.599228 20662 raft_consensus.cc:697] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:42.600224 20662 consensus_queue.cc:237] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:42.605353 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:42.606482 20017 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:42.609817 20704 consensus_queue.cc:237] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.589414 18426 catalog_manager.cc:5697] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 3, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 3 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:42.584164 20554 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:42.629976 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 71114.8us
I20260709 12:22:42.629335 20692 consensus_queue.cc:260] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.634088 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:42.635421 20692 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:42.636301 20497 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:42.637104 20497 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:42.638350 20644 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:42.638895 20644 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.639338 20497 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:42.645428 19210 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:42.672226 20654 raft_consensus.cc:2804] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:42.673045 20654 raft_consensus.cc:697] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:42.674007 20654 consensus_queue.cc:237] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:42.677176 18426 catalog_manager.cc:5697] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:42.595865 20680 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:42.679179 18426 catalog_manager.cc:5697] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:42.691327 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:42.697178 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:42.691465 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:42.701535 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:42.681895 20017 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:42.696871 18426 catalog_manager.cc:5697] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 2 to 3, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 3 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:42.712682 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.688843 20639 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:42.713908 18644 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:42.718910 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:42.700358 20696 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.720023 18426 catalog_manager.cc:5697] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 3 to 5, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 5 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:42.723273 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.724431 20640 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:42.728480 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:42.725034 18598 raft_consensus.cc:1275] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:22:42.736632 20732 log.cc:927] Time spent T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:22:42.737180 20741 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:42.740077 20638 consensus_meta.cc:287] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.751s	user 0.015s	sys 0.000s
I20260709 12:22:42.742151 20698 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.742771 20684 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.742762 20698 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:42.743660 20684 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.744350 19240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33372 (request call id 182) took 1158 ms. Trace:
I20260709 12:22:42.746088 20698 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:42.744895 19240 rpcz_store.cc:276] 0709 12:22:41.586255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.595996 (+  9741us) service_pool.cc:224] Handling call
0709 12:22:42.338808 (+742812us) spinlock_profiling.cc:243] Waited 9.97 ms on lock 0x7b5800003c98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baeee 000000000036eb39 00007efc8142e1e0 00007efc814f70c4 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:42.353155 (+ 14347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:42.392696 (+ 39541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:42.394430 (+  1734us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:42.451478 (+ 57048us) log.cc:844] Serialized 26 byte log entry
0709 12:22:42.622446 (+170968us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:42.622965 (+   519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:42.641823 (+ 18858us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:42.739582 (+ 97759us) raft_consensus.cc:1685] finished
0709 12:22:42.739600 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:42.744146 (+  4546us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4789,"raft.queue_time_us":39234,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":13102,"spinlock_wait_cycles":22932224,"thread_start_us":115054,"threads_started":1,"wal-append.queue_time_us":245230}
I20260709 12:22:42.692301 20591 consensus_queue.cc:1048] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:22:42.737224 18523 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:42.716594 20630 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.755033 20630 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:42.758311 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 44466.1us
I20260709 12:22:42.761389 18644 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:42.763171 20680 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:42.764323 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:42.759980 20582 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:42.767046 20582 raft_consensus.cc:697] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:42.768579 20420 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:42.768333 20582 consensus_queue.cc:237] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.769387 20420 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:42.763581 20680 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:42.771618 20680 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:42.771703 20420 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:42.773368 20661 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.774694 20432 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:22:42.780314 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 52068.1us
I20260709 12:22:42.791386 18426 catalog_manager.cc:5697] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 2 to 3, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 3 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:42.758172 20630 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:42.797098 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:42.749724 20644 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:42.804288 18426 catalog_manager.cc:5697] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 4 to 5, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 5 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
W20260709 12:22:42.807708 20761 log.cc:927] Time spent T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:22:42.810384 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:42.727054 20554 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:42.815922 20554 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:42.816862 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:42.750619 20696 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.827304 20696 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:42.826812 18426 catalog_manager.cc:5697] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 2 to 5, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 5 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:42.829195 18494 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:42.829077 18426 catalog_manager.cc:5697] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 2, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:42.830116 20591 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:42.830533 20591 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:42.832190 20591 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:42.833479 20640 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.834178 20640 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.836591 20640 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:42.837215 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:42.838442 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:42.839104 18526 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:42.839841 20696 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.840308 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:42.840476 20696 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.850661 18426 catalog_manager.cc:5697] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 3 to 4, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 4 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:42.852577 20696 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:42.841342 18680 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:42.852807 18426 catalog_manager.cc:5697] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:42.841816 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:42.857205 18597 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:42.857965 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:42.858744 18526 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:42.859454 20727 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:42.860128 20727 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.860808 18572 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:42.862707 20727 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:42.863524 20752 raft_consensus.cc:2804] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:42.863998 20752 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.864367 20752 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:42.865361 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:42.866467 20684 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:42.868185 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:42.857268 18426 catalog_manager.cc:5697] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:42.843068 18599 raft_consensus.cc:1275] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:42.841964 18598 raft_consensus.cc:1240] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:22:42.869735 18426 catalog_manager.cc:5697] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 3, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 3 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:42.870589 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:42.871451 18528 raft_consensus.cc:2393] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:42.872295 18680 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:42.875029 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:42.875133 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:42.876703 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:42.875910 18597 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:42.877815 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:42.879204 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 137875us
I20260709 12:22:42.841253 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:42.877038 18494 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:42.883394 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:42.885797 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:42.886497 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:42.887087 18675 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:22:42.888087 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:42.890293 18673 raft_consensus.cc:1240] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:42.892294 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:42.893133 18525 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:42.887471 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:42.871521 18426 catalog_manager.cc:5697] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 4, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 4 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:42.894956 18572 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:42.908938 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:42.780927 20639 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.909675 18528 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:42.912182 18572 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:42.894156 19239 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:42.893977 20661 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:42.922397 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:42.927888 20744 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:42.928406 20771 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:42.952306 18572 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:42.929239 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 52516.2us
I20260709 12:22:42.929248 18529 raft_consensus.cc:1240] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:42.930850 18426 catalog_manager.cc:5697] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 2, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:42.935891 20684 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:42.938558 20640 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:42.939891 20561 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.940615 18601 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:42.942421 20680 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:42.950810 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:42.956190 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.963984 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:42.960655 18426 catalog_manager.cc:5697] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 3, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 3 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:42.972050 20630 consensus_queue.cc:1059] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:42.971962 20561 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.972981 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:42.973733 20630 raft_consensus.cc:3055] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:42.974149 20630 raft_consensus.cc:740] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:42.974977 20630 consensus_queue.cc:260] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.976261 20741 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:42.977069 20741 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.979254 20680 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:42.983131 20749 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:42.964032 20644 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:42.983966 20749 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:42.984371 20644 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:42.986649 18570 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:42.988759 20630 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:42.990676 20640 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:42.993619 20640 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:42.987881 20457 consensus_meta.cc:287] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.556s	user 0.013s	sys 0.000s
I20260709 12:22:42.994331 18677 raft_consensus.cc:1240] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:22:42.994439 20457 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:42.995321 18678 raft_consensus.cc:1275] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:42.995687 18522 raft_consensus.cc:1240] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:42.997804 20639 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:42.997889 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:42.962173 20704 consensus_queue.cc:1059] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:22:42.999245 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:43.000180 18676 raft_consensus.cc:2393] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 3: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:43.001457 18672 raft_consensus.cc:1275] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:43.003998 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:43.005472 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:42.987454 20641 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:42.957029 20771 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.956718 20684 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.008206 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:43.041246 18526 raft_consensus.cc:2393] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 6: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:43.036291 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:43.008746 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:43.036885 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:43.037626 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:43.038471 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:43.006280 18426 catalog_manager.cc:5697] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 2, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:43.042825 18678 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:43.044332 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:42.975368 20561 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:43.046622 18494 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.042821 20684 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:43.050444 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 44944.7us
I20260709 12:22:43.001441 20704 raft_consensus.cc:3055] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:43.047803 18673 raft_consensus.cc:1275] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:43.049058 18677 raft_consensus.cc:2393] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 3: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
W20260709 12:22:43.043113 19210 leader_election.cc:336] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Timed out: RequestConsensusVote RPC to 127.16.240.131:36757 timed out after 1.605s (SENT)
I20260709 12:22:43.052845 19210 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:43.045682 20641 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.007849 20749 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:42.986673 20644 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:42.979637 20741 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:43.056672 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:43.040318 20771 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:43.043730 19240 raft_consensus.cc:1240] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:43.060334 18680 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:22:43.064751 18676 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:43.046204 20654 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:43.068426 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 81862.8us
I20260709 12:22:43.056355 20727 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:43.054489 20554 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.058413 20362 raft_consensus.cc:2804] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:43.056002 20704 raft_consensus.cc:740] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:43.072798 20654 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:43.082579 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:43.083264 18675 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:43.060912 20641 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:43.051281 20591 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:43.071058 20749 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:43.058554 20497 consensus_queue.cc:1059] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:22:43.091681 20362 raft_consensus.cc:697] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:43.085695 20554 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:43.089905 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:43.075501 19239 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:43.098871 18606 raft_consensus.cc:1240] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:43.097659 18676 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4.
I20260709 12:22:43.101907 18526 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:22:43.110162 20591 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:43.110939 20654 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:43.120323 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:43.120558 20554 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:43.106035 20638 raft_consensus.cc:3055] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:43.111658 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:43.121259 20638 raft_consensus.cc:740] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:43.121680 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:43.113490 18601 raft_consensus.cc:1240] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:43.114269 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:43.122298 20638 consensus_queue.cc:260] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:43.123116 18600 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:43.116642 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:43.118331 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:43.119000 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:43.120446 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:43.110495 20362 consensus_queue.cc:237] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:43.126470 18605 raft_consensus.cc:2410] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:43.128475 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:43.121012 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:43.129171 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:43.123546 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.115784 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:43.124121 18494 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.121235 20554 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
W20260709 12:22:43.131336 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 48003.1us
I20260709 12:22:43.131336 18494 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.131502 20727 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:43.133181 18570 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:43.133764 20561 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:43.134167 18529 raft_consensus.cc:3055] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:43.134567 18529 raft_consensus.cc:740] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:43.134714 20692 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:43.135349 20692 raft_consensus.cc:697] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:43.125331 20638 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:43.135584 18529 consensus_queue.cc:260] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:43.136919 18529 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:43.135502 18494 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.142027 20727 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:22:43.144228 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.143504 18494 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.149816 20752 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:43.151180 18599 raft_consensus.cc:2368] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 3. Current term is 4.
I20260709 12:22:43.152427 20692 consensus_queue.cc:237] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:43.156548 18570 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:43.158638 18644 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.158915 20640 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:43.159551 20644 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:43.160208 18644 leader_election.cc:400] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6.
I20260709 12:22:43.160595 18644 leader_election.cc:403] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:43.160833 20377 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:43.161317 20680 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6.
I20260709 12:22:43.162307 18570 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:43.159554 20640 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:43.165022 20640 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:43.162467 18644 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.170759 20432 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:43.174469 20457 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:43.122545 20704 consensus_queue.cc:260] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:43.181306 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:43.181950 18675 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:43.185034 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:43.168583 20684 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:43.189039 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:43.191023 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
W20260709 12:22:43.191867 20774 log.cc:927] Time spent T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:22:43.192775 20741 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:43.193043 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:22:43.193250 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 49843us
I20260709 12:22:43.194330 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:43.195325 18528 raft_consensus.cc:1275] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:43.197551 20752 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:43.181859 20591 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:43.199967 20771 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:43.201671 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:43.203485 20704 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:43.204698 20719 consensus_queue.cc:1059] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:22:43.206348 18475 auto_rebalancer.cc:629] Failed to schedule move for tablet c2c31f23053e4804b0fb872f29fde999: Illegal state: Replica a0dee333a83a45f1ab0c1bb6d094afd1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:22:43.208443 19210 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:43.220100 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 57736.3us
I20260709 12:22:43.220322 18529 raft_consensus.cc:1275] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:43.225214 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:43.230811 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:43.244102 18674 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:43.234480 18494 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.234885 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:43.245167 20719 raft_consensus.cc:3055] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:43.245781 20719 raft_consensus.cc:740] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:43.246320 18494 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:43.248775 20727 raft_consensus.cc:2749] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:43.249576 20727 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:43.235867 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:43.236092 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:43.237440 20641 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:43.258862 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:43.259619 18678 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:43.240576 18522 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:43.241818 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:43.247570 18494 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.261346 18644 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:43.261739 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:43.262425 18529 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:43.262862 18570 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:43.258867 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:43.262168 19246 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:43.246939 20719 consensus_queue.cc:260] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:43.267465 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:43.271013 18526 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:43.259421 20684 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:43.273806 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:43.260119 20662 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:43.243417 20420 consensus_queue.cc:1048] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:22:43.269793 20752 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:43.347522 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:43.352310 20638 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.412386 20719 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:43.343236 18680 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
W20260709 12:22:43.342036 20734 log.cc:927] Time spent T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:22:43.347112 20640 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:43.356449 18673 raft_consensus.cc:3055] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:22:43.417618 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 209237us
W20260709 12:22:43.341802 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 79077.7us
W20260709 12:22:43.418442 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 174912us
I20260709 12:22:43.346433 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:43.421088 18528 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:43.372339 18526 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:43.422864 18673 raft_consensus.cc:740] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:43.264499 20457 raft_consensus.cc:2749] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:43.278561 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:43.443614 18528 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:43.444262 18523 raft_consensus.cc:1275] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:43.427124 18529 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:22:43.425777 18570 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:43.427878 18677 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:43.275496 18598 raft_consensus.cc:2368] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:22:43.433925 20747 raft_consensus.cc:2243] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:43.436204 19210 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:43.436758 18475 auto_rebalancer.cc:629] Failed to schedule move for tablet ce446d878cef426395147773f6c9a25e: Illegal state: Replica a0dee333a83a45f1ab0c1bb6d094afd1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:22:43.447913 18572 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:43.425946 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 178444us
I20260709 12:22:43.442770 18522 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:43.275456 19244 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.454560 20691 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:43.455556 20691 raft_consensus.cc:697] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:43.455950 20692 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:43.422199 20771 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:43.449016 18570 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:43.456544 20641 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:43.458573 20591 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:43.279070 20749 consensus_queue.cc:1048] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.182s
I20260709 12:22:43.428407 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:43.462461 18570 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:43.463120 20641 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:43.463313 20662 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:43.468442 20747 raft_consensus.cc:2272] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:43.425218 20640 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:43.449074 18572 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:43.486697 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 59154.9us
I20260709 12:22:43.486479 18673 consensus_queue.cc:260] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:43.428423 20638 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:43.479128 20640 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:43.495285 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 46280.6us
I20260709 12:22:43.496060 18572 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:43.497591 18572 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:43.499959 18570 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:22:43.505478 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 69348.2us
I20260709 12:22:43.506544 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.498224 20771 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:43.510987 18644 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.511229 18673 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:43.503168 20420 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:22:43.517795 18475 auto_rebalancer.cc:629] Failed to schedule move for tablet 10f0fd04dea343f1a51febdac9b97f7b: Illegal state: Replica a0dee333a83a45f1ab0c1bb6d094afd1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:22:43.525941 18494 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.526347 20561 consensus_queue.cc:1048] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:43.529834 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:43.530958 20727 raft_consensus.cc:2749] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:43.504488 20684 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:43.508695 20641 raft_consensus.cc:2804] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:43.535483 19240 raft_consensus.cc:1240] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:43.543021 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
W20260709 12:22:43.509618 18570 raft_consensus.cc:2686] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:22:43.456851 20691 consensus_queue.cc:237] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:43.544888 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 45003.8us
I20260709 12:22:43.545782 18570 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:43.549145 20591 consensus_queue.cc:1048] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:43.550854 18494 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.552229 18494 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.552453 20561 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:43.553086 20727 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:43.541855 20741 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:43.553503 20727 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:43.553925 20727 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:43.557104 20561 consensus_queue.cc:1048] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:43.559075 18494 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.567978 20591 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:43.570573 20747 ts_tablet_manager.cc:1916] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:43.542012 19244 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 2.
I20260709 12:22:43.576387 20779 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:43.579923 20641 raft_consensus.cc:697] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:43.581094 20641 consensus_queue.cc:237] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:43.543051 20420 raft_consensus.cc:697] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:43.504182 20377 consensus_queue.cc:1048] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:22:43.547205 20684 raft_consensus.cc:697] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:43.562922 20683 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:43.587649 20684 consensus_queue.cc:237] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:43.591230 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 89188.8us
I20260709 12:22:43.592238 18644 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.585173 20420 consensus_queue.cc:237] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:43.593664 18644 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.594456 20644 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:43.594877 18644 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.595242 20644 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:43.595922 20741 raft_consensus.cc:2749] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:43.600960 20638 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:43.603255 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:43.605119 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:43.584492 18494 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:43.612789 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 67116.9us
I20260709 12:22:43.618192 18673 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:22:43.619309 18673 pending_rounds.cc:85] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting all ops after (but not including) 3
I20260709 12:22:43.620010 18673 pending_rounds.cc:107] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:22:43.620743 18673 raft_consensus.cc:2889] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:43.622687 18570 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:43.625947 18644 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.637276 20752 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:43.637998 20752 raft_consensus.cc:697] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:43.642076 19243 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
W20260709 12:22:43.643186 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 58767.9us
I20260709 12:22:43.632547 20638 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:43.652806 20638 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:43.638711 20591 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:43.654618 20591 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:43.655118 20591 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.651405 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:43.649577 18599 raft_consensus.cc:1275] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:43.650341 18494 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.637324 20644 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:43.651486 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:43.651616 20752 consensus_queue.cc:237] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:43.661727 18521 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:22:43.653255 20638 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:43.587550 20727 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:43.667778 20561 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:43.671638 18598 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 6.
I20260709 12:22:43.655680 20683 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:43.664974 18521 pending_rounds.cc:85] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 2
I20260709 12:22:43.688771 18521 pending_rounds.cc:107] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:22:43.686745 18599 raft_consensus.cc:1275] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:43.689179 18521 raft_consensus.cc:2889] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:43.692360 18570 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:43.664693 20640 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:43.694538 18644 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:43.698086 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 53859.1us
I20260709 12:22:43.698468 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:43.684790 20561 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:43.697522 20683 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:43.708323 20683 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:43.708998 20683 consensus_queue.cc:1048] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:43.703801 20457 consensus_queue.cc:1048] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:22:43.714865 20640 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:43.715884 20644 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:43.720113 20377 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:43.727175 20638 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:43.730406 20638 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:43.704023 20771 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:43.700083 20704 raft_consensus.cc:2804] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:43.745035 20704 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.745401 20704 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:43.739759 20561 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:43.691504 20779 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:22:43.758874 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 70107.2us
I20260709 12:22:43.753502 20704 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:43.774788 18644 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.777724 20644 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:43.782209 18570 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:43.783149 20017 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:43.786952 18677 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:43.788231 20684 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:43.790997 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:43.791630 18677 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:22:43.793300 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 93998.1us
I20260709 12:22:43.800209 19210 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.802404 18494 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:43.803731 18644 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.787235 20591 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:43.805495 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:43.808373 18673 raft_consensus.cc:1275] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:43.809028 18674 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:43.809716 18676 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:43.811215 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:43.814677 18678 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:22:43.812314 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:43.814942 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:43.815619 18679 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:22:43.760206 20779 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:43.813355 18675 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:22:43.816227 18494 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:43.816952 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:43.819850 18671 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:22:43.820420 19244 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:22:43.820801 19244 pending_rounds.cc:85] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4: Aborting all ops after (but not including) 4
I20260709 12:22:43.820739 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:43.821635 20368 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:22:43.813289 20644 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:43.825505 20727 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:43.812558 19210 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:43.826699 18680 raft_consensus.cc:1275] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:43.821794 19240 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:43.832252 20368 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:43.821328 19244 pending_rounds.cc:107] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:22:43.832719 20368 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:43.832826 19244 raft_consensus.cc:2889] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:43.833209 20368 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:43.834038 20662 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.834568 20662 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:43.826432 20457 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:43.812284 20749 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:43.836793 20662 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:43.837436 20684 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.837935 20684 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:43.807812 20719 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:43.840117 20719 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:43.841322 20683 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:43.841878 20683 raft_consensus.cc:697] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:43.842221 20719 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:43.842769 20683 consensus_queue.cc:237] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:43.816565 20654 consensus_queue.cc:1048] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:22:43.846302 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:43.864082 20684 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:43.868054 20704 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:43.868228 18644 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.869534 18671 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:43.870635 18679 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:43.871445 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:43.872360 18672 raft_consensus.cc:2393] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 6: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:43.872996 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:43.873730 18676 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:43.881225 18678 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:22:43.883073 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:22:43.883934 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 55472.2us
I20260709 12:22:43.887334 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:43.888127 18680 raft_consensus.cc:2393] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 6: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:43.889107 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:43.889411 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:43.894748 18676 raft_consensus.cc:1275] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:43.886979 20644 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:43.906451 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:43.868592 20779 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:43.907517 18674 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:43.908020 18676 raft_consensus.cc:1240] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:43.908116 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:43.918478 18527 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:43.909859 18523 raft_consensus.cc:1240] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:43.918870 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:43.919899 18673 raft_consensus.cc:2393] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 4: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:43.916004 18601 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:22:43.923399 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:43.929531 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:43.932118 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:43.932716 18606 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:43.882499 20640 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:43.934971 20591 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:43.936030 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:43.969726 18644 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:43.973443 18605 raft_consensus.cc:1240] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:22:43.941407 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:43.942279 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:43.958472 18674 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:43.961975 20457 raft_consensus.cc:697] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:43.963459 20747 ts_tablet_manager.cc:1929] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:43.964512 18572 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:43.940320 20017 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.989640 18679 raft_consensus.cc:2393] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 4: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:43.965164 20368 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:44.001184 20457 consensus_queue.cc:237] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:44.002950 20368 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:43.986318 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:44.012718 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:44.012861 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:44.013202 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:44.041903 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:43.970918 20640 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:44.049491 18524 raft_consensus.cc:2393] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 6: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:43.980131 20639 consensus_queue.cc:1059] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:22:44.014811 20747 log.cc:1199] T 30ca83d13be54a41b9c5aaebfc89de05 P c7bd71f1f37c45f28b52c154e59356b9: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-1-root/wals/30ca83d13be54a41b9c5aaebfc89de05
I20260709 12:22:44.061877 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:44.064352 18601 raft_consensus.cc:2393] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 6: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:44.008348 20684 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:44.076905 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:44.077715 18603 raft_consensus.cc:2393] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 5: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:43.997275 20017 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:44.052222 18600 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
W20260709 12:22:44.101663 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 106366us
I20260709 12:22:44.116391 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:44.072646 20684 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:44.120334 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 58501.2us
I20260709 12:22:44.115612 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:44.040187 20752 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:22:44.082253 20798 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.142853 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:44.202996 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:44.143272 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:44.211519 18599 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:44.213397 18521 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:44.145077 18523 raft_consensus.cc:1240] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:44.106308 20644 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:44.222685 18525 raft_consensus.cc:2368] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 3. Current term is 4.
I20260709 12:22:44.227936 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:22:44.100334 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 130732us
W20260709 12:22:44.222878 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 99359.3us
I20260709 12:22:44.196242 20640 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:44.172421 20639 raft_consensus.cc:3055] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:44.305989 20639 raft_consensus.cc:740] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:44.306468 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:44.307018 20639 consensus_queue.cc:260] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:44.308367 20639 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:44.123414 20684 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:44.340147 18644 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:44.274688 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:44.126686 20420 consensus_queue.cc:1059] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.120s
I20260709 12:22:44.099545 20561 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:44.351114 20561 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:44.277506 18494 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:22:44.352397 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 74983.8us
W20260709 12:22:44.352734 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 102955us
I20260709 12:22:44.199249 19240 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:44.281291 20644 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:44.353130 18494 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:44.359350 18494 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:44.278669 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 237990us
I20260709 12:22:44.168978 20362 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.158921 20554 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.115s
I20260709 12:22:44.180421 20798 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:44.298362 20796 log.cc:927] Time spent T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.094s	user 0.002s	sys 0.000s
I20260709 12:22:44.303633 19243 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:44.304632 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:44.305439 20747 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40934 (request call id 73) took 2837 ms. Trace:
W20260709 12:22:44.313884 18677 consensus_meta.cc:287] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.005s
I20260709 12:22:44.246686 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:44.341344 18527 raft_consensus.cc:2393] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:44.346383 20017 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:44.287477 20812 consensus_queue.cc:1048] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
W20260709 12:22:44.348171 20807 log.cc:927] Time spent T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:22:44.287940 20771 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:22:44.353592 18570 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:44.379056 18494 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:44.367578 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:44.369542 18677 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
W20260709 12:22:44.577788 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 286144us
W20260709 12:22:44.453238 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 99737.9us
I20260709 12:22:44.365401 20561 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:22:44.462510 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.401286 18526 raft_consensus.cc:2393] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:44.381783 20805 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:44.384230 20591 raft_consensus.cc:2804] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:44.658401 18644 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:44.576629 20814 raft_consensus.cc:2764] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:22:44.574261 20638 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:44.668009 20638 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:44.668489 20638 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:44.662899 18527 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:44.379630 20457 consensus_queue.cc:1059] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.275s
I20260709 12:22:44.643918 20741 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:44.380733 18598 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:22:44.376308 20362 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:44.664232 18570 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:44.403180 20799 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:44.689527 20799 raft_consensus.cc:697] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:44.456424 20801 consensus_queue.cc:1048] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.209s
I20260709 12:22:44.652055 20561 raft_consensus.cc:697] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:44.690683 20799 consensus_queue.cc:237] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:44.654291 20644 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:22:44.696204 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 52250.8us
I20260709 12:22:44.657703 20803 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.672258 20457 raft_consensus.cc:3055] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:44.663169 20591 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:44.681080 20802 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:44.732173 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 337533us
W20260709 12:22:44.736131 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 71959.3us
I20260709 12:22:44.740221 18494 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:44.672837 20771 consensus_queue.cc:1048] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:22:44.735034 20591 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:44.759040 18475 auto_rebalancer.cc:629] Failed to schedule move for tablet b52424a465944d0ba861991c593bdc17: Illegal state: Replica c7bd71f1f37c45f28b52c154e59356b9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:22:44.735951 20457 raft_consensus.cc:740] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:44.730669 20793 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:44.762516 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:44.829941 18676 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:44.794281 20727 consensus_queue.cc:1059] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:44.766358 18600 raft_consensus.cc:1275] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:44.672344 20741 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:44.735688 20644 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:44.370702 20747 rpcz_store.cc:276] 0709 12:22:41.520765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.522244 (+  1479us) service_pool.cc:224] Handling call
0709 12:22:42.471616 (+949372us) ts_tablet_manager.cc:1151] Deleting tablet 30ca83d13be54a41b9c5aaebfc89de05
0709 12:22:42.471775 (+   159us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:22:43.733039 (+1261264us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:43.963239 (+230200us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:44.305315 (+342076us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":923796,"tablet-delete.queue_time_us":526993,"thread_start_us":350733,"threads_started":1}
I20260709 12:22:44.741611 20803 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:44.852123 20818 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.110s
I20260709 12:22:44.852605 18525 raft_consensus.cc:1275] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:44.853679 20803 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:44.752900 20814 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 12:22:44.767403 20639 consensus_queue.cc:1059] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 12:22:44.839445 20827 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:44.831171 20798 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:44.865451 20727 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:44.838382 20793 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:44.907546 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 71567.1us
I20260709 12:22:44.862175 20802 consensus_queue.cc:1059] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:22:44.901856 20798 raft_consensus.cc:3055] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:22:44.974656 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 138460us
W20260709 12:22:44.979089 20833 log.cc:927] Time spent T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:22:44.933712 20798 raft_consensus.cc:740] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:44.868786 20561 consensus_queue.cc:237] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:45.065647 20829 log.cc:927] Time spent T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:22:44.974838 20591 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.038396 18644 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:45.038516 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 298408us
I20260709 12:22:44.898669 20457 consensus_queue.cc:260] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.129645 18494 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:45.084995 20817 log.cc:927] Time spent T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 12:22:45.191061 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 152736us
I20260709 12:22:45.044968 20802 consensus_queue.cc:1059] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.145s
I20260709 12:22:45.091830 20741 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:22:45.202762 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 73207.4us
I20260709 12:22:45.201066 18644 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:45.124774 20644 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:45.219234 18494 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:45.120420 20830 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:45.190336 20833 log.cc:927] Time spent T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:22:45.197001 20362 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:45.191439 20798 consensus_queue.cc:260] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:45.227731 20798 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:45.234473 20840 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:22:45.234985 20825 log.cc:927] Time spent T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.237s	user 0.000s	sys 0.000s
I20260709 12:22:45.224447 20727 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:45.239611 20591 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:45.242223 20793 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:45.245380 20805 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.245904 20805 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:45.248260 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 127127us
I20260709 12:22:45.199913 20842 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:45.221712 20818 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.253151 18570 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:45.225634 20457 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:45.276516 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 75490.7us
I20260709 12:22:45.224952 20830 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.279922 20741 consensus_queue.cc:1059] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:45.284533 20830 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:45.284580 20741 raft_consensus.cc:3055] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:45.285175 20741 raft_consensus.cc:740] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:45.286000 20741 consensus_queue.cc:260] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:45.280435 20850 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:45.291400 20850 raft_consensus.cc:697] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:45.292804 20850 consensus_queue.cc:237] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:45.282095 20638 consensus_meta.cc:287] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.613s	user 0.010s	sys 0.001s
I20260709 12:22:45.295802 18671 raft_consensus.cc:1275] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:45.296006 20638 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.297094 18671 raft_consensus.cc:1275] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:45.298079 20638 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:45.298345 18671 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:22:45.280260 20822 log.cc:927] Time spent T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.089s	user 0.000s	sys 0.002s
W20260709 12:22:45.268826 20684 consensus_meta.cc:287] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.912s	user 0.011s	sys 0.002s
I20260709 12:22:45.300052 18606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39798 (request call id 142) took 1288 ms. Trace:
I20260709 12:22:45.300422 18606 rpcz_store.cc:276] 0709 12:22:44.011967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.012153 (+   186us) service_pool.cc:224] Handling call
0709 12:22:44.050219 (+ 38066us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:44.223174 (+172955us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:44.223206 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:44.249681 (+ 26475us) log.cc:844] Serialized 26 byte log entry
0709 12:22:44.551253 (+301572us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:44.551307 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.551412 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:45.299821 (+748409us) raft_consensus.cc:1685] finished
0709 12:22:45.299848 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:45.299971 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3744,"raft.queue_time_us":66326,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":18801,"thread_start_us":438476,"threads_started":2,"wal-append.queue_time_us":703664}
I20260709 12:22:45.290261 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:45.302585 18678 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:45.287899 20830 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:45.303812 20830 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.280809 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1401) took 1268 ms. Trace:
I20260709 12:22:45.254546 20818 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.307255 20818 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:45.308131 20741 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:45.308718 20843 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.309283 20843 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.304651 18679 rpcz_store.cc:276] 0709 12:22:44.011967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.012270 (+   303us) service_pool.cc:224] Handling call
0709 12:22:44.049247 (+ 36977us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:44.124701 (+ 75454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:44.124833 (+   132us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:44.125676 (+   843us) log.cc:844] Serialized 26 byte log entry
0709 12:22:44.501595 (+375919us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:44.726660 (+225065us) log.cc:844] Serialized 14 byte log entry
0709 12:22:44.726959 (+   299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.727048 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:45.280554 (+553506us) raft_consensus.cc:1685] finished
0709 12:22:45.280587 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:45.280736 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":354232,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":86925,"raft.run_cpu_time_us":461,"raft.run_wall_time_us":31579,"thread_start_us":519860,"threads_started":3,"wal-append.queue_time_us":730527}
W20260709 12:22:45.311473 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.319895 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:45.279292 18644 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:45.336102 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 57719.9us
I20260709 12:22:45.311635 20843 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:45.334522 20798 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:45.337636 20842 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:45.337796 20798 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.340509 18644 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:45.341456 18644 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:45.276513 20644 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:45.344422 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 94782.8us
I20260709 12:22:45.351257 18644 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:45.352924 18644 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:22:45.354250 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 131662us
I20260709 12:22:45.354511 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:45.345243 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:45.361613 20843 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:45.322152 20830 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:45.384307 18522 raft_consensus.cc:1240] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:45.300076 20684 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.388986 18675 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:45.344149 20842 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:45.393951 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:45.397572 18494 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:45.334904 20805 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.368155 20368 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
W20260709 12:22:45.406793 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 45719.9us
I20260709 12:22:45.403471 18494 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:45.388164 20719 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:45.392095 20644 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:45.393500 20802 raft_consensus.cc:2749] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:45.412799 20719 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:45.413374 20684 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:45.414068 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.415341 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1340) took 1213 ms. Trace:
I20260709 12:22:45.410560 20793 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:45.407320 20852 raft_consensus.cc:2804] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:45.427392 20805 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:45.402704 20799 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:45.428843 20591 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:45.449607 20591 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.409788 20368 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:45.451105 20719 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:45.441970 18526 rpcz_store.cc:276] 0709 12:22:44.201734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.202645 (+   911us) service_pool.cc:224] Handling call
0709 12:22:45.415011 (+1212366us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54002d5ad4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:45.415217 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":437037824}
I20260709 12:22:45.405704 20855 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.431921 20691 raft_consensus.cc:3055] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:45.439489 20842 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.441283 20457 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.444466 20793 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:45.445374 20727 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:45.511289 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:45.489408 20691 raft_consensus.cc:740] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:45.514122 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:45.452286 20835 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:45.446647 20852 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
W20260709 12:22:45.520273 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 167431us
I20260709 12:22:45.572751 18644 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:45.488411 20840 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.488384 20799 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:45.580022 20858 log.cc:927] Time spent T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:22:45.580601 20802 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:45.501288 20457 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.513403 20793 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:45.494227 20855 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.595528 18675 raft_consensus.cc:3055] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:45.595970 18675 raft_consensus.cc:740] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:22:45.587803 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 153817us
I20260709 12:22:45.583962 18644 leader_election.cc:400] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 3. Current term is 4.
I20260709 12:22:45.590613 20368 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:45.591048 20798 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:45.582784 20835 raft_consensus.cc:697] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:45.597203 18644 leader_election.cc:403] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:45.592196 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:45.601953 18527 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4.
I20260709 12:22:45.593386 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:45.602409 18644 leader_election.cc:400] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:22:45.602782 18644 leader_election.cc:403] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:45.602850 18671 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:45.593933 20799 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:45.594447 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:45.608400 18679 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:45.571282 20852 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:45.609241 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:45.611447 18522 raft_consensus.cc:1275] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:45.597848 20818 consensus_queue.cc:1048] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:22:45.614352 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:45.516172 20727 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.618338 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:45.619899 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:45.620466 20591 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:45.613556 18675 consensus_queue.cc:260] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:45.625624 18675 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:45.625583 20855 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:45.627211 20870 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:22:45.612432 20863 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.628995 20863 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.631206 20863 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:45.634378 20793 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.607968 20644 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 3. Current term is 4.
I20260709 12:22:45.641594 20850 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:45.646418 20457 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:45.649497 20870 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.654007 18675 raft_consensus.cc:1275] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:45.650087 20870 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.671301 20835 consensus_queue.cc:237] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:45.678088 18671 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:45.681558 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:45.682792 18602 raft_consensus.cc:1240] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:22:45.499334 20842 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:45.684337 18644 connection.cc:256] RPC call timeout handler was delayed by -1.1547188360000291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
W20260709 12:22:45.684829 18644 connection.cc:256] RPC call timeout handler was delayed by -1.0647188359998836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
I20260709 12:22:45.685988 18644 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:45.569463 20691 consensus_queue.cc:260] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.694653 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:45.694867 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:45.696049 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:45.696642 18529 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:22:45.689852 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:45.700318 18606 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:45.673403 20368 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.707259 20368 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:45.686990 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:45.689018 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:45.689352 18598 raft_consensus.cc:1240] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:45.685683 20802 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.714318 20802 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:45.690564 18599 raft_consensus.cc:1240] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:45.691125 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:45.691416 18646 connection.cc:256] RPC call timeout handler was delayed by -1.041532718000326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
I20260709 12:22:45.685400 20644 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.692471 18604 raft_consensus.cc:1240] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:45.693038 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:45.693300 20727 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:45.616350 20798 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:45.732550 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:45.712747 20853 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:45.728713 18606 raft_consensus.cc:1240] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:45.710531 18671 raft_consensus.cc:2393] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 4: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:45.739794 18602 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:45.743113 18605 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:45.642246 20850 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:45.748957 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:45.753108 18605 raft_consensus.cc:1275] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:22:45.715140 20826 log.cc:927] Time spent T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 1.050s	user 0.006s	sys 0.010s
I20260709 12:22:45.588971 20840 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:45.757671 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:45.717126 20639 raft_consensus.cc:3055] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:45.765599 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:45.719662 20793 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:45.734560 20808 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:45.766532 18527 raft_consensus.cc:1240] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
W20260709 12:22:45.772384 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 78113.7us
I20260709 12:22:45.720507 20554 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:45.718221 20368 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:45.728039 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:45.717049 20802 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:45.777752 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:45.779062 18603 raft_consensus.cc:2393] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 4: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:45.754890 20741 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:45.779898 20865 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.780441 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:45.780273 20741 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:45.780633 20865 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.781191 18675 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:45.782680 20741 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:45.783032 20865 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:45.784185 20844 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.784833 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1380) took 1864 ms. Trace:
I20260709 12:22:45.784725 20844 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.765240 20853 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:45.785204 18680 rpcz_store.cc:276] 0709 12:22:43.919996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.923220 (+  3224us) service_pool.cc:224] Handling call
0709 12:22:43.965121 (+ 41901us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:44.031694 (+ 66573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:44.031725 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:44.048974 (+ 17249us) log.cc:844] Serialized 52 byte log entry
0709 12:22:44.579275 (+530301us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:44.579323 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.579398 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:45.714439 (+1135041us) spinlock_profiling.cc:243] Waited 7.14 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:22:45.784517 (+ 70078us) raft_consensus.cc:1685] finished
0709 12:22:45.784538 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:45.784771 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82194,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":16817,"spinlock_wait_cycles":16423680,"thread_start_us":376238,"threads_started":2,"wal-append.queue_time_us":581368}
I20260709 12:22:45.786583 20853 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.765450 20842 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:45.777752 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:45.790243 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:45.790835 18671 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:22:45.794446 18675 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:45.799779 18605 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:45.801760 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:45.770984 20639 raft_consensus.cc:740] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:45.803716 18521 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:45.802594 18530 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:45.807996 18680 raft_consensus.cc:1275] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:45.750741 20644 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.783291 20741 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:45.810428 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:45.750797 20798 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:45.795789 20853 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:45.816295 18646 leader_election.cc:400] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 3. Current term is 4.
I20260709 12:22:45.788893 20808 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:45.796782 20818 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:45.794732 20554 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:45.843817 18522 raft_consensus.cc:2468] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:45.843863 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:45.840341 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:45.846951 20852 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.852246 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:45.847371 20811 consensus_queue.cc:1059] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:22:45.862788 20811 raft_consensus.cc:3055] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:45.864709 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:45.867039 18530 raft_consensus.cc:2410] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:22:45.868613 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 93558.5us
I20260709 12:22:45.866360 20811 raft_consensus.cc:740] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:45.869697 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:45.869935 19212 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:45.870820 20874 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:45.871253 20874 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:45.871629 20874 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:45.873680 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:45.874593 18523 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 5.
I20260709 12:22:45.876644 20840 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:45.877935 20644 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:45.879330 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 130450us
I20260709 12:22:45.880395 18644 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:45.879635 19212 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:45.881400 18675 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:45.807469 20864 consensus_queue.cc:1048] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:22:45.885252 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:45.886372 18675 raft_consensus.cc:1275] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:45.886883 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:45.887266 18494 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:45.888187 20840 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:45.888131 20793 consensus_queue.cc:1059] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:45.888679 20840 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.889045 20840 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:45.889074 20793 raft_consensus.cc:3055] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:45.889559 20793 raft_consensus.cc:740] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:45.890228 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:45.890414 20793 consensus_queue.cc:260] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.886410 20802 raft_consensus.cc:2804] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:45.883018 20719 raft_consensus.cc:2804] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:45.891630 20793 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:45.897019 20554 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:45.898108 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:45.890872 18521 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
W20260709 12:22:45.893447 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.899734 18494 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:45.891784 20802 raft_consensus.cc:697] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:45.879102 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:45.842978 20818 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.913414 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:45.885485 20798 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:45.892192 20719 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.917335 20719 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:45.903362 20835 consensus_queue.cc:1048] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:45.903663 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:45.906908 20727 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:45.908198 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:45.908756 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:45.894160 18646 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.993s (SENT) [suppressed 16 similar messages]
I20260709 12:22:45.901881 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:45.902462 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:45.923314 18672 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 5.
I20260709 12:22:45.913990 18644 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:45.894981 20864 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.916414 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:45.892702 20877 log.cc:927] Time spent T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:22:45.921696 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:45.922765 18605 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:22:45.881735 20639 consensus_queue.cc:260] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.909504 20457 raft_consensus.cc:2804] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:45.926113 18675 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 5.
I20260709 12:22:45.927035 20727 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:45.929623 20870 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:45.940611 20727 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:45.940420 20878 consensus_queue.cc:1059] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:45.942001 20850 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:45.926666 20802 consensus_queue.cc:237] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:45.926704 20864 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:45.944582 18600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 1390) took 1694 ms. Trace:
I20260709 12:22:45.928877 20881 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:45.918802 18598 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:45.929270 20842 consensus_queue.cc:1059] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:45.917013 20644 consensus_queue.cc:1059] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:22:45.945010 18600 rpcz_store.cc:276] 0709 12:22:44.250378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.292215 (+ 41837us) service_pool.cc:224] Handling call
0709 12:22:44.292614 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:44.836972 (+544358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.944309 (+1107337us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b5400223dd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:45.944513 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1008676736}
I20260709 12:22:45.949465 18644 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:45.954450 20852 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:45.948836 20864 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:45.959228 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:22:45.968904 19210 connection.cc:256] RPC call timeout handler was delayed by -1.2004503729999669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
W20260709 12:22:45.973655 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.947698 20881 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:45.997052 20881 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:45.997439 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 48062us
I20260709 12:22:45.997964 20840 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:46.000862 20741 raft_consensus.cc:2764] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:22:46.000959 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:46.001801 19243 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:46.002923 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:46.003849 18600 raft_consensus.cc:2393] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 6: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:46.005151 20801 consensus_queue.cc:1048] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:46.012300 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:46.013394 18673 raft_consensus.cc:2393] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 4: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:46.019512 20662 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.021199 20662 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:46.026924 20662 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:46.022356 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:46.029124 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:46.030629 18600 raft_consensus.cc:1240] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:45.955971 20870 consensus_queue.cc:1059] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:22:46.042253 20840 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:46.037477 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:45.951516 20457 raft_consensus.cc:697] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:46.076836 20838 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:46.092921 20838 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.079528 20662 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.104032 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:46.104909 18675 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
W20260709 12:22:46.108045 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 213895us
I20260709 12:22:46.113919 20852 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.114606 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:46.093350 20870 consensus_queue.cc:1243] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:46.096913 20838 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:46.100678 20879 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.127871 19243 raft_consensus.cc:1275] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:46.100751 20662 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:46.133888 20882 log.cc:927] Time spent T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:22:46.116598 20852 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:46.148936 20662 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:46.150249 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:46.151019 18528 raft_consensus.cc:2368] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:22:46.151185 20881 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:46.153317 20808 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:46.161017 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:46.162365 18521 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:22:46.120500 20457 consensus_queue.cc:237] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:46.172580 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:46.178102 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:46.137766 20879 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:46.185320 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:46.186106 18521 raft_consensus.cc:2368] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:22:46.179646 20497 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.188659 20497 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:46.189532 20852 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:46.190877 20497 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:46.191740 20874 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:46.193934 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:46.195510 20874 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:46.196064 20879 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:46.196519 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:46.196642 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:46.197186 19243 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:46.200055 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:46.201201 20719 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:46.201937 19210 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:46.202281 19239 raft_consensus.cc:1240] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:46.204290 20887 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:46.204757 20887 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:46.203459 20719 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:46.200050 20727 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.208474 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:46.212739 19210 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:46.205156 20887 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:46.209712 20881 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:46.210086 20814 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:22:46.210875 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:46.210650 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:46.221542 18570 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:46.213238 19246 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:46.211603 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:46.215075 18527 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4.
I20260709 12:22:46.176929 20808 consensus_queue.cc:1048] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:22:46.216351 19210 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:46.233448 18494 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:46.235519 20497 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:46.236182 20497 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.236605 20497 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:46.237458 18494 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:46.243286 20704 consensus_queue.cc:1048] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:46.245903 20704 consensus_queue.cc:1048] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:46.248075 20820 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:46.248317 18570 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:46.250065 20691 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:46.250435 20820 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:46.251003 20820 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.251446 20820 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.252396 19210 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:46.255191 20818 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:46.256832 20801 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:46.257695 20801 raft_consensus.cc:697] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:46.258157 18494 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:46.259341 18494 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:46.259999 20683 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:46.260319 20835 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:46.261178 20835 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:46.261760 20835 raft_consensus.cc:697] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:46.260695 19210 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:46.262710 20835 consensus_queue.cc:237] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:46.264199 18494 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:46.265743 20840 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:46.266119 20840 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:46.266466 20840 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.214483 20727 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:46.270387 20696 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.270936 20696 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:46.271375 20727 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:46.251502 18570 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:46.283350 20696 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:46.277472 19247 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:46.282804 20497 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:46.279356 20561 consensus_queue.cc:1048] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:22:46.209559 20883 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
W20260709 12:22:46.290040 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:46.296520 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 45130.7us
I20260709 12:22:46.297066 20840 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:46.297492 18570 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:46.299371 20840 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:46.258949 20801 consensus_queue.cc:237] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:46.234504 20879 raft_consensus.cc:2804] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:46.309959 20696 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:46.312168 18570 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:46.319605 20696 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:46.320374 20696 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.320784 20696 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:46.329474 20881 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:46.330320 20881 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:46.331535 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1414) took 1535 ms. Trace:
I20260709 12:22:46.330667 18570 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:46.332461 18674 rpcz_store.cc:276] 0709 12:22:44.796062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.796212 (+   150us) service_pool.cc:224] Handling call
0709 12:22:44.831239 (+ 35027us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:44.831694 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:44.831734 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:44.858278 (+ 26544us) log.cc:844] Serialized 26 byte log entry
0709 12:22:45.355811 (+497533us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:45.389025 (+ 33214us) log.cc:844] Serialized 14 byte log entry
0709 12:22:45.389235 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.389309 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:46.328993 (+939684us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b180033fa00. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793f23f3 00007efc793f47c1 00007efc793f4779 00007efc793f4709 00007efc793f46d1 00007efc793f39cd 0000000000388634 0000000000388479 00007efc793d583a
0709 12:22:46.331238 (+  2245us) raft_consensus.cc:1685] finished
0709 12:22:46.331329 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:46.331470 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14811,"prepare.queue_time_us":35229,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":52054,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":11554,"spinlock_wait_cycles":2984704,"thread_start_us":384971,"threads_started":1,"wal-append.queue_time_us":575356}
I20260709 12:22:46.333706 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:46.335484 20881 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:46.336983 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:46.343832 20840 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:46.346647 20837 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:46.347132 20840 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:46.349102 20844 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:46.349331 20884 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:46.349776 20884 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:46.350273 20884 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:46.355640 18572 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:46.357175 20793 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:46.357452 20771 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:46.312340 20888 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:46.357767 20793 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:46.358107 20811 consensus_queue.cc:260] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:46.360167 20844 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:46.340085 20879 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:46.362145 20798 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:46.362358 18676 raft_consensus.cc:3055] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:46.363377 18676 raft_consensus.cc:740] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:46.362751 20798 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:46.362201 20844 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.364209 20844 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:46.339178 20818 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:46.365195 20798 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:46.364228 18676 consensus_queue.cc:260] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:46.367024 20752 consensus_queue.cc:1048] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:22:46.360492 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.374984 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:46.367700 20362 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:46.370054 18644 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:46.377516 18521 raft_consensus.cc:1240] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:46.378444 20881 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:46.378487 20814 consensus_queue.cc:1059] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:46.362462 20879 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:46.379132 20881 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.379998 20881 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.373803 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:46.386157 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:46.386282 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:46.386898 18675 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:46.387509 20811 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:46.388135 18676 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:46.390612 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:46.397538 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:22:46.398241 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.398366 19246 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:46.387162 18672 raft_consensus.cc:2393] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 5: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:46.398373 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:46.402668 20878 raft_consensus.cc:3055] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:46.403151 20878 raft_consensus.cc:740] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:46.349224 20840 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:46.410652 19246 raft_consensus.cc:1275] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:46.412294 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:46.410699 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:46.412216 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:46.416244 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:46.418133 18527 raft_consensus.cc:1240] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:46.419535 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:46.420881 19246 raft_consensus.cc:1275] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:22:46.423166 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 46086us
I20260709 12:22:46.316205 20886 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:46.425760 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:46.427659 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:46.429412 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 168778us
I20260709 12:22:46.429935 18602 raft_consensus.cc:1275] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:46.421989 18646 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:46.437116 18602 raft_consensus.cc:1275] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:46.438256 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:46.438814 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:46.438990 19210 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:46.439560 19246 raft_consensus.cc:2393] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 6: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:22:46.440654 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:46.443162 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:46.442221 18570 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:46.449461 18570 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:46.449728 18646 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:46.459574 18570 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:46.461184 18644 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:46.462836 20852 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:46.461184 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:46.464740 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:46.427063 20803 raft_consensus.cc:3055] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:46.467537 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:46.470394 18646 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:46.471539 18644 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:46.483879 18646 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:46.484414 18644 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:46.485737 18644 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:46.456378 18600 raft_consensus.cc:2368] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:22:46.453862 20888 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:46.490685 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:46.489732 18572 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:46.448638 18598 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:46.497895 19246 raft_consensus.cc:1275] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:46.466486 20814 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:46.469195 20771 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:46.408538 20878 consensus_queue.cc:260] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:46.520658 18572 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:46.491151 20802 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:46.485607 20849 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:46.518851 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:46.478260 20803 raft_consensus.cc:740] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:46.491993 20837 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:46.505244 20814 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:46.529039 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.495710 20870 raft_consensus.cc:2804] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:46.530778 18572 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:46.527407 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:46.496158 20852 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:46.529152 20691 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:46.532599 20457 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:46.538901 20844 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:46.480258 20820 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:46.523869 20771 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.504555 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:46.569693 18676 raft_consensus.cc:1275] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:46.572090 18522 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:46.585570 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:46.548714 19244 raft_consensus.cc:1275] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:46.533814 20849 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.537305 20815 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:46.580351 18521 raft_consensus.cc:1240] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:46.639866 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:22:46.588917 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 58209.1us
I20260709 12:22:46.579195 20814 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:46.639885 18606 raft_consensus.cc:2393] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 6: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:46.582484 20852 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.540699 20837 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:46.571137 20870 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:46.571580 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:46.652220 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:22:46.652451 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 168667us
I20260709 12:22:46.677739 18646 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:46.679409 18646 leader_election.cc:400] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:22:46.530319 20841 consensus_queue.cc:1059] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:22:46.539970 20840 consensus_queue.cc:1048] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:22:46.680249 18646 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:46.680750 20841 raft_consensus.cc:3055] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:46.681267 20841 raft_consensus.cc:740] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:46.682281 20841 consensus_queue.cc:260] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:46.661811 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:46.592836 20878 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:46.684909 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:46.686259 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:46.665822 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:46.666702 18572 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:46.640385 20644 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:22:46.595170 20691 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:46.589490 20793 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:46.673940 18522 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 6.
I20260709 12:22:46.595634 20771 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:46.590715 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:46.694409 18672 raft_consensus.cc:2393] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 4: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:46.586822 20612 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:46.569530 20798 consensus_queue.cc:1048] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:22:46.654438 20849 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.545495 20561 consensus_queue.cc:1048] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.124s
I20260709 12:22:46.705035 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:46.738480 18529 raft_consensus.cc:2393] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 5: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:46.708384 18524 raft_consensus.cc:1240] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:46.664593 20852 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:46.668020 20837 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:46.674942 20870 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:46.586608 20457 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:46.722919 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:46.692127 20497 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:46.705581 20815 raft_consensus.cc:2749] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:46.662179 20879 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:46.745803 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 65632.6us
I20260709 12:22:46.748191 18646 leader_election.cc:400] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:22:46.748489 18646 leader_election.cc:403] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:22:46.739356 20838 consensus_meta.cc:287] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.611s	user 0.010s	sys 0.003s
I20260709 12:22:46.701004 20727 consensus_queue.cc:1048] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:22:46.724273 20841 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:46.770529 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:46.667778 20803 consensus_queue.cc:260] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:46.780272 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:46.745252 20741 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:46.735262 20612 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:46.745700 20900 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:46.806358 19240 raft_consensus.cc:1240] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:46.835271 18644 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:46.772545 20838 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:46.806553 20704 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:46.815876 20818 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.854839 20639 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:46.869871 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 121799us
I20260709 12:22:46.829876 20803 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:46.855125 20893 log.cc:927] Time spent T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:22:46.881011 18646 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:46.876363 20887 consensus_meta.cc:287] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.660s	user 0.012s	sys 0.000s
I20260709 12:22:46.842664 20907 raft_consensus.cc:2804] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:46.851922 20802 raft_consensus.cc:2749] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:46.890290 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:46.875530 20798 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:46.892439 20901 log.cc:927] Time spent T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.132s	user 0.001s	sys 0.001s
W20260709 12:22:46.908484 20897 log.cc:927] Time spent T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:22:46.908735 20612 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:22:46.909956 20890 log.cc:927] Time spent T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:22:46.895982 20913 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:46.910262 18597 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:22:46.884019 20820 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:46.917574 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 104283us
I20260709 12:22:46.877804 20818 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:46.883481 20908 consensus_queue.cc:1059] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:22:46.885855 20844 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:46.921178 18494 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:46.966331 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 45310.7us
I20260709 12:22:46.967852 18494 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:46.928364 20906 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:46.882750 20887 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:46.974093 18494 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:46.975358 18494 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:46.972837 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 91911us
I20260709 12:22:46.978632 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:46.979108 18646 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:46.880515 20704 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:46.811297 18598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15e3196fc974445e967d05514226ac45"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
W20260709 12:22:46.962478 20683 consensus_meta.cc:287] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.702s	user 0.009s	sys 0.004s
I20260709 12:22:46.982371 20591 raft_consensus.cc:2749] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:46.982828 20917 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.983564 20818 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:46.984081 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:46.981940 18597 raft_consensus.cc:1240] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:22:46.915488 20798 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:46.998533 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:46.979862 20881 consensus_meta.cc:287] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.599s	user 0.005s	sys 0.007s
I20260709 12:22:47.001646 18527 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:47.000684 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:46.971930 20912 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:47.025451 18529 raft_consensus.cc:2410] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:46.995079 20801 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:46.991616 20840 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:46.996202 20683 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:47.042693 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.998961 20922 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:47.005841 20844 raft_consensus.cc:3055] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:47.008792 20879 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:47.037422 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 59252.1us
W20260709 12:22:47.051614 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 72619us
I20260709 12:22:47.028220 20907 raft_consensus.cc:697] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:46.998528 18598 raft_consensus.cc:606] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:47.055716 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:47.037927 19241 raft_consensus.cc:1240] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:47.053184 20457 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:47.022581 20881 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.080672 20838 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:47.067322 20910 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:47.085965 18527 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:47.054086 20906 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:47.064137 20915 raft_consensus.cc:2804] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:47.087073 20915 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:47.086956 20906 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.087951 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:22:47.088575 20894 log.cc:927] Time spent T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.253s	user 0.001s	sys 0.001s
W20260709 12:22:47.089787 20696 consensus_meta.cc:287] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.768s	user 0.010s	sys 0.003s
W20260709 12:22:47.090464 20891 log.cc:927] Time spent T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
I20260709 12:22:47.090233 20696 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.082314 20925 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:47.092968 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1433) took 1276 ms. Trace:
I20260709 12:22:47.092422 20925 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.087574 20915 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:47.082609 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:47.097739 18675 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:22:47.052593 20844 raft_consensus.cc:740] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:47.007493 20917 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:47.069574 20905 log.cc:927] Time spent T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 12:22:47.103956 18673 raft_consensus.cc:2368] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7.
I20260709 12:22:47.092486 18605 raft_consensus.cc:1240] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:22:47.095769 18572 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:47.039319 20912 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.093324 18680 rpcz_store.cc:276] 0709 12:22:45.816742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:45.817098 (+   356us) service_pool.cc:224] Handling call
0709 12:22:45.817516 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:45.817965 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:45.818007 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:45.826627 (+  8620us) log.cc:844] Serialized 26 byte log entry
0709 12:22:46.218501 (+391874us) spinlock_profiling.cc:243] Waited 6.1 ms on lock 0x7b180018fdc0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793d4e07 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793f1c02 00007efc7c07920b 00007efc7c07ed23 00007efc7c07f0d1 00007efc7c49aa0f
0709 12:22:46.423310 (+204809us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:46.688631 (+265321us) log.cc:844] Serialized 14 byte log entry
0709 12:22:46.743217 (+ 54586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:46.743297 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:47.092662 (+349365us) raft_consensus.cc:1685] finished
0709 12:22:47.092766 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:47.092906 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":380551,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":148300,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":28750,"spinlock_wait_cycles":53537920,"thread_start_us":498604,"threads_started":3,"wal-append.queue_time_us":750009}
I20260709 12:22:47.105994 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:47.064363 20820 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.081385 20798 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:47.109506 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:47.111181 20911 log.cc:927] Time spent T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:22:47.112035 20919 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:47.112592 20919 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.113300 20881 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:47.114329 20881 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:47.114799 20881 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.115123 20919 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:47.115727 20902 log.cc:927] Time spent T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
W20260709 12:22:47.116820 20884 consensus_meta.cc:287] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.766s	user 0.008s	sys 0.004s
I20260709 12:22:47.117326 20929 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:47.117584 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:47.119943 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:47.120498 18606 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:47.120404 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:47.128719 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:47.131441 18671 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:47.131943 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:47.108001 20838 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:47.138401 18646 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:47.138717 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:47.140945 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:47.141570 20920 log.cc:927] Time spent T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:22:47.142310 20913 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:22:47.117209 20884 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:47.151582 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:47.153103 18527 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:47.153678 18646 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:47.132201 20910 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.129817 20906 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:47.118391 20820 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.133646 20919 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:47.163259 18606 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:22:47.194474 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:47.194983 18644 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:47.149348 20838 raft_consensus.cc:697] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:47.167104 20639 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.188622 20878 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:47.138419 20771 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:47.125718 20929 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.170786 20696 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:47.212745 20923 log.cc:927] Time spent T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:22:47.202677 20913 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:47.215720 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:47.217159 18527 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:22:47.214838 18680 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 1.
I20260709 12:22:47.160619 20852 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:47.161500 20837 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.242817 20913 raft_consensus.cc:697] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:47.197548 20919 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.137856 20907 consensus_queue.cc:237] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.244951 20929 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:47.265650 20837 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:47.245519 20912 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:47.208642 20838 consensus_queue.cc:237] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.255317 18603 raft_consensus.cc:2393] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 6: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:47.152432 20844 consensus_queue.cc:260] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.193143 20910 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.265022 20931 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:47.269225 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:47.274168 18675 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:22:47.267369 20913 consensus_queue.cc:237] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.271369 20919 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:47.271973 20798 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:47.269552 20814 consensus_meta.cc:287] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.602s	user 0.008s	sys 0.004s
W20260709 12:22:47.276789 20930 log.cc:927] Time spent T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:22:47.276964 20917 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:47.266260 19244 raft_consensus.cc:1240] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:47.215149 20639 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.277990 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:47.283237 20798 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.278374 20771 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:22:47.281507 20849 consensus_meta.cc:287] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.000s
I20260709 12:22:47.285883 20844 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:44.977741 18411 catalog_manager.cc:5028] TS c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): tablet 30ca83d13be54a41b9c5aaebfc89de05 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:22:47.286397 20919 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.282413 20814 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.289139 20639 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:47.290848 20820 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:47.292194 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:47.272522 20884 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:47.286110 18424 catalog_manager.cc:5697] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:47.298161 18411 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 2.39151e+06us
I20260709 12:22:47.300823 18676 raft_consensus.cc:2393] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 8: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:47.301138 20727 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:47.298231 20919 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.304004 20727 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.306293 20919 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:47.306375 20727 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:47.311165 20914 log.cc:927] Time spent T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.337s	user 0.003s	sys 0.000s
I20260709 12:22:47.311565 20798 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:47.308068 20870 consensus_meta.cc:287] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.004s
I20260709 12:22:47.296702 20852 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:47.296628 20849 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:47.325230 20919 consensus_queue.cc:1059] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:47.326615 20919 raft_consensus.cc:3055] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:47.327070 20919 raft_consensus.cc:740] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:22:47.332901 20841 consensus_meta.cc:287] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.535s	user 0.008s	sys 0.004s
I20260709 12:22:47.335071 20919 consensus_queue.cc:260] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:47.345088 20919 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:47.346215 20907 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.346794 20907 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.321072 20870 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:47.354405 18673 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:47.365090 18679 raft_consensus.cc:2393] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 6: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
W20260709 12:22:47.375243 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:47.375465 20933 log.cc:927] Time spent T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:22:47.378003 20870 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:47.381343 18675 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 5.
I20260709 12:22:47.391901 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:47.400530 18494 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:47.398505 20913 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:47.388453 20907 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:47.393297 20814 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:47.398825 20727 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:47.414788 20727 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.417181 20727 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:47.401563 20803 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:47.407096 20922 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:47.410537 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:47.407032 20913 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.424317 18673 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:47.425698 20913 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:47.426815 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:47.429872 20915 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:47.432106 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:47.434199 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:22:47.438390 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.424074 20803 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.445556 20639 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:47.406551 20870 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:47.461298 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:47.475142 20639 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.445559 20840 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.475952 18673 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:22:47.475832 20870 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.476239 20840 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.476926 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:47.478071 20639 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:47.478261 18673 raft_consensus.cc:2393] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 5: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:47.461831 20886 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:47.445972 20922 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:47.484495 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 52494.2us
I20260709 12:22:47.486006 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:47.478427 20870 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:47.489269 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:47.489652 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:47.490559 18601 raft_consensus.cc:2368] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 5. Current term is 6.
I20260709 12:22:47.493937 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:47.497053 18673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1457) took 1029 ms. Trace:
I20260709 12:22:47.497581 18673 rpcz_store.cc:276] 0709 12:22:46.467246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.496271 (+1029025us) service_pool.cc:224] Handling call
0709 12:22:47.496577 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.496752 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:47.496774 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:47.496810 (+    36us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:47.496842 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.496893 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:47.496999 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:47.500424 20849 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:47.506671 18673 raft_consensus.cc:1240] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:47.508138 18673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1458) took 1040 ms. Trace:
I20260709 12:22:47.480679 20922 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.508737 18673 rpcz_store.cc:276] 0709 12:22:46.467547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.499194 (+1031647us) service_pool.cc:224] Handling call
0709 12:22:47.499562 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.507797 (+  8235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.508064 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:47.510990 18673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1459) took 1043 ms. Trace:
I20260709 12:22:47.508862 19210 leader_election.cc:400] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 5. Current term is 6.
I20260709 12:22:47.513741 19210 leader_election.cc:403] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:22:47.512899 18673 rpcz_store.cc:276] 0709 12:22:46.467876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.509965 (+1042089us) service_pool.cc:224] Handling call
0709 12:22:47.510337 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.510558 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:47.510604 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:47.510669 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:47.510728 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.510813 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:47.510929 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:47.515091 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:22:47.517298 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.518226 18673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 164) took 1034 ms. Trace:
I20260709 12:22:47.520725 18673 rpcz_store.cc:276] 0709 12:22:46.483647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.516057 (+1032410us) service_pool.cc:224] Handling call
0709 12:22:47.516511 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.516788 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:47.516843 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:47.516908 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:47.516955 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.517036 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:47.517982 (+   946us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:47.492431 20913 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:47.491405 20907 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:47.527901 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:47.502852 20639 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:47.496671 20841 consensus_queue.cc:1048] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:22:47.536532 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:47.513262 20919 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:47.542755 20919 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:47.543280 20936 log.cc:927] Time spent T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:22:47.526798 20884 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:47.513013 20820 consensus_queue.cc:1048] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:22:47.547106 20926 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:47.547791 20926 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.548184 18529 raft_consensus.cc:1240] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:47.529827 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:47.521606 20922 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:47.560415 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:47.533321 20840 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:47.551353 20561 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:47.572093 20561 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.535228 20907 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.588907 20919 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:47.589967 20907 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:47.590927 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:47.591347 20803 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:47.591969 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:47.595903 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:47.596315 18600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40948 (request call id 1382) took 1385 ms. Trace:
I20260709 12:22:47.596750 18600 rpcz_store.cc:276] 0709 12:22:46.210861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.211340 (+   479us) service_pool.cc:224] Handling call
0709 12:22:47.596127 (+1384787us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54002f5154. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:47.596256 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311593344}
I20260709 12:22:47.597636 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:47.598145 20884 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 5. Current term is 6.
I20260709 12:22:47.598345 18530 raft_consensus.cc:1240] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:47.538164 20913 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.536128 20639 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.585757 18677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1450) took 1200 ms. Trace:
I20260709 12:22:47.586210 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:47.602947 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:47.608088 18644 leader_election.cc:400] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
W20260709 12:22:47.609015 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.567032 20910 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:47.582633 20704 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:47.612890 18677 rpcz_store.cc:276] 0709 12:22:46.384968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.387018 (+  2050us) service_pool.cc:224] Handling call
0709 12:22:46.387299 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:46.387491 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:46.594180 (+206689us) log.cc:844] Serialized 14 byte log entry
0709 12:22:47.585258 (+991078us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b18003b0b00. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc7c0874bc 00007efc793d548b 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793ef455 00007efc7c4d7060 00007efc7c4e9716 00007efc7c4fa287
0709 12:22:47.585352 (+    94us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:47.585399 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:47.585447 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.585581 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:47.585697 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27068,"prepare.queue_time_us":347747,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":174595,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":12373,"spinlock_wait_cycles":6243072,"thread_start_us":484631,"threads_started":3,"wal-append.queue_time_us":200850}
I20260709 12:22:47.619966 20913 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:22:47.619835 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:47.634676 18527 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:47.620589 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:47.633157 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:47.639385 18675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1406) took 1193 ms. Trace:
I20260709 12:22:47.642479 18672 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:47.642414 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:47.643473 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:47.643656 18679 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:47.644490 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:47.603984 20842 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:47.644611 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:47.644580 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:47.681339 20894 log.cc:927] Time spent T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:22:47.681634 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40800 (request call id 1398) took 1267 ms. Trace:
I20260709 12:22:47.681818 18674 raft_consensus.cc:1240] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:22:47.682031 18676 rpcz_store.cc:276] 0709 12:22:46.413918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.685961 (+272043us) service_pool.cc:224] Handling call
0709 12:22:47.681428 (+995467us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b5400290ed4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:47.681574 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1408286080}
I20260709 12:22:47.682541 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:47.683317 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1456) took 1296 ms. Trace:
I20260709 12:22:47.683651 18674 rpcz_store.cc:276] 0709 12:22:46.386649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.315044 (+928395us) service_pool.cc:224] Handling call
0709 12:22:47.681558 (+366514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:47.682414 (+   856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.683167 (+   753us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b5400290ed0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:47.683267 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":830785920}
I20260709 12:22:47.684899 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:47.685408 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1462) took 1190 ms. Trace:
I20260709 12:22:47.685501 18606 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:47.611449 20591 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:47.685824 18674 rpcz_store.cc:276] 0709 12:22:46.495207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.684665 (+1189458us) service_pool.cc:224] Handling call
0709 12:22:47.684946 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.685120 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:47.685148 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:47.685186 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:47.685219 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.685271 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:47.685361 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:47.665105 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:47.690526 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1460) took 1204 ms. Trace:
I20260709 12:22:47.686386 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:47.660264 18603 raft_consensus.cc:1240] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:47.677083 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:47.694454 18678 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:47.658641 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:47.639916 18675 rpcz_store.cc:276] 0709 12:22:46.446345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.382098 (+935753us) service_pool.cc:224] Handling call
0709 12:22:47.386730 (+  4632us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:47.395254 (+  8524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:47.395276 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:47.399932 (+  4656us) log.cc:844] Serialized 26 byte log entry
0709 12:22:47.527709 (+127777us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:47.527784 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.527887 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:47.639096 (+111209us) raft_consensus.cc:1685] finished
0709 12:22:47.639124 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:47.639311 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2801,"raft.queue_time_us":1123,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":9266,"thread_start_us":83707,"threads_started":1,"wal-append.queue_time_us":212705}
I20260709 12:22:47.695293 18494 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:47.691632 18676 rpcz_store.cc:276] 0709 12:22:46.485771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.683148 (+1197377us) service_pool.cc:224] Handling call
0709 12:22:47.683414 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.683585 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:47.683610 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:47.683653 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:47.683686 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.683736 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:47.690471 (+  6735us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:47.696815 18676 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:47.697479 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1409) took 1107 ms. Trace:
I20260709 12:22:47.697821 18676 rpcz_store.cc:276] 0709 12:22:46.590335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.696209 (+1105874us) service_pool.cc:224] Handling call
0709 12:22:47.696517 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.697258 (+   741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.697417 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:47.699368 18602 raft_consensus.cc:2393] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 5: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:47.699596 18494 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:47.701565 18676 raft_consensus.cc:1240] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:47.701622 18494 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:47.702216 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1410) took 1051 ms. Trace:
I20260709 12:22:47.702544 18676 rpcz_store.cc:276] 0709 12:22:46.651073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.701201 (+1050128us) service_pool.cc:224] Handling call
0709 12:22:47.701415 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.701953 (+   538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.702132 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:47.665318 20752 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.683920 20639 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:47.703704 19212 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:47.704133 18679 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:47.680413 19241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33388 (request call id 334) took 1467 ms. Trace:
I20260709 12:22:47.662045 18597 raft_consensus.cc:1275] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:47.660060 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:47.638098 20910 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:47.675817 20881 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:47.664433 18598 raft_consensus.cc:1240] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:22:47.679664 20887 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:47.624900 20798 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:47.660072 20926 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:47.721410 20752 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.817142 20798 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.669740 20915 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:47.724408 19212 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:47.700424 20793 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:47.715466 20840 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:47.723634 20801 consensus_queue.cc:1059] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:22:47.816351 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:47.818791 18601 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:47.807294 18605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 1411) took 1374 ms. Trace:
I20260709 12:22:47.720410 18675 raft_consensus.cc:1240] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:47.989202 18675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1408) took 1441 ms. Trace:
I20260709 12:22:47.989676 18675 rpcz_store.cc:276] 0709 12:22:46.547566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.695483 (+1147917us) service_pool.cc:224] Handling call
0709 12:22:47.720162 (+ 24679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.988862 (+268700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.989130 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:47.814270 18679 raft_consensus.cc:1275] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:47.720549 18494 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:47.722322 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1463) took 1195 ms. Trace:
I20260709 12:22:47.991658 18674 rpcz_store.cc:276] 0709 12:22:46.527199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.693487 (+1166288us) service_pool.cc:224] Handling call
0709 12:22:47.721652 (+ 28165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.721899 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:47.721939 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:47.721998 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:47.722048 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.722121 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:47.722246 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:47.812104 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:47.864274 18604 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:22:47.790900 18678 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:47.718112 20835 raft_consensus.cc:2764] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
W20260709 12:22:47.983246 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.813290 20779 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:47.987720 18605 rpcz_store.cc:276] 0709 12:22:46.433246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.433385 (+   139us) service_pool.cc:224] Handling call
0709 12:22:46.433693 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:47.104522 (+670829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.806968 (+702446us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b5400070dd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:47.807220 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1514419584}
I20260709 12:22:47.862227 20809 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.993280 18603 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:47.815483 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.048296 20802 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:47.986732 20881 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.937584 20926 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:48.019582 20741 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:48.140668 20798 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:48.020918 20864 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:48.139530 20881 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:47.936676 20949 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:22:48.166721 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.871876 20910 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.048306 20913 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:47.721271 19241 rpcz_store.cc:276] 0709 12:22:46.212588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.213815 (+  1227us) service_pool.cc:224] Handling call
0709 12:22:46.288164 (+ 74349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.073282 (+785118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.680142 (+606860us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b54004d8854. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:47.680347 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1651019008}
I20260709 12:22:48.085157 20801 raft_consensus.cc:3055] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:48.171949 20926 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.101182 20835 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:48.056774 20919 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:48.161175 18597 raft_consensus.cc:2393] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 6: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:48.256217 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:48.226439 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.721087 20591 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:47.717204 20948 consensus_queue.cc:1048] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.434s
W20260709 12:22:48.246035 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 521659us
I20260709 12:22:48.252733 18676 raft_consensus.cc:1240] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:22:48.085599 20809 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.246093 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.171808 20864 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.260214 18604 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:48.261576 18675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1418) took 1261 ms. Trace:
I20260709 12:22:48.217350 20798 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.266121 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1412) took 1543 ms. Trace:
I20260709 12:22:48.231817 20683 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:48.236255 20801 raft_consensus.cc:740] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:48.146301 20802 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.231613 20457 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:48.307158 20591 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:48.277258 18675 rpcz_store.cc:276] 0709 12:22:47.000473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.097109 (+1096636us) service_pool.cc:224] Handling call
0709 12:22:48.261060 (+163951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:48.261240 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:48.261267 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:48.261308 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:48.261339 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.261405 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:48.261523 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:48.304930 18676 rpcz_store.cc:276] 0709 12:22:46.722570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.703238 (+980668us) service_pool.cc:224] Handling call
0709 12:22:48.252376 (+549138us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:48.265833 (+ 13457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.266058 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:48.186407 20741 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:48.323802 20683 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.263801 20915 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.307569 20926 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:48.236995 20913 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:48.263973 20887 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:48.263556 20907 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:48.349970 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:48.304116 20639 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:48.359426 20741 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:48.272975 20949 raft_consensus.cc:697] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:48.271633 20888 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:48.376886 20887 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:48.267328 20919 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:48.383528 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:48.384841 18675 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:48.387609 20752 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:48.380776 20639 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:48.397874 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 677370us
I20260709 12:22:48.399631 18494 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:48.313417 20798 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.384316 20926 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.350987 20457 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.395658 20801 consensus_queue.cc:260] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.422313 20801 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:48.422459 20798 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:48.381632 20907 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:48.424762 18677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1461) took 1933 ms. Trace:
I20260709 12:22:48.425801 20907 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:48.425153 18677 rpcz_store.cc:276] 0709 12:22:46.491656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.683450 (+1191794us) service_pool.cc:224] Handling call
0709 12:22:47.683724 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:47.697174 (+ 13450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:47.697202 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:47.697631 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 12:22:48.236296 (+538665us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:48.236358 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.236460 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:48.424549 (+188089us) raft_consensus.cc:1685] finished
0709 12:22:48.424570 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:48.424704 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4014,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":582,"thread_start_us":421944,"threads_started":1,"wal-append.queue_time_us":661537}
I20260709 12:22:48.427084 18677 raft_consensus.cc:1240] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:48.373848 20915 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.454348 20915 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:48.403717 19247 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.030s	sys 0.021s
I20260709 12:22:48.439818 20639 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:48.440986 20949 consensus_queue.cc:237] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:48.490365 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.490921 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.490979 20887 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:48.444651 20913 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:48.447116 18673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 165) took 1963 ms. Trace:
I20260709 12:22:48.492636 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.414705 20948 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:48.493619 20948 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.450071 20864 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:48.428452 20926 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:48.386626 20888 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:48.412639 20881 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:48.499253 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.500687 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.501374 20926 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:48.501952 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.401057 18494 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:48.503412 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 102448us
I20260709 12:22:48.504495 20779 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:48.470844 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.506125 18604 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:48.506893 20952 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:48.471879 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.507589 20952 consensus_queue.cc:1059] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:48.508183 18605 raft_consensus.cc:2410] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:48.508440 20952 consensus_queue.cc:1048] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:48.509214 19240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33372 (request call id 193) took 3124 ms. Trace:
I20260709 12:22:48.509784 20952 raft_consensus.cc:3055] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:48.482651 20919 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:48.488442 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:48.492013 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.448688 20683 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:48.492503 18673 rpcz_store.cc:276] 0709 12:22:46.484084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.528861 (+1044777us) service_pool.cc:224] Handling call
0709 12:22:47.529112 (+   251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:47.529427 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:47.529450 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:47.535128 (+  5678us) log.cc:844] Serialized 26 byte log entry
0709 12:22:47.804488 (+269360us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:47.804555 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.804665 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:48.446867 (+642202us) raft_consensus.cc:1685] finished
0709 12:22:48.446887 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:48.447049 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":5227,"thread_start_us":233433,"threads_started":1,"wal-append.queue_time_us":857296}
I20260709 12:22:48.493377 18603 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:48.461515 20802 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:48.484252 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.505431 18494 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:48.511567 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.510154 20952 raft_consensus.cc:740] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:48.519682 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.491596 18598 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:48.487973 20457 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:48.521850 18494 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:48.522477 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.509609 19240 rpcz_store.cc:276] 0709 12:22:45.384915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:45.389210 (+  4295us) service_pool.cc:224] Handling call
0709 12:22:46.333699 (+944489us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b5800003c98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:46.333909 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:46.853669 (+519760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.495899 (+1642230us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b54002747d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:48.509125 (+ 13226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1021623936}
I20260709 12:22:48.497836 20948 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:48.528026 18605 raft_consensus.cc:2393] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 7: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
W20260709 12:22:48.488219 19247 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.031s	sys 0.021s
W20260709 12:22:48.528272 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 262928us
I20260709 12:22:48.529385 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.523481 20683 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:48.543010 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.543715 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.544562 18675 raft_consensus.cc:1275] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:48.545714 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.529461 20926 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:48.563915 18601 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:48.544560 18600 raft_consensus.cc:2393] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 7: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:48.563660 18424 catalog_manager.cc:5697] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 4 to 5, leader changed from 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 5 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:48.552634 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:48.554183 19212 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:48.583492 20887 raft_consensus.cc:2804] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:48.571982 18494 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:48.578306 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.531015 20591 consensus_queue.cc:1059] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:22:48.597062 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:48.600230 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:48.601562 18599 raft_consensus.cc:1275] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:48.602870 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:48.603495 18675 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:48.604476 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:48.605504 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:48.606045 18675 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:48.606808 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:48.531172 20957 consensus_queue.cc:1059] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:22:48.530316 20952 consensus_queue.cc:260] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.578338 20926 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.618235 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.619382 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:48.612902 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 363314us
I20260709 12:22:48.624094 18675 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:48.626119 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.599483 20683 raft_consensus.cc:697] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:48.631896 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:48.632879 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.613241 20835 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:48.619767 18598 raft_consensus.cc:2393] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 5: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:48.634683 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1627) took 2158 ms. Trace:
I20260709 12:22:48.636409 18526 rpcz_store.cc:276] 0709 12:22:46.468502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.468658 (+   156us) service_pool.cc:224] Handling call
0709 12:22:46.469048 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:46.488371 (+ 19323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:46.488411 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:46.519926 (+ 31515us) log.cc:844] Serialized 26 byte log entry
0709 12:22:46.738980 (+219054us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:46.739056 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:46.739138 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:48.547417 (+1808279us) spinlock_profiling.cc:243] Waited 44.4 ms on lock 0x7b240011a8d8. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc792789c4 00007efc79276acb 00007efc79431dc9 00007efc79431a55 00007efc79430fb0 00007efc7c0a7488 00007efc7c0a7be8 00007efc7c07f398 00007efc7c07a76a 00007efc7c079bb6
0709 12:22:48.616677 (+ 69260us) raft_consensus.cc:1685] finished
0709 12:22:48.616710 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:48.626937 (+ 10227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22575,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4762,"spinlock_wait_cycles":102174592,"thread_start_us":161931,"threads_started":1,"wal-append.queue_time_us":260459}
I20260709 12:22:48.635237 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.640952 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.611449 20956 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:48.643635 18675 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:48.643678 18601 raft_consensus.cc:1240] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: [2.5-5.6]
I20260709 12:22:48.645107 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.648452 18604 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:22:48.646153 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.625968 20798 raft_consensus.cc:3055] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:48.624951 20926 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:48.626222 20457 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:48.627991 20811 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.655131 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:48.657284 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 74220.7us
W20260709 12:22:48.658957 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 58827.7us
I20260709 12:22:48.660621 18494 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:48.661096 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:48.661975 18494 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:48.655359 20798 raft_consensus.cc:740] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:48.650388 20925 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:48.677471 18494 leader_election.cc:400] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7.
I20260709 12:22:48.680721 18494 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:48.656672 20457 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:48.687763 18494 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:48.661867 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.665589 20835 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:48.690459 18644 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:48.693750 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.688778 18494 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:48.660629 20887 raft_consensus.cc:697] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 6 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:48.654453 20956 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.694373 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:48.697667 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:48.700356 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.702104 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.701898 20798 consensus_queue.cc:260] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:48.703311 20798 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:48.706506 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 80353.4us
I20260709 12:22:48.700709 18644 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:48.708989 20752 consensus_queue.cc:1059] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:48.710562 20752 raft_consensus.cc:3055] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:48.711010 20752 raft_consensus.cc:740] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:48.661543 20811 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.689610 20457 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:48.718819 18644 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:48.689815 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.719365 18570 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:48.697520 20957 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:48.695988 20888 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:48.729055 18599 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:48.723050 18644 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:48.712531 20925 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:48.726085 20842 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:48.732359 20842 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.732795 20842 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:48.730084 20969 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:48.712232 20962 raft_consensus.cc:2804] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:48.740996 18644 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:48.722218 20801 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:48.722286 20497 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:48.750887 20956 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:48.758013 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1480) took 1120 ms. Trace:
I20260709 12:22:48.758492 18676 rpcz_store.cc:276] 0709 12:22:47.637526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.430361 (+792835us) service_pool.cc:224] Handling call
0709 12:22:48.430657 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:48.431132 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:48.431160 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:48.431653 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 12:22:48.658215 (+226562us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:48.690964 (+ 32749us) log.cc:844] Serialized 14 byte log entry
0709 12:22:48.691529 (+   565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.691634 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:48.757764 (+ 66130us) raft_consensus.cc:1685] finished
0709 12:22:48.757787 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:48.757945 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":89374,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":5568,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":3984,"thread_start_us":197409,"threads_started":2,"wal-append.queue_time_us":281048}
I20260709 12:22:48.722899 20968 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:48.761101 20968 raft_consensus.cc:697] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:48.739980 20962 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.749034 20802 consensus_queue.cc:1048] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:22:48.696745 20683 consensus_queue.cc:237] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.767014 20811 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:48.730268 20752 consensus_queue.cc:260] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:48.768868 20752 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:48.765216 20962 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:48.762108 20968 consensus_queue.cc:237] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:48.775194 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 77898.3us
I20260709 12:22:48.749218 20919 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:48.779593 20956 consensus_queue.cc:1059] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:48.779965 20919 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:48.780449 20919 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:48.737408 20835 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:22:48.780714 20957 raft_consensus.cc:3055] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:48.781178 20957 raft_consensus.cc:740] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:48.735998 20887 consensus_queue.cc:237] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:48.782014 20957 consensus_queue.cc:260] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:48.783234 20957 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:48.778110 19242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33388 (request call id 339) took 1341 ms. Trace:
I20260709 12:22:48.763238 20801 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:48.748651 20900 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:48.780471 20956 consensus_queue.cc:1059] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:22:48.789578 18494 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:48.788769 18570 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:48.791129 18570 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:48.791893 20801 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:48.793951 18671 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 1434) took 2948 ms (client timeout 2658 ms). Trace:
W20260709 12:22:48.794878 18671 rpcz_store.cc:269] 0709 12:22:45.843359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:45.843533 (+   174us) service_pool.cc:224] Handling call
0709 12:22:48.791792 (+2948259us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54000be5d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:48.791920 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2950088576}
I20260709 12:22:48.792274 20835 consensus_queue.cc:1048] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:22:48.784605 19242 rpcz_store.cc:276] 0709 12:22:47.433222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.446267 (+ 13045us) service_pool.cc:224] Handling call
0709 12:22:48.712255 (+1265988us) spinlock_profiling.cc:243] Waited 7.46 ms on lock 0x7b5800003c98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793baf8c 00007efc793baef6 000000000036eb39 00007efc8142e1e0 00007efc814f70c4 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:22:48.719559 (+  7304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:48.728986 (+  9427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:48.730214 (+  1228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:48.739804 (+  9590us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:48.746201 (+  6397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.763996 (+ 17795us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:48.774409 (+ 10413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17168768}
I20260709 12:22:48.801741 20842 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.791999 20900 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:48.813894 18494 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:48.815486 18494 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:48.821535 18570 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:48.811334 20835 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:48.825328 20962 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.831199 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:48.832125 18606 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:48.833302 20840 consensus_queue.cc:1048] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:48.834738 20840 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:48.835108 20840 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.835430 20840 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:48.839900 20835 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:48.840389 20835 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:48.812680 20977 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:48.817189 20900 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:48.857764 18606 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:48.880878 18644 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:48.807425 20970 consensus_queue.cc:1059] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:22:48.883786 18570 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:48.819224 20959 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:48.813390 20926 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.814961 20457 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.887486 20969 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:48.877607 20976 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:48.855911 20962 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:48.877559 20803 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:48.885337 20683 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:48.905139 20457 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:48.907100 20926 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:48.908485 18597 raft_consensus.cc:1275] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:48.904557 20842 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:48.914220 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 98816.8us
I20260709 12:22:48.936750 18494 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:48.913005 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:48.913313 20803 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.892640 20802 raft_consensus.cc:2804] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:48.938746 20802 raft_consensus.cc:697] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:48.939781 20802 consensus_queue.cc:237] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.942458 20591 raft_consensus.cc:3055] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:48.942902 20591 raft_consensus.cc:740] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:48.943724 20591 consensus_queue.cc:260] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.945349 20591 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:48.943789 18672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 1478) took 1369 ms. Trace:
I20260709 12:22:48.946950 20801 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.947408 18672 rpcz_store.cc:276] 0709 12:22:47.574279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.590689 (+ 16410us) service_pool.cc:224] Handling call
0709 12:22:48.943583 (+1352894us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b54002927d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:48.943689 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117072128}
I20260709 12:22:48.948161 18677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1481) took 1254 ms. Trace:
I20260709 12:22:48.948553 18677 rpcz_store.cc:276] 0709 12:22:47.693651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.437579 (+743928us) service_pool.cc:224] Handling call
0709 12:22:48.437905 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:48.473766 (+ 35861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:48.473814 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:48.473874 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:48.473918 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.947886 (+473968us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b5400403dd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:48.947930 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:48.948089 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81748864}
I20260709 12:22:48.907125 20809 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:48.881910 20752 consensus_queue.cc:1059] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:22:48.951941 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.915337 20976 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:48.952713 18606 raft_consensus.cc:2393] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 6: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:48.955926 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:48.957005 18671 raft_consensus.cc:1240] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:22:48.957762 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:48.958541 18494 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:48.960090 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:48.960744 18671 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:22:48.960762 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:48.962123 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:48.962678 18606 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:48.963114 18494 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:48.964206 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:48.914314 20683 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:48.970155 18494 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:48.939581 20803 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:48.912714 20835 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:48.977068 18494 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:48.935622 20961 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:48.952064 20926 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:48.952111 20962 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:48.982460 18494 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:48.984402 18606 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:22:48.972915 20980 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:48.987872 18494 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:48.990797 18606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "298b8c963d93464e999fee75e74e9781"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:22:48.991561 18606 raft_consensus.cc:606] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:48.991984 18606 raft_consensus.cc:614] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:48.994738 18671 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
W20260709 12:22:48.994956 18680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40800 (request call id 1419) took 1896 ms (client timeout 1651 ms). Trace:
W20260709 12:22:48.995808 18680 rpcz_store.cc:269] 0709 12:22:47.098771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.105745 (+  6974us) service_pool.cc:224] Handling call
0709 12:22:48.994790 (+1889045us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54000be0d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:48.994891 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248785792}
I20260709 12:22:48.974406 20969 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:48.973162 20683 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:49.002198 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.987020 20497 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.976043 20976 raft_consensus.cc:697] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:49.008056 18525 raft_consensus.cc:1240] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:48.973119 20983 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:49.011965 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:48.981449 20970 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:48.968567 20457 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:22:48.993278 20980 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.981559 20926 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:49.020684 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:48.995785 20975 raft_consensus.cc:2804] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:49.022727 18572 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:49.040974 18530 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:22:49.050879 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 63081.2us
W20260709 12:22:49.068784 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 185110us
W20260709 12:22:49.071096 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 48474.9us
I20260709 12:22:49.072532 18494 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:48.987310 20919 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.075347 18572 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:49.077927 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:48.988025 20961 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:48.996938 20962 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.080561 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.044307 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.081851 18528 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:49.043664 20968 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:22:49.069460 20956 raft_consensus.cc:2749] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:49.041067 20980 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:49.079778 20948 consensus_meta.cc:287] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.538s	user 0.012s	sys 0.000s
I20260709 12:22:49.074812 20983 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:49.070952 20981 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:49.088063 20979 log.cc:927] Time spent T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:22:49.019806 20802 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:49.041755 20926 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:49.079375 20793 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:49.094591 18530 raft_consensus.cc:1240] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:49.042518 20975 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.069223 20969 consensus_queue.cc:1059] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:22:49.087193 20986 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:49.017416 20497 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.111572 20959 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:22:49.124562 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 46058.2us
I20260709 12:22:49.127307 20992 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:49.127939 20992 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:49.130170 20992 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:49.111997 20983 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:49.131910 20801 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:49.132376 20983 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:49.111804 20970 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:49.133497 20962 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:49.134020 20961 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:49.134619 20497 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:49.131937 20956 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:49.135960 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:49.136371 20561 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:49.136444 20956 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.125932 20959 raft_consensus.cc:697] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:22:49.138480 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 44996.2us
I20260709 12:22:49.138854 20956 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:49.139616 18494 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:49.141610 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.142331 18521 raft_consensus.cc:2368] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6.
W20260709 12:22:49.132541 20984 log.cc:927] Time spent T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:22:49.144981 20919 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:49.146461 20900 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.147372 20793 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:49.149948 20879 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:49.132257 20969 raft_consensus.cc:3055] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:49.153314 20835 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:49.154338 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:49.154680 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:49.180186 20879 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:49.184964 20879 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:49.179486 20727 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:49.185731 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.133194 20970 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.179364 20969 raft_consensus.cc:740] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:49.186075 20727 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:49.187258 20969 consensus_queue.cc:260] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:49.187933 20970 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:49.188289 20727 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:49.188661 20969 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:49.139246 20959 consensus_queue.cc:237] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:49.153942 20980 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.186020 20994 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:49.189504 20994 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:49.190765 20980 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:49.161672 20840 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:49.109295 20948 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.164676 18572 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:49.118255 20802 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.117575 20975 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:49.171015 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:49.202762 18522 raft_consensus.cc:2410] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:22:49.171306 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.172093 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.177772 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.124502 20976 consensus_queue.cc:237] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.180487 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.156592 20919 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.181236 20793 raft_consensus.cc:697] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:49.197595 18572 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:49.196044 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:49.201886 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:49.208138 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.204098 18525 raft_consensus.cc:2410] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:49.205605 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.205854 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.208417 18572 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:22:49.208644 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.208066 18530 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
I20260709 12:22:49.209447 18528 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:49.208024 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.210390 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.211041 18528 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:49.199520 20554 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:49.210844 18523 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:49.191725 20994 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:49.214076 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.212191 18529 raft_consensus.cc:2368] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3.
I20260709 12:22:49.211483 20919 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.214803 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:49.227170 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.215652 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.216413 20948 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:49.217783 20922 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:49.219290 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.220355 20793 consensus_queue.cc:237] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.193517 20840 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:49.192809 20591 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:49.223953 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:49.225072 18523 raft_consensus.cc:2393] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
W20260709 12:22:49.246500 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 168657us
I20260709 12:22:49.196382 20879 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:49.178290 20683 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.228227 18525 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 5.
I20260709 12:22:49.248183 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.249190 18525 raft_consensus.cc:2368] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6.
I20260709 12:22:49.250187 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.254374 18572 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:49.256985 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:49.257221 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.257771 18530 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:49.258458 18528 raft_consensus.cc:2393] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 6: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:49.261960 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.263715 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.265540 18527 raft_consensus.cc:1240] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:49.266826 20996 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:22:49.267498 18523 raft_consensus.cc:1275] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:49.268362 20802 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:49.260865 20554 consensus_queue.cc:1059] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:22:49.270591 20919 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:49.271692 20977 raft_consensus.cc:3055] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:49.260251 20907 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:49.272169 20977 raft_consensus.cc:740] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:49.272403 20907 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:49.273108 20977 consensus_queue.cc:260] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.274397 20977 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:49.274608 20907 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:49.276214 20981 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:49.276640 20981 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.276983 20981 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:49.278548 20811 consensus_queue.cc:1059] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:49.252156 20879 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:49.281191 20910 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:49.283059 18424 catalog_manager.cc:5697] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:49.283804 18426 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47714 (request call id 191) took 14490 ms (client timeout 15000 ms). Trace:
I20260709 12:22:49.285214 18644 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:49.286623 20910 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:49.245003 20922 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.284698 18424 catalog_manager.cc:5697] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 2 to 3, leader changed from 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 3 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:49.253947 20815 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:49.287699 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:49.292006 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:49.299540 18599 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:22:49.293030 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:49.296249 18424 catalog_manager.cc:5697] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 2 to 3, leader changed from 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 3 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:49.289239 18678 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:49.291276 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:49.279148 20975 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.304590 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.301888 18424 catalog_manager.cc:5697] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:49.323956 18521 raft_consensus.cc:2410] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:49.302512 18644 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:49.327780 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:49.328816 18680 raft_consensus.cc:2393] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 5: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:49.329187 18525 raft_consensus.cc:1240] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:49.329694 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:49.330315 18677 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 2.
I20260709 12:22:49.330557 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.331147 18525 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:49.331269 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:49.333104 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:49.334367 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:49.335572 18606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:22:49.321388 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.312160 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:49.337297 18528 raft_consensus.cc:2393] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 5: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:49.336241 18424 catalog_manager.cc:5697] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:49.338389 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:49.322362 18678 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:49.256121 20591 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.339355 18424 catalog_manager.cc:5697] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:49.340823 18424 catalog_manager.cc:5697] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:49.336298 18606 raft_consensus.cc:606] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:22:49.313802 20997 log.cc:927] Time spent T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:22:49.287060 20910 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.346057 18671 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:22:49.365728 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:49.384879 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:49.386890 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:49.387580 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:49.402442 18679 raft_consensus.cc:2393] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 5: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:49.315336 20683 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:49.389555 18601 consensus_queue.cc:237] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
W20260709 12:22:49.284200 18426 rpcz_store.cc:269] 0709 12:22:34.793106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.793379 (+   273us) service_pool.cc:224] Handling call
0709 12:22:49.283716 (+14490337us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:43.354690 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:43.386593 (+ 31903us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:43.386648 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:22:43.386682 (+    34us) tablet.cc:662] Decoding operations
0709 12:22:43.480498 (+ 93816us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:43.480636 (+   138us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:43.480678 (+    42us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:22:43.483276 (+  2598us) tablet.cc:701] Row locks acquired
0709 12:22:43.483328 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:22:43.483576 (+   248us) write_op.cc:270] Start()
0709 12:22:43.483793 (+   217us) write_op.cc:276] Timestamp: P: 1783599763483474 usec, L: 0
0709 12:22:43.483826 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:22:43.485001 (+  1175us) log.cc:844] Serialized 8738 byte log entry
0709 12:22:43.824392 (+339391us) op_driver.cc:464] REPLICATION: finished
0709 12:22:44.179787 (+355395us) write_op.cc:301] APPLY: starting
0709 12:22:44.201782 (+ 21995us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:44.299113 (+ 97331us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:44.299270 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:44.487472 (+188202us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:44.487989 (+   517us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 12:22:44.488062 (+    73us) write_op.cc:312] APPLY: finished
0709 12:22:44.488801 (+   739us) log.cc:844] Serialized 152 byte log entry
0709 12:22:44.489058 (+   257us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:44.489313 (+   255us) write_op.cc:454] Released schema lock
0709 12:22:44.489394 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:44.642090 (+152696us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:44.647365 (+  5275us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":149665,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":294357,"apply.run_cpu_time_us":16201,"apply.run_wall_time_us":431750,"num_ops":22,"prepare.queue_time_us":145332,"prepare.run_cpu_time_us":94531,"prepare.run_wall_time_us":283888,"raft.queue_time_us":89818,"raft.run_cpu_time_us":75165,"raft.run_wall_time_us":180657,"replication_time_us":340381,"thread_start_us":412536,"threads_started":4,"wal-append.queue_time_us":198917,"wal-append.run_cpu_time_us":15879,"wal-append.run_wall_time_us":1808232}]]}
I20260709 12:22:49.407696 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:49.390372 20975 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:49.392151 18522 raft_consensus.cc:1240] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:49.394635 18530 raft_consensus.cc:2468] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:49.395550 18599 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 2.
I20260709 12:22:49.399948 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:22:49.406764 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 70994.2us
I20260709 12:22:49.420689 19210 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:49.422657 20976 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:49.423168 20976 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:49.425351 20976 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:49.430158 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:49.431111 19242 raft_consensus.cc:2393] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 6: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:22:49.431386 18644 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:49.433692 20919 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:49.434206 20919 raft_consensus.cc:697] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:49.435088 20919 consensus_queue.cc:237] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.305037 20900 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 2 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:49.412863 19246 raft_consensus.cc:2393] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 5: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:22:49.345508 20962 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:49.414188 20981 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:49.415009 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 74270.1us
I20260709 12:22:49.306483 18598 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:49.415198 20849 consensus_queue.cc:1059] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:49.467312 19210 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:49.305608 20879 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:49.451478 20907 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:49.458103 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:49.458782 18599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:22:49.470875 18599 raft_consensus.cc:606] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:49.471236 18599 raft_consensus.cc:614] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:49.456364 20803 consensus_queue.cc:1048] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:22:49.456547 20962 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.313254 20926 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.404421 20910 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:49.464769 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:49.469341 19210 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:49.478613 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:49.483565 18524 raft_consensus.cc:1240] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:49.480235 18644 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:49.481947 19212 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:49.486104 19212 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:49.470492 20838 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:49.472608 20887 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:49.476965 20962 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:49.509099 18526 raft_consensus.cc:1240] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:49.510419 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:49.519275 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:49.493429 20879 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:49.522635 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:49.527177 18599 raft_consensus.cc:2393] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 7: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:49.493228 20900 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:49.529963 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:49.531181 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.529155 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:49.532277 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.532346 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.533643 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:49.534595 18524 raft_consensus.cc:2368] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6.
I20260709 12:22:49.474751 20907 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.540838 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.542162 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.511315 20961 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:49.545282 18524 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:22:49.554047 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:49.555876 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:49.556052 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 51416.3us
I20260709 12:22:49.556524 18521 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:49.559705 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:49.561441 18528 raft_consensus.cc:3055] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:49.561851 18528 raft_consensus.cc:740] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:49.569214 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.569944 18530 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:49.572213 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:49.573128 18676 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:49.575299 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:49.525074 20874 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:49.562849 18528 consensus_queue.cc:260] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.549834 20900 raft_consensus.cc:697] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:49.597141 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:49.575562 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:49.537817 20879 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:49.617341 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:49.617611 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:49.618239 18677 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
W20260709 12:22:49.611613 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 63019.9us
I20260709 12:22:49.612860 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:49.614007 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:49.576241 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:49.577761 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:49.615645 18528 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:49.588256 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:49.619630 18570 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:49.622423 18599 raft_consensus.cc:2393] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 6: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:49.622887 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:49.632273 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:49.632934 18601 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:49.637188 18604 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:49.638554 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:22:49.635275 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 165980us
I20260709 12:22:49.643100 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:49.641471 18570 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:49.550220 20961 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
W20260709 12:22:49.652117 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 95242.4us
W20260709 12:22:49.658835 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.659502 18528 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:22:49.664143 18528 pending_rounds.cc:85] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 2
I20260709 12:22:49.664568 18528 pending_rounds.cc:107] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:22:49.664484 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:49.665427 18528 raft_consensus.cc:2889] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:49.665727 18676 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:49.625563 20879 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:49.673672 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:49.643075 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:49.681174 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:49.682618 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:49.643304 20851 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:49.644276 20798 raft_consensus.cc:3055] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:49.661454 20591 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:49.687036 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:49.702991 18676 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:49.670892 20949 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:49.704488 18677 raft_consensus.cc:2393] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 5: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:49.685158 20811 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:49.692315 21005 log.cc:927] Time spent T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:22:49.694438 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
W20260709 12:22:49.695664 21002 log.cc:927] Time spent T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:22:49.697170 20981 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:49.669189 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:49.720986 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.698848 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:49.699548 18672 raft_consensus.cc:1240] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:49.671473 20961 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:49.670339 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:49.706612 18646 leader_election.cc:400] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6.
I20260709 12:22:49.669734 18601 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:22:49.685636 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
W20260709 12:22:49.719234 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 75684.4us
I20260709 12:22:49.732080 18646 leader_election.cc:403] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:49.698343 18675 raft_consensus.cc:1240] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:22:49.725636 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:49.702054 20798 raft_consensus.cc:740] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:49.713704 20802 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:49.730564 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 84812.6us
I20260709 12:22:49.739053 18646 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:49.740099 18494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.740357 18646 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:49.747061 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:49.751243 18644 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:49.787530 18598 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:49.715040 20818 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:22:49.804178 18675 raft_consensus.cc:1275] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:49.790596 21018 consensus_queue.cc:1059] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:22:49.736182 20803 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6.
I20260709 12:22:49.742702 20926 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:49.826997 20952 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:49.721161 20900 consensus_queue.cc:237] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.743027 20802 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:49.851670 21016 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.855055 20809 raft_consensus.cc:3055] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:49.855641 20803 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:49.857362 21017 consensus_queue.cc:1059] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:49.875321 18672 raft_consensus.cc:1275] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:22:49.875873 18672 pending_rounds.cc:85] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting all ops after (but not including) 6
I20260709 12:22:49.876145 18672 pending_rounds.cc:107] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:22:49.876427 18672 raft_consensus.cc:2889] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:49.842116 20798 consensus_queue.cc:260] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:49.837870 21021 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:49.874567 21011 log.cc:927] Time spent T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:22:49.869107 20907 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:49.863577 20976 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:49.841760 20951 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:22:49.865278 21019 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:49.870074 20809 raft_consensus.cc:740] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:49.899952 18600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:22:49.872152 21016 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:49.896296 18570 consensus_peers.cc:597] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ddef1433d2344c9a83050fe07ac225b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:49.859707 20962 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.888415 20926 consensus_queue.cc:1059] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:22:49.904434 20802 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:49.905206 20591 consensus_queue.cc:1059] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:49.885512 21021 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:49.887250 20803 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:49.922546 20879 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:49.923218 21016 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:49.923682 20809 consensus_queue.cc:260] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:49.927819 20922 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:49.930572 18677 raft_consensus.cc:1240] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:22:49.933876 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 182688us
I20260709 12:22:49.937122 18674 raft_consensus.cc:2393] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 7: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
W20260709 12:22:49.937680 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 197382us
I20260709 12:22:49.918808 18600 raft_consensus.cc:606] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:49.944615 18646 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:49.946599 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:49.933624 20802 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.933173 21021 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:49.937605 20975 raft_consensus.cc:3055] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:49.912971 20976 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:49.953049 18644 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:49.953846 20879 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:49.952239 18646 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:49.948071 20809 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:49.966271 18646 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:49.964274 20976 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:49.955400 20802 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:49.970234 20962 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:49.965075 21019 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:49.973086 21019 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:49.973461 21019 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:49.950584 20803 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:22:49.961473 20961 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:49.978755 21026 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:49.981034 19210 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:49.981662 20802 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:49.983196 20961 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:49.983924 21016 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:49.985936 19210 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:49.986841 18646 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:49.988116 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.959903 20900 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:49.955618 20975 raft_consensus.cc:740] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:50.024082 18646 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:49.995069 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:49.957479 21027 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:49.999868 18525 raft_consensus.cc:1240] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:50.000677 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:50.019842 21012 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:50.022351 20949 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:50.022686 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:22:49.986183 21003 log.cc:927] Time spent T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.340s	user 0.005s	sys 0.000s
I20260709 12:22:50.062404 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:50.063215 18680 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 6.
I20260709 12:22:50.064670 18570 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:50.068522 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:50.069747 18680 raft_consensus.cc:2393] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 5: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:50.072094 19210 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:50.030352 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1663) took 1038 ms. Trace:
I20260709 12:22:50.024804 20919 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:50.044291 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:50.007620 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:50.051641 18646 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:50.052763 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:50.024331 20975 consensus_queue.cc:260] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.054019 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:50.092075 18523 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:50.056051 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 169906us
I20260709 12:22:50.057917 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:50.061327 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:50.074576 20951 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:50.122126 20951 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.122527 20951 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:50.122767 20900 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:50.074488 21017 consensus_queue.cc:1048] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:50.045141 20907 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:50.075973 18526 rpcz_store.cc:276] 0709 12:22:48.991455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.991617 (+   162us) service_pool.cc:224] Handling call
0709 12:22:48.991931 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:49.512449 (+520518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:50.029767 (+517318us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b5400335254. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:50.030178 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1188773248}
I20260709 12:22:50.078528 20809 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:50.126621 18522 raft_consensus.cc:1275] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:50.059659 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:50.080159 18672 raft_consensus.cc:1240] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:22:50.083214 20981 consensus_queue.cc:1048] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:50.059724 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:50.128830 18600 raft_consensus.cc:2393] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 7: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:50.054730 21027 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:50.054595 21025 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:50.093019 18494 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.131572 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.132476 18529 raft_consensus.cc:1240] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:50.061951 20949 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:50.106065 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:50.134320 18523 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:50.134743 18605 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:50.107127 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:50.108603 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:22:50.128232 21030 log.cc:927] Time spent T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:22:50.136366 20922 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:50.109390 18601 raft_consensus.cc:1240] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:22:50.112499 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:50.102873 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 51317.2us
I20260709 12:22:50.116240 19240 raft_consensus.cc:2393] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 5: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:22:50.114286 20842 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:50.120330 20851 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.151234 18646 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:50.120795 20910 consensus_meta.cc:287] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.619s	user 0.013s	sys 0.000s
I20260709 12:22:50.128540 20975 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:50.129043 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:50.141776 20900 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.142714 18527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1669) took 1132 ms. Trace:
I20260709 12:22:50.152805 18646 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.156405 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:50.186839 18646 leader_election.cc:400] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6.
I20260709 12:22:50.188182 18646 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.189248 18646 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.158154 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:50.159536 18523 raft_consensus.cc:1240] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:50.171907 18572 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:22:50.174546 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 44611.2us
I20260709 12:22:50.088539 20919 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:50.137384 21028 log.cc:927] Time spent T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:22:50.185750 18527 rpcz_store.cc:276] 0709 12:22:49.010092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.010293 (+   201us) service_pool.cc:224] Handling call
0709 12:22:49.042805 (+ 32512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:49.265938 (+223133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:50.142469 (+876531us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b540009a6d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:50.142623 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":511820672}
I20260709 12:22:50.200138 18524 raft_consensus.cc:1275] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:50.133971 21027 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:50.137851 20793 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:50.205943 18605 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
W20260709 12:22:50.215687 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:50.180418 20803 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:50.195835 20815 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:50.195112 20962 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:50.198385 20919 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:50.194072 21026 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:50.228964 18678 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:50.202214 20802 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:50.181051 20879 consensus_queue.cc:1059] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 12:22:50.240321 21033 log.cc:927] Time spent T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:22:50.232355 18644 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:50.241225 18528 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 5.
I20260709 12:22:50.218006 20809 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:50.185001 20910 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.198258 20841 consensus_queue.cc:1059] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 12:22:50.248220 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 110623us
I20260709 12:22:50.201485 20900 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.186080 20851 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.243000 18522 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
I20260709 12:22:50.243805 20802 raft_consensus.cc:2749] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:50.219684 21019 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.260257 18494 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:22:50.266182 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 51056.5us
W20260709 12:22:50.267982 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 78775.2us
I20260709 12:22:50.277396 18494 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.277503 18646 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.279429 18494 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:50.280968 18646 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.282680 18494 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:50.283514 18646 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.284866 18673 raft_consensus.cc:2393] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 5: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:50.281468 20802 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:50.285745 18680 raft_consensus.cc:1240] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:50.286535 20962 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:50.278216 20752 raft_consensus.cc:3055] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:50.247089 21021 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:50.289669 20793 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:50.291826 20808 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:50.292881 20910 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:50.294971 21014 raft_consensus.cc:3055] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:50.295061 20900 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:50.300275 18646 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:50.301198 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 54781.9us
I20260709 12:22:50.281725 21029 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:50.282181 20956 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:50.304525 18572 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:50.281107 21039 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:50.306982 18672 raft_consensus.cc:1240] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:50.306159 18646 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:50.280640 20977 consensus_queue.cc:1059] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:22:50.295588 21014 raft_consensus.cc:740] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:50.312971 18646 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:50.290062 20752 raft_consensus.cc:740] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:50.285396 21012 consensus_queue.cc:1059] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:22:50.285853 21040 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:50.310554 20962 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:50.306124 20956 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:50.290170 20851 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:50.316053 20900 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:50.333945 20811 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:50.335002 21021 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:50.342923 18494 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.335654 21040 raft_consensus.cc:2804] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:50.330648 20962 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:50.339216 18521 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:22:50.312114 21039 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:50.305912 20910 consensus_queue.cc:1048] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:22:50.314881 21029 raft_consensus.cc:697] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:50.346127 18494 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.316390 20968 consensus_queue.cc:1059] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:22:50.351504 18494 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.341054 20956 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:50.321597 18646 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:50.347131 20962 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:50.344794 20952 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:50.356700 18646 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.348763 21039 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:50.347081 20811 raft_consensus.cc:697] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:50.354213 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:50.329672 21045 consensus_queue.cc:1059] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:22:50.359871 18646 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.350425 21040 raft_consensus.cc:697] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:50.365731 20952 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:50.365670 20811 consensus_queue.cc:237] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.352833 20838 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.368108 20968 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:50.377192 20803 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:50.377849 21049 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:50.384095 21029 consensus_queue.cc:237] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:50.382393 20838 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:50.385460 20798 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:50.352438 20752 consensus_queue.cc:260] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.391187 21019 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:50.391649 20752 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:50.392714 21040 consensus_queue.cc:237] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:50.395272 21009 log.cc:927] Time spent T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.726s	user 0.003s	sys 0.009s
I20260709 12:22:50.380371 18646 leader_election.cc:400] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6.
I20260709 12:22:50.359176 20802 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:50.417793 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:50.418859 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 114479us
I20260709 12:22:50.380643 21052 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:50.440423 20809 raft_consensus.cc:3055] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:50.440909 20809 raft_consensus.cc:740] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:50.441710 20809 consensus_queue.cc:260] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.443002 20809 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:50.448376 18673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 1491) took 1116 ms. Trace:
I20260709 12:22:50.448846 18673 rpcz_store.cc:276] 0709 12:22:49.332070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.332858 (+   788us) service_pool.cc:224] Handling call
0709 12:22:50.448150 (+1115292us) spinlock_profiling.cc:243] Waited 949 ms on lock 0x7b540038a754. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:50.448309 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2183074176}
I20260709 12:22:50.450240 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:50.457667 20838 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.458863 20951 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:50.462041 21014 consensus_queue.cc:260] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:50.482182 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:50.465061 21026 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:50.470081 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 48985us
I20260709 12:22:50.494623 18572 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:50.470815 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:50.471889 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:50.496789 18602 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:50.476171 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:50.473774 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:50.478914 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:50.500339 18528 raft_consensus.cc:1240] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 4. Current term is 5. Ops: []
W20260709 12:22:50.513317 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:50.457670 20956 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.554324 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 1497) took 1212 ms. Trace:
I20260709 12:22:50.558743 18674 rpcz_store.cc:276] 0709 12:22:49.342367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.384533 (+ 42166us) service_pool.cc:224] Handling call
0709 12:22:50.554136 (+1169603us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54000bead4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:50.554263 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1236809600}
I20260709 12:22:50.478329 20803 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:50.490377 20959 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:50.564741 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:50.505576 20771 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:50.590201 18523 raft_consensus.cc:1275] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:22:50.522416 20683 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.593972 18523 pending_rounds.cc:85] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 2
I20260709 12:22:50.595044 18523 pending_rounds.cc:107] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:22:50.597091 18523 raft_consensus.cc:2889] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:50.567095 21014 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:50.596526 19239 raft_consensus.cc:2393] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 7: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:22:50.583101 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:22:50.592628 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 241187us
I20260709 12:22:50.614701 18494 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:50.599586 18602 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:22:50.618445 18494 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.580310 20803 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.620905 18494 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:50.621802 20591 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:50.583765 20959 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.579942 20949 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:50.580411 20998 consensus_queue.cc:1059] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:22:50.599911 20683 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:50.622399 20874 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.632797 20591 raft_consensus.cc:697] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:50.650880 20874 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:50.651815 20591 consensus_queue.cc:237] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.653473 20874 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:50.632560 18494 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.622020 20975 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:50.655293 21060 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:50.656677 18494 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.656859 18521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1397) took 1126 ms. Trace:
I20260709 12:22:50.657231 18521 rpcz_store.cc:276] 0709 12:22:49.530267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.557118 (+ 26851us) service_pool.cc:224] Handling call
0709 12:22:50.656706 (+1099588us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b54003b4554. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:50.656804 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1658201344}
I20260709 12:22:50.658457 18494 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:50.626724 20798 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:50.662545 20922 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:50.665735 20922 raft_consensus.cc:697] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:50.665933 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:50.666725 20922 consensus_queue.cc:237] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.630457 21025 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:50.636821 20815 raft_consensus.cc:993] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:22:50.671954 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:50.672832 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:50.675009 18679 raft_consensus.cc:1275] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:50.675793 18672 raft_consensus.cc:1275] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:22:50.682082 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 123975us
I20260709 12:22:50.633344 19242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33372 (request call id 216) took 1021 ms. Trace:
I20260709 12:22:50.684754 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:50.689811 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:50.635653 20803 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:50.662721 20975 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:50.698401 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:50.699508 18671 raft_consensus.cc:1275] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:50.702764 18521 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 6.
I20260709 12:22:50.703199 20988 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.700872 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:50.678409 19244 raft_consensus.cc:1240] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:50.684759 18646 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:50.706478 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:50.708345 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:50.678095 20798 raft_consensus.cc:697] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:50.709167 18526 raft_consensus.cc:2393] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 5: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:50.718510 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:50.718479 20798 consensus_queue.cc:237] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.720293 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:50.720379 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:50.721004 18527 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:22:50.721769 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:50.712368 20988 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.631512 21027 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.663082 20919 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.723990 18646 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.725281 18646 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.725788 20919 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:50.726023 21027 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:50.726354 20803 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:50.726517 20919 raft_consensus.cc:2804] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:50.726104 20842 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:50.727041 20919 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:50.724045 20988 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:50.699244 20952 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.727979 20683 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:50.728685 20949 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:50.728430 20952 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.729557 20842 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:50.730533 20952 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:50.708734 20838 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:50.717115 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:50.731509 18530 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:50.731714 21025 consensus_queue.cc:1059] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:50.732084 18680 raft_consensus.cc:2393] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 5: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:50.732965 20842 raft_consensus.cc:3055] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:50.733304 20842 raft_consensus.cc:740] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:50.733443 21039 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.734568 18522 raft_consensus.cc:1240] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:50.734313 20842 consensus_queue.cc:260] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.719681 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:50.735659 20842 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:50.736673 18526 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:50.731585 20919 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:50.740533 20962 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.741739 20959 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:50.742630 20962 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:50.742887 20956 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:50.744213 21056 raft_consensus.cc:1081] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:22:50.744393 20998 raft_consensus.cc:3055] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:50.744838 20998 raft_consensus.cc:740] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:50.736330 18646 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.748742 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:50.749756 18598 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 6.
W20260709 12:22:50.754187 19209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:50.756916 18494 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.756916 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:50.758019 18646 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.760267 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:50.760267 18530 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:22:50.762434 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:50.699172 20887 raft_consensus.cc:3055] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:50.779158 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:50.771693 18646 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.708573 20981 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.780982 20887 raft_consensus.cc:740] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:50.796465 20981 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:50.797618 20887 consensus_queue.cc:260] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:50.798698 20981 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:50.798835 20887 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:50.801190 21059 log.cc:927] Time spent T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.194s	user 0.003s	sys 0.000s
I20260709 12:22:50.780496 21027 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:50.804170 21027 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:50.804602 21027 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:50.805804 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:50.781636 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:50.808445 18672 raft_consensus.cc:1240] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:22:50.745909 20951 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:50.809494 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:50.809685 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:50.810544 18600 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:50.811890 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:50.813447 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:50.815110 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:50.817670 19212 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:50.818382 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:50.818804 19212 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.818991 18674 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:22:50.823043 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:50.823696 18679 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:50.824141 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:50.824744 18672 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:22:50.824949 18598 raft_consensus.cc:1240] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:50.785331 18646 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:50.780732 21026 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:50.745734 20998 consensus_queue.cc:260] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.795156 21040 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:50.827068 18646 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.829015 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.830261 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:22:50.829939 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 73161.3us
I20260709 12:22:50.832494 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:50.820896 18644 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:50.768769 18526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:22:50.834626 18644 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:50.834756 18526 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:50.835186 18526 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:50.685110 19242 rpcz_store.cc:276] 0709 12:22:49.610972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.619221 (+  8249us) service_pool.cc:224] Handling call
0709 12:22:50.564955 (+945734us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b5800003c98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:22:50.632455 (+ 67500us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4792704}
I20260709 12:22:50.817394 21042 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.863623 18678 raft_consensus.cc:1240] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:50.870297 19210 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:50.870424 21040 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:50.870918 21040 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:50.871323 21040 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:50.871824 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:50.872370 21021 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:50.872444 18678 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:50.872884 21021 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.835186 21045 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:22:50.878070 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 45568.8us
I20260709 12:22:50.878988 20752 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:50.873965 20874 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:50.883986 20683 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.884620 20683 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.875172 20962 raft_consensus.cc:2749] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:50.829846 20949 consensus_queue.cc:1048] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:22:50.873628 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:50.829995 20900 raft_consensus.cc:2804] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:50.865418 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:50.875347 19210 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.830955 21017 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:50.869709 21026 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:50.886776 20683 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:50.844518 21064 log.cc:927] Time spent T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.114s	user 0.001s	sys 0.001s
I20260709 12:22:50.876284 18526 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.878429 18598 raft_consensus.cc:1240] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 7. Ops: []
I20260709 12:22:50.865774 18646 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:50.890580 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:50.932930 18570 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:50.907613 18679 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
I20260709 12:22:50.861824 20956 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:50.874307 21021 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:50.912139 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:50.913460 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:50.911545 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:50.935932 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:50.935528 20951 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:50.868587 20988 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
W20260709 12:22:50.948999 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 85048.6us
I20260709 12:22:50.910311 19241 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:50.944947 18494 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:50.873806 20952 consensus_queue.cc:1048] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:22:50.874469 20975 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:22:50.955793 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:22:50.930472 21067 log.cc:927] Time spent T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:22:50.910784 21029 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:50.954288 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:50.904294 21045 raft_consensus.cc:697] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:50.969067 21045 consensus_queue.cc:237] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:50.956599 18679 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:50.891693 20900 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:50.952220 18526 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:50.960422 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:50.985083 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:50.903980 20842 consensus_queue.cc:1059] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:22:50.939338 20815 consensus_queue.cc:1059] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:22:50.961078 20962 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:50.985899 18524 raft_consensus.cc:2393] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 5: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:50.955386 20798 raft_consensus.cc:2749] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:51.003901 20815 raft_consensus.cc:3055] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:51.004432 20815 raft_consensus.cc:740] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:51.005285 20815 consensus_queue.cc:260] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.006824 20815 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:51.007967 20803 consensus_queue.cc:1059] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:51.001753 20962 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:51.008960 20962 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:50.959091 21026 raft_consensus.cc:697] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:51.012477 21026 consensus_queue.cc:237] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.015005 18678 raft_consensus.cc:1240] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:50.973063 20981 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:50.876770 21042 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:50.939735 21017 raft_consensus.cc:697] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 5 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:50.987275 18570 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:50.957330 21039 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:50.962141 21029 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.990222 18646 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:50.999873 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 62793.8us
I20260709 12:22:50.999979 20802 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:51.047000 20802 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.041097 20952 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.049664 21029 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:51.049796 20952 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.051029 21040 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.049436 21054 consensus_queue.cc:1048] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:51.052402 21017 consensus_queue.cc:237] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:51.053122 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 76968.2us
I20260709 12:22:51.053719 20987 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:51.075376 20987 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.054530 21027 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.049170 20802 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:51.024360 18494 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:51.109158 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 84872.2us
W20260709 12:22:51.058599 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 68418.2us
I20260709 12:22:51.111658 18646 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:51.059587 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:51.112129 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:50.993551 20900 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:51.112766 18676 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:22:51.112766 18603 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:22:51.060974 18679 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:22:51.020192 20907 raft_consensus.cc:3055] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:51.076385 18570 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:51.165970 18494 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:51.063405 21019 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:51.106585 20952 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:51.165923 18644 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:51.075843 20987 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:51.106879 21039 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.169682 18521 raft_consensus.cc:1240] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:51.167413 20802 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:51.175204 18494 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:22:51.181097 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 104791us
W20260709 12:22:51.183691 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:51.166422 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 261024us
I20260709 12:22:51.022435 20919 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.121065 20907 raft_consensus.cc:740] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:22:51.189672 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 314389us
I20260709 12:22:51.168637 20798 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:51.208830 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:22:51.203310 21057 log.cc:927] Time spent T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.597s	user 0.005s	sys 0.000s
I20260709 12:22:51.206163 18679 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:51.218967 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:51.195526 21039 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:51.209548 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:51.210950 18602 raft_consensus.cc:1275] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:51.211326 18570 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:51.232610 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:51.184798 20922 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:51.212639 18603 raft_consensus.cc:1275] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:51.192384 20998 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:51.193581 20952 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:51.185573 20849 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:51.240427 18673 raft_consensus.cc:1240] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:51.242750 20922 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.206717 21025 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:51.257920 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:51.258579 21025 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:51.259052 21025 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:51.259222 21039 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:51.262418 21029 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.262991 21052 raft_consensus.cc:3055] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:51.263363 21052 raft_consensus.cc:740] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:51.252648 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:51.253436 20922 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:51.268834 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 148146us
I20260709 12:22:51.274757 18644 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:51.266819 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 155230us
I20260709 12:22:51.270394 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:51.284053 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:51.284543 18672 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:22:51.284683 18602 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:22:51.268653 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:51.241156 20976 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:51.246289 21014 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.278648 18677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1525) took 1064 ms. Trace:
I20260709 12:22:51.285018 18494 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:51.289223 18646 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:51.286132 20976 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.292912 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:51.293265 20976 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:51.234253 20838 consensus_queue.cc:1059] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:22:51.295565 18494 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:51.286521 18677 rpcz_store.cc:276] 0709 12:22:50.214241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.214367 (+   126us) service_pool.cc:224] Handling call
0709 12:22:50.214729 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:50.347405 (+132676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:50.347454 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:50.348023 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 12:22:50.827185 (+479162us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:50.827231 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.270078 (+442847us) spinlock_profiling.cc:243] Waited 70 ms on lock 0x7b540038bb54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:51.270146 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:51.270213 (+    67us) raft_consensus.cc:1685] finished
0709 12:22:51.270234 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.278554 (+  8320us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":773,"raft.queue_time_us":2974,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":161019264,"thread_start_us":526005,"threads_started":2,"wal-append.queue_time_us":581564}
I20260709 12:22:51.244629 20956 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:22:51.266994 20952 raft_consensus.cc:697] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:51.215946 20818 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.308184 20591 consensus_queue.cc:1048] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:51.307835 21019 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:51.276731 19241 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
W20260709 12:22:51.310801 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 60811.8us
I20260709 12:22:51.286206 20802 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:51.314946 18598 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:22:51.317474 18570 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:51.316057 19241 pending_rounds.cc:85] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4: Aborting all ops after (but not including) 6
I20260709 12:22:51.322398 21025 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.235405 20907 consensus_queue.cc:260] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.308907 21060 raft_consensus.cc:2804] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:51.311286 20962 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.299652 21014 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:51.304113 20683 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:51.339107 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:51.343233 18603 raft_consensus.cc:3055] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:51.343636 18603 raft_consensus.cc:740] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:51.347440 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:51.334230 19241 pending_rounds.cc:107] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:22:51.349115 18598 raft_consensus.cc:2393] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 6: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:51.337407 19210 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:51.337338 21054 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.347996 18603 consensus_queue.cc:260] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.365340 18603 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:22:51.342195 21060 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:51.367547 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 65923.5us
I20260709 12:22:51.331452 20968 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:22:51.368525 18494 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:51.369936 18494 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:51.316499 20818 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.360152 19241 raft_consensus.cc:2889] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:51.378881 18494 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:51.378086 19239 raft_consensus.cc:1275] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:51.378455 20952 consensus_queue.cc:237] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.352406 21027 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:51.372164 21073 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:51.310269 21052 consensus_queue.cc:260] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.348640 20977 consensus_queue.cc:1059] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:22:51.390254 18605 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:22:51.369496 21054 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:51.392851 21054 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:51.394299 21042 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:51.374225 21019 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:51.395524 21019 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.397953 21019 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:51.401937 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:51.402591 18679 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 6.
I20260709 12:22:51.402839 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:51.375810 20683 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:51.372308 21060 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:51.371524 19242 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:22:51.407126 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:51.405376 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:51.413197 21073 raft_consensus.cc:697] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:51.427533 21073 consensus_queue.cc:237] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:51.428848 21078 log.cc:927] Time spent T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:22:51.423300 21052 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:22:51.398480 21014 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:51.412938 20958 raft_consensus.cc:2749] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:51.434433 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 55640.3us
I20260709 12:22:51.438812 18494 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:51.420540 20988 raft_consensus.cc:2749] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:51.443333 18494 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:51.434742 21075 log.cc:927] Time spent T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 12:22:51.448096 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.434262 21083 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:51.436996 21026 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:51.434545 20842 consensus_queue.cc:1048] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:22:51.471135 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:51.456583 20988 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:22:51.466572 21021 consensus_meta.cc:287] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.000s
I20260709 12:22:51.478160 18602 raft_consensus.cc:1240] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:51.475762 18601 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:51.493974 18603 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:22:51.462435 21083 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:51.501681 21087 log.cc:927] Time spent T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:22:51.506660 20919 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:51.511694 21029 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:51.513206 21040 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:51.515056 20844 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.515625 20844 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.516212 20818 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:51.517906 20844 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:51.494549 20962 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:51.530818 21025 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:51.531477 21025 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:51.532030 21025 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.533321 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:51.534258 21025 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:51.534163 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:51.537340 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:51.538615 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:51.539377 18605 raft_consensus.cc:2393] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 6: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:51.540410 21042 raft_consensus.cc:3055] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:51.540812 21042 raft_consensus.cc:740] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:51.532061 19210 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:51.541689 21042 consensus_queue.cc:260] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:51.543031 21042 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:51.544310 21017 raft_consensus.cc:2804] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:51.544860 21017 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.545228 21017 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:51.546736 21079 log.cc:927] Time spent T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 12:22:51.465425 21026 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.551795 18673 raft_consensus.cc:1275] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:51.479578 20988 raft_consensus.cc:697] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:22:51.499195 21077 log.cc:927] Time spent T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
W20260709 12:22:51.567974 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 74217.3us
I20260709 12:22:51.569635 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:51.570119 18528 raft_consensus.cc:1275] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:51.570566 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:51.571156 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:51.571723 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:51.572314 18527 raft_consensus.cc:1240] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:51.573385 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:51.574299 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:51.574657 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:51.575089 18528 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:51.482414 21021 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:51.576977 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:51.592577 18522 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:22:51.593382 18528 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:51.591837 21092 ts_tablet_manager.cc:933] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:51.623980 21039 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:51.624257 18646 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:51.629626 18646 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:51.630505 18646 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:51.588809 20926 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:51.635823 18646 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:51.640988 18570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.642652 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:51.643895 19239 raft_consensus.cc:1240] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:51.644387 21093 consensus_queue.cc:1059] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:22:51.645219 19244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33388 (request call id 352) took 1433 ms. Trace:
I20260709 12:22:51.654593 18646 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:51.656785 18603 raft_consensus.cc:1275] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:22:51.659226 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.588575 21029 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:22:51.620434 20842 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:51.633127 21056 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.637655 21040 raft_consensus.cc:2749] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:51.593457 21025 consensus_queue.cc:1048] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:22:51.592113 20803 consensus_queue.cc:1059] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:22:51.655901 21027 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:51.633333 20919 raft_consensus.cc:2749] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:22:51.652957 21089 log.cc:927] Time spent T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:22:51.649580 21019 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:51.585875 21013 consensus_queue.cc:1048] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:22:51.653767 20956 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:51.677946 21056 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.690658 20956 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.692735 21056 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:51.693063 20956 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:51.675717 20842 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.694136 21043 consensus_queue.cc:1059] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:22:51.695397 21043 raft_consensus.cc:3055] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:51.679560 21082 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:51.658480 20926 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.695789 21043 raft_consensus.cc:740] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:51.697526 21026 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:51.697180 21043 consensus_queue.cc:260] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:51.697937 20926 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:51.698184 21043 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:51.666859 18646 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:51.634390 20976 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:51.689354 21096 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:51.702087 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:51.660909 19244 rpcz_store.cc:276] 0709 12:22:50.211901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.217459 (+  5558us) service_pool.cc:224] Handling call
0709 12:22:50.245638 (+ 28179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:50.716365 (+470727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.644943 (+928578us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b54004533d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:51.645152 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":947461504}
I20260709 12:22:51.705013 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:51.680686 19240 raft_consensus.cc:1240] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:51.704536 20842 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:51.708370 20968 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:51.713924 21083 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:51.715799 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:51.716542 18605 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:22:51.675841 21073 consensus_queue.cc:1048] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:22:51.682806 20803 consensus_queue.cc:1243] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Peer 2f9872512f1646bc835906bd0e98c6a7 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:22:51.712963 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 46177.5us
I20260709 12:22:51.723344 18646 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:51.720053 18644 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:51.710168 21096 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.728615 21096 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:51.732419 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 67322.3us
I20260709 12:22:51.739295 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:51.741554 18522 raft_consensus.cc:1240] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:22:51.752508 21021 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:51.753638 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:51.731297 21017 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:51.754355 18605 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:51.673980 20988 consensus_queue.cc:237] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.744645 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:51.758056 18524 raft_consensus.cc:2410] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 12:22:51.753571 20900 consensus_meta.cc:287] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.640s	user 0.011s	sys 0.000s
I20260709 12:22:51.725407 20919 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:51.686702 20922 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.755869 20803 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:51.766052 20842 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:51.752511 21100 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.784911 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:51.756313 21026 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:51.754366 21039 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:51.792121 18678 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:51.738027 20811 consensus_queue.cc:1059] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:22:51.787371 20803 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:51.764516 20900 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:51.792002 18605 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
I20260709 12:22:51.766971 21017 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:51.767230 21060 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:51.798149 21092 tablet_copy_client.cc:323] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.130:37079
I20260709 12:22:51.801767 20803 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:51.796054 20962 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:51.803881 20683 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:51.793743 20842 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:51.820269 18523 raft_consensus.cc:2393] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 7: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:51.821687 20842 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:51.822726 20907 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:51.795459 21039 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.829856 21039 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:51.832947 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:51.833891 18524 raft_consensus.cc:2393] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 8: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:51.805078 20952 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.805927 20922 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:51.764408 21088 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:51.845512 20952 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.795152 21100 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.785495 20919 raft_consensus.cc:697] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:51.849167 20919 consensus_queue.cc:237] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.814316 18677 raft_consensus.cc:1240] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:51.815717 20962 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.816720 20900 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:51.817183 20976 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:51.808073 21026 raft_consensus.cc:697] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:51.853282 21026 consensus_queue.cc:237] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:51.810577 20987 consensus_meta.cc:287] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.614s	user 0.011s	sys 0.002s
I20260709 12:22:51.819397 21060 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:51.860351 18603 raft_consensus.cc:3055] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:51.860956 18603 raft_consensus.cc:740] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:22:51.861665 20809 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 7 is higher.
I20260709 12:22:51.863961 21100 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:51.842024 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:51.843092 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:51.865482 18525 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:22:51.849362 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:51.866909 19239 raft_consensus.cc:2393] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
W20260709 12:22:51.856273 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.853914 18521 raft_consensus.cc:1240] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:51.858165 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:51.858460 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:51.870261 20838 consensus_queue.cc:1059] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:51.860456 20815 raft_consensus.cc:3055] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:51.872439 20815 raft_consensus.cc:740] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:51.872797 21056 raft_consensus.cc:3055] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:51.873584 21056 raft_consensus.cc:740] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:51.861693 18603 consensus_queue.cc:260] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:51.873848 18673 raft_consensus.cc:1240] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:51.874312 18603 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:51.874526 21056 consensus_queue.cc:260] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.853820 20962 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:51.841388 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:51.879356 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:51.880034 18675 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:51.858251 20987 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.881356 20841 consensus_queue.cc:1059] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:51.882018 18600 raft_consensus.cc:1240] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:51.883077 20987 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:51.876462 21086 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.884553 18616 tablet_copy_service.cc:140] P c7bd71f1f37c45f28b52c154e59356b9: Received BeginTabletCopySession request for tablet 6ddef1433d2344c9a83050fe07ac225b from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:39798)
I20260709 12:22:51.894490 18616 tablet_copy_service.cc:161] P c7bd71f1f37c45f28b52c154e59356b9: Beginning new tablet copy session on tablet 6ddef1433d2344c9a83050fe07ac225b from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:39798: session id = 8c29c312e4544452b1162d7f81a58cb4-6ddef1433d2344c9a83050fe07ac225b
I20260709 12:22:51.906010 18674 raft_consensus.cc:1240] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:22:51.906821 18675 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:22:51.906605 18572 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:51.872898 20900 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:51.884251 21086 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.922080 18572 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:51.918576 18675 raft_consensus.cc:1240] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:51.931598 18603 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:22:51.932273 18603 pending_rounds.cc:85] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9: Aborting all ops after (but not including) 6
I20260709 12:22:51.937449 18603 pending_rounds.cc:107] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:22:51.937857 18603 raft_consensus.cc:2889] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:51.938236 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.941459 18678 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
I20260709 12:22:51.873781 20815 consensus_queue.cc:260] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:51.943804 19210 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:51.951148 20976 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:51.952584 21072 raft_consensus.cc:2804] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:51.953140 21072 raft_consensus.cc:697] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:51.954039 21072 consensus_queue.cc:237] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:51.951666 20771 consensus_queue.cc:1059] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:22:51.957134 21086 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:51.957695 21042 raft_consensus.cc:3055] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:51.958595 21042 raft_consensus.cc:740] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:22:51.961228 21081 log.cc:927] Time spent T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.681s	user 0.002s	sys 0.000s
I20260709 12:22:51.962231 18616 tablet_copy_source_session.cc:215] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:22:51.965565 21104 log.cc:927] Time spent T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:22:51.965406 20803 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.968098 18530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1416) took 1053 ms. Trace:
I20260709 12:22:51.968518 18530 rpcz_store.cc:276] 0709 12:22:50.914413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.914568 (+   155us) service_pool.cc:224] Handling call
0709 12:22:50.914899 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:50.915252 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:50.915289 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:50.915771 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 12:22:51.672413 (+756642us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b18000aae60. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793d4e07 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793f1c02 00007efc7c07920b 00007efc7c07ed23 00007efc7c07f0d1 00007efc7c49aa0f
0709 12:22:51.756994 (+ 84581us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:51.757044 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.757112 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:51.967719 (+210607us) raft_consensus.cc:1685] finished
0709 12:22:51.967765 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.968014 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":175,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":140,"spinlock_wait_cycles":37935360,"thread_start_us":84369,"threads_started":1,"wal-append.queue_time_us":898681}
I20260709 12:22:51.971364 18605 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:51.981612 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:51.959448 21042 consensus_queue.cc:260] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.005240 21043 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:52.012351 18570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.012308 21043 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.014889 21043 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:52.019838 21100 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:52.020596 21100 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:52.022827 21100 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:51.917419 20900 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:51.951666 20976 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.087345 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:52.113080 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:52.113962 18525 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:52.114293 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:52.115346 18680 raft_consensus.cc:2393] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 7: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:22:52.115882 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:52.116456 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:52.094326 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:52.087404 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:52.086934 18675 raft_consensus.cc:1275] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:52.118031 18523 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:52.100433 21017 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:52.118976 18674 raft_consensus.cc:2393] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 8: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:52.107570 18424 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60812 (request call id 104) took 9192 ms. Trace:
I20260709 12:22:52.037637 18678 raft_consensus.cc:1240] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:52.108279 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:52.120909 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:52.108966 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:52.121505 18680 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:52.123422 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:52.124029 18599 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:52.124735 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:52.124881 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:52.125733 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:52.125888 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:52.126842 18678 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:52.118597 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:52.127573 18675 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:22:52.127847 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:52.085770 21105 log.cc:927] Time spent T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
I20260709 12:22:52.121881 18671 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:22:52.130554 18675 raft_consensus.cc:1240] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:52.130321 18604 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:52.131364 18671 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:52.126343 18603 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:52.089609 20952 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:52.137681 18679 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:22:52.137811 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:52.138094 18679 pending_rounds.cc:85] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting all ops after (but not including) 1
I20260709 12:22:52.138391 18679 pending_rounds.cc:107] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:22:52.138180 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:52.138645 18679 raft_consensus.cc:2889] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:52.138971 18674 raft_consensus.cc:2393] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 4: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:52.140022 21039 consensus_queue.cc:1059] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:52.141137 20975 raft_consensus.cc:3055] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:52.141517 20975 raft_consensus.cc:740] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:52.142295 20975 consensus_queue.cc:260] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.093359 20815 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:52.143612 20975 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:52.144009 18599 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:22:52.151422 20900 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:52.152421 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:52.153117 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:52.154590 18494 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:52.153707 20975 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:52.155812 20683 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:52.156240 20683 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.156245 20975 raft_consensus.cc:697] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:52.156697 20683 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:52.135490 21017 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:52.120042 18424 rpcz_store.cc:276] 0709 12:22:42.914989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.915283 (+   294us) service_pool.cc:224] Handling call
0709 12:22:52.105425 (+9190142us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:49.734360 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:49.889327 (+154967us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:49.889392 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:22:49.889414 (+    22us) tablet.cc:662] Decoding operations
0709 12:22:50.012657 (+123243us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:50.012765 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:50.012809 (+    44us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:22:50.013824 (+  1015us) tablet.cc:701] Row locks acquired
0709 12:22:50.013851 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:22:50.014082 (+   231us) write_op.cc:270] Start()
0709 12:22:50.014232 (+   150us) write_op.cc:276] Timestamp: P: 1783599770013998 usec, L: 0
0709 12:22:50.014262 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:22:50.015170 (+   908us) log.cc:844] Serialized 3628 byte log entry
0709 12:22:50.275688 (+260518us) op_driver.cc:464] REPLICATION: finished
0709 12:22:50.368739 (+ 93051us) write_op.cc:301] APPLY: starting
0709 12:22:50.368854 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:50.369298 (+   444us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:50.395862 (+ 26564us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:50.448561 (+ 52699us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:50.448796 (+   235us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:22:50.448847 (+    51us) write_op.cc:312] APPLY: finished
0709 12:22:50.449159 (+   312us) log.cc:844] Serialized 71 byte log entry
0709 12:22:50.449382 (+   223us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:50.449515 (+   133us) write_op.cc:454] Released schema lock
0709 12:22:50.449564 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:50.449920 (+   356us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:50.449946 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2887908,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":90499,"apply.run_cpu_time_us":4476,"apply.run_wall_time_us":81226,"num_ops":9,"prepare.queue_time_us":313959,"prepare.run_cpu_time_us":8606,"prepare.run_wall_time_us":329422,"raft.queue_time_us":192310,"raft.run_cpu_time_us":32744,"raft.run_wall_time_us":100214,"replication_time_us":238353,"thread_start_us":301346,"threads_started":4,"wal-append.queue_time_us":31740,"wal-append.run_cpu_time_us":76717,"wal-append.run_wall_time_us":1409303}]]}
I20260709 12:22:52.157887 20975 consensus_queue.cc:237] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.120374 20976 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:52.164341 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:52.159711 21017 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:52.164821 20683 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.168548 20803 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:52.168166 18494 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:52.119851 20988 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.172237 21060 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:52.173060 21060 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:52.173480 21060 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:52.172219 20988 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.172580 21042 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:52.176896 20988 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:52.177832 18644 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:52.178939 21013 consensus_queue.cc:1059] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:52.181456 18677 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:52.181329 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:52.189416 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.191850 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:52.192623 18528 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:52.192996 18525 raft_consensus.cc:1275] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:52.195712 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:52.196930 18523 raft_consensus.cc:2393] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 7: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:52.198123 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:52.198837 18605 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:52.199342 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:52.193892 18680 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:22:52.198210 21029 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.204174 20874 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:52.204766 21029 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:52.171839 20683 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:52.207916 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:52.215301 18599 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:52.213552 18530 raft_consensus.cc:1275] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:52.214154 18494 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:52.218519 18528 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
I20260709 12:22:52.194314 20803 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:52.224852 19212 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:52.194927 20900 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:52.247207 20683 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:52.232561 20803 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:52.254185 21045 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:52.220928 20968 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 12:22:52.261477 21119 log.cc:927] Time spent T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 12:22:52.281250 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 67178.6us
I20260709 12:22:52.272138 18598 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:52.224243 20956 consensus_queue.cc:1059] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:22:52.247211 21013 consensus_queue.cc:1048] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:22:52.260720 21103 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:52.253057 20900 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.274017 18600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 1467) took 1064 ms. Trace:
I20260709 12:22:52.260486 21021 consensus_queue.cc:1048] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:22:52.274835 21045 raft_consensus.cc:697] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:52.275158 20683 raft_consensus.cc:697] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:52.305193 20988 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.303339 20907 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:22:52.308313 20919 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:52.346643 20956 consensus_queue.cc:1243] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer a0dee333a83a45f1ab0c1bb6d094afd1 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:22:52.308123 21103 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:52.308563 21095 raft_consensus.cc:3055] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:52.311724 18600 rpcz_store.cc:276] 0709 12:22:51.210008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.212389 (+  2381us) service_pool.cc:224] Handling call
0709 12:22:51.228962 (+ 16573us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.882406 (+653444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.273765 (+391359us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b540015c054. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:52.273953 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1501490048}
I20260709 12:22:52.266562 20803 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:52.345453 21045 consensus_queue.cc:237] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:52.372134 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 70657.8us
W20260709 12:22:52.377138 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 129194us
I20260709 12:22:52.379815 18494 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:52.381242 18494 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:52.396220 20683 consensus_queue.cc:237] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.401393 21103 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:52.374564 21095 raft_consensus.cc:740] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:52.375569 20988 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:52.406176 21027 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:52.406492 20900 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:52.406710 20988 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:52.406764 21027 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.407972 21029 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:52.409137 21027 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:52.386133 21026 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:52.409917 21026 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:52.412226 21026 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:52.392575 20591 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:22:52.420570 21122 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:52.421603 21060 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.422998 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:52.415683 20956 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:52.436514 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:52.393102 20962 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:52.392299 20842 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:52.403020 21095 consensus_queue.cc:260] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.449465 19210 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:52.453728 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:52.453881 21041 raft_consensus.cc:3055] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:52.454743 21041 raft_consensus.cc:740] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:52.457193 20851 raft_consensus.cc:3055] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:52.457733 20851 raft_consensus.cc:740] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:52.461046 21072 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.461673 21072 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:52.458763 20851 consensus_queue.cc:260] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.465219 20851 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:52.467986 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:52.447654 20962 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.447088 21026 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.473115 21026 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.468010 21041 consensus_queue.cc:260] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:52.475307 21026 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:52.472406 20962 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:22:52.450901 20842 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.429675 20988 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.374181 20919 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.454769 19243 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:52.446403 20956 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:52.498114 21060 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:52.499321 21072 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:52.489217 21041 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:52.502213 21121 log.cc:927] Time spent T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:22:52.503894 20842 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:52.509550 20919 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:52.485049 21103 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:52.487528 21095 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:52.488909 20956 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:52.485793 20988 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.521327 20803 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:52.540602 21056 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:52.545374 20976 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.547884 20988 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:52.549469 20956 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.550268 20976 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:52.554770 20803 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:52.551431 20956 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:52.592125 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:52.610766 18523 raft_consensus.cc:1275] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:52.626073 18606 raft_consensus.cc:2368] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10.
W20260709 12:22:52.636644 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 502315us
I20260709 12:22:52.638736 18570 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:52.644335 18644 leader_election.cc:400] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10.
I20260709 12:22:52.645318 18644 leader_election.cc:403] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:22:52.673871 20962 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:52.675937 20842 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.675671 20962 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.678838 20907 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:52.679385 20900 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.680150 21026 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:52.679945 20907 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.680414 20900 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.681185 21026 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.683539 20907 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:52.688043 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:52.697093 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:52.686787 20809 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:52.684106 20811 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:52.699654 21041 consensus_queue.cc:1048] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:22:52.710788 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:52.716922 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:52.697796 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:52.700201 20771 consensus_queue.cc:1059] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:22:52.727131 20811 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:52.729460 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:52.730738 20811 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:52.683501 20900 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:52.676950 20842 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.694985 20818 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:52.825282 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:52.705086 21021 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:52.856160 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 212455us
I20260709 12:22:52.824069 18601 raft_consensus.cc:1275] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:52.689414 21027 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:52.864267 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 67096.9us
W20260709 12:22:52.865918 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 484896us
W20260709 12:22:52.867486 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.868541 18598 raft_consensus.cc:1275] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:52.868077 18427 catalog_manager.cc:5697] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 1 to 3, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 3 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:52.872648 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 234199us
I20260709 12:22:52.873540 20771 raft_consensus.cc:3055] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:22:52.875303 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.876371 21140 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.741402 21026 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:52.876319 21021 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:52.878986 20771 raft_consensus.cc:740] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:52.883924 20962 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:52.885778 18524 raft_consensus.cc:1275] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:52.874436 18494 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:52.887884 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:52.894466 18572 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:52.894833 20771 consensus_queue.cc:260] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.897431 20771 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:52.892364 18427 catalog_manager.cc:5697] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:52.898552 21140 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.899979 18572 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:52.900063 20809 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:52.906497 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.904265 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:52.914650 18600 raft_consensus.cc:2393] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 8: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:52.903786 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:52.916671 20815 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:52.917249 20815 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.917367 19243 raft_consensus.cc:2393] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:22:52.914539 20809 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.917685 20815 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:52.917934 20809 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:52.916700 18598 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:22:52.923161 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:52.913081 21012 consensus_queue.cc:1048] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:22:52.909672 18570 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:52.927867 20962 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.931454 20962 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:52.934306 20962 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:52.936501 20842 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:52.936578 20818 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:52.937453 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:52.938651 21140 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:52.930612 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:52.941850 21095 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:52.939703 21026 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.940667 18644 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:52.988494 18530 raft_consensus.cc:1275] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:22:52.992285 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 82844.6us
I20260709 12:22:53.000222 21026 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:52.988543 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 114726us
I20260709 12:22:52.999364 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:53.009356 20968 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:53.010283 20968 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:53.031464 20956 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:53.032624 20956 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.033143 21095 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.033854 21095 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
W20260709 12:22:53.039958 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 99520.1us
I20260709 12:22:53.041018 21026 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:53.041723 21026 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:53.042089 21026 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:53.042493 21026 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:53.044080 21095 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:53.043973 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:53.045065 21136 consensus_queue.cc:1048] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:53.047021 18570 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:53.005035 20818 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:53.048247 20818 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.043920 18523 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:53.057600 18524 raft_consensus.cc:1240] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:53.088981 18673 raft_consensus.cc:1275] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:53.093880 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:53.081517 21136 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:53.111709 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:53.112857 19244 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:53.124465 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:53.125574 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:53.126430 18598 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:22:53.127394 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:53.130029 20818 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:53.131143 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 50208.4us
I20260709 12:22:53.134701 18603 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:53.118208 20809 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.136705 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:53.139879 18494 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:53.130021 20956 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:53.147184 18602 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:53.138381 20842 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.156983 20842 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.157733 20956 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:53.158347 20956 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:53.158836 20956 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:53.159382 20842 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:53.166412 18605 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:53.172711 18523 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:22:53.173071 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:53.173929 19243 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:53.174146 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:53.174804 18677 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:53.175138 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.175976 18525 raft_consensus.cc:2393] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 7: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:53.182382 19243 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:53.183558 21132 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:53.187143 18677 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:53.189342 21139 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:53.190073 21139 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:53.191210 21021 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:53.193722 21139 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:53.178036 20815 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.193915 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:53.231556 18599 raft_consensus.cc:2368] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7.
I20260709 12:22:53.204607 21139 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:53.203925 21021 consensus_queue.cc:1048] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:22:53.238595 18597 raft_consensus.cc:2393] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 6: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:53.224449 21095 consensus_queue.cc:1059] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:22:53.229176 20811 consensus_queue.cc:1048] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:22:53.253391 21095 raft_consensus.cc:3055] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:53.249847 20968 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:53.269577 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:53.274902 20962 consensus_queue.cc:1048] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:53.275820 18644 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:53.280098 18644 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:53.282106 21140 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:53.282625 21140 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.283103 21140 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:53.282786 20962 consensus_queue.cc:1048] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:53.267987 21095 raft_consensus.cc:740] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:53.279662 18673 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:53.287544 20842 raft_consensus.cc:2804] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:53.292975 20842 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.292343 21095 consensus_queue.cc:260] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.293603 20842 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:53.294366 21095 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:53.260793 21139 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.305650 18644 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:53.298767 20809 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:53.306541 20811 consensus_queue.cc:1059] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:22:53.320379 20811 raft_consensus.cc:3055] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:53.322657 18494 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:53.329169 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:53.330317 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.327617 18644 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:53.332412 18644 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:53.331363 18572 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:53.332213 20962 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:53.322947 20811 raft_consensus.cc:740] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:53.336817 20900 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:53.339457 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:53.341871 20900 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:53.342366 20900 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:53.342289 18680 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:53.332087 21021 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:53.333227 20815 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:53.358045 20998 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:53.358752 20998 raft_consensus.cc:697] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:22:53.359066 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 45182.4us
I20260709 12:22:53.359656 21092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ddef1433d2344c9a83050fe07ac225b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:53.343420 21021 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:53.360641 20771 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:53.362716 21027 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10.
I20260709 12:22:53.400128 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:53.400430 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.399108 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:22:53.403851 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 71506.5us
I20260709 12:22:53.398821 20771 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:53.408814 18521 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:53.407320 21154 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:53.412530 20771 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:53.413415 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.395164 21139 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:53.414372 21136 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:53.407557 20815 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.421630 21027 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:53.369114 20998 consensus_queue.cc:237] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.445871 18644 leader_election.cc:400] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7.
I20260709 12:22:53.444574 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.401964 20949 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 12:22:53.450831 18644 leader_election.cc:403] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:53.427203 20962 raft_consensus.cc:697] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:22:53.461423 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.451197 21027 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:53.447767 21145 log.cc:927] Time spent T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:22:53.447974 21132 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.447611 21153 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:53.434625 20842 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.473258 21157 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:53.474218 21160 raft_consensus.cc:476] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Not starting pre-election -- already a leader
I20260709 12:22:53.427486 20811 consensus_queue.cc:260] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.467905 21027 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:53.446362 20815 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:53.473308 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:53.462761 20771 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.489648 18673 raft_consensus.cc:2410] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 12:22:53.492587 18646 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.728s (SENT) [suppressed 4 similar messages]
I20260709 12:22:53.493026 21021 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:53.493705 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.503536 18599 raft_consensus.cc:1240] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:22:53.512360 18526 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:53.516758 21139 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:53.517732 21158 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.527141 21163 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:53.527521 21158 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.527164 21139 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:53.532536 21139 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:53.526113 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.490784 20900 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.537537 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.494786 21160 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:53.559006 20838 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.560066 20838 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.563783 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:53.567196 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:53.525446 20811 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:53.504405 20771 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.486361 21153 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.534751 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:53.575225 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.503715 21132 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.582057 18530 raft_consensus.cc:2368] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10.
I20260709 12:22:53.595844 21158 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:53.581616 21166 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:53.597060 21166 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:53.601421 21168 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:22:53.605705 18522 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:53.512862 21157 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.609081 20956 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:53.610980 21157 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:53.612454 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:53.613274 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.587736 21140 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.566774 20838 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:53.620075 21164 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:53.622117 21155 log.cc:927] Time spent T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.156s	user 0.001s	sys 0.001s
I20260709 12:22:53.623914 21158 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:53.624375 20771 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:53.611371 20956 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:53.599475 21166 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:53.527680 21163 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.688359 21021 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:53.689114 21021 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:53.693403 21012 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.694031 21012 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:53.691602 21021 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:53.638535 18529 raft_consensus.cc:2393] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:53.639535 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:53.696799 21012 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:53.696678 18526 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:22:53.638989 20900 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:53.638368 20815 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:53.700519 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.702045 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.702087 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.700814 18522 raft_consensus.cc:2368] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10.
I20260709 12:22:53.704766 21139 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.705019 21136 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:53.707155 21139 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.707646 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.635506 18521 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
W20260709 12:22:53.717119 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 149997us
I20260709 12:22:53.724203 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.726927 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.728336 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.729198 18521 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
W20260709 12:22:53.733314 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.714202 20900 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:53.715379 20842 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:53.582381 21160 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.745332 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.730935 18597 raft_consensus.cc:2410] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:22:53.738092 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:53.748564 18601 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:22:53.744889 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:53.749275 18600 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:53.748715 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.580297 20962 consensus_queue.cc:237] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:53.746197 18521 raft_consensus.cc:2368] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7.
I20260709 12:22:53.751601 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:53.758776 18606 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:22:53.758421 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:53.768066 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:53.721158 21158 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.768778 18605 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:22:53.773505 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.777652 18521 raft_consensus.cc:1240] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:53.763224 20842 raft_consensus.cc:2764] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:22:53.730711 21136 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.783735 18524 raft_consensus.cc:1275] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:53.744835 20900 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.740053 18599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:22:53.789947 18599 raft_consensus.cc:606] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:53.790338 18599 raft_consensus.cc:614] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:22:53.795930 21026 consensus_meta.cc:287] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.753s	user 0.015s	sys 0.002s
I20260709 12:22:53.796512 21026 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:53.799057 21026 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:53.800261 18679 raft_consensus.cc:1240] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:53.801222 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:53.792580 20771 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:53.803126 20771 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.805500 20771 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:53.812976 18522 raft_consensus.cc:2410] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:22:53.798817 21140 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:53.815362 21179 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.821839 18600 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:22:53.739370 21164 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.839083 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.789948 20998 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:53.855791 21150 log.cc:927] Time spent T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638: Append to log took a long time: real 0.604s	user 0.006s	sys 0.001s
I20260709 12:22:53.856099 21026 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.856689 21026 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.870899 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.921276 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:53.835829 21168 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7.
W20260709 12:22:53.927652 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.927999 18606 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
W20260709 12:22:53.872951 21095 consensus_meta.cc:287] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.578s	user 0.008s	sys 0.005s
I20260709 12:22:53.926906 18522 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:22:53.884667 21172 consensus_queue.cc:1059] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 12:22:53.887419 21159 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.892521 21140 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:53.885354 20900 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:53.857113 20842 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:53.888855 21152 log.cc:927] Time spent T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.534s	user 0.004s	sys 0.000s
I20260709 12:22:53.891528 21163 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:53.992240 20962 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:53.992558 21160 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:53.943513 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.992868 20962 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:53.994266 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.994947 18521 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:53.994424 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:53.944932 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.884932 21174 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.997440 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.997195 21174 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:53.998174 18523 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:53.999121 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:53.953155 18530 raft_consensus.cc:1240] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:53.884438 21166 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:53.884143 21173 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:53.965087 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.856693 21153 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:53.886101 21139 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:53.974346 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.978017 18605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:22:54.009934 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:54.010279 18605 raft_consensus.cc:606] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:54.010833 18605 raft_consensus.cc:614] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:53.983587 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.983839 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:53.984371 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.973793 18529 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:22:54.012434 18525 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:54.015882 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:22:54.016759 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.987462 21136 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:53.990180 18644 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:54.001245 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:53.990968 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:53.986565 20842 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.018913 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.016544 18604 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:54.019570 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:53.947834 20998 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.001245 21167 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.027122 18522 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:54.027983 18524 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 6.
I20260709 12:22:54.028137 20874 consensus_queue.cc:1059] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:22:54.028455 18599 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4.
I20260709 12:22:54.029587 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:54.034102 18600 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:22:53.854368 21179 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:54.034744 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 78839.3us
I20260709 12:22:53.974270 21140 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.039178 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:54.039800 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 49697.5us
I20260709 12:22:54.021319 21132 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:54.038905 18572 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:54.041859 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:54.045765 18673 raft_consensus.cc:2368] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8.
I20260709 12:22:54.041954 18644 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:53.973404 21159 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:54.046828 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.047675 18530 raft_consensus.cc:2410] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:22:54.048357 18606 raft_consensus.cc:1275] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:54.032202 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:54.007926 21166 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.050859 18570 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:54.043911 21163 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:54.059610 21164 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:54.061640 20998 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:54.063052 21176 raft_consensus.cc:3055] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:54.063508 21176 raft_consensus.cc:740] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:54.064045 21179 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:54.064616 21188 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:54.064494 21176 consensus_queue.cc:260] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.065415 21158 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:54.065871 21176 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:54.066958 21026 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:54.068737 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:54.069273 18530 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:54.070827 18679 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
W20260709 12:22:54.055611 21027 consensus_meta.cc:287] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.003s
I20260709 12:22:54.074724 18572 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:54.077209 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:54.067477 21163 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.074349 21172 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:54.089845 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.074716 21188 raft_consensus.cc:697] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:54.038329 21167 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.092199 18529 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:54.094247 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:54.094556 21166 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:54.102521 18604 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:22:54.036417 21173 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.089906 21163 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:54.112046 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:54.113884 20818 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:54.118472 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.092778 21172 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:54.119906 20818 raft_consensus.cc:697] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:54.121766 21188 consensus_queue.cc:237] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:54.122089 20818 consensus_queue.cc:237] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.123869 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.124233 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.125075 18529 raft_consensus.cc:2393] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 6: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:54.126207 19210 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:54.127377 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 72115.9us
I20260709 12:22:54.078841 21027 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:54.128260 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 72671.5us
I20260709 12:22:54.134498 18530 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:22:54.136209 19212 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:54.141625 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:54.142661 18530 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:54.128473 21172 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:54.144049 21189 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:54.131480 21012 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:54.157508 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 105905us
I20260709 12:22:54.158471 18644 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:54.161649 18644 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:54.161238 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.172098 21186 raft_consensus.cc:2804] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:54.178942 20842 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:54.146548 21021 raft_consensus.cc:2804] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:54.179979 21021 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.180428 21021 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:54.180994 21159 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:54.183225 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.184128 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:54.184653 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.185534 18525 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:22:54.187002 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:54.163910 21189 raft_consensus.cc:697] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:54.188665 21189 consensus_queue.cc:237] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.189677 21027 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:54.192399 21173 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:54.192850 20949 raft_consensus.cc:3055] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:54.193410 20949 raft_consensus.cc:740] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:54.194636 21140 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:54.195098 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.194510 20949 consensus_queue.cc:260] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:54.195873 18527 raft_consensus.cc:2393] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:54.200316 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:54.201063 18673 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:54.180001 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:54.202220 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:54.202345 18679 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:54.203397 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:54.183534 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.206007 18528 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:54.206509 18675 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
W20260709 12:22:54.212913 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 138310us
W20260709 12:22:54.213637 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 48266.9us
I20260709 12:22:54.204073 18678 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:54.215471 18644 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:54.220397 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:54.222286 18529 raft_consensus.cc:2368] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10.
I20260709 12:22:54.227147 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.228789 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.194528 21167 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:54.220291 20874 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:54.215716 21186 raft_consensus.cc:697] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:22:54.246605 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 168689us
I20260709 12:22:54.238962 18572 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:54.245946 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:54.241365 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 80477.7us
I20260709 12:22:54.249136 18603 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:54.249790 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.245150 18530 raft_consensus.cc:2410] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:22:54.238994 20842 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:54.248389 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:54.253173 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:54.257272 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.257776 18527 raft_consensus.cc:2368] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10.
I20260709 12:22:54.262444 18598 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:54.260064 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:54.265146 18603 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:22:54.273475 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:54.272258 18644 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:54.276585 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:54.283478 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.284168 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:54.273331 20842 raft_consensus.cc:697] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:54.303277 18671 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:54.284966 21186 consensus_queue.cc:237] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.303973 20842 consensus_queue.cc:237] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.305114 21174 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:54.267700 21026 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.305938 21026 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.285234 21163 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.311872 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.288810 18570 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:54.289368 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 50500.9us
I20260709 12:22:54.289950 21168 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:54.315006 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:54.294720 19244 raft_consensus.cc:1275] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:54.294548 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:54.295235 18644 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:54.295832 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:54.298827 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:54.299734 20818 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:54.299865 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:54.248474 20874 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:54.307525 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.289635 21188 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:54.315785 18604 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:54.316764 18528 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:22:54.318791 18677 raft_consensus.cc:2410] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:22:54.320338 18679 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 5.
I20260709 12:22:54.324780 18673 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
I20260709 12:22:54.330417 18674 raft_consensus.cc:2393] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 6: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:54.330526 20818 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.340899 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.333058 20874 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:54.334610 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:54.343472 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 54748.6us
I20260709 12:22:54.334762 21163 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:54.335619 19239 raft_consensus.cc:2410] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:22:54.335955 21136 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:54.336863 20949 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:54.330919 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:54.372658 18572 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:54.376745 18570 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:54.377434 21203 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:54.379323 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:54.380740 18526 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:54.381944 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:54.382675 18606 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:22:54.341168 21188 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:54.379204 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 84898.4us
I20260709 12:22:54.386129 21203 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.388129 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.343082 21199 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.389941 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:54.390693 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:54.392738 20962 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:54.393926 18604 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:54.394366 21026 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:54.395536 21092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:33388 (request call id 357) took 3045 ms. Trace:
I20260709 12:22:54.391638 21139 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:54.391520 20811 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:54.341657 21193 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:54.403316 18601 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:22:54.391968 20838 consensus_queue.cc:1059] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:22:54.407701 18606 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:54.406111 21199 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.403260 21203 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:54.401613 21188 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:54.474083 18526 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:54.441200 18674 raft_consensus.cc:1240] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:54.408562 21092 rpcz_store.cc:276] 0709 12:22:51.360524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.363649 (+  3125us) service_pool.cc:224] Handling call
0709 12:22:51.638129 (+274480us) ts_tablet_manager.cc:934] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
0709 12:22:53.357864 (+1719735us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:22:54.056538 (+698674us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:54.074028 (+ 17490us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:22:54.376132 (+302104us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:22:54.394975 (+ 18843us) tablet_replica.cc:206] Creating consensus instance
0709 12:22:54.395306 (+   331us) ts_tablet_manager.cc:989] Replica registered.
0709 12:22:54.395409 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":35463,"tablet-copy.queue_time_us":183834,"thread_start_us":134398,"threads_started":2}
W20260709 12:22:54.446808 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.446655 21172 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.448307 20818 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:54.453373 18672 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:22:54.455807 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:54.483078 18604 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:54.458385 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.456079 21139 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.466926 21199 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:54.498148 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 117714us
I20260709 12:22:54.492481 21139 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:54.464351 21193 raft_consensus.cc:697] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:54.510674 18676 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:54.514071 18572 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:54.517797 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:54.518458 18601 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:54.520157 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:54.520890 18606 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:54.496995 21021 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:54.524296 20811 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:54.524757 20811 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:54.525136 20811 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:54.525931 21139 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:54.528352 21139 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:54.530815 18604 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:22:54.534096 19210 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:54.505060 21092 tablet_copy_client.cc:806] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:54.536288 21092 tablet_copy_client.cc:670] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:54.536648 21194 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:54.537110 21194 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:54.537459 21194 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:54.542776 21193 consensus_queue.cc:237] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.547152 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:54.548089 19239 raft_consensus.cc:2393] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:22:54.553870 18644 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:54.555708 18644 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:54.559274 18644 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:54.563295 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:54.552197 21194 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:54.559902 20842 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:54.569700 21163 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:54.603147 21163 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.603602 21163 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:54.570158 20998 raft_consensus.cc:3055] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:54.570336 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:54.570855 21185 raft_consensus.cc:2804] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:54.573082 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:54.615263 18528 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:54.576328 18644 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:54.576822 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 194190us
I20260709 12:22:54.576862 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:54.544152 21203 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.616274 18644 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:54.580382 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.596146 18672 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:54.598465 21021 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:54.599903 20842 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:54.600554 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.601260 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.613152 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:54.615046 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:54.618575 18644 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:54.618045 18601 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:22:54.619091 18521 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:54.617048 18604 raft_consensus.cc:2410] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:22:54.616503 18570 leader_election.cc:400] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8.
I20260709 12:22:54.620620 18570 leader_election.cc:403] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:54.573720 21172 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:54.619999 18644 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:54.647531 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:54.614379 20998 raft_consensus.cc:740] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:54.615072 21185 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.651543 18644 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:54.626173 21174 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:54.625005 21026 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:54.620785 20962 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:54.666651 18528 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:22:54.672539 18679 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:54.676879 18524 raft_consensus.cc:2393] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 6: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:54.625382 20842 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:54.657017 21176 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:54.664090 21174 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:54.681850 21174 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:54.661808 21185 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:54.685186 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:54.684424 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:54.688071 18677 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:22:54.688295 18674 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:54.623519 20811 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.667542 21167 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:54.705520 18521 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:54.706954 19212 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:54.684211 21199 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8.
I20260709 12:22:54.711984 20962 raft_consensus.cc:697] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:54.712531 20900 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.652442 20998 consensus_queue.cc:260] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:54.667955 21026 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.762310 21026 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:54.762506 20900 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:54.692101 21208 log.cc:927] Time spent T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 12:22:54.733956 18672 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:22:54.676532 21172 consensus_queue.cc:1048] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:22:54.684767 21176 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:54.756233 21192 raft_consensus.cc:2804] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:54.766507 20811 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:54.786114 21194 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:54.785593 21192 raft_consensus.cc:697] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 8 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:54.772785 18674 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
W20260709 12:22:54.774235 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 157931us
I20260709 12:22:54.787354 21163 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.792562 21163 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:54.765285 20998 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:54.805856 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 185088us
I20260709 12:22:54.809963 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:54.812749 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:54.788445 21176 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:54.814965 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.694595 21188 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.817950 18604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:22:54.820318 18604 raft_consensus.cc:606] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:54.820701 18604 raft_consensus.cc:614] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:54.830929 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:54.804328 21185 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.836717 18522 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:54.837906 21185 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:54.841164 21174 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.841481 18570 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:54.843127 18570 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:54.843961 21220 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:54.846964 18570 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:54.848259 20818 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:54.848694 20818 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:54.849110 20818 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:54.849815 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:54.851898 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:54.854251 20962 consensus_queue.cc:237] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.856113 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:54.857455 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:54.843461 21174 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:54.858932 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:54.868639 18674 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:54.868755 18673 raft_consensus.cc:1275] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:54.875298 18570 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:54.876312 21219 raft_consensus.cc:2804] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:54.880308 21219 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.880692 21219 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:54.880774 18671 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:22:54.881363 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:54.882009 18680 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:54.882977 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:54.883711 18675 raft_consensus.cc:2368] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7.
I20260709 12:22:54.845988 21220 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.890756 19210 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:54.893325 18597 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:54.818265 21192 consensus_queue.cc:237] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:54.893015 21026 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:54.902225 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:54.902487 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:54.919802 18676 raft_consensus.cc:1240] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:54.924360 18602 raft_consensus.cc:2393] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 8: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:54.919548 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:54.926316 19243 raft_consensus.cc:1240] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:54.902896 21194 raft_consensus.cc:2804] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:54.930469 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:54.902352 21139 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:55.021742 18599 raft_consensus.cc:2368] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5.
I20260709 12:22:54.930154 18600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:22:55.024814 18600 raft_consensus.cc:606] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:54.928341 18674 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
W20260709 12:22:54.976748 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 101585us
I20260709 12:22:54.928339 18604 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:54.999200 18597 raft_consensus.cc:1275] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:54.898994 21167 raft_consensus.cc:697] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:22:55.019556 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 73336.2us
I20260709 12:22:54.898435 21220 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:54.976181 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:54.947687 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:54.956646 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:54.884151 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:55.031729 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:54.903155 18606 raft_consensus.cc:1240] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 8. Ops: [6.4-6.4]
I20260709 12:22:55.036921 18605 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:55.032222 18527 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:55.038378 19210 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:55.040679 18597 raft_consensus.cc:2393] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 6: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:55.041774 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:54.858023 20818 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:55.002487 21188 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:55.043337 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:55.048604 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:55.050534 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:55.052313 20818 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:55.053179 21073 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:55.041515 19210 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:55.051468 18675 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:22:55.023576 21139 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:55.024233 21194 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:55.044603 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:55.073258 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:55.086428 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 44994.1us
I20260709 12:22:55.086632 21189 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.087386 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:55.088040 19241 raft_consensus.cc:1275] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:55.088250 18570 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:55.087190 21189 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:55.089303 21207 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:55.089460 18570 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:55.089622 21215 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:55.089780 21207 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.090262 21207 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:55.090490 21189 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:55.093053 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:55.093679 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:55.090615 18570 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:55.093871 18599 raft_consensus.cc:2368] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7.
I20260709 12:22:55.094290 18605 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:55.101963 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:55.103092 18674 raft_consensus.cc:2368] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7.
I20260709 12:22:55.110927 18644 leader_election.cc:400] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7.
I20260709 12:22:55.111347 18644 leader_election.cc:403] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:22:55.036314 21176 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:55.068027 21139 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:55.115145 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:55.090435 21215 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:55.114462 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 53874.8us
I20260709 12:22:55.075958 21194 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:55.042172 21219 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:55.118644 18604 raft_consensus.cc:1275] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:55.120014 18678 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:22:55.120116 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:55.118208 21223 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:55.094215 21167 consensus_queue.cc:237] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:55.130116 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:55.121659 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:55.111734 20811 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:55.126147 20818 consensus_queue.cc:1048] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:22:55.133265 21219 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:55.130002 20962 consensus_queue.cc:1048] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:22:55.134030 18597 raft_consensus.cc:2368] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7.
I20260709 12:22:55.127449 18674 raft_consensus.cc:2393] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 6: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:55.131229 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:55.134961 21021 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:55.135104 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:55.135970 21230 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:55.136261 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:55.136832 18674 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:55.137444 18606 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:55.140100 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:55.140853 21186 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:55.145040 21176 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:55.124384 18570 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:55.146654 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:55.147274 18675 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:22:55.133877 19242 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:22:55.149080 20818 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:55.149639 18675 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:22:55.154412 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:55.168443 18671 raft_consensus.cc:2393] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 7: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:55.155205 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:55.158486 21139 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:55.161167 21194 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:55.162225 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:55.162966 18572 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:55.164433 18529 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:22:55.165398 18603 raft_consensus.cc:1240] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:55.188553 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:55.165668 18673 raft_consensus.cc:1275] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:22:55.166589 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:55.065136 20842 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:55.180622 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:55.169713 18675 raft_consensus.cc:1275] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:55.190836 18673 pending_rounds.cc:85] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting all ops after (but not including) 4
I20260709 12:22:55.191424 18606 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:55.201642 18605 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:22:55.206017 19243 raft_consensus.cc:1240] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:55.207588 18674 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:55.208873 18523 raft_consensus.cc:1275] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:55.113842 21012 consensus_queue.cc:1048] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:22:55.191891 18673 pending_rounds.cc:107] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:22:55.214551 18673 raft_consensus.cc:2889] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:55.215407 18600 raft_consensus.cc:1240] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:55.216780 18525 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:22:55.218745 18672 raft_consensus.cc:1240] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: []
W20260709 12:22:55.220158 21224 log.cc:927] Time spent T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:22:55.224750 18606 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:22:55.227766 21026 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:55.203629 21189 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:55.230026 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:55.229050 21189 raft_consensus.cc:697] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:55.232523 18572 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:22:55.240495 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 110882us
I20260709 12:22:55.241412 21199 raft_consensus.cc:2764] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:22:55.243046 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:55.243644 18673 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:55.244704 21199 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:55.248183 21199 consensus_queue.cc:1048] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:55.248608 21203 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:55.241524 21194 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:55.249931 21092 tablet_copy_client.cc:538] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:22:55.250866 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 132241us
I20260709 12:22:55.252669 18673 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4.
I20260709 12:22:55.253222 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:55.253521 18603 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:55.253906 18525 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:22:55.256383 18527 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:22:55.256707 18606 raft_consensus.cc:1275] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:55.262302 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:55.263540 18494 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:55.264003 18572 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:55.264032 18606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:22:55.265640 18606 raft_consensus.cc:606] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:55.258010 21223 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7.
I20260709 12:22:55.243499 21189 consensus_queue.cc:237] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:55.266592 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:55.282971 21213 raft_consensus.cc:993] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:22:55.283535 21213 raft_consensus.cc:1081] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:22:55.271183 21186 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:22:55.268651 21188 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:55.289834 21188 raft_consensus.cc:697] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:22:55.293376 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.261795 21219 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:22:55.277987 20842 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:55.295590 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:55.296679 18646 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:55.300470 18603 raft_consensus.cc:2368] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7.
I20260709 12:22:55.303833 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:55.304291 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:55.301651 19210 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:55.308939 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:55.310109 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:55.311337 20900 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:55.314209 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:55.318209 18646 leader_election.cc:400] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7.
I20260709 12:22:55.294932 21207 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:55.303000 21221 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:55.291052 21188 consensus_queue.cc:237] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:55.340090 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:55.344265 18570 leader_election.cc:400] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7.
I20260709 12:22:55.348064 18570 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:55.319823 20962 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:55.339972 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:55.351496 18606 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:22:55.352512 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:55.355227 18570 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:55.357118 18570 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:55.358996 18678 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:22:55.329708 21235 raft_consensus.cc:2804] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:55.349123 18521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:22:55.368589 18521 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:55.368993 18521 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:55.350659 21221 raft_consensus.cc:697] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:55.388903 19241 raft_consensus.cc:2368] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:22:55.393330 21221 consensus_queue.cc:237] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:55.361819 20838 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:55.396304 20838 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:55.400242 20900 consensus_queue.cc:1048] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:55.403643 21207 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:55.405073 21231 log.cc:927] Time spent T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:22:55.417860 18646 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:55.424791 18646 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:55.464143 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:55.465243 18680 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:55.464018 18521 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:55.478039 18521 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:55.481909 18680 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 5.
W20260709 12:22:55.484305 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 127253us
I20260709 12:22:55.488966 18570 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:55.489557 18646 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:55.492081 19210 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:55.475399 20818 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:55.473661 20900 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:55.475473 20842 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.505852 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:55.488256 20962 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:55.511531 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 161698us
I20260709 12:22:55.495942 21219 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:55.500888 21186 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:55.501922 20771 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:22:55.523978 18646 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:55.515352 21235 raft_consensus.cc:697] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 4 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
W20260709 12:22:55.528007 21236 log.cc:927] Time spent T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 12:22:55.528189 21247 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:55.528273 19212 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:55.520581 21073 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:55.514379 20842 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:55.565047 21220 consensus_meta.cc:287] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.002s
I20260709 12:22:55.565503 21139 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:55.566046 20842 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:55.532850 18644 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:55.567451 21235 consensus_queue.cc:237] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:55.568681 18644 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:55.533692 20818 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:55.516642 21230 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:55.569559 18644 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:55.570011 21230 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:55.570945 21167 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:55.571224 18644 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:55.518383 21219 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.551095 20900 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:55.563848 21192 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:55.571676 21026 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:55.572350 20842 raft_consensus.cc:2764] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:22:55.562740 21092 tablet_bootstrap.cc:492] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:22:55.569554 20818 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:55.572785 21230 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:55.580586 21073 raft_consensus.cc:697] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:22:55.541133 18646 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:55.557750 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 294306us
W20260709 12:22:55.574055 21234 log.cc:927] Time spent T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.371s	user 0.003s	sys 0.000s
I20260709 12:22:55.574301 18525 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:22:55.604261 18572 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:55.618438 18494 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:55.619990 18494 leader_election.cc:400] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7.
I20260709 12:22:55.620337 18494 leader_election.cc:403] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:55.621117 21232 consensus_queue.cc:1048] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:55.621244 21221 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:55.623222 21232 raft_consensus.cc:2764] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:22:55.628728 18529 raft_consensus.cc:1275] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:55.576855 21219 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:55.623358 21230 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7.
I20260709 12:22:55.617311 21026 raft_consensus.cc:697] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:55.565513 21220 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:55.627790 18494 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:55.574443 21247 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:55.576581 21203 consensus_queue.cc:1048] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
W20260709 12:22:55.640232 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 99158.2us
W20260709 12:22:55.665618 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 87957.2us
I20260709 12:22:55.640305 20962 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:55.641798 20900 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:55.641330 21073 consensus_queue.cc:237] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:55.669152 21230 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:55.672279 21230 raft_consensus.cc:697] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:55.632970 20838 consensus_queue.cc:1048] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:22:55.643222 21246 consensus_queue.cc:1048] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:55.666764 18494 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:22:55.676743 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 72612.6us
I20260709 12:22:55.668956 20900 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.678387 18602 raft_consensus.cc:1240] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7. Ops: []
W20260709 12:22:55.720292 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 149127us
I20260709 12:22:55.681666 18646 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:55.720167 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:55.716034 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 49294.6us
I20260709 12:22:55.651952 21167 raft_consensus.cc:697] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:55.679580 21221 raft_consensus.cc:2764] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:22:55.680892 20900 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:55.688024 21139 raft_consensus.cc:2804] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:55.691529 21247 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:55.729401 20962 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:55.693156 21232 consensus_queue.cc:1059] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
W20260709 12:22:55.753852 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 73078.2us
I20260709 12:22:55.759270 18646 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:55.765549 21167 consensus_queue.cc:237] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:55.721277 21255 consensus_queue.cc:1059] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:22:55.817502 21255 consensus_queue.cc:1243] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer a0dee333a83a45f1ab0c1bb6d094afd1 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:22:55.818068 21255 raft_consensus.cc:3055] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:55.818377 21255 raft_consensus.cc:740] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:55.782452 21260 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:55.823464 21263 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.824092 21263 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:55.748886 21026 consensus_queue.cc:237] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:55.826604 21263 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:55.790935 21220 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:55.691156 21230 consensus_queue.cc:237] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:55.792532 18646 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:55.803704 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 87007.9us
I20260709 12:22:55.806456 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:55.780169 21221 consensus_queue.cc:1059] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:22:55.774078 21254 consensus_queue.cc:1048] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:55.775209 21199 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.813779 21232 raft_consensus.cc:3055] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:55.839798 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:22:55.843211 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 50881.1us
I20260709 12:22:55.850991 18679 raft_consensus.cc:1240] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:55.854293 18646 leader_election.cc:400] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10.
I20260709 12:22:55.855029 21221 raft_consensus.cc:3055] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:55.851102 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:55.857968 18597 raft_consensus.cc:3055] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:55.858320 18597 raft_consensus.cc:740] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:55.855453 21221 raft_consensus.cc:740] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:55.859230 18646 leader_election.cc:400] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10.
I20260709 12:22:55.819252 21255 consensus_queue.cc:260] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:55.864866 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:55.866358 18680 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:55.871007 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:55.924500 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:55.846014 18426 catalog_manager.cc:5697] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 5 to 7, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 7 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:55.845816 20962 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:55.944674 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 197154us
I20260709 12:22:55.944859 18672 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:22:55.866009 18597 consensus_queue.cc:260] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:55.945818 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.946205 18426 catalog_manager.cc:5697] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 5 to 7, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 7 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:55.843948 21139 raft_consensus.cc:697] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:55.966055 18680 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
W20260709 12:22:55.972007 18427 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47728 (request call id 208) took 20778 ms (client timeout 15000 ms). Trace:
I20260709 12:22:55.973287 21255 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:55.856730 21232 raft_consensus.cc:740] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:55.954061 18426 catalog_manager.cc:5697] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:55.980013 18674 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:22:55.974994 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:55.986593 18676 raft_consensus.cc:2393] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 7: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:55.842885 20818 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:55.985801 18426 catalog_manager.cc:5697] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
W20260709 12:22:55.991919 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 135602us
I20260709 12:22:55.998594 18646 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:56.004779 18680 raft_consensus.cc:1240] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:55.994446 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:55.996752 18426 catalog_manager.cc:5697] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 2 to 3, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 3 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:56.007563 18679 raft_consensus.cc:2393] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 6: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:55.861043 21199 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:56.015355 20962 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:56.026328 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:56.029642 21232 consensus_queue.cc:260] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:56.010130 18426 catalog_manager.cc:5697] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 2 to 4, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 4 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:56.023605 18646 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:56.037494 18426 catalog_manager.cc:5697] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 4 to 5, leader changed from 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 5 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:22:56.040273 18426 catalog_manager.cc:5697] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 1 to 7, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 7 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:56.042497 18426 catalog_manager.cc:5697] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:55.953646 21139 consensus_queue.cc:237] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:56.051218 21167 raft_consensus.cc:2764] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
W20260709 12:22:56.114230 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 101288us
I20260709 12:22:56.115459 18494 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:56.115310 18646 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:56.118808 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:56.119544 18646 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:55.972553 18427 rpcz_store.cc:269] 0709 12:22:35.175416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.175654 (+   238us) service_pool.cc:224] Handling call
0709 12:22:55.953960 (+20778306us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:53.028677 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:53.029625 (+   948us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:53.029691 (+    66us) write_op.cc:435] Acquired schema lock
0709 12:22:53.029739 (+    48us) tablet.cc:662] Decoding operations
0709 12:22:53.030343 (+   604us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:53.030472 (+   129us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:53.030515 (+    43us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:22:53.031332 (+   817us) tablet.cc:701] Row locks acquired
0709 12:22:53.031402 (+    70us) write_op.cc:260] PREPARE: finished
0709 12:22:53.031623 (+   221us) write_op.cc:270] Start()
0709 12:22:53.031843 (+   220us) write_op.cc:276] Timestamp: P: 1783599773031543 usec, L: 0
0709 12:22:53.031874 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:22:53.071813 (+ 39939us) log.cc:844] Serialized 935 byte log entry
0709 12:22:53.760015 (+688202us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:22:54.091281 (+331266us) op_driver.cc:464] REPLICATION: finished
0709 12:22:54.328972 (+237691us) write_op.cc:301] APPLY: starting
0709 12:22:54.340851 (+ 11879us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:54.381802 (+ 40951us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:54.388676 (+  6874us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:54.389152 (+   476us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:54.389418 (+   266us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:22:54.389462 (+    44us) write_op.cc:312] APPLY: finished
0709 12:22:54.389756 (+   294us) log.cc:844] Serialized 29 byte log entry
0709 12:22:54.390001 (+   245us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:54.390106 (+   105us) write_op.cc:454] Released schema lock
0709 12:22:54.390162 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:54.390588 (+   426us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:54.390618 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1120934,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":186318,"apply.run_cpu_time_us":2520,"apply.run_wall_time_us":79196,"num_ops":2,"prepare.queue_time_us":92930,"prepare.run_cpu_time_us":8048,"prepare.run_wall_time_us":57624,"raft.queue_time_us":180232,"raft.run_cpu_time_us":58938,"raft.run_wall_time_us":130659,"replication_time_us":1051729,"spinlock_wait_cycles":3886464,"thread_start_us":301646,"threads_started":4,"wal-append.queue_time_us":126741,"wal-append.run_cpu_time_us":26512,"wal-append.run_wall_time_us":2188602}]]}
I20260709 12:22:56.049098 21219 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:56.110412 21021 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:56.116834 18426 catalog_manager.cc:5697] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 4 to 7, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 7 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:56.133517 21270 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.133968 21263 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:56.176746 18570 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:56.139938 21167 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:56.181536 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 66193.8us
I20260709 12:22:56.056540 21221 consensus_queue.cc:260] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:56.184207 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:56.184913 18603 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:56.172930 21021 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:56.190711 18494 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:56.174440 21247 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:56.185050 20815 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:56.209437 18603 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 5.
I20260709 12:22:56.216892 20900 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:56.192291 21247 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:56.224440 21280 log.cc:927] Time spent T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:22:56.180522 21270 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:56.265476 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:56.267547 18679 raft_consensus.cc:1275] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:56.225507 20818 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:56.276201 18526 raft_consensus.cc:3055] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:56.502843 18526 raft_consensus.cc:740] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:56.307322 21286 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.503613 21286 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:56.503718 18526 consensus_queue.cc:260] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:56.504709 21247 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:56.269299 21188 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:56.514181 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.259980 21260 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.461365 21268 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:56.492591 18673 raft_consensus.cc:1240] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:22:56.494098 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 217459us
W20260709 12:22:56.488862 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 298200us
I20260709 12:22:56.483374 21219 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:56.500770 21186 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:56.504820 18526 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:56.483047 21203 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:56.618925 21199 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:56.619364 21203 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:56.619021 21186 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:56.599869 21021 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:56.502702 21270 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:56.607000 21188 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:56.596419 21286 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:56.595707 21275 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:56.503638 20900 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:56.620285 21285 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:56.629043 18494 leader_election.cc:400] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5.
I20260709 12:22:56.642477 18494 leader_election.cc:403] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:22:56.621831 21203 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:56.629959 18570 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:56.648993 18677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.018s	sys 0.016s
I20260709 12:22:56.637250 20815 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:56.649561 18526 raft_consensus.cc:1275] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:22:56.651109 21247 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:22:56.651366 18677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.019s	sys 0.016s
W20260709 12:22:56.652741 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 378515us
W20260709 12:22:56.651044 21230 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.002s	sys 0.033s
I20260709 12:22:56.638134 20998 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
W20260709 12:22:56.651046 21255 consensus_meta.cc:287] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.677s	user 0.017s	sys 0.000s
I20260709 12:22:56.639842 21268 consensus_queue.cc:1048] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:22:56.644160 21285 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:56.654518 21192 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:56.681677 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 52779.8us
I20260709 12:22:56.661904 20949 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:56.686627 21241 log.cc:927] Time spent T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 1.165s	user 0.011s	sys 0.000s
I20260709 12:22:56.643327 21297 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
W20260709 12:22:56.678436 21230 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.002s	sys 0.033s
I20260709 12:22:56.640093 21260 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:56.659690 21275 raft_consensus.cc:2749] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5.
I20260709 12:22:56.679247 21286 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:56.659125 20815 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:56.714318 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 67900.4us
I20260709 12:22:56.715538 18494 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:56.717392 18527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1818) took 1457 ms. Trace:
I20260709 12:22:56.717810 18527 rpcz_store.cc:276] 0709 12:22:55.259675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.261306 (+  1631us) service_pool.cc:224] Handling call
0709 12:22:55.262020 (+   714us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:55.262402 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:55.262436 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:55.271849 (+  9413us) log.cc:844] Serialized 26 byte log entry
0709 12:22:55.385142 (+113293us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:55.385188 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.385269 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:56.656216 (+1270947us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:22:56.717073 (+ 60857us) raft_consensus.cc:1685] finished
0709 12:22:56.717095 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.717313 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25284,"raft.queue_time_us":2023,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":2451,"spinlock_wait_cycles":2301824,"thread_start_us":76582,"threads_started":1,"wal-append.queue_time_us":194002}
I20260709 12:22:56.720324 20771 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:56.725060 20771 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:56.727263 20771 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:56.729174 18675 raft_consensus.cc:1275] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:56.732685 21188 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:56.700325 21186 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:56.693375 21192 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:56.735625 18679 raft_consensus.cc:1275] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:22:56.695429 20949 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:56.749775 18602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 1503) took 1821 ms. Trace:
I20260709 12:22:56.719858 21275 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:56.742256 18494 leader_election.cc:400] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7.
I20260709 12:22:56.759572 18494 leader_election.cc:403] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:56.759709 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:56.752820 18600 raft_consensus.cc:1275] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:56.757076 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:56.761230 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:56.761778 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:56.750259 18602 rpcz_store.cc:276] 0709 12:22:54.927992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.929228 (+  1236us) service_pool.cc:224] Handling call
0709 12:22:54.948564 (+ 19336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:55.682253 (+733689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.749523 (+1067270us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54002233d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:56.749702 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1677980032}
I20260709 12:22:56.762395 18679 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:56.722652 21199 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.764755 18494 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:56.766711 18494 leader_election.cc:400] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7.
I20260709 12:22:56.769315 18604 raft_consensus.cc:1275] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:56.769760 18494 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:56.772209 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:56.756238 21188 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:22:56.785034 21294 log.cc:927] Time spent T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:22:56.785458 21188 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:56.786351 21199 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:56.785897 21021 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:56.788594 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:56.706022 21286 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:56.794075 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:56.796291 18603 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:56.741487 21229 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:56.783814 21230 consensus_queue.cc:1059] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:22:56.802465 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:56.792078 21283 consensus_queue.cc:1059] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:22:56.795542 21275 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:56.836575 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 102189us
I20260709 12:22:56.791949 21255 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:56.809161 21260 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:56.796016 21268 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:22:56.789041 21297 raft_consensus.cc:2749] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:56.809880 21286 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:56.811705 20949 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:56.811940 21232 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:56.787925 21296 consensus_queue.cc:1048] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:22:56.816023 21188 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:56.817747 21301 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.820546 18603 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:22:56.867641 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:56.821501 21270 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:56.823122 18529 raft_consensus.cc:1275] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:22:56.827672 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.832934 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:56.806771 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:56.839035 18572 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:56.837785 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:56.743248 21136 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.087s
W20260709 12:22:56.853384 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 57470.1us
I20260709 12:22:56.855461 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:56.862424 18644 leader_election.cc:400] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Vote denied by peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879) with higher term. Message: Invalid argument: T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:22:56.869704 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:56.879281 18530 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:56.852906 21021 consensus_queue.cc:1048] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:22:56.853130 21235 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:56.881250 18494 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:56.886240 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:56.885058 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:56.866072 21199 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:56.888959 18494 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:56.865451 21262 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:56.888144 21230 consensus_queue.cc:1059] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:22:56.891199 21267 raft_consensus.cc:2749] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:56.888468 21283 raft_consensus.cc:2749] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:56.889070 18680 raft_consensus.cc:2393] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 5: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:56.867564 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:56.897583 18673 raft_consensus.cc:1275] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:56.897785 18494 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:56.903625 18494 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:56.903718 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:56.900154 18644 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:56.898216 21297 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:56.906559 21186 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:56.906746 21297 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:56.907145 21186 raft_consensus.cc:697] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:22:56.899438 21230 consensus_queue.cc:1059] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:56.908192 21230 raft_consensus.cc:3055] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:56.907150 21293 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:56.908640 21230 raft_consensus.cc:740] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:56.909051 21293 raft_consensus.cc:697] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:56.909651 21230 consensus_queue.cc:260] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:56.909967 21293 consensus_queue.cc:237] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:56.910913 21230 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:56.912412 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:56.913667 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:56.913935 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:56.900058 21227 log.cc:927] Time spent T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 1.698s	user 0.005s	sys 0.003s
I20260709 12:22:56.914055 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:56.914747 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:56.900223 21229 raft_consensus.cc:3055] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:56.888235 21259 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:22:56.915720 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:56.915953 18530 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:22:56.896477 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:56.993975 18529 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:56.970515 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:56.907618 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:56.969858 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:56.907606 21285 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:56.993103 18522 raft_consensus.cc:2410] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:22:56.970502 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:56.878360 21246 consensus_queue.cc:1048] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:22:56.999571 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:56.995039 18524 raft_consensus.cc:2376] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8. Re-sending same reply.
W20260709 12:22:57.003270 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 74420.3us
I20260709 12:22:56.878820 21270 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:56.873582 21301 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:57.004678 18528 raft_consensus.cc:2368] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7.
I20260709 12:22:57.006009 21273 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:57.007207 21305 consensus_queue.cc:1048] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:57.008041 20815 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:56.892609 21235 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:56.908198 21186 consensus_queue.cc:237] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:57.012408 18673 raft_consensus.cc:1240] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:57.052733 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:57.342409 18529 raft_consensus.cc:2393] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 7: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:57.342679 18644 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:57.344064 18527 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
W20260709 12:22:57.039299 18570 consensus_peers.cc:597] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:56.930418 21229 raft_consensus.cc:740] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:57.347139 21229 consensus_queue.cc:260] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:57.348568 21229 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:57.268705 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:57.275960 21295 raft_consensus.cc:3055] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:57.350653 21295 raft_consensus.cc:740] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:57.350919 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:57.351506 21295 consensus_queue.cc:260] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:57.352203 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:57.352628 21295 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:57.352730 21273 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:57.353826 18599 raft_consensus.cc:1240] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 12:22:57.042325 19244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 415) took 2152 ms. Trace:
I20260709 12:22:57.207770 21275 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:57.341208 18597 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:57.041869 21092 tablet_bootstrap.cc:492] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:22:57.355037 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:57.243255 21021 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:57.357009 21092 tablet_bootstrap.cc:492] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:22:57.360075 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:57.360364 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:57.362258 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:57.369313 18527 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:22:57.369715 18674 raft_consensus.cc:1275] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:57.370121 18528 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:57.370286 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:57.364540 18605 raft_consensus.cc:1240] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10. Ops: []
W20260709 12:22:57.111121 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 228604us
W20260709 12:22:57.345124 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 516578us
I20260709 12:22:57.372887 18674 raft_consensus.cc:1240] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:57.343402 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:57.375288 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:57.376560 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:57.345024 21270 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:57.359926 18646 connection.cc:256] RPC call timeout handler was delayed by -1.0208898209998551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
W20260709 12:22:57.390302 18646 leader_election.cc:336] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.535s (SENT)
I20260709 12:22:57.390837 18646 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:57.378978 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:57.392385 18646 leader_election.cc:336] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.604s (SENT)
W20260709 12:22:57.393491 18646 leader_election.cc:336] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.605s (SENT)
I20260709 12:22:57.393939 18646 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:57.390352 18494 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:57.367688 21203 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:57.395330 18646 leader_election.cc:336] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.659s (SENT)
W20260709 12:22:57.399289 18646 leader_election.cc:336] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.853s (SENT)
I20260709 12:22:57.399909 18646 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:57.400343 19243 raft_consensus.cc:2410] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:22:57.401305 19212 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.008s	sys 0.016s
W20260709 12:22:57.402009 19212 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.008s	sys 0.016s
I20260709 12:22:57.341073 21221 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:57.409072 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:57.412315 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:57.416666 18494 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:57.354966 21273 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:57.384477 21021 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:57.423309 21092 ts_tablet_manager.cc:1403] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 1.861s	user 0.078s	sys 0.055s
I20260709 12:22:57.340736 21192 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:57.432210 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:57.444316 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:57.110594 19239 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:57.463452 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:57.386686 21292 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.023s	sys 0.000s
I20260709 12:22:56.931882 21262 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:57.450937 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.385459 21286 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:57.394030 20815 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.423967 21314 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:57.483700 21292 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.024s	sys 0.001s
I20260709 12:22:57.425382 20998 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.354772 19244 rpcz_store.cc:276] 0709 12:22:54.890316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.899572 (+  9256us) service_pool.cc:224] Handling call
0709 12:22:54.946983 (+ 47411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:55.022872 (+ 75889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:55.023802 (+   930us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:55.027766 (+  3964us) log.cc:844] Serialized 26 byte log entry
0709 12:22:55.129533 (+101767us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:55.129587 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.170022 (+ 40435us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:56.899422 (+1729400us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:22:57.041940 (+142518us) raft_consensus.cc:1685] finished
0709 12:22:57.041979 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.042231 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57594,"raft.queue_time_us":66575,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":4391,"spinlock_wait_cycles":46292864,"thread_start_us":88898,"threads_started":1,"wal-append.queue_time_us":173729}
I20260709 12:22:57.556524 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:57.404702 21283 consensus_queue.cc:1059] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.101s
I20260709 12:22:57.503826 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:57.560752 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 142788us
I20260709 12:22:57.410177 20900 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:57.561291 18528 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:22:57.543953 18529 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:57.610826 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:57.424275 20949 consensus_queue.cc:1048] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.137s
I20260709 12:22:57.425359 21270 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:57.609321 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.631868 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:57.488673 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:57.639264 18644 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:57.633191 18529 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 6.
I20260709 12:22:57.656786 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:57.494918 21186 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.490367 21259 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:57.641312 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:57.657660 18606 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 5.
I20260709 12:22:57.504216 21275 raft_consensus.cc:2804] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:22:57.662292 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 245797us
I20260709 12:22:57.672416 18677 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:57.561880 21203 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:57.682339 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:57.684790 18529 raft_consensus.cc:1275] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:57.627840 21270 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:57.696152 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 296898us
I20260709 12:22:57.656183 21021 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:57.505581 21286 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:57.661814 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:22:57.718482 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 110560us
W20260709 12:22:57.718983 21307 log.cc:927] Time spent T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:22:57.718602 20818 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:57.719846 21271 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:57.721117 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.626387 20998 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:57.740177 18597 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
W20260709 12:22:57.772672 18597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40954 (request call id 1516) took 1922 ms (client timeout 2057 ms). Trace:
I20260709 12:22:57.682787 20900 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:57.754122 18572 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:57.780898 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:57.781420 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:57.558492 20815 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:57.686074 21275 raft_consensus.cc:697] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:57.776911 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:57.782845 18671 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
W20260709 12:22:57.773088 18597 rpcz_store.cc:269] 0709 12:22:55.850164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.850848 (+   684us) service_pool.cc:224] Handling call
0709 12:22:57.037242 (+1186394us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b58006b90d0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c43b0aa 00007efc7c4bd447 00007efc7c4d5fe7 00007efc7c4d77de 00007efc7c4e327c 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c
0709 12:22:57.772610 (+735368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2101771648}
I20260709 12:22:57.708933 21270 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:57.669834 21186 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:57.808125 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:57.817328 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:57.809424 18597 raft_consensus.cc:1240] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:22:57.703003 21203 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:57.732194 21259 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.820480 18597 raft_consensus.cc:1275] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:57.835261 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:57.810111 18603 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:22:57.821954 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 67957.1us
I20260709 12:22:57.836423 18599 raft_consensus.cc:1275] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:22:57.822674 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 121600us
I20260709 12:22:57.823935 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:57.837778 18525 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:22:57.824384 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:57.839144 18606 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:22:57.830909 18604 raft_consensus.cc:1275] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:57.836889 18598 raft_consensus.cc:1240] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:57.836835 18572 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:57.794502 21296 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.781073 20900 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.722975 21293 consensus_queue.cc:1059] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.093s
W20260709 12:22:57.861783 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:57.842183 18646 leader_election.cc:336] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.973s (SENT)
W20260709 12:22:57.863204 18646 leader_election.cc:336] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.976s (SENT)
I20260709 12:22:57.863700 18646 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:57.845146 18602 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:57.812764 21253 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.858795 18671 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:57.862110 18572 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:57.870435 18601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1532) took 1102 ms. Trace:
W20260709 12:22:57.870436 21317 log.cc:927] Time spent T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:22:57.862298 20900 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:57.870889 18601 rpcz_store.cc:276] 0709 12:22:56.768158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.770668 (+  2510us) service_pool.cc:224] Handling call
0709 12:22:56.814633 (+ 43965us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:56.815096 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.815138 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:56.815826 (+   688us) log.cc:844] Serialized 26 byte log entry
0709 12:22:57.001100 (+185274us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:57.005321 (+  4221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.005418 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:57.870226 (+864808us) raft_consensus.cc:1685] finished
0709 12:22:57.870245 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.870372 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2487,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":106,"thread_start_us":184772,"threads_started":1,"wal-append.queue_time_us":628029}
I20260709 12:22:57.834422 21199 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:57.876395 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:57.887847 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:57.909405 18525 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:57.937803 18605 raft_consensus.cc:1240] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:57.937485 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:57.874784 21235 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:57.780982 21271 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:57.894775 21136 raft_consensus.cc:2804] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:57.874050 21301 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:57.940604 21268 consensus_meta.cc:287] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 1.082s	user 0.005s	sys 0.008s
I20260709 12:22:57.866411 21283 consensus_queue.cc:1048] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 12:22:57.955997 21136 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:57.960970 19243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 418) took 1123 ms. Trace:
I20260709 12:22:57.961191 21136 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:57.961619 20998 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:57.963696 21230 consensus_meta.cc:287] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 1.052s	user 0.015s	sys 0.001s
W20260709 12:22:57.965349 21321 log.cc:927] Time spent T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:22:57.967108 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1627) took 1208 ms. Trace:
W20260709 12:22:57.967311 21322 log.cc:927] Time spent T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:22:57.861500 21296 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:57.968912 21308 log.cc:927] Time spent T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.130s	user 0.004s	sys 0.000s
W20260709 12:22:57.944305 21232 consensus_meta.cc:287] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 1.079s	user 0.010s	sys 0.003s
I20260709 12:22:57.970068 18672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 1626) took 1211 ms. Trace:
I20260709 12:22:57.970302 20815 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:57.970722 21331 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:57.852551 21259 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:57.886061 21253 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:57.974413 18523 raft_consensus.cc:2410] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:22:57.961360 19243 rpcz_store.cc:276] 0709 12:22:56.837186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.837493 (+   307us) service_pool.cc:224] Handling call
0709 12:22:57.956663 (+1119170us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b54004d8854. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:57.960874 (+  4211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1208448896}
W20260709 12:22:57.975147 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 93880.7us
I20260709 12:22:57.951473 21271 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:57.967526 18676 rpcz_store.cc:276] 0709 12:22:56.758553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.758766 (+   213us) service_pool.cc:224] Handling call
0709 12:22:56.759035 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:56.787827 (+ 28792us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.787858 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:56.801726 (+ 13868us) log.cc:844] Serialized 26 byte log entry
0709 12:22:57.297941 (+496215us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b180030fe20. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793d4e07 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793f1c02 00007efc7c07920b 00007efc7c07ed23 00007efc7c07f0d1 00007efc7c49aa0f
0709 12:22:57.404277 (+106336us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:57.609463 (+205186us) log.cc:844] Serialized 14 byte log entry
0709 12:22:57.609661 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.609713 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:57.966681 (+356968us) raft_consensus.cc:1685] finished
0709 12:22:57.966804 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.967010 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":57420,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":18588,"spinlock_wait_cycles":61216000,"thread_start_us":223786,"threads_started":2,"wal-append.queue_time_us":868450}
I20260709 12:22:57.970448 18672 rpcz_store.cc:276] 0709 12:22:56.758294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.758438 (+   144us) service_pool.cc:224] Handling call
0709 12:22:56.758722 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:56.759083 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.759110 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:56.771538 (+ 12428us) log.cc:844] Serialized 26 byte log entry
0709 12:22:57.150205 (+378667us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:57.150265 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.150365 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:57.969876 (+819511us) raft_consensus.cc:1685] finished
0709 12:22:57.969893 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.970015 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":450,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":26151,"thread_start_us":312487,"threads_started":1,"wal-append.queue_time_us":975420}
W20260709 12:22:57.982250 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.980861 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:57.953295 21306 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.970486 21232 raft_consensus.cc:3055] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:57.952917 21314 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:57.961655 21287 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:58.004891 18570 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:57.976644 21268 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7.
I20260709 12:22:57.972234 21262 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:57.959543 21286 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:58.038792 18597 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:22:58.040984 18570 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:58.014408 21287 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.003391 21232 raft_consensus.cc:740] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:58.040253 21271 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:58.079196 18570 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:58.071890 18494 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:58.081171 18494 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:57.959770 21275 consensus_queue.cc:237] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:58.090903 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 400855us
W20260709 12:22:58.110538 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 247350us
I20260709 12:22:58.113480 19212 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:22:58.067917 21338 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:57.995586 21331 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:58.075253 21262 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:58.113492 18521 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:22:58.089658 20998 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:58.079967 21287 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:58.072816 21273 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:58.126060 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:58.078662 21268 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:22:58.112169 21325 log.cc:927] Time spent T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.304s	user 0.000s	sys 0.001s
W20260709 12:22:58.133533 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 50965us
I20260709 12:22:58.135344 21340 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:58.116626 21012 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.001s	sys 0.011s
I20260709 12:22:58.035331 21314 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:58.119328 18646 leader_election.cc:336] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.249s (SENT)
I20260709 12:22:58.148255 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:58.151894 18600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.002s	sys 0.015s
I20260709 12:22:58.160403 18494 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:58.138202 21305 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:58.015096 21306 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:58.170073 18646 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:22:58.170449 18600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.002s	sys 0.015s
I20260709 12:22:58.177949 19210 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:58.168632 21354 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.175114 21305 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:58.179001 21203 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:58.179469 21305 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:58.179116 21354 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:58.127451 21262 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:58.179738 21319 log.cc:927] Time spent T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
W20260709 12:22:58.190358 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 71044.7us
W20260709 12:22:58.190884 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 178448us
I20260709 12:22:58.161095 21215 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.199283 21354 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:58.133390 21219 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
W20260709 12:22:58.187477 21012 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.003s	sys 0.016s
I20260709 12:22:58.183064 21021 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:58.189826 21340 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.180678 21186 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:58.240051 18672 raft_consensus.cc:1275] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:58.242278 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:58.243729 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:58.183205 21328 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:58.244441 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:58.245535 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:58.183614 21262 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:58.238307 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:58.133266 21338 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:58.157698 21273 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:58.166206 21268 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:58.221105 21296 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:58.261538 21333 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:58.260486 21021 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:58.252975 21203 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.235140 21215 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:58.317603 21021 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:58.317863 21203 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:58.319643 21215 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:58.262084 21342 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:22:58.320575 21203 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:58.188203 21293 consensus_queue.cc:1059] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:22:58.321034 21268 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:58.244308 21299 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:58.265849 21354 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:58.287045 21340 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:58.326747 21340 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:58.266600 21348 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:58.291141 21229 consensus_meta.cc:287] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.942s	user 0.006s	sys 0.004s
I20260709 12:22:58.292776 18677 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:22:58.259943 19241 raft_consensus.cc:2393] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 6: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:58.272981 21351 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:58.312467 21306 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:58.284125 21270 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:58.320863 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:58.264910 18671 raft_consensus.cc:2410] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:22:58.293527 21253 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:58.273254 21259 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:58.333108 18524 raft_consensus.cc:2410] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:22:58.277949 21314 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:22:58.338943 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 167516us
I20260709 12:22:58.280308 21331 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:58.367432 18527 raft_consensus.cc:2410] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:22:58.368083 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 175625us
W20260709 12:22:58.335863 21295 consensus_meta.cc:287] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.983s	user 0.009s	sys 0.004s
I20260709 12:22:58.329510 21273 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:58.329269 21328 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:58.276306 21346 consensus_queue.cc:1048] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 12:22:58.382033 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:58.388093 18646 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:58.278721 21329 consensus_queue.cc:1059] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
W20260709 12:22:58.401016 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.405869 18530 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
W20260709 12:22:58.408536 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 213460us
I20260709 12:22:58.286821 20900 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:58.341065 21136 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:58.266738 21092 raft_consensus.cc:359] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 5 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:58.418660 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:58.419323 18525 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
W20260709 12:22:58.436517 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 48545.4us
I20260709 12:22:58.339267 21348 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:58.438117 18601 raft_consensus.cc:1240] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:58.459065 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:58.459805 18525 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:22:58.462716 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1480) took 1557 ms. Trace:
I20260709 12:22:58.463147 18523 rpcz_store.cc:276] 0709 12:22:56.905300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.914493 (+  9193us) service_pool.cc:224] Handling call
0709 12:22:58.462501 (+1548008us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400442fd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:58.462637 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2419813760}
I20260709 12:22:58.463927 19240 raft_consensus.cc:1240] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:58.463995 21334 raft_consensus.cc:3055] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:58.464531 21334 raft_consensus.cc:740] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:58.424106 21314 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:58.472179 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 60910.3us
I20260709 12:22:58.473626 21259 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:22:58.481709 21367 consensus_queue.cc:1048] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:22:58.482560 21270 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:58.481787 21338 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:58.455039 21351 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:58.417469 21186 consensus_queue.cc:1048] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:22:58.493389 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:58.496978 18646 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.306s (SENT) [suppressed 22 similar messages]
I20260709 12:22:58.498090 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:58.486718 21327 log.cc:927] Time spent T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.559s	user 0.011s	sys 0.001s
I20260709 12:22:58.510932 18528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1504) took 1501 ms. Trace:
I20260709 12:22:58.499608 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:58.512698 18529 raft_consensus.cc:1240] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:58.512959 21348 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:58.500065 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:58.501085 18674 raft_consensus.cc:1240] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:22:58.472090 21290 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:58.512900 18676 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
I20260709 12:22:58.518103 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:58.466981 21339 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:58.410712 21328 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:58.498368 18678 raft_consensus.cc:1240] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:58.506060 18672 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:58.525359 21092 raft_consensus.cc:740] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:22:58.506482 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:58.507685 21355 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:58.526207 21092 consensus_queue.cc:260] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:58.526780 21355 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:58.518103 21367 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:22:58.528561 21326 log.cc:927] Time spent T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.414s	user 0.003s	sys 0.003s
I20260709 12:22:58.528254 21367 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:58.507944 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:58.530200 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:58.530436 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:58.504869 21259 consensus_queue.cc:1243] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer 2f9872512f1646bc835906bd0e98c6a7 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:22:58.508616 21368 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:22:58.530624 21290 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:58.509016 21255 raft_consensus.cc:3055] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:58.534626 21364 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:22:58.534955 21255 raft_consensus.cc:740] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:58.509464 20900 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:58.510016 21357 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.537855 21357 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:58.538326 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1503) took 1529 ms. Trace:
I20260709 12:22:58.540169 21357 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:58.538708 18526 rpcz_store.cc:276] 0709 12:22:57.009205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.681808 (+672603us) service_pool.cc:224] Handling call
0709 12:22:57.706157 (+ 24349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:57.988906 (+282749us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:58.183820 (+194914us) log.cc:844] Serialized 14 byte log entry
0709 12:22:58.404296 (+220476us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:58.414471 (+ 10175us) log.cc:844] Serialized 26 byte log entry
0709 12:22:58.415049 (+   578us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:58.415349 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 12:22:58.461918 (+ 46569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:58.462011 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:58.538105 (+ 76094us) raft_consensus.cc:1685] finished
0709 12:22:58.538125 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:58.538264 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129485,"prepare.queue_time_us":293379,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":255296,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":34171,"spinlock_wait_cycles":6867840,"thread_start_us":526358,"threads_started":3,"wal-append.queue_time_us":289581}
I20260709 12:22:58.542520 18679 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:22:58.511366 18528 rpcz_store.cc:276] 0709 12:22:57.009469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.683617 (+674148us) service_pool.cc:224] Handling call
0709 12:22:57.684136 (+   519us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:58.308888 (+624752us) spinlock_profiling.cc:243] Waited 9.34 ms on lock 0x7b180034a500. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc7c0874bc 00007efc793d548b 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793ef455 00007efc7c4d7060 00007efc7c4d7bfb 00007efc7c4e264b
0709 12:22:58.309047 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:58.309074 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:58.311607 (+  2533us) log.cc:844] Serialized 52 byte log entry
0709 12:22:58.455461 (+143854us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:58.466277 (+ 10816us) log.cc:844] Serialized 14 byte log entry
0709 12:22:58.502405 (+ 36128us) log.cc:844] Serialized 14 byte log entry
0709 12:22:58.502606 (+   201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:58.502679 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:58.510715 (+  8036us) raft_consensus.cc:1685] finished
0709 12:22:58.510739 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:58.510873 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34021,"prepare.queue_time_us":17179,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":172937,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":17901,"spinlock_wait_cycles":40262784,"thread_start_us":276949,"threads_started":2,"wal-append.queue_time_us":169858}
I20260709 12:22:58.520300 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:58.465359 21334 consensus_queue.cc:260] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:58.534889 21275 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:58.509613 21351 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:58.545655 18524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1506) took 1535 ms. Trace:
I20260709 12:22:58.546739 21329 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.550650 21329 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:58.552731 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:58.548985 18524 rpcz_store.cc:276] 0709 12:22:57.009973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.353750 (+343777us) service_pool.cc:224] Handling call
0709 12:22:57.425693 (+ 71943us) spinlock_profiling.cc:243] Waited 6.27 ms on lock 0x7b5800002798. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:22:58.125908 (+700215us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b5800002798. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bae9c 00007efc793baa5b 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:22:58.525547 (+399639us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54003b4554. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:58.545569 (+ 20022us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":460411648}
I20260709 12:22:58.556471 18646 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:58.561059 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:58.562270 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:58.562012 18494 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:58.565328 18494 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:58.559119 21259 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:58.568746 21351 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:58.568574 21259 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:58.569718 21136 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:58.571322 21259 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:58.572077 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:58.560967 21334 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:58.580971 18524 raft_consensus.cc:1275] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:22:58.573040 21221 consensus_meta.cc:287] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 1.112s	user 0.004s	sys 0.010s
I20260709 12:22:58.552419 21275 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:58.574087 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:58.574781 18673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 246) took 1160 ms. Trace:
W20260709 12:22:58.575524 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.577651 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:58.669543 18600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1534) took 1891 ms. Trace:
W20260709 12:22:58.787710 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:58.863492 18527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1493) took 1934 ms (client timeout 2306 ms). Trace:
I20260709 12:22:58.728977 18597 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:58.659372 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 102990us
W20260709 12:22:58.930809 18527 rpcz_store.cc:269] 0709 12:22:56.928962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.425554 (+496592us) service_pool.cc:224] Handling call
0709 12:22:57.887640 (+462086us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b5800002798. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:22:58.863162 (+975522us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b5400335254. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:58.863398 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1114627712}
W20260709 12:22:58.718448 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.929440 18572 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:58.729415 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:58.938947 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1522) took 1924 ms. Trace:
I20260709 12:22:58.638170 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:58.728194 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:58.932158 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 366856us
I20260709 12:22:58.737018 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:58.840876 18522 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:22:58.951045 18523 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:58.943622 18603 raft_consensus.cc:1240] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 12:22:58.961000 18598 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:22:58.960335 18494 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:58.965631 19212 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:58.967696 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:58.927278 18673 rpcz_store.cc:276] 0709 12:22:57.414823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.492322 (+ 77499us) service_pool.cc:224] Handling call
0709 12:22:57.560460 (+ 68138us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:57.561966 (+  1506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:57.562006 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:57.578042 (+ 16036us) log.cc:844] Serialized 26 byte log entry
0709 12:22:58.117968 (+539926us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:58.118013 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:58.118091 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:58.574542 (+456451us) raft_consensus.cc:1685] finished
0709 12:22:58.574561 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:58.574704 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1103,"raft.queue_time_us":67255,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":25927,"thread_start_us":495783,"threads_started":1,"wal-append.queue_time_us":845680}
I20260709 12:22:58.560881 21273 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:58.977388 19241 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33388 (request call id 381) took 1499 ms (client timeout 1689 ms). Trace:
I20260709 12:22:58.977447 21273 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:58.726421 21219 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.568799 21328 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:58.978796 21219 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:58.979206 21339 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:58.979848 21339 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:58.980883 21219 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:58.982004 21339 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:58.982322 21287 consensus_meta.cc:287] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.826s	user 0.008s	sys 0.004s
I20260709 12:22:58.982741 21287 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:58.941999 18570 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:58.898555 21092 ts_tablet_manager.cc:1434] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 1.475s	user 0.011s	sys 0.003s
I20260709 12:22:58.563529 21331 consensus_queue.cc:1059] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.414s
W20260709 12:22:58.984103 21092 ts_tablet_manager.cc:1467] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: Tablet startup took 1560ms
I20260709 12:22:58.985234 18606 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:22:58.976601 19210 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:58.581652 21286 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:58.927222 21203 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:58.978273 19239 raft_consensus.cc:1275] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:22:58.986303 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:58.986403 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:22:58.987762 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 58422.4us
I20260709 12:22:58.832820 21201 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.561131 21338 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.661763 21329 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:58.885247 21357 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:58.939471 18680 rpcz_store.cc:276] 0709 12:22:57.014344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.014469 (+   125us) service_pool.cc:224] Handling call
0709 12:22:57.335090 (+320621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:57.335377 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:57.502910 (+167533us) log.cc:844] Serialized 14 byte log entry
0709 12:22:58.938223 (+1435313us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b180030f7c0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc7c0874bc 00007efc793d548b 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793ef455 00007efc7c4d7060 00007efc7c4e9716 00007efc7c4fa287
0709 12:22:58.938344 (+   121us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:58.938408 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:58.938471 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:58.938573 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:58.938725 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6395,"prepare.queue_time_us":621540,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":162635,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":40382,"spinlock_wait_cycles":43603840,"thread_start_us":705546,"threads_started":3,"wal-append.queue_time_us":781311}
I20260709 12:22:58.561337 21314 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:59.010777 18572 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:58.927647 20900 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:59.011631 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:22:59.003221 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 56690.2us
I20260709 12:22:58.671300 21351 raft_consensus.cc:2804] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:58.659196 21340 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:58.961273 21283 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.928864 18600 rpcz_store.cc:276] 0709 12:22:56.777967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.778837 (+   870us) service_pool.cc:224] Handling call
0709 12:22:56.779266 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.779579 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:57.285282 (+505703us) log.cc:844] Serialized 14 byte log entry
0709 12:22:58.176679 (+891397us) log.cc:844] Serialized 14 byte log entry
0709 12:22:58.668972 (+492293us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b18003adaa0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc7936cc0a 00007efc82aac219 00007efc793f4a40 00007efc793ef4e4 00007efc793ef455 00007efc7c4d7060 00007efc7c4e9716 00007efc7c4fa287 00007efc7c4fa208
0709 12:22:58.669153 (+   181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:58.669212 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:58.669260 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:58.669335 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:58.669467 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":487093,"prepare.queue_time_us":1029317,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":84,"raft.queue_time_us":499286,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":4797,"spinlock_wait_cycles":4845440,"thread_start_us":1337922,"threads_started":2,"wal-append.queue_time_us":963642}
I20260709 12:22:59.011332 21246 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:58.894546 21373 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.563098 21270 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.024403 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:59.032697 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:59.022514 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:58.984776 21287 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:59.037456 18572 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:59.032924 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:59.011844 21331 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:22:58.966720 21199 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
W20260709 12:22:58.978022 19241 rpcz_store.cc:269] 0709 12:22:57.477678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.504825 (+ 27147us) service_pool.cc:224] Handling call
0709 12:22:58.977144 (+1472319us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b54005c12d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:58.977321 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":968539008}
I20260709 12:22:58.678787 21262 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:59.009219 21073 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:59.009071 21221 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:59.008878 21312 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:58.671612 21305 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:59.009294 21286 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:59.076740 21299 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:59.015700 21339 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:59.063160 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:22:59.115314 21021 consensus_meta.cc:287] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.797s	user 0.009s	sys 0.003s
I20260709 12:22:59.051345 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:59.064755 21273 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:59.044734 21188 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:59.091244 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.120483 18524 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:22:59.065352 21270 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.063529 21373 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.015372 21203 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:22:59.063944 21375 log.cc:927] Time spent T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.392s	user 0.000s	sys 0.001s
I20260709 12:22:59.112944 21286 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:59.107719 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:59.024062 21247 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:59.049216 21351 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:59.024847 21201 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.038442 21338 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:59.116129 18600 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:22:59.141175 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:59.115370 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:59.052452 20900 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:59.015578 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 73699.9us
I20260709 12:22:59.015447 21334 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:22:59.044512 21357 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:59.127506 19243 raft_consensus.cc:1240] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:59.059438 21283 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.117157 21299 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.115943 21021 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:59.110827 21186 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:59.113849 21314 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:59.114727 21339 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:59.142122 18597 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
W20260709 12:22:59.145560 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 158986us
I20260709 12:22:59.122179 21188 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:59.155181 18526 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 6.
I20260709 12:22:59.149580 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:59.153185 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:59.158726 18494 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:59.157578 18524 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:59.154934 18600 raft_consensus.cc:2410] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 7 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:22:59.144469 18570 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:22:58.984532 21092 ts_tablet_manager.cc:1469] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: Trace:
0709 12:22:51.360524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.363649 (+  3125us) service_pool.cc:224] Handling call
0709 12:22:51.638129 (+274480us) ts_tablet_manager.cc:934] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
0709 12:22:53.357864 (+1719735us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:22:54.056538 (+698674us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:54.074028 (+ 17490us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:22:54.376132 (+302104us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:22:54.394975 (+ 18843us) tablet_replica.cc:206] Creating consensus instance
0709 12:22:54.395306 (+   331us) ts_tablet_manager.cc:989] Replica registered.
0709 12:22:54.395409 (+   103us) inbound_call.cc:177] Queueing success response
0709 12:22:55.558148 (+1162739us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:22:57.423918 (+1865770us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:22:57.614641 (+190723us) tablet_replica.cc:261] Starting instrumentation
0709 12:22:57.837715 (+223074us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":35463,"mutex_wait_us":63275,"raft.queue_time_us":2334,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"tablet-copy.queue_time_us":183834,"tablet-download-pool.queue_time_us":4209,"tablet-download-pool.run_cpu_time_us":1604,"tablet-download-pool.run_wall_time_us":702337,"thread_start_us":134398,"threads_started":2}
I20260709 12:22:59.161758 21188 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:59.160247 21314 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:59.164116 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:59.164959 21314 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:59.165131 20900 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:59.152597 21299 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:59.166340 21339 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:59.167217 21260 raft_consensus.cc:3055] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:59.167675 21260 raft_consensus.cc:740] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:22:59.168305 21382 log.cc:927] Time spent T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:22:59.168677 21260 consensus_queue.cc:260] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:59.170070 21260 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:59.170189 18599 raft_consensus.cc:1240] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 12:22:59.172186 18521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1482) took 2266 ms (client timeout 2009 ms). Trace:
W20260709 12:22:59.172361 21381 log.cc:927] Time spent T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:22:59.172627 18521 rpcz_store.cc:269] 0709 12:22:56.905929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.913799 (+  7870us) service_pool.cc:224] Handling call
0709 12:22:59.171972 (+2258173us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002c7254. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:59.172091 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2639502080}
I20260709 12:22:59.173833 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.174643 18521 raft_consensus.cc:2410] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:22:59.171407 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:59.175633 19245 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:59.183249 18524 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:22:59.179316 18528 raft_consensus.cc:1275] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:59.185111 21312 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:59.165402 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:59.187966 21201 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:59.122665 21232 consensus_queue.cc:260] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.145656 21351 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:59.188863 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.222239 18570 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:59.188844 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.191191 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:22:59.188884 20900 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:59.222087 21221 raft_consensus.cc:2804] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:59.225849 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:59.226168 21199 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:59.226696 21199 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:59.227138 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:59.228080 18597 raft_consensus.cc:2393] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 6: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:22:59.227830 21273 consensus_queue.cc:1059] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:22:59.228678 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:59.228866 21199 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:59.229241 18602 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:22:59.226037 20900 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:22:59.224218 21247 consensus_queue.cc:1048] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:22:59.232019 20900 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:59.232893 21373 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:59.178823 21290 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:59.226037 21221 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.239720 18570 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:22:59.241762 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 50724.3us
I20260709 12:22:59.180986 21275 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:59.175369 21270 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:59.177063 21021 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:59.245765 18521 raft_consensus.cc:1240] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:59.158149 21186 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:59.247048 18521 raft_consensus.cc:1275] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:59.250417 18601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1548) took 1377 ms. Trace:
I20260709 12:22:59.254516 18601 rpcz_store.cc:276] 0709 12:22:57.873100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.875464 (+  2364us) service_pool.cc:224] Handling call
0709 12:22:57.931814 (+ 56350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:58.454092 (+522278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:59.250203 (+796111us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b54002b7fd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:59.250351 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1137850112}
I20260709 12:22:59.251927 21290 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:59.240607 21221 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:59.256636 19245 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:22:59.260423 18601 raft_consensus.cc:1275] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:22:59.259068 21271 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:59.242666 21219 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:59.262984 21219 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.263398 21219 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:59.257097 21299 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.263259 21255 consensus_queue.cc:260] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.257447 21290 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:59.264882 21290 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:59.265412 21299 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:59.243286 21201 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.266166 18601 raft_consensus.cc:1240] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:22:59.337567 21186 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:59.335734 21305 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:59.340545 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:59.342897 21338 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:22:59.320894 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 59693.2us
I20260709 12:22:59.344298 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:59.348639 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:59.346104 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:59.347091 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:59.349339 18671 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:22:59.349849 18672 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:22:59.352356 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:59.355969 18676 raft_consensus.cc:2410] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:59.244655 21273 consensus_queue.cc:1243] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Peer a0dee333a83a45f1ab0c1bb6d094afd1 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:22:59.361027 18494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:59.361582 18494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.364638 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:59.365155 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:59.366402 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:59.367657 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:59.245394 21373 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:59.269359 21203 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:59.317371 21262 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:59.372292 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:59.372363 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:59.347640 21290 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.379352 18674 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:59.382558 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:59.363945 21338 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:59.366207 21275 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.315834 21270 consensus_queue.cc:1059] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:22:59.381469 18494 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:59.387090 18674 raft_consensus.cc:2393] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 6: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:22:59.387122 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:59.388547 21385 consensus_queue.cc:1059] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:22:59.388839 21334 raft_consensus.cc:2749] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:59.372537 21215 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:59.398227 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:59.401634 21339 consensus_queue.cc:1059] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:59.391652 21275 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:59.403998 18522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1499) took 2405 ms (client timeout 1917 ms). Trace:
I20260709 12:22:59.404943 21275 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:22:59.404572 18522 rpcz_store.cc:269] 0709 12:22:56.998482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.353241 (+354759us) service_pool.cc:224] Handling call
0709 12:22:57.682162 (+328921us) spinlock_profiling.cc:243] Waited 6.62 ms on lock 0x7b5800002798. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:22:59.403783 (+1721621us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b54003b4054. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:59.403902 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2250301056}
I20260709 12:22:59.404516 18672 raft_consensus.cc:2955] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Committing config change with OpId 4.3: config changed from index -1 to 3, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:59.391451 21338 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.409719 21338 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:59.396502 21215 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.412231 21215 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:59.416070 21329 raft_consensus.cc:3055] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:59.416599 21186 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:59.417368 21186 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:59.418027 21367 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:59.419406 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:59.420608 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:59.420768 18646 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:59.416657 21329 raft_consensus.cc:740] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:22:59.422885 21329 consensus_queue.cc:260] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.424381 21329 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:59.393368 21262 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:59.432648 21262 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.440415 21262 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:59.444000 21186 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:22:59.445119 18530 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1489) took 2517 ms (client timeout 1605 ms). Trace:
W20260709 12:22:59.445674 18530 rpcz_store.cc:269] 0709 12:22:56.927927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.999240 (+ 71313us) service_pool.cc:224] Handling call
0709 12:22:59.444869 (+2445629us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002c7c54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:59.445030 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2422330240}
I20260709 12:22:59.447474 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:59.448675 19242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 423) took 1025 ms. Trace:
I20260709 12:22:59.449117 21221 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:59.450589 18524 raft_consensus.cc:1240] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:22:59.453356 21221 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:59.453752 21283 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:59.455958 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:59.457667 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:59.457481 21219 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:22:59.461654 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:59.465377 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 43506.3us
I20260709 12:22:59.459052 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:59.371104 21201 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.449085 19242 rpcz_store.cc:276] 0709 12:22:58.423907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.436108 (+ 12201us) service_pool.cc:224] Handling call
0709 12:22:59.447296 (+1011188us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b5800003c98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baeee 000000000036eb39 00007efc8142e1e0 00007efc814f70c4 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:22:59.448597 (+  1301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4091008}
I20260709 12:22:59.467321 21357 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:59.395638 21351 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.467869 18572 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:59.469836 20900 consensus_queue.cc:1048] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:22:59.470796 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.377707 21373 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:59.471289 18606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1547) took 1636 ms. Trace:
I20260709 12:22:59.501439 18572 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:59.473004 21331 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:22:59.473464 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.502741 18572 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:22:59.481709 21247 raft_consensus.cc:2955] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Committing config change with OpId 4.3: config changed from index -1 to 3, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:59.474929 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:59.517925 18572 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:59.470856 21219 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:59.475736 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:59.467635 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:59.546960 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:22:59.443341 21286 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.447417 21188 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:59.544349 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.485442 21359 raft_consensus.cc:2749] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:59.548920 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.501870 18606 rpcz_store.cc:276] 0709 12:22:57.848837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.850673 (+  1836us) service_pool.cc:224] Handling call
0709 12:22:57.851436 (+   763us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:58.985754 (+1134318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:59.471041 (+485287us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002f5154. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:59.471227 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2606900096}
I20260709 12:22:59.553736 18530 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:22:59.557461 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:59.558171 18530 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:59.517436 21262 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:59.556210 18528 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:22:59.567101 21219 consensus_queue.cc:1048] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:59.568710 21355 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:59.569093 21286 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:59.570307 21290 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:59.551100 21215 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:59.571902 21201 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:59.573514 21188 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:59.547407 21199 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:59.577435 18602 raft_consensus.cc:1240] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:59.551856 21287 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:59.571966 18522 raft_consensus.cc:1240] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:59.589255 21373 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:22:59.589926 21262 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.590467 21262 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:59.591039 18525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 1855) took 1220 ms. Trace:
I20260709 12:22:59.590102 18530 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:22:59.593858 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:22:59.564858 21299 consensus_queue.cc:1059] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:22:59.595563 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:59.597434 21351 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:22:59.595580 21299 raft_consensus.cc:3055] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:59.598932 21299 raft_consensus.cc:740] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:59.599772 21299 consensus_queue.cc:260] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.601364 21299 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:59.603677 18601 raft_consensus.cc:1275] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:59.604151 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:59.572161 21215 raft_consensus.cc:697] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:22:59.606161 19212 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:59.606853 21215 consensus_queue.cc:237] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.607240 21369 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:59.607920 21369 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.608278 21369 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:59.608774 18522 raft_consensus.cc:1240] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:59.607455 19245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 425) took 1084 ms. Trace:
I20260709 12:22:59.611061 18602 raft_consensus.cc:1240] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:22:59.613065 19210 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:59.611431 19245 rpcz_store.cc:276] 0709 12:22:58.523385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.523534 (+   149us) service_pool.cc:224] Handling call
0709 12:22:59.607295 (+1083761us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b54006cd254. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:59.607396 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1482832256}
I20260709 12:22:59.591426 18525 rpcz_store.cc:276] 0709 12:22:58.370914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.463359 (+ 92445us) service_pool.cc:224] Handling call
0709 12:22:58.525670 (+ 62311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:58.525875 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:58.526173 (+   298us) log.cc:844] Serialized 14 byte log entry
0709 12:22:58.582694 (+ 56521us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:58.582767 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:58.582826 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:58.582910 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:59.589568 (+1006658us) spinlock_profiling.cc:243] Waited 56.1 ms on lock 0x7b18002319a0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793c02a6 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4
0709 12:22:59.590840 (+  1272us) spinlock_profiling.cc:243] Waited 62 ms on lock 0x7b54003b4550. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:22:59.590957 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":560,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":122,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":36850,"spinlock_wait_cycles":271679744,"thread_start_us":56126,"threads_started":1,"wal-append.queue_time_us":530123}
W20260709 12:22:59.618636 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 232469us
I20260709 12:22:59.626367 18494 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:22:59.623440 21073 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:59.621234 21359 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:22:59.637001 21359 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.639308 21359 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:22:59.640197 18673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 250) took 1082 ms. Trace:
I20260709 12:22:59.639806 21262 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.640583 18673 rpcz_store.cc:276] 0709 12:22:58.557763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.986911 (+429148us) service_pool.cc:224] Handling call
0709 12:22:58.987198 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:59.161061 (+173863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:59.161094 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:59.161146 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:59.161193 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:59.639957 (+478764us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54001f2054. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:22:59.640020 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:59.640142 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399349120}
I20260709 12:22:59.649312 18605 raft_consensus.cc:1240] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:22:59.676143 21373 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.684573 21373 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.676239 21273 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:59.688289 21273 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.688844 21273 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:59.697904 18426 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60812 (request call id 105) took 5716 ms. Trace:
W20260709 12:22:59.704602 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 49692.8us
I20260709 12:22:59.719328 18494 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:59.720906 18494 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:59.687489 21373 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:59.700364 18426 rpcz_store.cc:276] 0709 12:22:53.981094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.981377 (+   283us) service_pool.cc:224] Handling call
0709 12:22:59.697778 (+5716401us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:56.644516 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:56.715438 (+ 70922us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:56.719568 (+  4130us) write_op.cc:435] Acquired schema lock
0709 12:22:56.720380 (+   812us) tablet.cc:662] Decoding operations
0709 12:22:56.729221 (+  8841us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:56.729280 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:56.729308 (+    28us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:22:56.730122 (+   814us) tablet.cc:701] Row locks acquired
0709 12:22:56.730142 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:22:56.730299 (+   157us) write_op.cc:270] Start()
0709 12:22:56.730426 (+   127us) write_op.cc:276] Timestamp: P: 1783599776730251 usec, L: 0
0709 12:22:56.730446 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:22:56.731136 (+   690us) log.cc:844] Serialized 4014 byte log entry
0709 12:22:57.041332 (+310196us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc793d50ac 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793f1c02 00007efc7c07920b
0709 12:22:58.405323 (+1363991us) op_driver.cc:464] REPLICATION: finished
0709 12:22:58.667856 (+262533us) write_op.cc:301] APPLY: starting
0709 12:22:58.667950 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:58.668167 (+   217us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:58.668189 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:58.669426 (+  1237us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:58.669651 (+   225us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:22:58.669697 (+    46us) write_op.cc:312] APPLY: finished
0709 12:22:58.669993 (+   296us) log.cc:844] Serialized 77 byte log entry
0709 12:22:58.670165 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:58.670292 (+   127us) write_op.cc:454] Released schema lock
0709 12:22:58.670349 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:58.670693 (+   344us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:58.673378 (+  2685us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":670964,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":253973,"apply.run_cpu_time_us":2817,"apply.run_wall_time_us":2821,"num_ops":10,"prepare.queue_time_us":410198,"prepare.run_cpu_time_us":28414,"prepare.run_wall_time_us":939094,"raft.queue_time_us":461478,"raft.run_cpu_time_us":47893,"raft.run_wall_time_us":223229,"replication_time_us":1644677,"spinlock_wait_cycles":8637312,"thread_start_us":1275239,"threads_started":4,"wal-append.queue_time_us":934467,"wal-append.run_cpu_time_us":25953,"wal-append.run_wall_time_us":2046879}]]}
I20260709 12:22:59.734817 21286 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:59.753672 19245 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 5 LEARNER]: Advancing to term 6
I20260709 12:22:59.756103 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:59.759595 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:22:59.762458 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:59.763089 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:22:59.749660 21188 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:22:59.765105 21188 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.761955 21201 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.772635 21201 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.735365 21290 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:59.764051 18673 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:22:59.786605 18494 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:22:59.791574 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.791982 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.792742 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:59.793517 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:59.793795 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:59.794543 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:22:59.794813 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.795331 18521 raft_consensus.cc:1275] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:59.794251 18528 raft_consensus.cc:2376] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7. Re-sending same reply.
I20260709 12:22:59.805807 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:59.806842 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:59.808231 18525 raft_consensus.cc:2393] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 7: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
W20260709 12:22:59.809114 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 238083us
I20260709 12:22:59.818614 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:59.793473 19245 raft_consensus.cc:2955] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 LEARNER]: Committing config change with OpId 4.3: config changed from index -1 to 3, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:22:59.821877 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.823504 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:22:59.823609 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.784055 21188 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:59.801379 21373 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:59.824530 18525 raft_consensus.cc:2410] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:22:59.794926 21300 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:22:59.825264 18602 raft_consensus.cc:2368] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 5. Current term is 6.
W20260709 12:22:59.835621 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 205641us
W20260709 12:22:59.836826 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 213770us
I20260709 12:22:59.839493 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.841771 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.842831 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.844342 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:59.845268 18530 raft_consensus.cc:2410] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:22:59.845986 18528 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:22:59.840806 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.846915 18521 raft_consensus.cc:2393] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:22:59.828684 21399 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:22:59.819758 21199 consensus_queue.cc:1059] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:22:59.881551 18570 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:22:59.831899 21201 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:59.810451 21286 consensus_queue.cc:1048] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:22:59.849382 18521 pending_rounds.cc:85] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 3
I20260709 12:22:59.884512 18521 pending_rounds.cc:107] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:22:59.830384 21300 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:22:59.850214 21262 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:22:59.856652 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.884909 18521 raft_consensus.cc:2889] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:59.894460 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.896484 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.893929 18616 tablet_copy_service.cc:342] P c7bd71f1f37c45f28b52c154e59356b9: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-6ddef1433d2344c9a83050fe07ac225b received from {username='slave'} at 127.0.0.1:39798
W20260709 12:22:59.914117 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 67130.3us
I20260709 12:22:59.892807 21188 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:59.923576 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:22:59.924887 18528 raft_consensus.cc:2376] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6. Re-sending same reply.
I20260709 12:22:59.920921 18616 tablet_copy_service.cc:434] P c7bd71f1f37c45f28b52c154e59356b9: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-6ddef1433d2344c9a83050fe07ac225b on tablet 6ddef1433d2344c9a83050fe07ac225b with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:22:59.857764 21399 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:22:59.919010 21188 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:59.950532 21400 log.cc:927] Time spent T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:22:59.952742 21300 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:22:59.962091 21397 log.cc:927] Time spent T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:22:59.923535 21021 consensus_queue.cc:1059] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:22:59.923094 21247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:39794 (request call id 9) took 10581 ms. Trace:
W20260709 12:22:59.976761 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:59.980741 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 133359us
W20260709 12:22:59.977608 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 96158.3us
I20260709 12:22:59.995512 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.970034 21188 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:59.998618 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.999256 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:22:59.976213 21339 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.002169 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:00.012037 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:00.012754 18528 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:23:00.002033 21351 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
W20260709 12:23:00.016198 21405 log.cc:927] Time spent T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.129s	user 0.000s	sys 0.002s
I20260709 12:23:00.016688 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:00.017220 21399 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:00.003602 21339 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:00.021962 21408 log.cc:927] Time spent T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:23:00.028162 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:00.030360 18526 raft_consensus.cc:2410] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:23:00.033406 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:00.034206 18680 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:23:00.034538 18675 raft_consensus.cc:1275] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:00.036895 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:00.038774 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:00.038908 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:00.041986 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:00.039422 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:00.043053 18680 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:00.044720 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:00.045526 18677 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:23:00.054957 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:00.061146 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:00.062979 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:00.066082 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:00.069242 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:00.075266 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:00.075356 21399 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.076880 21399 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.080333 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:00.075268 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:00.025949 21351 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.040238 21357 consensus_queue.cc:1048] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
W20260709 12:23:00.110205 21410 log.cc:927] Time spent T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:23:00.110960 20900 consensus_queue.cc:1048] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:00.113423 21331 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:00.114037 21331 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:00.117522 21351 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:00.118505 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:00.119994 21331 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:00.120277 18526 raft_consensus.cc:1240] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 12:23:00.123951 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 62971.6us
I20260709 12:23:00.105043 21255 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:00.126294 18646 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:00.127808 21339 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:00.128196 18646 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:00.129354 21369 consensus_meta.cc:287] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.004s
I20260709 12:23:00.130086 18646 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:00.129892 21369 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:00.132440 18646 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:00.134071 18605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1565) took 1017 ms. Trace:
I20260709 12:23:00.136767 21273 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.106424 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:00.121730 21232 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:00.134353 18605 rpcz_store.cc:276] 0709 12:22:59.116785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:59.556432 (+439647us) service_pool.cc:224] Handling call
0709 12:22:59.597988 (+ 41556us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:59.649833 (+ 51845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:00.133871 (+484038us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b54001cf554. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:00.134020 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117070208}
I20260709 12:23:00.140727 19243 raft_consensus.cc:2393] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 7: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:22:59.980449 21247 rpcz_store.cc:276] 0709 12:22:49.340503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.340621 (+   118us) service_pool.cc:224] Handling call
0709 12:22:49.465632 (+125011us) log.cc:844] Serialized 513 byte log entry
0709 12:22:49.857917 (+392285us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b5400216220. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c45fb26 00007efc7c45949a 00007efc7c458714 00007efc7c438eaa 00007efc7c43fd53 00007efc7c43fcd9 00007efc7c43fc69 00007efc7c43fc31 00007efc7c43edfd 0000000000388634
0709 12:22:49.963348 (+105431us) spinlock_profiling.cc:243] Waited 7.85 ms on lock 0x7b1800171dc0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793f23f3 00007efc793f47c1 00007efc793f4779 00007efc793f4709 00007efc793f46d1 00007efc793f39cd 0000000000388634 0000000000388479 00007efc793d583a
0709 12:22:50.475697 (+512349us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b5400216220. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c458142 00007efc7c438eaa 00007efc7c43fd53 00007efc7c43fcd9 00007efc7c43fc69 00007efc7c43fc31 00007efc7c43edfd 0000000000388634 0000000000388479 00007efc793f2475
0709 12:22:59.914962 (+9439265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86821,"raft.queue_time_us":88139,"raft.run_cpu_time_us":25652,"raft.run_wall_time_us":1076418,"spinlock_wait_cycles":87407744,"thread_start_us":79452,"threads_started":1,"wal-append.queue_time_us":212012,"wal-append.run_cpu_time_us":3433,"wal-append.run_wall_time_us":1268123}
I20260709 12:23:00.149199 19245 raft_consensus.cc:1240] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:00.152298 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:00.154199 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:00.157253 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:00.158324 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:00.158718 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:00.177238 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:00.180935 18523 raft_consensus.cc:1240] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:00.141443 21357 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:00.145838 21331 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:00.151341 21359 consensus_queue.cc:1059] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:23:00.165709 21351 raft_consensus.cc:2749] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:00.173462 19239 raft_consensus.cc:2468] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:23:00.175289 21422 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:00.261230 21273 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:00.261482 21422 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.193511 21424 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.263309 21424 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.266816 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:00.272109 18527 raft_consensus.cc:2410] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:23:00.250346 21395 raft_consensus.cc:3055] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:00.256219 21359 raft_consensus.cc:3055] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:00.256119 21357 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:23:00.290706 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 158298us
W20260709 12:23:00.298041 18527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57384 (request call id 1861) took 1365 ms (client timeout 1658 ms). Trace:
W20260709 12:23:00.298655 18527 rpcz_store.cc:269] 0709 12:22:58.932559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.935066 (+  2507us) service_pool.cc:224] Handling call
0709 12:22:59.889632 (+954566us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b5800002798. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:23:00.266632 (+377000us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b5800002798. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bae9c 00007efc793baa5b 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:23:00.297975 (+ 31343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9157120}
W20260709 12:23:00.299456 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.211912 21290 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.306003 21188 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.306807 21422 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:00.313396 21411 raft_consensus.cc:3055] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:00.315582 18522 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:23:00.302711 18644 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:23:00.302733 21420 log.cc:927] Time spent T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:23:00.296016 21359 raft_consensus.cc:740] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:00.296392 21395 raft_consensus.cc:740] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:00.331660 18644 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:23:00.346777 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 50188.2us
I20260709 12:23:00.327641 21411 raft_consensus.cc:740] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:00.348275 18646 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:00.350648 18646 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:00.352355 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:00.327476 21290 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.356935 18676 raft_consensus.cc:2368] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 5. Current term is 6.
I20260709 12:23:00.336529 21359 consensus_queue.cc:260] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.360275 21359 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:00.360962 21426 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:00.364342 21411 consensus_queue.cc:260] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:00.365005 21351 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:00.336727 21395 consensus_queue.cc:260] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:00.366043 21351 raft_consensus.cc:697] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:00.367182 21395 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:00.367218 21351 consensus_queue.cc:237] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:00.373652 21290 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:00.375504 21188 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:00.380549 21424 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:00.381393 21424 raft_consensus.cc:2749] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:00.385155 21431 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:00.391079 21331 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:00.405577 21421 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.416673 18524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 365) took 1867 ms. Trace:
I20260709 12:23:00.417197 18524 rpcz_store.cc:276] 0709 12:22:58.549684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:59.236678 (+686994us) service_pool.cc:224] Handling call
0709 12:22:59.237061 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:59.451301 (+214240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:00.416298 (+964997us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400287154. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:00.416591 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490497280}
I20260709 12:23:00.419173 21369 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:00.412483 21421 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:00.425081 21421 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:00.482293 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 128624us
I20260709 12:23:00.483165 18644 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:00.488230 21422 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:00.488631 18644 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:00.489522 21422 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:00.489940 18644 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:00.490718 21422 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:00.491113 18644 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:00.491676 18529 raft_consensus.cc:2410] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:23:00.491964 21422 raft_consensus.cc:2804] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:00.492224 21295 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.492314 18644 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:00.496803 21295 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.497515 18644 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:00.498327 21331 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:00.498736 21331 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:00.499099 21331 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.499630 21422 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.500056 21422 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.502211 21431 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:00.504820 18644 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:00.507022 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 157204us
I20260709 12:23:00.508081 18646 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:00.508108 18644 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:00.510514 18644 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:00.509699 21424 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:00.512051 21430 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:00.512795 21430 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:00.513362 21430 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:00.515192 21429 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:00.515789 21429 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.518293 21429 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:00.526413 21430 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:00.514729 21331 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:00.529179 21429 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:00.534407 18494 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:00.535497 21232 raft_consensus.cc:2804] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:00.535938 21232 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:00.536381 21232 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:00.538728 18494 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:00.539201 21331 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:00.531879 21357 raft_consensus.cc:697] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:00.544394 21429 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.544958 21357 consensus_queue.cc:237] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.548061 21429 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:00.552155 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:00.553638 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:00.540872 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 558871us
I20260709 12:23:00.563930 21373 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:23:00.541783 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 558696us
I20260709 12:23:00.564433 21373 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:00.564852 21373 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:00.566316 21422 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.567706 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:00.569286 18494 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:00.577432 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:00.578981 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:23:00.581276 18529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1510) took 2100 ms (client timeout 1719 ms). Trace:
I20260709 12:23:00.581528 18530 raft_consensus.cc:1275] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
W20260709 12:23:00.581710 18529 rpcz_store.cc:269] 0709 12:22:58.480435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.517958 (+ 37523us) service_pool.cc:224] Handling call
0709 12:23:00.581066 (+2063108us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b5400286c54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:00.581209 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4477435648}
I20260709 12:23:00.582158 21286 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:00.581861 18530 pending_rounds.cc:85] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 4
I20260709 12:23:00.586184 18530 pending_rounds.cc:107] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:23:00.586351 18494 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:00.586582 18530 raft_consensus.cc:2889] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:00.587890 18494 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:00.589248 18494 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:00.590027 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:00.590747 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:00.591681 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 81209.7us
I20260709 12:23:00.510524 21351 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:00.602928 18644 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:00.603590 18598 raft_consensus.cc:2393] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:00.602914 18494 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:00.607730 21295 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:00.608410 21295 consensus_queue.cc:1048] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:00.606117 21429 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:00.611295 21422 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:00.602415 21431 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:00.596596 21286 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:00.612201 21339 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:00.596071 21290 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:00.601938 21255 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:00.613798 21232 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:00.615375 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 50657.4us
W20260709 12:23:00.617596 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 53440.1us
I20260709 12:23:00.618734 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:00.618965 21188 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.619884 21399 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:00.620220 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:00.602255 21351 consensus_queue.cc:1059] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:23:00.621346 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:00.622211 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:00.622936 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:00.623538 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:00.595575 21437 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:00.624878 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:00.626089 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:00.629609 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.635126 18644 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:00.649914 18572 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:00.661947 18598 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:00.662879 18572 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:00.663306 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:00.664044 18572 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:00.660887 21188 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.665441 21417 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:00.666082 21417 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:00.666729 21215 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:00.667275 21215 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:00.667657 21215 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.650195 18570 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:00.668464 21254 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:00.666791 21188 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:00.664892 18572 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:00.655153 21255 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:00.676296 21255 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.677466 21219 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:00.677980 21219 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:00.678216 18605 raft_consensus.cc:2393] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 7: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:00.678382 21219 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:00.680466 21357 raft_consensus.cc:3055] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:00.680908 21357 raft_consensus.cc:740] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:00.647406 21339 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.681579 21339 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:00.681782 21357 consensus_queue.cc:260] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.682363 21373 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.683065 21357 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:00.626642 21433 consensus_queue.cc:1048] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:23:00.642817 21429 consensus_queue.cc:1059] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:23:00.644170 21424 consensus_queue.cc:1059] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:23:00.684168 18572 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:00.648274 21383 consensus_queue.cc:1059] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 12:23:00.693172 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 58045.4us
I20260709 12:23:00.684465 21437 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:00.693984 18644 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:00.694384 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 47060.3us
I20260709 12:23:00.695691 18494 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:00.698298 18494 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:00.703541 18644 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:00.705497 18646 leader_election.cc:336] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.909s (SENT)
I20260709 12:23:00.706314 18646 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:00.717134 18494 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:00.732352 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.714587 18644 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:00.733975 18494 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:00.736539 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:00.736254 18572 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:00.741153 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:00.743433 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:00.741937 18599 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:00.744221 18602 raft_consensus.cc:2393] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 7: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:00.746276 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:00.746892 18606 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.700531 21428 raft_consensus.cc:3055] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:00.696854 21437 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:00.702392 21351 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:00.699086 21188 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:00.715850 21439 raft_consensus.cc:3055] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:00.702497 21290 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:00.760459 21201 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:00.778952 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:23:00.758971 21442 log.cc:927] Time spent T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:23:00.768405 18644 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:00.700519 21440 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:00.749620 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:00.782773 18601 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:23:00.710875 18425 catalog_manager.cc:5697] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:00.707671 21262 consensus_queue.cc:1059] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:23:00.788645 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:00.789525 18671 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:00.709648 21429 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:00.770869 21424 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.729748 21232 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:00.713967 21427 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:00.776247 18602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15e3196fc974445e967d05514226ac45"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
W20260709 12:23:00.777863 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 152715us
I20260709 12:23:00.740921 21433 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:00.780025 18599 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.779459 21290 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.760123 21299 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:00.708485 21415 consensus_queue.cc:1059] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 12:23:00.760392 21428 raft_consensus.cc:740] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:00.792016 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:00.713480 21359 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:00.793988 18606 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:00.781457 21188 raft_consensus.cc:697] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:00.830593 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:00.831388 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:00.831647 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:00.866981 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:00.833019 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:00.767490 21404 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:00.822121 18644 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:00.782109 21430 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:00.773295 21439 raft_consensus.cc:740] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:00.788096 21440 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.838537 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:00.846335 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:00.847070 21255 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.895732 19246 raft_consensus.cc:2368] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7.
I20260709 12:23:00.848659 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:00.853861 21215 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.790182 21434 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:00.790549 21199 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:00.856367 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:00.898551 18526 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.787712 21201 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:00.857139 21431 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:00.857625 21428 consensus_queue.cc:260] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:00.858573 21339 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:00.859205 18599 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:00.860831 21219 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.868119 18527 raft_consensus.cc:2410] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 10 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:23:00.869350 21427 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:00.872809 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 202718us
I20260709 12:23:00.876348 21415 raft_consensus.cc:3055] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:00.791736 21373 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:00.886433 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 64407.2us
I20260709 12:23:00.844157 18425 catalog_manager.cc:5697] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 4 to 6, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 6 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:00.823949 21448 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:00.839789 21290 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:00.877866 21422 raft_consensus.cc:3055] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:00.896870 18525 raft_consensus.cc:2393] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 5: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:00.901361 18572 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:00.934149 18572 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:00.902487 18521 raft_consensus.cc:1240] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:00.889213 21312 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:00.884450 21444 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:00.835119 21424 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:00.944484 21428 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:00.944993 21312 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:00.946219 21424 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:00.891949 21433 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:00.904760 21199 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:00.908739 21439 consensus_queue.cc:260] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.947960 18677 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4.
I20260709 12:23:00.947993 21433 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.948638 21439 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:00.949059 21433 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:00.939459 21262 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:00.939607 21287 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:00.953922 21188 consensus_queue.cc:237] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.918206 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:00.918483 18527 raft_consensus.cc:1240] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:00.908953 21431 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.892910 21440 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.920569 21415 raft_consensus.cc:740] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:00.961192 18425 catalog_manager.cc:5697] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 3 to 5, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 5 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:00.962391 21415 consensus_queue.cc:260] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.963688 21415 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:00.921672 21373 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:00.939514 21422 raft_consensus.cc:740] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:00.965060 21373 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:00.965704 21395 raft_consensus.cc:3055] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:00.966123 21395 raft_consensus.cc:740] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:00.966174 21422 consensus_queue.cc:260] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:00.922142 21452 consensus_queue.cc:1048] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:00.893801 21359 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:00.927474 21427 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:00.928151 18570 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:00.930182 18526 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
W20260709 12:23:00.939587 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.939584 18644 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:00.888456 21404 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:00.967052 21395 consensus_queue.cc:260] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:00.990860 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.962860 18425 catalog_manager.cc:5697] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 1 to 3, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 3 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:00.947455 21312 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:00.997603 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 58105us
I20260709 12:23:00.968359 18529 raft_consensus.cc:2393] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 7: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:01.004074 18671 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
I20260709 12:23:00.959632 18530 raft_consensus.cc:2410] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:23:00.967451 21422 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:01.008474 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 88721.8us
I20260709 12:23:01.013234 18644 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:01.015821 18425 catalog_manager.cc:5697] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 2 to 5, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 5 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:00.974359 21450 log.cc:927] Time spent T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:23:01.019881 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:01.020869 18677 raft_consensus.cc:1240] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:00.967680 21359 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:01.039237 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.053901 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:01.049098 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:00.981922 21431 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:00.986424 21373 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:00.986441 21339 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:00.972894 21411 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.984607 21199 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:01.080277 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:01.018770 21247 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:00.986964 21437 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.024547 18644 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:00.976835 21215 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:00.984498 21201 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:00.992901 21219 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:00.987524 21255 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:01.015103 21357 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:23:01.067162 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.372798 21357 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:01.373298 21357 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:01.373613 21255 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.374135 21255 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.376255 21255 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:01.378765 21255 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.071346 18680 raft_consensus.cc:2393] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 5: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:01.381103 21357 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.381222 21255 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.383334 21357 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:01.385888 21255 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:01.028339 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:23:01.386714 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 362225us
W20260709 12:23:01.346154 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:01.318740 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 474809us
I20260709 12:23:01.199424 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:01.092515 21247 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.388187 21247 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:01.390264 19210 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:01.145963 21359 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:01.291541 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:01.391084 21357 raft_consensus.cc:2804] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:01.391393 18677 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:23:01.391659 21357 raft_consensus.cc:697] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:01.280260 18606 raft_consensus.cc:1240] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:01.211650 21290 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.392813 21357 consensus_queue.cc:237] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.394325 21290 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:01.226219 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:01.395344 18673 raft_consensus.cc:2410] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:23:01.292672 18676 raft_consensus.cc:1240] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
W20260709 12:23:01.168643 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.151865 21254 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.397831 21254 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.399048 18644 leader_election.cc:400] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Vote denied by peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879) with higher term. Message: Invalid argument: T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7.
I20260709 12:23:01.399394 18644 leader_election.cc:403] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:23:01.213025 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:01.399955 21422 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879) with higher term. Message: Invalid argument: T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7.
I20260709 12:23:01.400502 18597 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:23:01.104250 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:01.153721 18678 raft_consensus.cc:1275] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:23:01.402930 18678 pending_rounds.cc:85] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting all ops after (but not including) 3
I20260709 12:23:01.403192 18678 pending_rounds.cc:107] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:23:01.403409 18678 raft_consensus.cc:2889] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:01.405097 21247 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.188726 18603 raft_consensus.cc:1240] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:01.407228 21247 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:01.303800 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:01.202720 21433 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.409878 21433 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:01.177608 21299 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:01.301580 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:01.117379 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:01.173718 21440 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.410615 21299 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.411403 19246 raft_consensus.cc:2393] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 4: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:01.412782 21299 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:01.178501 21417 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:01.413203 21440 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:01.413516 21417 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.413985 21440 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:01.414772 21440 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:01.180584 21453 log.cc:927] Time spent T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.242s	user 0.000s	sys 0.002s
I20260709 12:23:01.417121 18522 raft_consensus.cc:2393] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 8: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:01.415570 21417 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:01.137329 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:01.061657 21429 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:01.419782 21429 raft_consensus.cc:697] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:01.420317 18603 raft_consensus.cc:1240] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:01.420815 21429 consensus_queue.cc:237] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:01.422308 18606 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:23:01.295864 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 200836us
I20260709 12:23:01.423393 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:01.424013 18597 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:23:01.281847 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:01.082261 18529 raft_consensus.cc:2955] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Committing config change with OpId 4.3: config changed from index -1 to 3, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:23:01.419812 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:01.419816 18605 raft_consensus.cc:1240] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:01.427889 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:01.428504 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:01.400076 21254 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:01.430433 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:01.431190 18604 raft_consensus.cc:2393] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 5: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:01.162362 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:01.431910 21254 consensus_queue.cc:1059] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:01.161425 21404 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:01.157881 21437 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:01.432720 21459 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.065181 21395 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:01.433259 21459 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:01.435384 21459 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:01.159543 21427 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:01.221800 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:01.435849 18603 raft_consensus.cc:1240] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:01.435938 21233 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:01.436259 18527 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:01.437528 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 47352.8us
W20260709 12:23:01.100612 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.116511 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:01.440172 18530 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:01.440402 18644 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:01.442768 21254 raft_consensus.cc:3055] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:01.443179 21254 raft_consensus.cc:740] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:01.115208 21199 consensus_queue.cc:1059] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 12:23:01.444259 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:01.444427 21199 raft_consensus.cc:3055] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:01.444881 21199 raft_consensus.cc:740] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:01.445346 21433 consensus_queue.cc:1059] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:23:01.158627 21450 log.cc:927] Time spent T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:23:01.445737 20900 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:01.447288 20900 raft_consensus.cc:3055] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:01.063305 20815 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:23:01.073513 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 303541us
I20260709 12:23:01.447670 20900 raft_consensus.cc:740] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:01.447906 20815 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.448575 20900 consensus_queue.cc:260] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.282703 18570 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:23:01.449164 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.449071 18494 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:01.449071 21290 consensus_queue.cc:1059] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:01.450040 20815 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:01.450366 18494 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:01.450552 18528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1546) took 1426 ms. Trace:
I20260709 12:23:01.386933 18675 raft_consensus.cc:2410] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:23:01.393339 18524 raft_consensus.cc:2393] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 7: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:01.451350 21457 raft_consensus.cc:2749] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:01.452559 18494 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:01.422209 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:01.453646 21290 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:01.453711 18494 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:01.455848 21290 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:01.450969 18528 rpcz_store.cc:276] 0709 12:23:00.024364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.024657 (+   293us) service_pool.cc:224] Handling call
0709 12:23:00.024992 (+   335us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:00.029429 (+  4437us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:23:00.616952 (+587523us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b1800380680. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793d4e07 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793ef455 00007efc7fed73c7 00007efc7c4e99a7 00007efc7c4f25e5 00007efc7c4f2568
0709 12:23:00.695334 (+ 78382us) log.cc:844] Serialized 14 byte log entry
0709 12:23:00.868549 (+173215us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:00.870043 (+  1494us) log.cc:844] Serialized 52 byte log entry
0709 12:23:00.870176 (+   133us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:00.870400 (+   224us) log.cc:844] Serialized 14 byte log entry
0709 12:23:00.870740 (+   340us) log.cc:844] Serialized 14 byte log entry
0709 12:23:00.872367 (+  1627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:00.872578 (+   211us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:00.973649 (+101071us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:23:01.450322 (+476673us) raft_consensus.cc:1685] finished
0709 12:23:01.450343 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:01.450495 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":276812,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":96,"raft.queue_time_us":106133,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":10907,"spinlock_wait_cycles":89724032,"thread_start_us":190609,"threads_started":3,"wal-append.queue_time_us":196980}
I20260709 12:23:01.456349 21219 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.456938 21219 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.457439 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:01.446045 21422 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:01.458664 21422 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.459070 21422 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:01.459127 21219 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:01.459371 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:01.460286 21421 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:01.450914 21255 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:01.460713 21421 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.461215 21421 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:01.461058 21359 consensus_queue.cc:1059] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:01.462007 21437 raft_consensus.cc:3055] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:01.462355 21437 raft_consensus.cc:740] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:23:01.449895 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 167289us
I20260709 12:23:01.465716 21201 consensus_queue.cc:1059] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:01.432507 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:01.444018 21254 consensus_queue.cc:260] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.467818 21254 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:01.468101 19210 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:01.468856 21233 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:01.469331 21233 raft_consensus.cc:697] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:01.470291 21233 consensus_queue.cc:237] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:01.454845 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:01.450572 20815 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:01.369467 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 193392us
W20260709 12:23:01.475148 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.475270 21404 raft_consensus.cc:3055] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:01.475929 21404 raft_consensus.cc:740] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:01.476399 18646 leader_election.cc:336] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.719s (SENT)
W20260709 12:23:01.477504 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.477159 21404 consensus_queue.cc:260] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.478574 18646 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:01.479331 21451 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:01.479957 21427 consensus_queue.cc:1059] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:01.480134 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:01.480746 18600 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:01.062950 18425 catalog_manager.cc:5697] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 2 to 3, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 3 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:01.481793 21439 raft_consensus.cc:3055] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:01.482208 21439 raft_consensus.cc:740] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:01.482525 21427 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:01.482456 18425 catalog_manager.cc:5697] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 3 to 6, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 6 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:01.483110 21439 consensus_queue.cc:260] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.484320 21439 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:01.485031 20900 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:01.484777 18425 catalog_manager.cc:5697] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 4 to 5, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 5 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:01.451139 21452 raft_consensus.cc:3055] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:01.366612 18602 raft_consensus.cc:606] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:01.463127 21437 consensus_queue.cc:260] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.488013 21452 raft_consensus.cc:740] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:01.488737 21437 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:01.488929 21452 consensus_queue.cc:260] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.490238 21452 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:01.200330 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:01.491735 19244 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:23:01.497664 18572 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:01.464155 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:01.445721 21199 consensus_queue.cc:260] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.500913 21199 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:01.500990 21416 consensus_queue.cc:1175] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" responder_term: 4 status { last_received { term: 4 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 4 index: 3 } }
I20260709 12:23:01.509714 21215 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:01.510447 21215 raft_consensus.cc:697] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:01.511623 21215 consensus_queue.cc:237] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:01.515187 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:01.518611 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 50574.3us
I20260709 12:23:01.521066 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:01.522693 18570 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:01.529829 21201 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:01.541896 21440 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:01.542438 18570 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:01.543957 21417 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:01.544531 21417 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:01.544988 21417 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:01.487350 18425 catalog_manager.cc:5697] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 1 to 2, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:01.549659 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:01.550551 18675 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
I20260709 12:23:01.527446 18646 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:01.544070 21404 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:01.543460 18570 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:01.560688 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:01.561365 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:01.567062 20900 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:01.561671 21219 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:01.569487 18604 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 3.
I20260709 12:23:01.571492 21422 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:01.574898 18530 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:01.577355 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:01.577834 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 50511.5us
W20260709 12:23:01.569286 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 55863.3us
I20260709 12:23:01.639998 18572 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:01.566507 18527 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:01.580267 18600 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:01.641077 18599 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
I20260709 12:23:01.641933 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:01.643158 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:01.643946 18600 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:01.637850 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:01.635020 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:01.645778 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:01.581277 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:01.554049 18425 catalog_manager.cc:5697] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:01.586148 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:01.591529 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:01.592659 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:01.594223 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.632652 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:01.648209 18672 raft_consensus.cc:2393] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 9: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:01.615131 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:01.648326 18675 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:23:01.619299 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:01.619552 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:01.648705 18680 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:23:01.648728 18425 catalog_manager.cc:5697] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:01.620850 18570 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:01.652530 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:01.629760 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:01.630697 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:01.656641 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:01.609081 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:01.657353 18521 raft_consensus.cc:2393] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 8: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:01.657389 18676 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:01.652777 18528 raft_consensus.cc:1275] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:23:01.653226 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:01.658469 18673 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:23:01.653329 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:01.600955 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:01.653636 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:01.654354 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:01.660486 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:01.661615 18524 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:23:01.636199 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:01.662479 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:01.663070 19246 raft_consensus.cc:2393] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 7: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:01.663128 18523 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:01.651945 21440 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:01.664439 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:01.664347 21440 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.665400 21433 consensus_queue.cc:1059] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:01.666070 21433 consensus_queue.cc:1243] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer 2f9872512f1646bc835906bd0e98c6a7 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:23:01.666486 21440 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:01.664630 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:01.666590 21433 consensus_queue.cc:1048] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:01.667294 18601 raft_consensus.cc:2393] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 8: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:01.671953 21359 raft_consensus.cc:3055] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:01.672410 21359 raft_consensus.cc:740] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:01.672696 21422 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:01.673362 21359 consensus_queue.cc:260] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.674873 21359 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:01.675163 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:01.675992 18605 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:23:01.677270 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:01.677883 18522 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:23:01.679082 21417 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:01.654956 18599 raft_consensus.cc:1240] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:23:01.682677 18527 raft_consensus.cc:1240] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:01.683825 21219 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:01.859516 18676 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:01.684890 21439 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:01.632476 20815 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:23:01.660558 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:01.686530 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 65857us
I20260709 12:23:01.869269 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:01.711551 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:01.638212 21459 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.872013 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:01.872787 18525 raft_consensus.cc:2368] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7.
I20260709 12:23:01.811261 21215 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:01.873545 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:01.810571 18572 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:23:01.874809 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 64337.3us
I20260709 12:23:01.875844 18572 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:01.876967 21219 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:01.877489 21219 raft_consensus.cc:697] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:01.816583 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:01.878396 21219 consensus_queue.cc:237] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.791109 18425 catalog_manager.cc:5697] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:01.880728 18597 raft_consensus.cc:2393] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 7: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:01.636030 21415 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.809631 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:01.886180 18572 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:01.784482 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:01.888298 18572 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:01.784570 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:01.889102 18680 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:01.813556 18600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "298b8c963d93464e999fee75e74e9781"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:01.890661 18600 raft_consensus.cc:606] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:01.890895 18572 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:01.891204 18600 raft_consensus.cc:614] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:01.686179 21369 consensus_queue.cc:1059] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.134s
I20260709 12:23:01.830147 21440 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:01.830708 21290 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.830380 21421 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:01.833838 21255 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:01.834410 21458 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.836377 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:01.840183 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:01.907790 18529 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:23:01.908874 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:01.848793 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:01.846446 18604 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:23:01.818130 18602 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:01.851670 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:01.850257 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:01.852636 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:01.855499 18677 raft_consensus.cc:1240] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:23:01.755316 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:01.911787 18528 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:23:01.912098 18522 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:01.913204 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:01.743383 21247 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:23:01.684319 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 83479.5us
I20260709 12:23:01.916815 18677 raft_consensus.cc:1240] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:01.867329 18494 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:01.894987 21199 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:01.811964 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:01.873299 21215 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:01.808064 18671 raft_consensus.cc:1240] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:01.877614 21188 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:01.883445 18525 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:23:01.925582 18525 raft_consensus.cc:1240] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:01.925781 18521 raft_consensus.cc:1240] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:23:01.872068 18678 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:23:01.871647 18570 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:01.927856 18679 raft_consensus.cc:2410] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:23:01.893392 18672 raft_consensus.cc:2393] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 7: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:01.895272 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:01.930423 18525 raft_consensus.cc:1240] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:01.908891 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:01.867499 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:01.931319 18524 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:01.917745 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 50519.4us
I20260709 12:23:01.872330 21459 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:01.922297 18675 raft_consensus.cc:2393] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 8: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:01.896497 20815 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:01.898509 21395 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:23:01.897457 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.809131 21201 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:01.931464 18522 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:23:01.932265 18494 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:01.892756 21415 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.898123 21254 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:23:01.922851 21451 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:23:01.951174 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.905092 21299 consensus_queue.cc:1059] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:23:01.902550 21440 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.974133 18598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:01.927137 21199 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:01.906579 21290 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.974974 18598 raft_consensus.cc:606] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:23:01.983064 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 50873.2us
I20260709 12:23:01.933296 21247 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:01.983383 18598 raft_consensus.cc:614] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:01.978957 18644 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:01.935523 20815 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:01.927018 21439 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:23:02.013346 18529 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:23:01.984423 18603 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:01.984135 18494 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:02.005035 18644 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:02.006029 18524 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:01.962256 21395 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:02.006672 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 60424.3us
I20260709 12:23:01.984388 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:02.026873 18527 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:23:02.011507 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:02.027649 18600 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:02.010373 19242 raft_consensus.cc:2393] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 5: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:01.985294 21199 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:02.020573 18494 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:01.916993 21255 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.923638 21458 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:01.960395 21188 raft_consensus.cc:697] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:01.985597 21451 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:01.982834 21417 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:02.010736 20815 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:02.022442 21456 log.cc:927] Time spent T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.003s
W20260709 12:23:02.020310 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 148839us
I20260709 12:23:02.021009 20900 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:02.021942 21395 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:02.022619 21422 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:02.056264 18570 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:23:02.065029 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.026805 21373 raft_consensus.cc:2804] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:02.065688 18526 raft_consensus.cc:2393] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:02.066295 18570 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:02.067683 21312 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:02.068384 21312 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:23:02.072077 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 48706us
I20260709 12:23:02.059674 21255 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:01.986502 21428 consensus_queue.cc:1059] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:23:02.086400 18603 raft_consensus.cc:1275] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:02.088963 18600 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:23:02.090044 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:02.092108 18677 raft_consensus.cc:2368] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5.
W20260709 12:23:02.107007 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 86498.1us
I20260709 12:23:02.109202 18679 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:23:02.109656 18679 pending_rounds.cc:85] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting all ops after (but not including) 2
I20260709 12:23:02.109901 18679 pending_rounds.cc:107] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:23:02.110136 18679 raft_consensus.cc:2889] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:02.110379 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:02.112089 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:02.112906 18529 raft_consensus.cc:1275] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:23:02.111613 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:02.106789 18600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:02.114135 18600 raft_consensus.cc:606] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:02.112217 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:02.115507 18677 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:23:02.117951 18494 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:02.119871 18494 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:23:02.099610 21475 log.cc:927] Time spent T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:23:02.117661 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:02.126719 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:02.074436 21373 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:23:02.139024 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 48751.8us
I20260709 12:23:02.140362 19210 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:02.144296 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.098232 21255 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:02.146899 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.147766 18527 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:23:02.153740 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 55439.1us
I20260709 12:23:02.153793 19210 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:02.102453 20900 raft_consensus.cc:697] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:02.123909 21428 consensus_queue.cc:1243] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer a0dee333a83a45f1ab0c1bb6d094afd1 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:23:02.162458 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:02.140534 21373 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:02.173432 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 84912.8us
W20260709 12:23:02.182917 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 88498us
I20260709 12:23:02.184578 18646 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:02.155131 21480 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:23:02.191706 18475 auto_rebalancer.cc:629] Failed to schedule move for tablet 6874b99e69744371a73c71762816db62: Illegal state: Replica 2f9872512f1646bc835906bd0e98c6a7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:02.165584 21485 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:02.156155 21421 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:02.179852 21215 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:02.187577 21467 log.cc:927] Time spent T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 12:23:02.155956 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:02.154683 21451 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:02.215719 21440 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:02.217294 21415 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:02.159876 21433 consensus_queue.cc:1048] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 12:23:02.217893 21359 consensus_meta.cc:287] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.543s	user 0.012s	sys 0.000s
I20260709 12:23:02.158972 21188 consensus_queue.cc:237] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.191874 20900 consensus_queue.cc:237] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.239228 18644 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:02.284780 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 45678.7us
W20260709 12:23:02.269433 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 84950.8us
I20260709 12:23:02.239060 21073 raft_consensus.cc:3055] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:02.239144 21485 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.238792 21305 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:02.276422 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 173064us
I20260709 12:23:02.238390 21459 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:02.229707 21484 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:23:02.267095 21476 log.cc:927] Time spent T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 12:23:02.264966 21451 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.283483 19240 raft_consensus.cc:2368] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5.
I20260709 12:23:02.287448 18646 leader_election.cc:400] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7.
W20260709 12:23:02.274622 21477 log.cc:927] Time spent T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:23:02.290772 18602 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:23:02.296164 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:02.297161 18524 raft_consensus.cc:1240] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:02.270532 21290 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:02.301884 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 143155us
I20260709 12:23:02.264164 21199 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.397873 18598 raft_consensus.cc:1240] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:02.300890 21485 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:02.362648 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 242861us
I20260709 12:23:02.276612 21437 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:23:02.372502 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 85257.3us
I20260709 12:23:02.311429 21305 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:02.295130 21359 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:02.293803 21073 raft_consensus.cc:740] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:02.382550 18572 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:02.384287 21373 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:02.416414 21373 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:02.392804 21489 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:02.417321 21359 raft_consensus.cc:697] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:23:02.395224 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 241474us
I20260709 12:23:02.418283 21359 consensus_queue.cc:237] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:02.418550 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:02.419799 18526 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 5.
I20260709 12:23:02.416416 21305 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:02.399348 18494 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:02.284039 21422 raft_consensus.cc:697] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:02.421133 21073 consensus_queue.cc:260] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:02.422154 19212 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:02.422585 21073 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:02.408617 18646 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:02.424580 21254 raft_consensus.cc:2804] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:02.425201 21495 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:02.425704 21299 consensus_queue.cc:1048] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:02.372175 21451 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:02.411136 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.436720 18494 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:02.422158 21422 consensus_queue.cc:237] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.404438 21492 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.425017 21254 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.466921 21254 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:02.467334 21482 log.cc:927] Time spent T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.253s	user 0.002s	sys 0.000s
I20260709 12:23:02.466810 21492 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:02.469161 21199 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:02.442314 18677 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:02.473737 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:02.474396 18675 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4.
I20260709 12:23:02.475263 18494 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:02.457033 18646 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:02.476984 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 54908.8us
I20260709 12:23:02.477759 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:02.481503 18494 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:02.425422 21498 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:02.483172 21452 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:02.438829 21373 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:02.484076 21373 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:02.484443 21373 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:02.487872 21233 raft_consensus.cc:2804] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:02.488390 21233 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.488889 21233 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:02.470681 21290 consensus_queue.cc:1059] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:23:02.491627 21427 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:02.492225 21395 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.492503 20815 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.493834 18597 raft_consensus.cc:1240] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:02.494459 21395 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:02.412307 21262 raft_consensus.cc:3055] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:02.482019 18646 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:02.500355 18646 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:02.503250 21262 raft_consensus.cc:740] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:02.427460 21458 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:02.506978 18494 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:02.404310 21484 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 12:23:02.482869 21498 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:02.544795 21498 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:02.563935 21490 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:02.564411 21290 consensus_queue.cc:1243] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer a0dee333a83a45f1ab0c1bb6d094afd1 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:23:02.565058 21290 raft_consensus.cc:3055] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:02.565411 21290 raft_consensus.cc:740] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:02.566251 21290 consensus_queue.cc:260] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.567456 21290 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:02.568905 21255 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:02.496840 21427 raft_consensus.cc:697] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:02.583742 21427 consensus_queue.cc:237] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.591951 21452 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:02.592656 21452 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.595018 21452 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:02.595949 20815 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:02.597630 21219 raft_consensus.cc:1064] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
W20260709 12:23:02.598102 21219 raft_consensus.cc:1068] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9: Unable to promote non-voter 8c29c312e4544452b1162d7f81a58cb4: Service unavailable: leader transfer in progress
I20260709 12:23:02.543454 21440 raft_consensus.cc:2764] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:23:02.569061 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 62179us
I20260709 12:23:02.606560 18494 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:02.508278 21489 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:02.498202 21500 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:02.573053 21433 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.574853 21254 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.479278 21404 consensus_queue.cc:1059] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.122s
I20260709 12:23:02.600054 21219 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.621496 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:02.646060 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.615621 21500 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:02.658037 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 231889us
I20260709 12:23:02.619268 21440 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:02.647917 18494 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:02.625684 21486 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:02.614352 21496 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:23:02.647305 21452 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:02.653239 21500 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:02.620575 21433 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.683461 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:02.677191 21255 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:02.674445 21429 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.689214 21429 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.690358 21451 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.680649 21486 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.647472 21439 consensus_queue.cc:1059] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:23:02.674749 18494 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:02.702081 18494 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:23:02.703266 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 49937.2us
I20260709 12:23:02.707370 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:02.707715 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:23:02.709154 18570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.008s	sys 0.015s
W20260709 12:23:02.709591 18570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.008s	sys 0.015s
W20260709 12:23:02.709961 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 550313us
I20260709 12:23:02.710405 18494 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:02.716480 18529 raft_consensus.cc:1275] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:23:02.650985 21219 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.725250 18494 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:02.736194 18494 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:02.748785 18494 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:02.726544 20900 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.695933 21429 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:02.757196 19244 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:23:02.716596 21290 raft_consensus.cc:2749] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:02.673441 21359 consensus_queue.cc:1059] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 12:23:02.716405 21490 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:02.719549 21255 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:02.729099 21440 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:02.727536 21452 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:23:02.808074 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 96489us
I20260709 12:23:02.830885 18598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:02.832815 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:02.833602 18521 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:23:02.835425 18570 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:02.842226 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:02.843175 18597 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:23:02.766214 21255 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:02.831845 18598 raft_consensus.cc:606] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:02.856141 18644 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:02.784641 21290 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:02.761492 20900 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.839048 21440 raft_consensus.cc:697] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:02.880126 21517 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.879931 21440 consensus_queue.cc:237] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.880755 21517 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.808112 21427 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.803043 21439 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:02.807672 21287 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:02.887706 18603 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:02.838608 21489 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.827235 21516 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:02.904459 21489 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.906663 21489 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:02.907187 21489 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:02.873167 21255 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:02.897930 21287 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:02.909502 21287 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:02.916348 21255 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:02.917506 21262 consensus_queue.cc:260] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.918757 21255 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:02.919147 21262 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:02.898948 21486 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:02.899523 21254 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:02.920516 21219 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:02.767158 21490 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.873685 21451 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:02.888406 21395 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:02.920985 21500 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.883250 21215 consensus_queue.cc:1048] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:23:02.922034 21517 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:02.922319 21498 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.895884 21427 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.907685 21489 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.946954 21427 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:02.947538 21490 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:02.932176 21439 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.948575 21489 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:02.903658 21373 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.949612 21500 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:02.950712 21373 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:02.874473 21485 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.946970 21498 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:02.952816 21485 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:02.953967 20900 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:02.891399 21422 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:02.956537 21439 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:02.898815 21506 log.cc:927] Time spent T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:23:02.957644 21429 raft_consensus.cc:3055] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:02.940948 21357 raft_consensus.cc:3055] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:02.958132 21429 raft_consensus.cc:740] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:02.958351 21357 raft_consensus.cc:740] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:02.959089 21429 consensus_queue.cc:260] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.959319 21357 consensus_queue.cc:260] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.956794 21422 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.930542 21433 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:02.960500 21429 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:02.960625 21422 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:02.964262 21510 log.cc:927] Time spent T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.052s	user 0.000s	sys 0.002s
I20260709 12:23:02.965395 21492 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:02.966943 21501 log.cc:927] Time spent T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 12:23:02.956494 21233 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:02.970331 21422 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:02.973680 21422 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:02.974416 21357 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:03.017330 18524 raft_consensus.cc:2393] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 5: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
W20260709 12:23:03.018599 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 269685us
I20260709 12:23:03.022765 18528 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:03.024241 18530 raft_consensus.cc:2393] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 8: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:02.888733 18570 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:03.049893 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:03.051512 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:03.053323 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:03.054353 18604 raft_consensus.cc:1275] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:03.054980 18605 raft_consensus.cc:1240] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:03.055377 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:03.055935 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:03.058372 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:03.064319 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.070904 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:03.083467 20815 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:03.097860 21233 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:03.110325 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:03.110585 18597 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:23:03.115826 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:03.116102 21422 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:03.117020 18597 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:23:03.117415 18494 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:03.117471 21422 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:03.120132 21500 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.118287 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:03.112207 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:03.124760 18606 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:03.128172 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 44769us
I20260709 12:23:03.121506 21422 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:03.122073 21485 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:03.129671 21485 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:03.129549 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:03.131174 18527 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:23:03.122471 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:03.122807 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:03.124235 18597 raft_consensus.cc:2393] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 7: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:03.122938 21373 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:03.120818 21500 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:03.136765 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 248018us
I20260709 12:23:03.138100 18522 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:23:03.139024 21500 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:03.139770 21492 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:03.123355 21383 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:03.136381 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:03.136353 21485 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:03.140614 21492 raft_consensus.cc:697] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:03.143615 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:03.132367 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:03.154147 18602 raft_consensus.cc:2393] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 8: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:03.222275 18599 raft_consensus.cc:2393] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 5: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
W20260709 12:23:03.218890 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 75052.9us
I20260709 12:23:03.221678 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:03.150863 21373 raft_consensus.cc:697] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:03.224098 18606 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:23:03.225835 18527 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:03.147910 21383 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:03.231905 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:03.233045 18526 raft_consensus.cc:2393] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 11: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:03.234273 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:03.235191 21383 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:03.237429 18604 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:03.225850 20815 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:03.242576 20815 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:03.245323 21373 consensus_queue.cc:237] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:03.235201 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:03.247879 21331 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.224537 21492 consensus_queue.cc:237] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:03.250408 21331 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:03.255968 21331 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:03.256302 18570 leader_election.cc:400] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5.
I20260709 12:23:03.256724 18570 leader_election.cc:403] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:23:03.256508 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:03.257833 19240 raft_consensus.cc:2393] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 7: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:03.229940 18521 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:03.235656 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:03.281734 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:03.287062 18528 raft_consensus.cc:2368] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:23:03.292515 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:03.293460 18676 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:23:03.293170 21262 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:03.295504 18426 catalog_manager.cc:5697] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:03.299336 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:03.299494 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:03.300239 18677 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:23:03.300442 18598 raft_consensus.cc:2368] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7.
I20260709 12:23:03.300872 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:03.301532 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:03.301677 21215 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5.
I20260709 12:23:03.302258 18677 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:03.302110 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:03.292759 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:03.301555 18599 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:03.301705 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:03.305954 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:03.307303 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:03.308068 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:03.308786 18597 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:03.308926 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:03.310241 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:03.310365 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:03.311295 18679 raft_consensus.cc:2393] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 4: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:03.312493 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:03.313297 18680 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:03.313639 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:03.315245 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:03.315968 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:03.317436 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:03.318360 18603 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:23:03.319939 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:03.320604 18601 raft_consensus.cc:2393] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 5: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:03.324349 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:03.324596 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:03.324958 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:03.325265 18600 raft_consensus.cc:2393] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 5: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:03.325681 18605 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:23:03.325927 18524 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:23:03.327064 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:03.327708 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:03.332748 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:03.333998 18528 raft_consensus.cc:2368] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8.
I20260709 12:23:03.336190 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:03.337014 18604 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:23:03.337917 18530 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:03.338049 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:03.338004 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:03.315977 18522 raft_consensus.cc:2393] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:03.344211 18672 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:23:03.344410 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:03.344907 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:03.345173 18522 raft_consensus.cc:1275] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:23:03.345552 18522 pending_rounds.cc:85] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 4
I20260709 12:23:03.345613 18605 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:03.320622 21215 raft_consensus.cc:993] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:23:03.348519 21215 raft_consensus.cc:1081] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:23:03.348627 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:03.348753 18675 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:23:03.349402 19244 raft_consensus.cc:1275] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:03.349591 21496 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:03.350355 21496 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:03.354002 21496 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:03.358498 18526 raft_consensus.cc:1240] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:03.362084 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:03.362774 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:03.311489 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:03.345854 18522 pending_rounds.cc:107] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:23:03.370771 18522 raft_consensus.cc:2889] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:03.372113 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:03.318379 18572 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:03.375025 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 56832.4us
I20260709 12:23:03.377030 18572 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:03.378086 18426 catalog_manager.cc:5697] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 2 to 5, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 5 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:03.380302 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:03.384361 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:03.327623 18524 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:23:03.387337 21496 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.388018 21496 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:03.388430 18524 raft_consensus.cc:1275] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:03.389814 18524 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:03.390504 21496 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:03.393512 21500 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:03.394308 21500 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:03.397083 21500 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:03.397502 18646 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:03.400857 21433 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:03.401503 21433 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.402034 21433 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:03.402755 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:03.408494 18426 catalog_manager.cc:5697] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index -1 to 3, term changed from 1 to 6, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 6 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:23:03.413551 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:03.420061 21357 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.444420 18525 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
I20260709 12:23:03.444480 21357 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:03.445931 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 48884.1us
I20260709 12:23:03.420499 21254 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:03.421135 21188 consensus_queue.cc:1059] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:03.421818 21487 raft_consensus.cc:2804] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:03.422084 21422 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:03.446477 19212 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:03.453872 18676 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:23:03.424556 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:03.425346 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 48514.5us
I20260709 12:23:03.428287 18527 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 6.
I20260709 12:23:03.456938 18597 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:03.434466 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:03.435333 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:03.436602 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:03.436937 18524 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:03.446843 18672 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 6.
I20260709 12:23:03.459129 18680 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:23:03.439360 18426 catalog_manager.cc:5697] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:03.432617 18679 raft_consensus.cc:1275] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:23:03.458587 18530 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:23:03.465006 18599 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:23:03.465629 18602 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:03.461586 18679 pending_rounds.cc:85] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting all ops after (but not including) 3
I20260709 12:23:03.469911 18679 pending_rounds.cc:107] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:23:03.470265 18679 raft_consensus.cc:2889] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:03.471328 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:03.472775 18672 raft_consensus.cc:2393] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 5: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:03.451660 21254 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.484429 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:03.485535 18598 raft_consensus.cc:2393] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 8: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:03.485745 18675 raft_consensus.cc:1275] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:23:03.486157 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:03.486934 19212 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:03.487599 21254 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:03.494228 19244 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
W20260709 12:23:03.498750 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 45759.4us
I20260709 12:23:03.491526 18677 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:03.496737 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:03.494113 18646 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:03.503136 18678 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:03.488003 21496 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:03.483223 21487 raft_consensus.cc:697] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:03.504846 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:03.482605 21500 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:03.517634 18673 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:23:03.513083 21496 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.528533 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:03.538312 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:03.498355 21422 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:23:03.548331 18524 raft_consensus.cc:2393] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 9: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:03.544730 18676 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:23:03.532567 21496 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:03.562400 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 88858.4us
I20260709 12:23:03.557354 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:23:03.564604 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.570958 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:03.558722 21357 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:23:03.575449 18676 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:23:03.548583 21500 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:03.581547 21305 raft_consensus.cc:2804] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:03.581846 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:03.582402 21305 raft_consensus.cc:697] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:03.582341 21517 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:23:03.564970 21188 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.595108 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:03.597543 19210 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:03.591684 21524 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:03.570853 18526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:23:03.599581 18526 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:03.600062 18526 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:03.593150 21487 consensus_queue.cc:237] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:03.604118 21188 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:03.606118 21331 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:03.606711 21188 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:03.585232 21433 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:03.611986 21484 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:03.613595 21331 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:03.614252 21331 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:03.617830 21500 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:03.586674 20900 consensus_queue.cc:1048] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:23:03.585351 21305 consensus_queue.cc:237] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:03.612062 21422 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:03.625665 18678 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:03.629581 18675 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:03.639946 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:03.636934 21254 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:03.643041 18606 raft_consensus.cc:2393] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 5: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:03.644491 21500 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.644711 18494 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:03.653579 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:03.657739 20815 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:03.658644 20815 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:03.635682 21383 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:03.665112 21383 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.665542 21383 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:03.667536 18674 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:03.668905 18521 raft_consensus.cc:2410] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:23:03.640568 18675 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:03.671130 21262 raft_consensus.cc:3055] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:03.672287 21262 raft_consensus.cc:740] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:03.673291 21262 consensus_queue.cc:260] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:03.673894 18646 leader_election.cc:400] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:23:03.674240 18646 leader_election.cc:403] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:03.674631 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:03.674815 21262 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:03.675563 18646 leader_election.cc:400] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8.
I20260709 12:23:03.675910 18646 leader_election.cc:403] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:23:03.676097 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:03.680469 20815 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:03.680701 21433 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:03.688090 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 91344.5us
W20260709 12:23:03.696779 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 43710.1us
W20260709 12:23:03.699780 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 51417.1us
I20260709 12:23:03.721117 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:03.723067 18644 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:03.635982 21517 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:03.702373 21485 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:03.696362 21500 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:03.741283 18570 leader_election.cc:400] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Vote denied by peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879) with higher term. Message: Invalid argument: T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5.
I20260709 12:23:03.742008 18494 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:03.648072 21357 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 12:23:03.702833 20900 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8.
I20260709 12:23:03.741155 21485 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:03.718958 21524 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:23:03.730168 21331 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:03.758708 18570 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:23:03.784514 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 61583.2us
I20260709 12:23:03.786284 18644 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:03.787564 18644 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:03.789324 18644 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:03.760098 21485 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:03.782497 21331 raft_consensus.cc:2749] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:03.819818 21439 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:03.830600 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 88689us
W20260709 12:23:03.823964 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 72883.1us
I20260709 12:23:03.794574 21500 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:03.826802 21496 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:03.827916 21201 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.829537 21357 raft_consensus.cc:2749] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:03.821650 21373 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:03.838647 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:03.840150 18678 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:23:03.843922 21199 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:03.848702 21299 raft_consensus.cc:1064] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:23:03.849524 21548 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:03.850092 21485 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:03.860211 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:03.863912 18494 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:03.816581 21524 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:03.870414 21439 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:03.769395 21517 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:03.792896 21433 consensus_queue.cc:1059] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:23:03.794445 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:03.878940 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 44675.6us
I20260709 12:23:03.916723 18570 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:03.918193 19240 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:03.904085 21201 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:03.920306 21544 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:03.920943 21544 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:03.921746 21299 raft_consensus.cc:1068] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9: Unable to promote non-voter 8c29c312e4544452b1162d7f81a58cb4: Service unavailable: leader transfer in progress
I20260709 12:23:03.923159 21544 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:03.923933 21547 consensus_queue.cc:1048] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:03.925745 21395 raft_consensus.cc:993] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:23:03.926378 21395 raft_consensus.cc:1081] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:23:03.927078 21517 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:03.929105 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 96474.4us
W20260709 12:23:03.931790 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 142537us
I20260709 12:23:03.904404 21524 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.936800 18494 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:03.948616 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:03.960423 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:03.949493 18526 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:23:03.960783 18525 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:03.961056 18528 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:03.932612 21373 raft_consensus.cc:2764] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:23:03.963893 18494 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:23:03.968705 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 69987.7us
I20260709 12:23:03.971455 18644 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:03.973030 21545 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:03.973897 21545 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:03.976109 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.976456 21547 raft_consensus.cc:2749] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:03.977190 21439 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:03.977316 18527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:23:03.978017 18527 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:03.978456 18527 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:03.978497 18570 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:03.941238 21524 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:03.981420 21492 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:03.946982 21262 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:03.983656 21404 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:03.985121 21485 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:03.956975 21357 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:23:03.987185 21549 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:23:03.989429 18526 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:03.992336 18523 raft_consensus.cc:1240] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7. Ops: []
W20260709 12:23:03.993860 18425 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47708 (request call id 171) took 20087 ms (client timeout 15000 ms). Trace:
I20260709 12:23:04.000245 21485 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:04.000839 18644 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:04.002278 21549 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:04.002525 18644 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:04.003376 21439 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:04.004350 18644 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:04.004632 21496 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:04.005028 21439 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:03.966223 21500 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:04.006080 21201 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:04.006716 21545 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:04.006119 21500 raft_consensus.cc:697] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:04.005542 21439 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:04.000864 21485 raft_consensus.cc:697] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:04.009102 21500 consensus_queue.cc:237] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:04.009907 21485 consensus_queue.cc:237] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:04.012209 21357 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:04.012897 21357 raft_consensus.cc:697] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:04.014587 21519 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.014916 21357 consensus_queue.cc:237] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:04.015218 21519 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:04.020859 21254 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:04.024564 18494 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:04.025619 18494 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:04.026544 21373 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:04.027184 21373 raft_consensus.cc:697] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:04.028210 21373 consensus_queue.cc:237] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:04.028847 21538 log.cc:927] Time spent T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.216s	user 0.000s	sys 0.004s
I20260709 12:23:04.030475 18494 leader_election.cc:400] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7.
I20260709 12:23:04.031522 21519 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:04.033265 18570 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:23:03.994431 18425 rpcz_store.cc:269] 0709 12:22:43.906046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.929098 (+ 23052us) service_pool.cc:224] Handling call
0709 12:22:44.004705 (+ 75607us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b54002175d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c449090 00007efc7c4e7f3a 00007efc8229de9c 00007efc8239c04e 00007efc8085d2a4 00007efc8085d232 00007efc8085d161 00007efc8085d0dc 00007efc8085c392 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:03.993565 (+19988860us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:02.061126 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:02.063546 (+  2420us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:02.063586 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:23:02.063610 (+    24us) tablet.cc:662] Decoding operations
0709 12:23:02.068168 (+  4558us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:02.068230 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:02.068255 (+    25us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:23:02.069306 (+  1051us) tablet.cc:701] Row locks acquired
0709 12:23:02.069324 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:23:02.069504 (+   180us) write_op.cc:270] Start()
0709 12:23:02.069610 (+   106us) write_op.cc:276] Timestamp: P: 1783599782069439 usec, L: 0
0709 12:23:02.069632 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:23:02.094131 (+ 24499us) log.cc:844] Serialized 4846 byte log entry
0709 12:23:02.624858 (+530727us) op_driver.cc:464] REPLICATION: finished
0709 12:23:02.881808 (+256950us) write_op.cc:301] APPLY: starting
0709 12:23:02.881905 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:02.882167 (+   262us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:02.938028 (+ 55861us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:02.940587 (+  2559us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:02.940957 (+   370us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:23:02.941013 (+    56us) write_op.cc:312] APPLY: finished
0709 12:23:02.941336 (+   323us) log.cc:844] Serialized 89 byte log entry
0709 12:23:02.941520 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:02.941660 (+   140us) write_op.cc:454] Released schema lock
0709 12:23:02.941707 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:02.942145 (+   438us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:02.942174 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12353,"reported_tablets":51,"spinlock_wait_cycles":82212736,"child_traces":[["op",{"apply.queue_time_us":256635,"apply.run_cpu_time_us":4164,"apply.run_wall_time_us":60325,"num_ops":12,"prepare.queue_time_us":122932,"prepare.run_cpu_time_us":15993,"prepare.run_wall_time_us":201386,"raft.queue_time_us":373188,"raft.run_cpu_time_us":17781,"raft.run_wall_time_us":145522,"replication_time_us":555037,"thread_start_us":764890,"threads_started":5,"wal-append.queue_time_us":184080}]]}
I20260709 12:23:04.031518 18494 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:04.041038 18522 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:23:04.042196 21383 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:04.043627 18525 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:23:04.048199 21201 consensus_queue.cc:1059] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:04.048954 18524 raft_consensus.cc:1240] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:04.072779 18525 pending_rounds.cc:85] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 3
I20260709 12:23:04.075841 18525 pending_rounds.cc:107] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:23:04.076160 18525 raft_consensus.cc:2889] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:04.073411 21496 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:04.077970 21496 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:04.080632 21496 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:04.081627 21254 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:23:04.081892 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 48718.6us
I20260709 12:23:04.082115 21201 raft_consensus.cc:3055] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:04.082578 21201 raft_consensus.cc:740] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:04.083395 20815 consensus_queue.cc:1048] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:04.052140 21556 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.066030 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:04.080817 21383 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:04.056689 21437 raft_consensus.cc:3055] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:23:04.083715 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 52306.2us
I20260709 12:23:04.018776 18644 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:04.088006 18521 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:04.097873 18528 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
W20260709 12:23:04.094805 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 76108us
I20260709 12:23:04.101226 18644 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:04.103528 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:04.120878 18525 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:23:04.101914 18527 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:04.104754 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:04.115513 18494 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:04.084846 21440 raft_consensus.cc:2804] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:04.114063 21422 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:04.125247 21422 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.125417 18570 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:04.125774 21422 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:04.102509 21545 raft_consensus.cc:2764] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:23:04.026775 21524 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:04.102344 21437 raft_consensus.cc:740] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:04.126323 20815 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:04.136255 18527 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:04.103799 21199 consensus_queue.cc:1048] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:23:04.148104 20815 raft_consensus.cc:697] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:04.138254 18494 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:04.139132 21429 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:04.147503 21524 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:04.103885 21556 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:04.140024 21549 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:04.154542 21545 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:04.155109 18494 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:04.156131 21545 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:04.158353 21556 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:04.159016 18494 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:04.151983 21519 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:04.160269 21519 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.160784 21519 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:04.165712 21219 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:23:04.168722 21437 consensus_queue.cc:260] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:04.170171 21437 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:04.180747 21545 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.181139 20815 consensus_queue.cc:237] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:04.083536 21201 consensus_queue.cc:260] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:23:04.181567 21545 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:04.125196 21440 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:04.117424 21262 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:23:04.191643 19210 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:04.186173 18524 raft_consensus.cc:1275] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:23:04.199645 18598 raft_consensus.cc:1275] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:04.182700 21201 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:04.200532 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:04.200680 18570 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:04.201637 21404 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:04.202200 21404 raft_consensus.cc:697] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:04.203086 18570 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:04.203409 21395 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:04.204975 21305 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:04.196331 21440 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:04.203099 21404 consensus_queue.cc:237] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:04.207803 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.210198 21487 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:04.210618 21487 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:04.211014 21487 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:04.210852 21484 consensus_queue.cc:1048] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:04.201189 18524 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:04.127840 21254 consensus_queue.cc:1059] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:23:04.213317 18570 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:04.222137 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:04.220940 18572 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:04.225625 18525 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
I20260709 12:23:04.229806 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:04.230110 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:04.230929 18530 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:04.231104 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:04.226233 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:04.231863 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:04.232651 18597 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:04.233480 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:04.234347 18606 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:23:04.232610 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:04.226779 19212 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:04.227016 21219 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:23:04.238691 21484 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:04.239259 21484 raft_consensus.cc:697] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:04.240869 21484 consensus_queue.cc:237] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:04.244076 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:04.229832 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:04.247653 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:04.254781 18530 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:04.261003 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:04.264674 18597 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:04.267817 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:04.268812 18524 raft_consensus.cc:2393] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 5: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
W20260709 12:23:04.268728 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 44012.9us
I20260709 12:23:04.324332 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:04.373538 21559 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.379194 21559 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:04.380458 21188 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:04.381901 21559 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:04.382946 18599 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:23:04.386595 18646 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:04.375850 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.375952 18521 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:23:04.389038 21559 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:04.272594 21215 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:04.391487 21215 raft_consensus.cc:697] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:04.393206 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.392712 21215 consensus_queue.cc:237] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:04.397382 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:04.398715 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:04.400069 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:04.401209 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:04.401924 18671 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:04.376152 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 60830us
I20260709 12:23:04.376369 21549 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:04.271625 21357 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:04.376446 21485 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.300737 21439 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:04.454356 18646 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:04.464427 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:04.455600 18644 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:04.462174 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 248914us
I20260709 12:23:04.420311 21556 raft_consensus.cc:2764] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:23:04.480314 18570 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:04.476745 21357 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:04.489434 21357 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:04.489630 21558 raft_consensus.cc:2804] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:04.491696 18494 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:04.483882 18674 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:23:04.494378 18671 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:04.477661 21433 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:04.494079 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:04.501948 21558 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.510658 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:04.513057 21558 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:04.514285 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 287574us
I20260709 12:23:04.487375 21440 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:04.473273 21485 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:04.538399 19212 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:04.545303 18527 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:23:04.548355 18524 raft_consensus.cc:2393] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 6: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
W20260709 12:23:04.549887 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 94477us
I20260709 12:23:04.532226 21433 raft_consensus.cc:697] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:04.520207 21429 consensus_queue.cc:1048] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:23:04.562574 18644 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:04.567451 18644 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:04.555604 21545 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:04.574172 18644 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:04.576632 18644 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:04.564527 21544 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:23:04.566735 21567 log.cc:927] Time spent T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:23:04.579002 21331 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:23:04.597332 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 88325.3us
I20260709 12:23:04.600776 21546 raft_consensus.cc:2764] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:23:04.602129 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:04.602900 18598 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
I20260709 12:23:04.603802 21439 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:04.606608 21433 consensus_queue.cc:237] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:04.610731 21544 raft_consensus.cc:697] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 8 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:04.612429 21440 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:04.612291 21544 consensus_queue.cc:237] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:04.612390 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:04.619418 18680 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:23:04.623059 21566 log.cc:927] Time spent T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:23:04.626080 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:04.627254 18598 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:04.577632 21215 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:04.574328 20900 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:23:04.603611 21563 log.cc:927] Time spent T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
W20260709 12:23:04.602176 21564 log.cc:927] Time spent T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:23:04.640420 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:04.663204 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:04.664188 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:04.665717 18600 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:04.678527 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:04.679435 18672 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:04.675163 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 122362us
I20260709 12:23:04.633183 21331 raft_consensus.cc:2764] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:23:04.684684 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:04.685689 18494 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:23:04.700016 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 123384us
I20260709 12:23:04.712682 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:04.713389 18676 raft_consensus.cc:2393] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 8: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:04.731638 18673 raft_consensus.cc:1275] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:23:04.736142 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:04.738731 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:04.738867 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:04.741246 18475 auto_rebalancer.cc:629] Failed to schedule move for tablet 298b8c963d93464e999fee75e74e9781: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:23:04.742704 21422 consensus_meta.cc:287] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.616s	user 0.011s	sys 0.000s
I20260709 12:23:04.748142 18605 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:04.749476 21589 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:04.739512 18603 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:23:04.723690 21201 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.706104 21440 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:23:04.743176 21422 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:04.736940 21519 consensus_meta.cc:287] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.576s	user 0.014s	sys 0.001s
I20260709 12:23:04.765390 18600 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
I20260709 12:23:04.864171 18672 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:23:04.875511 18603 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:23:04.882634 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:04.885083 21595 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.885871 21595 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:04.889083 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:04.890463 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:04.886860 21437 consensus_meta.cc:287] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.716s	user 0.011s	sys 0.003s
W20260709 12:23:04.894268 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.898515 21558 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:04.899942 21440 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:04.900069 21598 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:04.891671 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:04.902043 18603 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:04.911211 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:04.900821 21440 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:04.920771 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:23:04.933419 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 197372us
I20260709 12:23:04.924796 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:04.901050 21598 raft_consensus.cc:697] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:04.779840 21201 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:04.871779 21485 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:04.956287 18598 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:23:04.876396 21519 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:04.940821 21484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.054s	sys 0.068s
W20260709 12:23:04.958631 21484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.062s	sys 0.076s
I20260709 12:23:04.961095 21558 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
W20260709 12:23:04.938263 21559 consensus_meta.cc:287] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.549s	user 0.012s	sys 0.000s
I20260709 12:23:04.962323 21559 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:23:04.963119 21571 log.cc:927] Time spent T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.566s	user 0.001s	sys 0.000s
I20260709 12:23:04.963452 18678 raft_consensus.cc:1275] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:04.965560 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:04.966307 18605 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:23:04.967310 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:04.949589 21254 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:04.967965 18605 raft_consensus.cc:3055] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:04.970263 18605 raft_consensus.cc:740] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:04.971571 21201 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:04.968396 21254 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:04.971374 18605 consensus_queue.cc:260] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:04.969784 18600 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
W20260709 12:23:04.921396 21487 consensus_meta.cc:287] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.710s	user 0.008s	sys 0.006s
W20260709 12:23:04.944280 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 157777us
I20260709 12:23:04.974398 18603 raft_consensus.cc:1275] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:05.047058 18605 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:05.047789 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:05.049889 18602 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:05.045429 21487 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:05.051932 21603 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:05.052495 21603 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:05.054014 21487 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:05.054653 21603 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:05.056380 21600 log.cc:927] Time spent T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 12:23:05.056916 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:05.061017 18475 auto_rebalancer.cc:629] Failed to schedule move for tablet a5481f6762264d10bd4a98a8b0e678e4: Illegal state: Replica c7bd71f1f37c45f28b52c154e59356b9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:05.061233 21598 consensus_queue.cc:237] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:23:05.064395 21422 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:04.976239 21299 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:05.081457 21373 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:05.085098 21404 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:05.077325 21299 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:05.096029 21299 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:05.091912 21373 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:05.105170 21440 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:05.106388 21373 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:05.112533 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.113993 21519 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:05.124673 21254 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:05.125744 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:05.129925 21404 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:05.130468 21404 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:05.134117 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:05.134944 18671 raft_consensus.cc:2393] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 5: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:05.137048 21219 raft_consensus.cc:3055] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:05.137845 21219 raft_consensus.cc:740] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:05.138799 21219 consensus_queue.cc:260] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:05.145397 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:05.146118 18674 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:05.148138 21437 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:05.160035 18673 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:23:05.161500 18605 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:23:05.169696 21219 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:05.193874 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:05.232738 18680 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:05.191078 21517 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:05.241106 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:05.240904 21517 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:05.179922 21437 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:05.246145 21437 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:05.250671 18605 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:23:05.252120 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:05.253153 18675 raft_consensus.cc:2368] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10.
I20260709 12:23:05.255240 18598 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:23:05.260010 18601 raft_consensus.cc:1275] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:05.260427 18673 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:05.262017 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:05.264151 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:05.264773 18599 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:23:05.266660 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:05.259964 21605 log.cc:927] Time spent T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.335s	user 0.002s	sys 0.000s
I20260709 12:23:05.278245 18602 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:23:05.278891 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:05.286751 21439 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.287384 21439 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:05.289716 21439 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:05.292470 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:05.299119 18494 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:23:05.313617 18570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.281822 21595 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:05.279946 21517 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:05.321318 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:05.324688 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:05.325103 18528 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:05.321457 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:05.322181 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:05.327134 18530 raft_consensus.cc:2393] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 11: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:05.323081 18526 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:23:05.323493 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:05.327400 18570 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:05.330152 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:05.330790 18529 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:05.332444 18527 raft_consensus.cc:1240] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:23:05.318729 21519 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:05.336328 21519 raft_consensus.cc:697] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:05.334473 21254 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:05.337240 21254 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.337636 21254 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:05.337349 21519 consensus_queue.cc:237] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:05.341934 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:05.303109 21598 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:05.357378 18570 leader_election.cc:400] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10.
I20260709 12:23:05.367146 18570 leader_election.cc:403] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:23:05.366968 18675 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:23:05.368191 18528 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:23:05.355014 18606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40948 (request call id 1650) took 1124 ms. Trace:
I20260709 12:23:05.369556 18606 rpcz_store.cc:276] 0709 12:23:04.222856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.301863 (+ 79007us) service_pool.cc:224] Handling call
0709 12:23:05.346963 (+1045100us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54002b89d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:05.347099 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":407334272}
I20260709 12:23:05.375806 21584 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:05.399535 18494 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:05.349469 21404 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:05.385772 21517 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.350577 21215 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:23:05.334700 21595 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 12:23:05.407174 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:05.418233 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:05.418900 18570 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:05.407047 18494 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:05.391963 21524 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.414081 21517 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:05.421866 21524 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:05.423830 21524 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:05.388015 21598 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:05.387342 21594 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:23:05.408517 21545 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:05.433794 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:05.419548 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:05.420395 21596 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:05.437928 18570 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:05.420580 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:05.421123 18672 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:23:05.427067 18494 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:05.430420 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:05.431632 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:05.441516 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:05.441581 18606 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:05.442219 18678 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:23:05.436300 18673 raft_consensus.cc:1275] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:05.444298 18601 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:23:05.445818 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:05.446147 21395 raft_consensus.cc:2804] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:05.446462 18679 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:05.446540 21395 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.446971 21395 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:05.436200 20815 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:05.457093 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:05.458678 21500 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:05.461175 21500 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:05.461625 21500 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:05.465204 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:05.465912 18599 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:23:05.461189 21559 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:05.468438 21559 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:05.470619 21559 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:05.443400 18494 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:05.427032 21517 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:05.482885 18606 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:23:05.487551 18494 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:05.490480 18644 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:23:05.495311 21565 log.cc:927] Time spent T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 1.022s	user 0.002s	sys 0.002s
I20260709 12:23:05.495596 21404 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:05.497967 21596 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:05.479440 21439 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:05.499552 21439 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:05.500079 21547 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:23:05.482692 21619 log.cc:927] Time spent T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:23:05.507121 18644 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:05.493716 21440 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:05.485229 21357 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:05.524883 18679 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:05.503736 21524 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:05.529613 18644 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:05.536247 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40800 (request call id 1600) took 1129 ms. Trace:
I20260709 12:23:05.511680 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:05.503149 21439 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:05.509057 21558 raft_consensus.cc:2804] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:05.536962 18679 rpcz_store.cc:276] 0709 12:23:04.395979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.396126 (+   147us) service_pool.cc:224] Handling call
0709 12:23:05.441605 (+1045479us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:23:05.525543 (+ 83938us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8625024}
I20260709 12:23:05.525234 20900 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:05.523765 21440 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:23:05.545215 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 57787.5us
I20260709 12:23:05.528713 21519 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:05.543416 21598 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:05.544299 21559 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:05.544418 21558 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:05.554100 21440 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:05.577724 18521 raft_consensus.cc:1240] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:05.579514 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:05.578491 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:05.584100 18523 raft_consensus.cc:1240] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:05.538409 21547 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:23:05.537978 21357 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:05.540028 21524 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:05.593755 18529 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:05.568612 21517 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.598877 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:05.601169 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 47953.6us
W20260709 12:23:05.598142 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 56043.8us
I20260709 12:23:05.598505 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:05.580470 21558 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:05.611465 18523 raft_consensus.cc:2368] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10.
I20260709 12:23:05.612329 18529 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:05.581187 21598 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:05.618083 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:05.609315 18644 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:05.619206 18529 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:23:05.620115 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:05.593154 21559 raft_consensus.cc:697] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:05.562502 21519 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:05.600091 21584 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10.
I20260709 12:23:05.636523 21395 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:05.648315 21559 consensus_queue.cc:237] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:05.617347 21357 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:05.657706 21254 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:05.659391 21627 log.cc:927] Time spent T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:23:05.653998 21558 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:05.662329 21545 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:23:05.664165 21587 log.cc:927] Time spent T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.932s	user 0.000s	sys 0.004s
I20260709 12:23:05.665210 21524 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:05.666072 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:05.666391 21519 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:05.615334 21517 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:05.628334 21437 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:23:05.683903 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 93057.2us
I20260709 12:23:05.769876 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:23:05.689023 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 80700.5us
I20260709 12:23:05.689836 21637 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:05.705546 21395 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:05.706115 18597 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:05.708781 21634 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:23:05.630586 21629 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:23:05.670017 21546 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:05.790208 21546 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:05.792809 21546 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:05.624406 21598 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:05.724121 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.730158 18426 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60812 (request call id 106) took 4336 ms. Trace:
I20260709 12:23:05.795909 18426 rpcz_store.cc:276] 0709 12:23:01.393515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.393770 (+   255us) service_pool.cc:224] Handling call
0709 12:23:05.730056 (+4336286us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:03.634107 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:03.635359 (+  1252us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:03.635433 (+    74us) write_op.cc:435] Acquired schema lock
0709 12:23:03.635508 (+    75us) tablet.cc:662] Decoding operations
0709 12:23:03.813578 (+178070us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:03.813684 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:03.813714 (+    30us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:23:03.814291 (+   577us) tablet.cc:701] Row locks acquired
0709 12:23:03.814340 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:23:03.814603 (+   263us) write_op.cc:270] Start()
0709 12:23:03.814786 (+   183us) write_op.cc:276] Timestamp: P: 1783599783814534 usec, L: 0
0709 12:23:03.814810 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:23:03.818250 (+  3440us) log.cc:844] Serialized 1762 byte log entry
0709 12:23:03.994446 (+176196us) op_driver.cc:464] REPLICATION: finished
0709 12:23:04.387171 (+392725us) write_op.cc:301] APPLY: starting
0709 12:23:04.387261 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:04.387428 (+   167us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:04.387575 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:04.388303 (+   728us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:04.388571 (+   268us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:23:04.388615 (+    44us) write_op.cc:312] APPLY: finished
0709 12:23:04.389290 (+   675us) log.cc:844] Serialized 41 byte log entry
0709 12:23:04.390159 (+   869us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:04.390264 (+   105us) write_op.cc:454] Released schema lock
0709 12:23:04.390335 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:04.390862 (+   527us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:04.390894 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":69014,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":392412,"apply.run_cpu_time_us":2565,"apply.run_wall_time_us":3678,"num_ops":4,"prepare.queue_time_us":25259,"prepare.run_cpu_time_us":6042,"prepare.run_wall_time_us":184566,"replication_time_us":179433,"thread_start_us":258277,"threads_started":2}]]}
I20260709 12:23:05.728330 21440 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:05.801302 21440 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:05.750489 20900 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:05.805917 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:05.811091 21517 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:05.775918 21637 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:05.813326 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:05.814563 21637 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:05.762022 18644 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:05.765959 18675 raft_consensus.cc:2368] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5.
I20260709 12:23:05.773272 18525 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:05.774083 18673 raft_consensus.cc:1275] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:23:05.818423 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 56526.6us
I20260709 12:23:05.776702 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:23:05.781189 18570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.819082 18644 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:05.781618 21545 consensus_queue.cc:1048] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:05.782267 21544 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:05.774191 21604 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:05.770270 21215 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.788000 18527 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:05.777763 18494 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:05.789007 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:05.819231 18523 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:05.781510 21640 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:05.777688 18572 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:05.691682 21500 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:05.832369 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:05.995229 18679 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:06.001614 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 223913us
I20260709 12:23:06.005512 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:05.888597 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:06.008364 18527 raft_consensus.cc:1275] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:23:05.903586 18644 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:06.024103 18529 raft_consensus.cc:1275] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:23:06.051573 18679 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
W20260709 12:23:06.029413 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 125937us
I20260709 12:23:06.018512 18494 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:05.829773 21357 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.061223 21357 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:05.832516 21517 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:06.062407 21517 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.062772 21517 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:06.063400 21404 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:05.991681 21254 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:06.066588 21429 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:06.067178 21429 raft_consensus.cc:697] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:06.068444 18602 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:23:06.068122 21429 consensus_queue.cc:237] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:06.069131 21596 raft_consensus.cc:2764] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:23:05.959115 18424 catalog_manager.cc:5697] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 4 to 6, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 6 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:05.930259 21587 log.cc:927] Time spent T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:23:05.830034 21395 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.928452 20815 consensus_queue.cc:1048] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.130s
I20260709 12:23:06.089709 18604 raft_consensus.cc:1275] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:06.058277 21558 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:06.059084 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:05.857002 21544 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:05.795532 21598 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:06.061527 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 283920us
I20260709 12:23:05.959965 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:06.096408 21439 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.109161 21439 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:06.109970 21500 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:06.111426 21299 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:06.112246 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:06.112000 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:06.113049 18672 raft_consensus.cc:2393] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 6: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:06.113855 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:06.114130 18605 raft_consensus.cc:1240] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:23:06.115231 18523 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:06.116204 21595 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:06.116750 21595 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:06.048630 21640 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:06.119223 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:06.120056 18572 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:06.120939 21640 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:06.121546 21604 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:06.105310 21629 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.078642 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:06.076077 18646 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:05.857229 20900 raft_consensus.cc:2804] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:06.093050 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:06.104540 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:06.131423 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:06.105219 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:06.132021 18597 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:06.133055 18572 leader_election.cc:400] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10.
I20260709 12:23:06.107152 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:06.111996 21299 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:06.101459 18424 catalog_manager.cc:5697] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.137689 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:05.939687 21642 log.cc:927] Time spent T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.250s	user 0.004s	sys 0.000s
I20260709 12:23:06.122700 21629 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:06.134814 19244 raft_consensus.cc:2468] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:23:06.134824 18572 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:05.876506 21215 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:06.107544 21637 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:06.145820 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 49096.3us
I20260709 12:23:06.076102 21357 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:06.146920 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:23:06.148833 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 72841.1us
I20260709 12:23:06.130906 21519 raft_consensus.cc:2764] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:23:06.010728 21636 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.125s
W20260709 12:23:06.144891 21638 log.cc:927] Time spent T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:23:06.145233 18570 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:06.135949 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:06.094928 21395 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:06.137792 21439 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:06.151203 21422 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:06.097905 21437 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:23:06.178848 18599 raft_consensus.cc:1275] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:06.144338 21500 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:06.180342 21199 raft_consensus.cc:2804] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:06.144624 21634 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:06.232239 21634 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:06.234515 21634 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:06.237943 21629 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:06.182533 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:06.241382 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 58985.3us
I20260709 12:23:06.242403 21596 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:06.242501 18494 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:06.243006 21596 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.174469 18424 catalog_manager.cc:5697] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 5 to 7, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 7 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:06.136544 21586 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:23:06.191587 21299 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:06.162410 21599 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:06.195360 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:06.163718 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:06.170889 21545 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:06.281230 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 180026us
I20260709 12:23:06.153359 21604 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:06.182879 18603 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
W20260709 12:23:06.211812 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 59728.4us
I20260709 12:23:06.160388 20900 raft_consensus.cc:697] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:06.205206 21559 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.221215 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:06.226521 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:06.227415 21395 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:06.228112 21598 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:06.230967 21383 consensus_queue.cc:1048] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:06.246805 19210 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:06.247475 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:06.251267 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:06.264940 18424 catalog_manager.cc:5697] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 3 to 4, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 4 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.169277 21637 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:06.200762 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:06.315238 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:06.215065 21643 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:06.301621 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:06.305991 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:06.243691 21596 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:06.246215 21439 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:06.223534 21219 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:23:06.316808 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 69411.8us
I20260709 12:23:06.262291 21629 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:06.299168 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:06.276090 21199 raft_consensus.cc:697] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:06.344087 18424 catalog_manager.cc:5697] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 2 to 5, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 5 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:06.262514 21546 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:23:06.355636 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:06.320429 21440 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:06.377869 18424 catalog_manager.cc:5697] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 5 to 6, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 6 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:06.296574 21545 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:06.396592 18424 catalog_manager.cc:5697] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.400485 18424 catalog_manager.cc:5697] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.397220 21524 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:23:06.407186 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 245659us
I20260709 12:23:06.319600 21201 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:23:06.296969 21500 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:06.311201 21559 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:06.335954 20815 consensus_queue.cc:1048] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:23:06.293028 21599 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:06.335533 21598 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:06.425011 21629 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:23:06.366240 21640 consensus_queue.cc:1048] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
W20260709 12:23:06.447054 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 106486us
I20260709 12:23:06.338356 21643 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:06.356292 21219 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:06.347177 21439 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:06.492123 21500 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:06.722841 21549 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:06.725045 21549 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:06.727239 21549 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:06.728294 21545 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:06.729208 21544 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:06.729861 21219 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:06.723268 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 476504us
I20260709 12:23:06.732668 19210 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:06.733421 21383 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:06.733847 19210 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:06.724303 21559 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:06.723873 21596 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:06.734381 21643 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:06.722023 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 310437us
I20260709 12:23:06.735833 21500 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.736670 21500 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:06.739182 21500 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:06.562500 18424 catalog_manager.cc:5697] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 6, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 6 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:06.742482 21596 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:06.742375 18424 catalog_manager.cc:5697] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 3 to 5, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 5 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:06.743194 21652 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:23:06.478389 21656 log.cc:927] Time spent T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:23:06.746220 21598 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:06.558508 21517 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:06.748368 18674 raft_consensus.cc:1240] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:06.750819 21517 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:06.489928 20900 consensus_queue.cc:237] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:06.740449 21437 consensus_queue.cc:1059] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:06.740904 18644 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:06.753054 21558 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.753362 18604 raft_consensus.cc:1240] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:06.755513 18494 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:06.753695 21559 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:23:06.479256 21649 log.cc:927] Time spent T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:23:06.435580 21572 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:06.422688 21636 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.759531 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:06.790477 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:06.489694 21199 consensus_queue.cc:237] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:06.792882 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:06.760677 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 447828us
I20260709 12:23:06.481115 21637 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:06.435362 21524 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:06.449717 21215 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:06.785923 18494 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:06.786566 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 45730.1us
I20260709 12:23:06.796068 18424 catalog_manager.cc:5697] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 5, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 5 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.801980 18600 raft_consensus.cc:1275] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:06.816488 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:06.811458 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:06.928828 18527 raft_consensus.cc:2393] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 6: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:06.787294 21666 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:06.791674 21517 raft_consensus.cc:3055] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:06.931177 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:06.943666 18673 raft_consensus.cc:2468] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 6.
I20260709 12:23:06.944115 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:06.931931 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:06.930034 18597 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:06.931504 18424 catalog_manager.cc:5697] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 5, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 5 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:06.791407 21549 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:06.946375 21549 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:06.946836 21549 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:06.948653 21524 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:06.907399 18494 leader_election.cc:400] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5.
I20260709 12:23:06.791255 21559 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:06.791483 21546 consensus_queue.cc:1048] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.117s
I20260709 12:23:06.963527 18424 catalog_manager.cc:5697] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.840792 21637 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:23:06.952030 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 44847.7us
I20260709 12:23:06.896872 21437 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.972060 21437 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:06.791061 21558 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:23:06.968804 18424 catalog_manager.cc:5697] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.974457 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:06.986001 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:06.975030 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:06.987125 18524 raft_consensus.cc:2468] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:23:06.988305 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:06.991428 18524 raft_consensus.cc:1240] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:06.976593 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:06.992420 18599 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:06.979523 18522 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:23:07.002574 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:07.003429 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:06.824935 21598 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:06.932647 21595 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:06.975765 18601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1670) took 1154 ms. Trace:
I20260709 12:23:07.009291 18424 catalog_manager.cc:5697] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 2, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:07.007766 18599 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:23:06.828830 21636 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.013414 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:07.014873 18522 raft_consensus.cc:2368] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7.
I20260709 12:23:06.943394 21517 raft_consensus.cc:740] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:07.016119 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:07.011435 18424 catalog_manager.cc:5697] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 3 to 5, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 5 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:07.009377 18601 rpcz_store.cc:276] 0709 12:23:05.810138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.814481 (+  4343us) service_pool.cc:224] Handling call
0709 12:23:05.814775 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:05.815293 (+   518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:05.815323 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:05.815848 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:23:06.077058 (+261210us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:06.077095 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:06.077158 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:06.963881 (+886723us) raft_consensus.cc:1685] finished
0709 12:23:06.963903 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:06.964040 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24522,"raft.queue_time_us":1121,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":50822,"thread_start_us":260857,"threads_started":1,"wal-append.queue_time_us":357717}
I20260709 12:23:07.023698 18524 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:23:07.025023 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:07.034251 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:07.045159 18528 raft_consensus.cc:2393] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 8: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:07.042852 18522 raft_consensus.cc:1240] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:07.012627 21654 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:07.058082 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:07.058452 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:07.027894 21637 raft_consensus.cc:697] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:07.033782 21199 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:07.060954 21604 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:07.016757 21598 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.037954 21670 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:07.075079 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:23:07.081912 21665 log.cc:927] Time spent T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 12:23:07.083775 21611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.020s	sys 0.011s
W20260709 12:23:07.084297 21611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.020s	sys 0.011s
W20260709 12:23:07.093782 21660 log.cc:927] Time spent T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:23:07.093428 21637 consensus_queue.cc:237] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.093663 19239 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 LEARNER]: Advancing to term 7
I20260709 12:23:07.075913 21661 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.062685 21654 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:07.096405 21661 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:23:07.098839 21558 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:07.070698 21517 consensus_queue.cc:260] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.103261 18604 raft_consensus.cc:1275] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:23:07.085647 21670 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.075721 21604 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:07.107206 18646 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.682s (SENT) [suppressed 9 similar messages]
I20260709 12:23:07.110379 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:07.074596 21199 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:07.112648 21671 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.144896 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:07.160987 18675 raft_consensus.cc:1275] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:07.074856 21599 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:07.168347 18673 raft_consensus.cc:1275] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:07.171875 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:07.169880 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:07.139320 21299 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:07.171075 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:07.168051 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:07.074898 21429 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:07.183127 21439 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:07.187574 21681 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.143292 21671 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.188277 21681 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:07.172524 19246 raft_consensus.cc:2468] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:23:07.201968 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:07.094570 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:07.204197 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:07.204843 18675 raft_consensus.cc:2468] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:23:07.219059 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:07.223412 18494 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:07.223879 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 116713us
I20260709 12:23:07.196849 20815 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.205428 21517 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:07.225190 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:07.227409 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:07.197616 18600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:07.234206 18600 raft_consensus.cc:606] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:07.226847 18572 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:07.231503 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:07.235040 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:07.237111 18603 raft_consensus.cc:1240] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:23:07.235442 18646 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:07.239176 18646 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:07.239539 18572 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:07.246215 18494 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:07.250689 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:07.256034 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:07.256606 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:07.195214 21299 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.260035 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:07.195112 21429 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.266985 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:07.268756 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:07.272992 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:07.273097 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:07.274856 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:07.253010 21519 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:07.255642 21395 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:07.255546 21422 raft_consensus.cc:2804] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:07.228473 21546 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:23:07.255795 21439 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:07.230573 21545 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:23:07.301334 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:07.260483 21586 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:07.265772 21634 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:07.230255 20815 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.330006 20815 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:07.333021 21299 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:07.335021 18606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1675) took 1476 ms. Trace:
I20260709 12:23:07.335417 18606 rpcz_store.cc:276] 0709 12:23:05.858943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.863628 (+  4685us) service_pool.cc:224] Handling call
0709 12:23:05.864325 (+   697us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:06.260040 (+395715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:06.260071 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:06.292578 (+ 32507us) log.cc:844] Serialized 26 byte log entry
0709 12:23:06.605978 (+313400us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:06.657811 (+ 51833us) log.cc:844] Serialized 14 byte log entry
0709 12:23:07.034228 (+376417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.334629 (+300401us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b54000708d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:07.334669 (+    40us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:07.334715 (+    46us) raft_consensus.cc:1685] finished
0709 12:23:07.334816 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.334962 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38220,"prepare.queue_time_us":74756,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":146425,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":23892,"spinlock_wait_cycles":836266752,"thread_start_us":620366,"threads_started":2,"wal-append.queue_time_us":446839}
I20260709 12:23:07.281206 21422 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.341216 21422 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:07.306259 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:07.345358 18598 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:07.348008 21545 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:07.348634 21545 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.350781 21545 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:07.352957 21598 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:07.356266 21654 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:07.356518 21199 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:07.357013 21559 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:07.380697 21653 log.cc:927] Time spent T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.929s	user 0.001s	sys 0.006s
I20260709 12:23:07.382014 19242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 453) took 1549 ms. Trace:
I20260709 12:23:07.370819 21636 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:07.256068 21629 consensus_queue.cc:1059] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:23:07.317544 21429 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:07.320842 21655 log.cc:927] Time spent T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.832s	user 0.007s	sys 0.000s
I20260709 12:23:07.321681 19239 raft_consensus.cc:1275] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEARNER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:07.323184 18525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2021) took 1022 ms. Trace:
I20260709 12:23:07.325837 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1617) took 1237 ms. Trace:
I20260709 12:23:07.326503 21549 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:07.328245 21680 log.cc:927] Time spent T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:23:07.423179 18674 rpcz_store.cc:276] 0709 12:23:06.088469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.091182 (+  2713us) service_pool.cc:224] Handling call
0709 12:23:06.115006 (+ 23824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:06.748859 (+633853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.325524 (+576665us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b54000be0d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:07.325760 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1456027392}
I20260709 12:23:07.382153 18602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 1617) took 1302 ms. Trace:
I20260709 12:23:07.302902 18530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2018) took 1002 ms. Trace:
W20260709 12:23:07.415194 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 444117us
W20260709 12:23:07.416464 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 161462us
I20260709 12:23:07.420476 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:07.304812 21659 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:07.421913 18525 rpcz_store.cc:276] 0709 12:23:06.301178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.314503 (+ 13325us) service_pool.cc:224] Handling call
0709 12:23:06.314817 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:06.744661 (+429844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:06.744690 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:06.744730 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:06.744758 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.322867 (+578109us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b54002e4354. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:07.322933 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.323106 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":988132096}
I20260709 12:23:07.425539 18602 rpcz_store.cc:276] 0709 12:23:06.080038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.080197 (+   159us) service_pool.cc:224] Handling call
0709 12:23:06.110802 (+ 30605us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:06.115070 (+  4268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:06.115097 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:06.115631 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 12:23:06.311650 (+196019us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:06.311779 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:06.311846 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:07.369892 (+1058046us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:23:07.381856 (+ 11964us) raft_consensus.cc:1685] finished
0709 12:23:07.381880 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.382089 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3850,"raft.queue_time_us":10204,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":121990016,"thread_start_us":93960,"threads_started":1,"wal-append.queue_time_us":262098}
I20260709 12:23:07.359527 21661 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:07.427713 18530 rpcz_store.cc:276] 0709 12:23:06.300204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.302240 (+  2036us) service_pool.cc:224] Handling call
0709 12:23:06.325187 (+ 22947us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:06.732255 (+407068us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:06.732301 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:06.732356 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:06.732402 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.281456 (+549054us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b54000820d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:07.302699 (+ 21243us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.302829 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":935618304}
I20260709 12:23:07.438314 21429 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:07.438831 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:07.439167 21429 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.441500 18644 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:07.442119 21429 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:07.449467 21682 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:07.450486 21682 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:23:07.453194 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 207062us
I20260709 12:23:07.457377 18598 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 12.
I20260709 12:23:07.460758 18646 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:07.471129 18677 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:07.454010 18494 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:07.423359 21199 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.425670 21604 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:07.518328 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 64580.6us
W20260709 12:23:07.517313 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 56693.2us
I20260709 12:23:07.549454 18646 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:07.552874 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 98957.1us
I20260709 12:23:07.553638 18494 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:07.562314 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 398106us
W20260709 12:23:07.517933 21655 log.cc:927] Time spent T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:23:07.422972 21633 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 12:23:07.572067 18644 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:07.518280 20815 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:07.516683 21439 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:07.518324 21634 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:07.581728 18494 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:07.451371 21659 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:07.578631 18646 leader_election.cc:400] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7.
I20260709 12:23:07.579833 18644 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:07.564760 21636 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:07.585851 21690 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:07.570848 21545 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:07.587925 21500 raft_consensus.cc:3055] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:07.583847 21439 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.582049 20815 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.547986 21558 consensus_queue.cc:1059] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:23:07.605217 21690 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:07.605813 18605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 1624) took 1488 ms. Trace:
I20260709 12:23:07.605926 21690 raft_consensus.cc:697] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:07.608805 21558 raft_consensus.cc:3055] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:07.609218 21558 raft_consensus.cc:740] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:07.610044 21558 consensus_queue.cc:260] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:07.601137 21545 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:07.592995 21694 raft_consensus.cc:2749] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:07.583530 21654 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:07.612751 21654 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:07.613145 21654 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:07.613726 21549 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:07.614142 20815 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:07.602409 21500 raft_consensus.cc:740] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:07.615360 21500 consensus_queue.cc:260] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.518476 21429 consensus_queue.cc:1059] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:23:07.579548 21586 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:07.585222 18646 leader_election.cc:403] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:23:07.579520 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:07.583680 21599 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:07.382681 19242 rpcz_store.cc:276] 0709 12:23:05.836780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.880139 (+ 43359us) service_pool.cc:224] Handling call
0709 12:23:05.925532 (+ 45393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:06.171548 (+246016us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:06.204957 (+ 33409us) log.cc:844] Serialized 14 byte log entry
0709 12:23:06.751442 (+546485us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:06.751504 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:06.754643 (+  3139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.381494 (+626851us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54004d7954. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:07.381577 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.381781 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1820,"prepare.queue_time_us":7334,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":60,"raft.queue_time_us":98542,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":14809,"spinlock_wait_cycles":518213760,"thread_start_us":162620,"threads_started":2,"wal-append.queue_time_us":144026}
I20260709 12:23:07.591531 21598 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:07.548650 21199 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:07.606300 18605 rpcz_store.cc:276] 0709 12:23:06.117296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.120188 (+  2892us) service_pool.cc:224] Handling call
0709 12:23:06.120489 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:06.122343 (+  1854us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:23:06.122967 (+   624us) log.cc:844] Serialized 14 byte log entry
0709 12:23:06.329135 (+206168us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:06.329785 (+   650us) log.cc:844] Serialized 26 byte log entry
0709 12:23:06.329970 (+   185us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:06.330019 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:06.330142 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:07.320276 (+990134us) spinlock_profiling.cc:243] Waited 59.9 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:23:07.604417 (+284141us) raft_consensus.cc:1685] finished
0709 12:23:07.605350 (+   933us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.605743 (+   393us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19368,"prepare.queue_time_us":161,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":28757,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":14811,"spinlock_wait_cycles":137795968,"thread_start_us":186280,"threads_started":1,"wal-append.queue_time_us":286458}
I20260709 12:23:07.612341 21545 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:07.611488 21558 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:07.592195 18494 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:07.639714 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 47612.7us
W20260709 12:23:07.628880 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 50400.7us
I20260709 12:23:07.624790 21586 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.630007 21659 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:07.597566 21634 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.632159 21549 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7.
I20260709 12:23:07.625149 21599 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:07.644469 18646 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:07.644375 18570 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:07.616874 21636 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:07.607321 21690 consensus_queue.cc:237] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.646937 21546 raft_consensus.cc:2749] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:07.671363 18646 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:07.660441 21599 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:07.660811 20815 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:07.702301 21712 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:07.705616 21712 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.650648 21694 consensus_queue.cc:1048] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:23:07.673034 21682 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:07.660173 21440 consensus_queue.cc:1059] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:23:07.687216 21633 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:23:07.714296 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 54068.7us
I20260709 12:23:07.687004 21383 consensus_queue.cc:1048] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:23:07.696638 21667 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:07.687400 21549 consensus_queue.cc:1059] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:23:07.717540 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:07.722394 18570 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:07.711483 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:07.714706 21604 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.735877 18570 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:07.689464 21652 consensus_queue.cc:1048] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:23:07.741272 21437 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:07.746354 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:07.718724 21215 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:07.721316 21201 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.749367 18598 raft_consensus.cc:2393] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 9: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:07.757782 21674 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:07.743366 20815 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:07.786516 21559 raft_consensus.cc:3055] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:07.787201 21559 raft_consensus.cc:740] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:07.774367 21633 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:07.790810 21633 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.793990 21633 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:07.794427 21500 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:07.801608 21704 log.cc:927] Time spent T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:23:07.762092 21201 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:07.806145 21681 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:07.806485 21201 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:07.761898 21215 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:07.807654 21671 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:07.808679 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:07.809175 21215 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:07.808701 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:07.813117 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:07.813732 19243 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:23:07.816023 21586 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:07.816046 18570 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:07.759899 21439 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:07.748432 21604 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.823721 21517 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:07.824582 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:07.824447 21517 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.825026 21636 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:07.824803 21546 raft_consensus.cc:3055] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:07.773917 21549 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:07.732234 21667 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.814677 21545 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:07.862249 21604 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:07.857970 21199 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:07.867283 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 51313.6us
I20260709 12:23:07.867525 21709 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:07.868542 21709 raft_consensus.cc:697] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:07.856539 21549 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.869863 21709 consensus_queue.cc:237] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.867457 21201 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:07.871971 21201 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:07.872392 21201 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:07.876816 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:07.877537 19242 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:07.878149 21517 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:07.826301 21546 raft_consensus.cc:740] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:07.881289 21546 consensus_queue.cc:260] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:07.882694 18523 raft_consensus.cc:1240] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:07.883011 21546 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:07.890048 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 163066us
I20260709 12:23:07.884832 21545 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:07.892035 18494 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:07.897763 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:07.909106 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:07.910025 18602 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:07.885443 21634 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:07.923770 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:07.915892 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:07.906054 21199 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:23:07.911134 21422 consensus_meta.cc:287] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.566s	user 0.010s	sys 0.005s
I20260709 12:23:07.909987 21666 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:23:07.949607 21667 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:07.955024 21707 log.cc:927] Time spent T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:23:07.955935 21712 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:07.907300 21711 raft_consensus.cc:2804] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:07.997700 21549 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:08.024765 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:08.004876 21711 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.026820 21711 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:07.973299 21654 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:08.000170 21422 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:08.037684 21422 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:08.038604 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:07.999562 21559 consensus_queue.cc:260] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:08.044576 21559 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:07.983734 21199 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:08.060012 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 173784us
W20260709 12:23:08.014967 18494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.072345 18494 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:08.073312 18522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1640) took 1016 ms. Trace:
I20260709 12:23:08.073760 18522 rpcz_store.cc:276] 0709 12:23:07.056867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.059806 (+  2939us) service_pool.cc:224] Handling call
0709 12:23:07.060213 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.161225 (+101012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:07.161263 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:07.161306 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:07.161334 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:08.070334 (+909000us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400082fd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:08.073118 (+  2784us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:08.073253 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231773568}
W20260709 12:23:08.074801 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 454502us
I20260709 12:23:08.075804 19210 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:08.077157 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:08.078320 21640 raft_consensus.cc:2804] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:08.078538 21698 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:08.091626 18601 raft_consensus.cc:1240] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:08.093294 18528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 1629) took 1107 ms. Trace:
I20260709 12:23:08.094324 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:08.095927 18494 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:08.093896 18528 rpcz_store.cc:276] 0709 12:23:06.980643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.985653 (+  5010us) service_pool.cc:224] Handling call
0709 12:23:08.067404 (+1081751us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b54002d5ad4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:08.088288 (+ 20884us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117719808}
I20260709 12:23:08.062767 21199 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:08.100533 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:08.102260 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:08.102875 18606 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:23:08.102785 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:08.081560 21654 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:08.112262 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.112107 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:08.111901 21661 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:08.108402 21545 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:08.117785 21661 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:08.119593 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:08.120846 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:08.079231 21640 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:08.124154 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:08.128927 18600 raft_consensus.cc:2393] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 9: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:08.124439 18494 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:08.097293 21634 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:08.097476 21721 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:23:08.126390 21661 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:08.110993 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:08.081579 21666 consensus_queue.cc:1048] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:23:08.133500 21439 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:08.140751 18494 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:08.127170 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:08.133316 21545 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:08.144593 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.144320 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.273411 21439 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:08.274549 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.274688 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.192680 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.194502 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.143332 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:08.276497 18530 raft_consensus.cc:2393] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 8: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:08.280395 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.276109 18522 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:23:08.146579 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.195405 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.296075 18678 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:08.278905 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.296516 18679 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
I20260709 12:23:08.196777 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:08.193315 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.147969 18526 raft_consensus.cc:1275] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:23:08.131891 21640 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:08.297981 18521 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
W20260709 12:23:08.300861 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 160152us
I20260709 12:23:08.302021 18494 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:08.153960 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.296519 18524 raft_consensus.cc:2393] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 6: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
W20260709 12:23:08.266708 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 71271.1us
I20260709 12:23:08.303370 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:08.306761 18605 raft_consensus.cc:1275] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:08.193464 21664 raft_consensus.cc:993] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:23:08.309749 18494 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:08.195053 21720 log.cc:927] Time spent T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:23:08.324349 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:08.326623 18605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:08.328186 18605 raft_consensus.cc:606] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:08.328647 18494 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:08.328832 18605 raft_consensus.cc:614] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:08.326738 18572 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:08.205274 21429 raft_consensus.cc:3055] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:08.331310 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.332943 18494 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:08.136801 21599 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:08.308135 21545 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:08.312572 21634 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:08.337626 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:08.338368 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:08.343326 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.329555 21664 raft_consensus.cc:1081] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Signalling peer a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:23:08.360905 18605 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:23:08.135637 21711 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:08.331594 21637 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.357302 18600 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:08.331375 21709 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:08.370182 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.337338 21440 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:08.377760 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:08.378401 18598 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:08.374631 18644 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:08.380236 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.381034 18678 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
W20260709 12:23:08.381548 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.381479 21688 consensus_queue.cc:1059] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:23:08.383234 21728 log.cc:927] Time spent T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.242s	user 0.000s	sys 0.004s
I20260709 12:23:08.384035 21634 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:08.384455 21422 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:08.384895 21422 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.384624 21634 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:08.385267 21422 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:08.387048 21634 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:08.387168 21215 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:08.397611 21215 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:08.388986 21688 consensus_queue.cc:1048] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:08.343067 21670 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:08.342722 21429 raft_consensus.cc:740] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:08.392527 18644 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:08.343029 21439 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:08.354426 21666 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:08.402230 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.340032 21719 consensus_queue.cc:1059] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:23:08.367789 21604 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:08.430758 18598 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
W20260709 12:23:08.411144 21546 consensus_meta.cc:287] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.527s	user 0.015s	sys 0.000s
I20260709 12:23:08.443828 18678 raft_consensus.cc:1275] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:23:08.450482 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.444489 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.377295 21637 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:08.454309 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.396162 21727 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:23:08.460515 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.464969 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.437069 21682 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:08.470580 21682 raft_consensus.cc:697] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:08.472834 21682 consensus_queue.cc:237] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:08.476327 21500 consensus_meta.cc:287] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.681s	user 0.013s	sys 0.002s
I20260709 12:23:08.477190 21599 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:08.478564 21711 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:08.479673 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.471215 21429 consensus_queue.cc:260] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:08.481011 21201 consensus_meta.cc:287] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.608s	user 0.008s	sys 0.003s
I20260709 12:23:08.481125 21429 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:08.481474 21201 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:08.483628 18603 raft_consensus.cc:1240] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:08.484675 18679 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:08.461114 21658 raft_consensus.cc:3055] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:08.466503 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.463445 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.486784 18675 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:08.481153 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.494079 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.495867 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:08.498224 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.485963 21658 raft_consensus.cc:740] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:08.499351 18671 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:23:08.497103 21711 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:08.502327 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 190262us
I20260709 12:23:08.505661 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:08.507923 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:08.499670 18527 raft_consensus.cc:2393] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 8: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:08.510471 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.511327 18644 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:08.509295 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.513935 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.514523 18527 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:08.515316 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.515781 21422 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:08.516657 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:08.517151 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 133195us
I20260709 12:23:08.519711 21637 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:08.508304 21201 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:08.533739 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.538149 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.540565 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.541699 18527 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:23:08.542919 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.551810 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.552498 18678 raft_consensus.cc:2393] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 5: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
W20260709 12:23:08.558650 18494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.529862 21727 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:08.504673 21711 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:08.524729 21199 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:08.569731 18598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:08.570461 18598 raft_consensus.cc:606] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:08.570809 18598 raft_consensus.cc:614] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:08.577666 18527 raft_consensus.cc:2393] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 4: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:08.577694 18494 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:08.578014 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:08.576606 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:08.580677 18671 raft_consensus.cc:2393] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 7: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:08.562685 21439 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:08.581987 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:08.574469 21727 raft_consensus.cc:697] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:08.586556 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.573215 21634 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:08.589133 18677 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:08.599186 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.592382 21727 consensus_queue.cc:237] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:08.601778 21422 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:08.603303 21711 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:08.586602 21439 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:08.603777 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:08.590248 21731 log.cc:927] Time spent T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:23:08.595705 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.608129 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:08.608292 18678 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:08.608692 18598 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:08.595968 18605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2586476710143e281df940fcb3d3238"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:08.581195 21629 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:08.561132 21658 consensus_queue.cc:260] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:08.594919 21640 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:08.597512 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.606892 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.609731 18605 raft_consensus.cc:606] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:08.620867 18671 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 2.
I20260709 12:23:08.616096 18672 raft_consensus.cc:1240] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:08.629812 18598 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:23:08.631968 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.632697 18677 raft_consensus.cc:2410] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:23:08.611370 21629 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.631371 18644 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:08.641095 19240 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:08.641350 19211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:08.641577 21736 log.cc:927] Time spent T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:23:08.636875 21658 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:08.643198 21629 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:08.610893 21634 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:08.655921 18600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:08.656785 18600 raft_consensus.cc:606] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:08.657191 18600 raft_consensus.cc:614] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:08.663033 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:08.647975 21422 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:08.668985 19240 raft_consensus.cc:2468] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:08.672737 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:08.676357 18644 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:08.676857 21199 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:08.677531 21422 raft_consensus.cc:697] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:08.677644 21688 raft_consensus.cc:2749] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:08.678315 18644 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:08.678552 21422 consensus_queue.cc:237] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:08.679113 21688 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:08.688336 21439 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:08.679563 18644 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:08.691766 21599 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:08.693120 21640 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:08.700911 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:08.701032 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:08.701916 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:08.707401 21546 raft_consensus.cc:1064] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
W20260709 12:23:08.707984 21546 raft_consensus.cc:1068] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7: Unable to promote non-voter 8c29c312e4544452b1162d7f81a58cb4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:23:08.709906 18570 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:08.711946 21611 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:08.712374 21611 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.712735 21611 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:08.666819 21634 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:08.721503 21611 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:08.725788 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.726677 18680 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:23:08.729360 18570 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:08.739192 18570 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:08.763060 18672 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:23:08.729687 21634 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:08.768215 21634 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:08.771574 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.745676 19210 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:08.801787 18680 raft_consensus.cc:1240] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:08.802654 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 57099.3us
I20260709 12:23:08.806876 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:08.807932 18680 raft_consensus.cc:2368] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 6. Current term is 7.
I20260709 12:23:08.723847 21611 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:08.811167 19210 leader_election.cc:400] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 6. Current term is 7.
I20260709 12:23:08.743896 21199 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:08.820055 19210 leader_election.cc:403] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 12:23:08.818990 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 79919.7us
I20260709 12:23:08.741675 21636 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:08.745239 21733 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:08.828286 21662 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 6. Current term is 7.
W20260709 12:23:08.831521 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.813295 21383 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:08.796178 21629 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:08.835772 18570 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:08.836627 21681 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:08.838128 18570 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:08.821267 21201 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:08.825176 21199 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.834576 21383 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:08.841300 21734 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:08.844165 21383 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:08.844604 21629 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:08.844781 21634 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:08.854180 21667 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:08.854795 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.854969 18494 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:08.839948 21604 consensus_queue.cc:1048] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:23:08.856954 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:08.857344 21706 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:08.857755 18529 raft_consensus.cc:2393] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 9: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:08.858557 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:08.859192 18529 raft_consensus.cc:2393] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 7: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:08.860909 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:08.863852 21201 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:08.866463 21215 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:08.869473 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.854831 21667 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:08.847536 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:08.890527 18525 raft_consensus.cc:2368] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 6. Current term is 7.
I20260709 12:23:08.800060 21429 consensus_queue.cc:1059] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:23:08.888126 18521 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:23:08.912041 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.913040 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:08.891952 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:08.888181 21734 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:08.894217 21500 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:08.895596 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:08.895654 21383 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:08.896325 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:08.832198 21733 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:08.908094 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:08.914716 18572 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:08.914973 18678 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:23:08.917356 18527 raft_consensus.cc:2368] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9.
W20260709 12:23:08.922608 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.923825 18646 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:08.876051 21199 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:08.919116 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 85865.7us
I20260709 12:23:08.917320 18529 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:08.935132 19212 leader_election.cc:400] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 6. Current term is 7.
I20260709 12:23:08.936995 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:08.931012 18572 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:08.935070 18678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:40802
I20260709 12:23:08.938126 18678 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:08.938656 18678 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:08.948050 19244 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:08.950613 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:08.952020 18646 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:08.833096 21636 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:08.927615 21733 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:08.922951 21629 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:08.932998 21661 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:08.971175 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:08.971890 18676 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:08.976141 21629 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:08.979010 21629 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:08.984817 21201 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:08.927428 21500 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:08.986920 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:08.923146 21734 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:08.981698 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:08.989879 21734 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:08.990305 18523 raft_consensus.cc:1240] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:08.955211 21664 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:08.990990 21664 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:08.991528 21664 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:08.983886 21383 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:08.993739 21636 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:08.987699 18604 raft_consensus.cc:2368] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 9. Current term is 10.
I20260709 12:23:08.996090 19210 leader_election.cc:400] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 9. Current term is 10.
I20260709 12:23:08.996443 19210 leader_election.cc:403] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 12:23:08.998417 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 51052.1us
I20260709 12:23:08.999121 18572 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:08.999881 18523 raft_consensus.cc:1275] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:09.000216 18572 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:09.001812 21734 raft_consensus.cc:2804] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:09.004163 21586 raft_consensus.cc:993] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:23:09.004624 21586 raft_consensus.cc:1081] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:23:09.002265 21734 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:09.006055 21734 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:09.008941 18525 raft_consensus.cc:1240] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:23:09.027878 21734 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.028616 18523 raft_consensus.cc:1240] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6. Ops: []
W20260709 12:23:09.033419 21730 log.cc:927] Time spent T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.562s	user 0.004s	sys 0.000s
I20260709 12:23:08.985383 21201 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.033753 21734 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:08.967995 18529 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:23:09.035693 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:09.027410 21199 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.045475 21199 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:09.046377 18676 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:09.038005 21201 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.051291 21201 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:09.040722 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:09.039587 21667 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:08.987564 21500 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:09.070688 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:09.102728 18604 raft_consensus.cc:1240] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:23:09.078064 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:09.103849 18494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.087699 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:09.089412 18523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2586476710143e281df940fcb3d3238"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:23:09.105365 18523 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:09.105722 18523 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:09.094533 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 142621us
I20260709 12:23:09.107659 18646 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.100378 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:09.116824 18529 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:09.101524 18602 raft_consensus.cc:1240] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:23:09.125314 18601 raft_consensus.cc:1240] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260709 12:23:08.944221 21215 consensus_queue.cc:1048] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.165s
I20260709 12:23:09.133224 18600 raft_consensus.cc:1240] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:09.097779 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:09.103245 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:09.115964 19244 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:09.112586 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:09.141469 18494 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:09.142441 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:09.109766 21549 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:09.116101 18605 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:23:09.139056 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:09.170888 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:09.171484 18673 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:09.112911 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:09.148826 18646 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.150180 18523 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.156000 21636 raft_consensus.cc:2804] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:09.170905 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:09.147181 21662 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 9. Current term is 10.
I20260709 12:23:09.165532 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:09.165908 21429 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:09.168049 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:09.168769 18570 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:09.196815 18570 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:09.197889 18570 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:09.110684 21690 raft_consensus.cc:2749] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:23:09.150250 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 45257.7us
I20260709 12:23:09.216410 18494 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.173257 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:09.115940 21637 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.162506 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:09.222159 18675 raft_consensus.cc:2410] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
W20260709 12:23:09.193377 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 44635.3us
I20260709 12:23:09.222735 18523 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:09.223908 18646 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.219663 18680 raft_consensus.cc:2368] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 9. Current term is 10.
I20260709 12:23:09.218590 18494 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:09.230994 18494 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:09.240955 18646 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.237624 21711 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:09.242852 21711 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:09.244947 21711 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:09.245648 21711 raft_consensus.cc:2804] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:09.246097 21711 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:09.246537 21711 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:09.213860 21199 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:09.221863 21734 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:09.248083 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:09.194203 21636 raft_consensus.cc:697] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:09.225911 21629 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.229547 21634 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:09.253901 18646 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.253947 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:09.236616 21500 raft_consensus.cc:2804] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:09.231703 21549 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:09.231421 21611 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:09.256222 18673 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:09.266669 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:09.266865 18646 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.268013 18646 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.268260 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:09.269287 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 147707us
I20260709 12:23:09.248806 21429 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:09.271451 18529 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:23:09.265311 18678 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.274931 18680 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:23:09.275544 18680 pending_rounds.cc:85] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting all ops after (but not including) 5
I20260709 12:23:09.275902 18680 pending_rounds.cc:107] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:23:09.276196 18680 raft_consensus.cc:2889] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:09.277545 18677 raft_consensus.cc:1240] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:23:09.231570 21637 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.256157 21734 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:09.260185 21500 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.281832 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:09.278967 18572 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:09.258637 21634 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:09.283514 18601 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:23:09.269778 21750 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:23:09.293674 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 62824.2us
I20260709 12:23:09.277791 21682 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:09.299232 18494 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:09.292128 21611 raft_consensus.cc:2804] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:09.302143 21637 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:09.289168 21634 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:09.288998 21500 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:09.297786 21750 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:09.312871 21750 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:09.317049 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:09.318034 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:09.275425 21549 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:09.321977 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:09.322681 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:09.323196 18601 raft_consensus.cc:2410] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:23:09.323405 18602 raft_consensus.cc:2393] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 9: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:09.324281 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:09.324352 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:09.332430 21752 log.cc:927] Time spent T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:23:09.336088 21636 consensus_queue.cc:237] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:09.379981 18678 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:09.263340 21629 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.286775 21734 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:09.303669 21637 raft_consensus.cc:2804] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:09.388356 21712 raft_consensus.cc:3055] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:09.388859 21712 raft_consensus.cc:740] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:09.389696 21712 consensus_queue.cc:260] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:09.390919 21712 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:09.393219 21664 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.379618 21611 raft_consensus.cc:697] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:09.396610 21611 consensus_queue.cc:237] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.319108 21733 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:23:09.400460 18600 raft_consensus.cc:1240] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:09.401273 21637 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:09.401538 21733 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:09.401737 21637 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:09.406308 21749 raft_consensus.cc:2749] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:09.406746 21215 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.407276 21215 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:09.407799 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 136546us
I20260709 12:23:09.409372 21215 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:09.409801 18599 raft_consensus.cc:1240] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10. Ops: []
W20260709 12:23:09.410343 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.412885 21559 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:09.414093 21629 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:09.415015 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:09.416467 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:09.417264 18526 raft_consensus.cc:2410] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 12:23:09.417799 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:09.418341 18605 raft_consensus.cc:3055] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:09.418463 18604 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:09.418671 18605 raft_consensus.cc:740] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:09.419621 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:09.424592 19210 leader_election.cc:400] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 9. Current term is 10.
I20260709 12:23:09.419395 18605 consensus_queue.cc:260] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.426606 18605 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:23:09.429566 21750 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.395562 21664 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:09.434556 21500 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.441517 18529 raft_consensus.cc:1240] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:23:09.444046 21500 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:09.445135 18604 raft_consensus.cc:1275] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:23:09.431874 21750 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:09.451102 18424 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47714 (request call id 192) took 15980 ms (client timeout 15000 ms). Trace:
I20260709 12:23:09.454382 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:09.455173 18604 raft_consensus.cc:2393] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 9: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:09.454049 21711 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:09.457314 21757 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:09.458766 21637 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.460165 21733 consensus_queue.cc:1059] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:09.517299 21733 raft_consensus.cc:3055] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:09.517670 21733 raft_consensus.cc:740] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:09.518471 21733 consensus_queue.cc:260] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.461674 18521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2054) took 1265 ms. Trace:
I20260709 12:23:09.461841 18529 raft_consensus.cc:1240] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:09.462183 21711 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:09.520155 18521 rpcz_store.cc:276] 0709 12:23:08.196441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.460495 (+1264054us) service_pool.cc:224] Handling call
0709 12:23:09.461017 (+   522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:09.461346 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:09.461374 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:09.461419 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:09.461449 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.461505 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:09.461622 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:09.464951 21634 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:09.471082 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 172179us
I20260709 12:23:09.484179 18528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1653) took 1127 ms. Trace:
I20260709 12:23:09.484875 21750 consensus_queue.cc:1048] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:09.486557 21599 consensus_queue.cc:1059] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:09.534346 21599 raft_consensus.cc:3055] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:09.534946 21599 raft_consensus.cc:740] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:09.536005 21762 consensus_queue.cc:1059] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:09.536383 21599 consensus_queue.cc:260] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.537096 21762 consensus_queue.cc:1243] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer a0dee333a83a45f1ab0c1bb6d094afd1 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:09.537874 21599 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:09.540181 21706 raft_consensus.cc:3055] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:09.540795 21706 raft_consensus.cc:740] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:09.530750 18528 rpcz_store.cc:276] 0709 12:23:08.357151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:08.955737 (+598586us) service_pool.cc:224] Handling call
0709 12:23:08.956207 (+   470us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:08.956686 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:08.956725 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:08.971134 (+ 14409us) log.cc:844] Serialized 52 byte log entry
0709 12:23:09.481179 (+510045us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:09.482048 (+   869us) log.cc:844] Serialized 14 byte log entry
0709 12:23:09.483531 (+  1483us) log.cc:844] Serialized 14 byte log entry
0709 12:23:09.483732 (+   201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.483851 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:09.483909 (+    58us) raft_consensus.cc:1685] finished
0709 12:23:09.483929 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:09.484101 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1058,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":7254,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":6263,"thread_start_us":320894,"threads_started":1,"wal-append.queue_time_us":344246}
I20260709 12:23:09.519686 21733 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:09.541836 21659 consensus_queue.cc:1059] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:09.542629 18603 raft_consensus.cc:1240] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:09.543249 21659 raft_consensus.cc:3055] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:09.543334 21500 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:09.543804 21659 raft_consensus.cc:740] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:09.543954 21764 consensus_queue.cc:1059] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:09.544797 21764 consensus_queue.cc:1243] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer a0dee333a83a45f1ab0c1bb6d094afd1 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:23:09.544677 21659 consensus_queue.cc:260] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:09.546057 21659 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:09.541841 21706 consensus_queue.cc:260] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.547185 21706 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:09.549499 21500 raft_consensus.cc:3055] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:09.549954 21500 raft_consensus.cc:740] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:09.549556 21763 consensus_queue.cc:1059] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:09.550736 21500 consensus_queue.cc:260] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.491869 21661 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:09.493891 21734 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.510761 21670 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:09.511896 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 243941us
I20260709 12:23:09.558913 18646 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:09.513455 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 311905us
I20260709 12:23:09.532992 21711 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:09.551206 21763 consensus_queue.cc:1243] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:23:09.489239 18605 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:09.543721 18494 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:23:09.452986 18424 rpcz_store.cc:269] 0709 12:22:53.527994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.528379 (+   385us) service_pool.cc:224] Handling call
0709 12:23:09.451008 (+15922629us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:07.212846 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:07.213444 (+   598us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:07.213482 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:23:07.213503 (+    21us) tablet.cc:662] Decoding operations
0709 12:23:07.311914 (+ 98411us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:07.322810 (+ 10896us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:07.322846 (+    36us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:23:07.324244 (+  1398us) tablet.cc:701] Row locks acquired
0709 12:23:07.324264 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:23:07.324415 (+   151us) write_op.cc:270] Start()
0709 12:23:07.324532 (+   117us) write_op.cc:276] Timestamp: P: 1783599787324365 usec, L: 0
0709 12:23:07.324554 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:23:07.553792 (+229238us) log.cc:844] Serialized 6401 byte log entry
0709 12:23:07.861786 (+307994us) op_driver.cc:464] REPLICATION: finished
0709 12:23:08.120467 (+258681us) write_op.cc:301] APPLY: starting
0709 12:23:08.120552 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:08.120871 (+   319us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:08.121003 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:08.122886 (+  1883us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:08.123160 (+   274us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:23:08.123205 (+    45us) write_op.cc:312] APPLY: finished
0709 12:23:08.123532 (+   327us) log.cc:844] Serialized 113 byte log entry
0709 12:23:08.130786 (+  7254us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:08.142403 (+ 11617us) write_op.cc:454] Released schema lock
0709 12:23:08.189445 (+ 47042us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:08.310012 (+120567us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:08.312751 (+  2739us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":35692,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":258398,"apply.run_cpu_time_us":4255,"apply.run_wall_time_us":145796,"num_ops":16,"prepare.queue_time_us":129374,"prepare.run_cpu_time_us":39454,"prepare.run_wall_time_us":470934,"raft.queue_time_us":171665,"raft.run_cpu_time_us":39067,"raft.run_wall_time_us":206241,"replication_time_us":537044,"thread_start_us":442635,"threads_started":4,"wal-append.queue_time_us":108315,"wal-append.run_cpu_time_us":34554,"wal-append.run_wall_time_us":1467786}]]}
I20260709 12:23:09.560621 18570 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:09.561983 18525 raft_consensus.cc:1240] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:09.562496 18523 raft_consensus.cc:1240] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:09.564936 18644 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:09.562016 18646 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:09.562978 18602 raft_consensus.cc:1240] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:09.567046 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:09.568150 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:09.568323 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:09.569208 18678 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:09.568781 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:09.568742 18605 raft_consensus.cc:3055] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:09.569941 18605 raft_consensus.cc:740] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:09.570766 18605 consensus_queue.cc:260] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.568884 21750 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:09.572670 21757 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:09.573586 21637 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:09.576735 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:09.577652 21661 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:09.568284 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:09.581239 21762 raft_consensus.cc:1064] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:23:09.583491 21750 consensus_queue.cc:1059] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:09.574381 21634 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:09.574606 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:09.586846 18494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.575769 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:09.587334 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:09.576188 18603 raft_consensus.cc:1240] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:09.576391 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:09.588209 18605 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:09.586604 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:09.575286 21734 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:09.589082 18570 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:09.592389 21767 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:09.590109 18494 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.592849 21767 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:09.593106 18570 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:09.593410 21711 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:09.593233 21767 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:09.593890 21611 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:09.594637 18494 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.595490 21711 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:09.596462 18570 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:09.597368 21611 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:09.598030 21611 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:09.598408 21611 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:09.591315 21757 raft_consensus.cc:697] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:09.600636 21757 consensus_queue.cc:237] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.601841 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:09.584512 21763 raft_consensus.cc:3055] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:09.602581 21670 consensus_queue.cc:1059] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:09.602681 21763 raft_consensus.cc:740] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:09.603794 21199 raft_consensus.cc:3055] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:09.604185 21199 raft_consensus.cc:740] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:09.604547 21661 consensus_queue.cc:1059] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:09.605064 21199 consensus_queue.cc:260] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.606535 21199 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:09.605518 21664 raft_consensus.cc:3055] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:09.608093 21664 raft_consensus.cc:740] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:09.608367 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:09.609071 21664 consensus_queue.cc:260] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.618312 21767 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.619268 21662 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:09.560369 21500 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:09.626631 21662 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:09.629433 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.630648 21662 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:09.630885 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:09.631196 18678 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:23:09.632093 21727 raft_consensus.cc:3055] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:09.632490 21727 raft_consensus.cc:740] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:09.633423 21727 consensus_queue.cc:260] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:09.635107 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 73167.5us
I20260709 12:23:09.636344 18646 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:09.620666 21763 consensus_queue.cc:260] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.621891 21664 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:09.625804 18605 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:23:09.569078 21636 raft_consensus.cc:2749] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:09.638221 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:23:09.640002 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 43619.1us
W20260709 12:23:09.640440 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 43842.2us
I20260709 12:23:09.647326 19244 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
I20260709 12:23:09.651440 18494 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.651516 18646 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.653666 18525 raft_consensus.cc:2393] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 4: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:09.654719 21636 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:09.656906 21688 raft_consensus.cc:2764] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:23:09.655885 21750 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:09.662503 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.663259 21711 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:23:09.669448 21772 log.cc:927] Time spent T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:23:09.669301 18677 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
I20260709 12:23:09.672266 21762 consensus_queue.cc:237] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:09.675953 21763 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:09.659250 21599 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:09.639590 21637 consensus_queue.cc:1059] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:23:09.683149 21637 raft_consensus.cc:3055] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:09.683674 21637 raft_consensus.cc:740] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:09.684808 21637 consensus_queue.cc:260] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.686230 21637 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:09.688196 21727 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:09.688688 21599 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:09.689168 21599 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:09.694306 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.682137 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:09.696091 21586 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:09.696663 21586 raft_consensus.cc:697] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:09.697590 21586 consensus_queue.cc:237] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:09.696326 18570 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:09.703090 21706 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:09.704656 18494 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.708035 21661 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:09.711009 21706 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:09.714013 18494 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.715687 18570 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:09.716856 21706 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:09.717702 19210 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:09.718605 21662 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:09.719026 21662 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:09.719413 21662 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:09.721065 21661 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:09.723176 18494 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.724134 21712 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:09.725297 18570 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:09.729064 21712 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.730360 21733 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:09.731261 21712 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:09.725790 18606 raft_consensus.cc:2410] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:23:09.734086 21662 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:09.734418 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:09.734995 18570 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:09.735247 18646 leader_election.cc:400] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9.
I20260709 12:23:09.760015 18646 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.736454 21611 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.762399 18646 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.758299 21706 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:09.763919 21750 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:09.764348 21750 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:09.764731 21750 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:09.745193 18423 catalog_manager.cc:5697] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 3 to 4, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 4 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:09.784106 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:09.791966 18423 catalog_manager.cc:5697] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 5 to 6, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 6 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:09.797343 21611 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:09.798840 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:09.800585 18528 raft_consensus.cc:2393] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 8: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:09.803296 21698 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.803870 21698 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:09.806602 21698 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:09.807835 21500 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:09.808404 21500 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.810382 21500 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:09.654495 21767 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:09.755143 18494 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.760015 18570 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:09.742997 21599 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:09.761863 21765 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:09.777740 21662 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:09.812485 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 57426.1us
W20260709 12:23:09.812485 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 52547.2us
I20260709 12:23:09.816464 18646 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.818686 18678 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
I20260709 12:23:09.821022 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:09.828307 18525 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:23:09.829959 19210 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:09.833156 18494 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:09.836819 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:09.840678 18605 raft_consensus.cc:1240] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:09.842144 18677 raft_consensus.cc:1275] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:09.844767 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:09.846766 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:09.847555 18528 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:23:09.850118 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:09.853262 18680 raft_consensus.cc:1275] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:23:09.858042 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:09.860308 19244 raft_consensus.cc:1275] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEARNER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:23:09.862039 18521 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:09.862589 18526 raft_consensus.cc:1275] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:23:09.862982 18526 pending_rounds.cc:85] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 2
I20260709 12:23:09.863198 18526 pending_rounds.cc:107] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:23:09.863430 18526 raft_consensus.cc:2889] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:09.865520 18526 pending_rounds.cc:85] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 2
I20260709 12:23:09.865811 18526 pending_rounds.cc:107] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:23:09.865856 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:09.866098 18526 raft_consensus.cc:2889] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:09.866684 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:09.867414 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:09.868183 18494 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:09.868611 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:09.795141 18423 catalog_manager.cc:5697] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 6 to 7, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 7 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:09.872397 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:09.872741 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:09.875095 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:09.878048 18605 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:09.879279 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:09.880824 18671 raft_consensus.cc:1240] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:23:09.883289 18679 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:23:09.886631 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:09.815901 21500 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:09.819984 21611 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:09.890306 19212 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:09.891990 18494 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.891294 18673 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:09.875934 21636 raft_consensus.cc:2804] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:09.894999 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:09.832561 21439 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:09.898830 18570 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:09.861047 21706 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:09.871699 21659 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:09.854537 21762 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.912580 18606 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:23:09.914283 18597 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:09.906590 18680 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:09.917816 18523 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:09.853416 21712 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:23:09.898478 21764 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:23:09.939685 21712 consensus_queue.cc:1243] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer 2f9872512f1646bc835906bd0e98c6a7 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:23:09.860908 21634 consensus_queue.cc:1059] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:23:09.928483 21659 raft_consensus.cc:697] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:09.944819 21659 consensus_queue.cc:237] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:09.921350 21762 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.894421 21559 consensus_queue.cc:1059] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:23:09.952348 21712 raft_consensus.cc:3055] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:09.952724 21712 raft_consensus.cc:740] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:09.924108 21734 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:09.953634 21712 consensus_queue.cc:260] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.908154 21662 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:09.961992 18528 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:09.907886 21611 raft_consensus.cc:697] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:09.920445 21629 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:09.946838 18423 catalog_manager.cc:5697] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:09.925876 21706 raft_consensus.cc:697] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:09.951570 21762 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:09.977906 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 86181.4us
I20260709 12:23:09.982362 18494 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:09.963302 21662 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.966969 21549 raft_consensus.cc:2749] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:09.987586 18494 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.968019 21750 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:09.987614 21662 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:10.006383 18494 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:09.988492 21634 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:23:10.013622 21776 log.cc:927] Time spent T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:23:09.998373 21636 raft_consensus.cc:697] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:09.992633 21629 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:10.014184 18423 catalog_manager.cc:5697] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 1 to 5, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 5 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:10.020888 21636 consensus_queue.cc:237] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:10.025315 18423 catalog_manager.cc:5697] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 4 to 5, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 5 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.028054 21706 consensus_queue.cc:237] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:10.036377 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 115379us
I20260709 12:23:10.043853 21599 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:10.045205 21637 consensus_queue.cc:1048] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:10.047336 21762 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:10.010872 21611 consensus_queue.cc:237] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:10.041846 21629 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:10.064258 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:10.064468 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:10.064953 18680 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:10.065310 18605 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:10.066975 18646 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:10.067853 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:10.068626 18605 raft_consensus.cc:2393] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 7: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:10.069146 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:10.069969 18606 raft_consensus.cc:2393] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 7: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:10.068553 18646 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:10.075788 19240 raft_consensus.cc:1275] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:10.081944 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:10.088306 18494 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:10.090766 18494 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:10.100214 18494 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:23:10.108006 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 148477us
I20260709 12:23:10.077907 21727 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:10.099640 21634 consensus_queue.cc:1059] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:23:10.091847 21763 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:10.067531 21599 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:23:10.107012 21762 raft_consensus.cc:2804] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:10.103176 21782 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:10.079795 21749 consensus_queue.cc:1048] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
W20260709 12:23:10.143851 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 43774.7us
I20260709 12:23:10.144659 18494 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:10.124599 21439 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:10.133493 21706 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:10.140508 21763 raft_consensus.cc:697] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:10.181658 21636 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:10.184667 21611 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:10.185597 21706 raft_consensus.cc:697] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:10.188059 21636 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.248402 21706 consensus_queue.cc:237] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:10.188956 21611 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:10.261823 21611 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:10.263535 21779 log.cc:927] Time spent T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260709 12:23:10.270864 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 125145us
I20260709 12:23:10.272606 18528 pending_rounds.cc:85] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 3
I20260709 12:23:10.272956 18528 pending_rounds.cc:107] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:23:10.273221 18528 raft_consensus.cc:2889] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:10.273670 21762 raft_consensus.cc:697] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:10.275441 21711 raft_consensus.cc:3055] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:10.275049 21762 consensus_queue.cc:237] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:10.244423 21636 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:10.277448 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:10.177894 21439 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:10.279357 18521 raft_consensus.cc:1275] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:23:10.280580 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:10.278005 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:23:10.312492 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 198831us
I20260709 12:23:10.319482 18605 raft_consensus.cc:1240] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7. Ops: []
W20260709 12:23:10.314586 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 196475us
W20260709 12:23:10.316327 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 185442us
I20260709 12:23:10.321786 18570 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:10.324980 18605 raft_consensus.cc:1240] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:23:10.275861 21711 raft_consensus.cc:740] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:23:10.340051 21784 log.cc:927] Time spent T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 12:23:10.351459 21711 consensus_queue.cc:260] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:10.320744 21800 consensus_queue.cc:1048] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:23:10.321610 21763 consensus_queue.cc:237] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:10.381009 21801 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:10.421456 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 98705.8us
I20260709 12:23:10.434974 21798 consensus_queue.cc:1059] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:23:10.432621 21801 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:10.440615 21801 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:10.443380 21801 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:10.462491 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 108551us
I20260709 12:23:10.465945 18570 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:10.485083 18570 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:10.486697 18570 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:10.463869 21711 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:10.489406 18570 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:23:10.491021 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 134767us
I20260709 12:23:10.492470 21604 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:10.492473 21733 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:10.484454 21798 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:10.498322 21813 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:10.512801 21813 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:10.502378 21439 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:10.483151 21799 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:10.521337 21813 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:10.521696 21712 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:10.524267 21797 log.cc:927] Time spent T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 12:23:10.504768 21796 log.cc:927] Time spent T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:23:10.508481 21798 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:10.531776 21604 raft_consensus.cc:697] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:10.534461 21604 consensus_queue.cc:237] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:10.504494 21662 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:10.541524 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 111064us
W20260709 12:23:10.545487 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 46597.6us
W20260709 12:23:10.580307 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 91009.7us
I20260709 12:23:10.581436 18570 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:10.605023 18675 raft_consensus.cc:1240] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:10.589478 21801 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:10.597204 21799 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:10.645295 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:10.645589 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:10.574290 21813 consensus_queue.cc:1048] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 12:23:10.644407 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 178790us
I20260709 12:23:10.650331 18675 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:10.651103 18679 raft_consensus.cc:1240] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:10.656175 18606 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:23:10.657779 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:10.658339 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:10.651162 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:10.662398 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:10.656461 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:10.665609 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:10.666291 21801 raft_consensus.cc:697] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:10.646433 21763 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:10.666741 21688 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:10.668547 21798 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:10.669449 18529 raft_consensus.cc:1275] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:23:10.670317 21800 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:10.640411 21750 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:10.646692 21749 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:10.676512 18606 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:23:10.676973 18521 raft_consensus.cc:2393] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 8: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:10.678521 18673 raft_consensus.cc:1275] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:23:10.682839 18570 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:10.685299 18600 raft_consensus.cc:2393] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 9: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:10.662482 21799 raft_consensus.cc:697] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:10.693771 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:10.714783 18605 raft_consensus.cc:2393] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 7: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:10.695662 18644 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:10.686910 19244 raft_consensus.cc:1275] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:10.720707 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:10.721513 19244 raft_consensus.cc:2368] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9.
I20260709 12:23:10.814456 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:10.684619 21661 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:23:10.688272 21783 consensus_queue.cc:1059] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 12:23:10.841144 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 130115us
W20260709 12:23:10.830974 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 181791us
W20260709 12:23:10.833931 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 147614us
I20260709 12:23:10.725883 21727 raft_consensus.cc:2749] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:10.698768 21763 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:10.883458 18570 leader_election.cc:400] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879) with higher term. Message: Invalid argument: T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9.
W20260709 12:23:10.833563 21636 consensus_meta.cc:287] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.002s
I20260709 12:23:10.879372 21801 consensus_queue.cc:237] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:10.878044 21799 consensus_queue.cc:237] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:10.880824 21661 raft_consensus.cc:3055] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:10.705542 21688 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:10.892165 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 44680.2us
I20260709 12:23:10.829571 21733 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:10.887205 18570 leader_election.cc:403] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:10.866695 21757 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:10.904479 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 215130us
W20260709 12:23:10.902102 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 251618us
I20260709 12:23:10.914325 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:10.921200 18606 raft_consensus.cc:1240] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:23:10.922922 18675 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:10.894940 21750 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:10.897315 21661 raft_consensus.cc:740] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:10.717535 21749 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:10.968531 21661 consensus_queue.cc:260] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:10.973443 21661 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:10.974553 21688 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:10.976099 21825 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:10.908802 21199 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:23:10.927660 21662 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:10.980840 21662 consensus_queue.cc:1059] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:10.970868 18675 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:10.893872 21636 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:10.981758 21828 raft_consensus.cc:3055] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:10.982131 21828 raft_consensus.cc:740] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:10.983155 21636 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:10.984306 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:23:10.984535 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 82939.1us
I20260709 12:23:10.990641 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:10.992254 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:10.995611 18527 raft_consensus.cc:2393] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 8: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:10.987999 21750 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:11.006359 18680 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:10.895998 21814 consensus_queue.cc:1048] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
W20260709 12:23:11.024166 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 306036us
I20260709 12:23:11.032567 21734 consensus_queue.cc:1048] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:10.973789 21749 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:11.007570 21750 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:10.956460 21764 consensus_queue.cc:1048] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 12:23:10.926615 21757 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:11.069278 18680 raft_consensus.cc:1275] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:10.982977 21828 consensus_queue.cc:260] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:11.081285 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 51461.1us
I20260709 12:23:11.084731 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:11.085408 18599 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:11.091624 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:11.094275 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:11.094051 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:11.097414 19242 raft_consensus.cc:2393] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 3: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:11.101084 18597 raft_consensus.cc:1275] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:23:11.103597 21826 log.cc:927] Time spent T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 12:23:11.111712 18675 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:23:11.112061 18644 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:11.115155 18644 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:11.116039 21549 raft_consensus.cc:2749] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:11.077024 21827 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:11.117966 18644 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:11.105751 21712 consensus_meta.cc:287] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.583s	user 0.003s	sys 0.011s
I20260709 12:23:11.128368 21827 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:11.134665 21827 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:11.135404 21763 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:10.895835 19239 raft_consensus.cc:2955] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 3 to 6, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:11.144080 21782 raft_consensus.cc:3055] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:11.144728 21782 raft_consensus.cc:740] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:23:11.146461 21805 log.cc:927] Time spent T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.573s	user 0.001s	sys 0.001s
I20260709 12:23:11.145890 21782 consensus_queue.cc:260] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:11.106869 21559 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:11.118219 21599 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:11.150206 21764 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:11.132053 21549 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:11.151609 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 253564us
I20260709 12:23:11.162439 21764 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:11.164894 21764 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:11.169185 18521 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:23:11.169646 18521 pending_rounds.cc:85] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 3
I20260709 12:23:11.169886 18521 pending_rounds.cc:107] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:23:11.158453 18644 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:11.170118 18521 raft_consensus.cc:2889] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:11.170404 18680 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:23:11.171681 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:11.172259 18675 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:11.178339 18675 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:23:11.185809 18600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:11.186592 18600 raft_consensus.cc:606] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:11.187019 18600 raft_consensus.cc:614] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:11.151651 21757 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:11.194994 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:11.184329 21782 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:11.211055 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:11.217962 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:11.230470 19240 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:11.219969 21658 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:11.234221 18597 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:11.221964 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:11.179877 21599 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.224500 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:11.227389 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:11.228669 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:11.194108 21829 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.192683 21803 raft_consensus.cc:2804] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:11.239328 21764 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:11.256461 19246 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:11.256757 21764 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:11.233753 21757 consensus_queue.cc:1048] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:11.226986 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:11.236663 18605 raft_consensus.cc:1275] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:23:11.236908 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:11.259845 18494 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:11.158152 21559 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:11.266299 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:11.269086 18494 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:11.271687 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:11.272894 18677 raft_consensus.cc:2393] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 10: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:11.275931 18644 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:11.277873 18646 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:11.278301 18604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:11.278896 18604 raft_consensus.cc:606] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:11.280833 18644 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:11.225212 21750 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:11.240468 21199 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879) with higher term. Message: Invalid argument: T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9.
I20260709 12:23:11.304450 18529 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:11.225653 21814 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 12:23:11.259016 21803 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:11.361040 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.276888 21781 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:11.281646 21793 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:11.270879 21634 consensus_queue.cc:1048] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 12:23:11.399199 18604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:11.399892 18604 raft_consensus.cc:606] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:11.270812 21830 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 12:23:11.400591 18604 raft_consensus.cc:614] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:11.263227 21599 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:11.377741 21834 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:23:11.397972 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.415410 18528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1683) took 1129 ms. Trace:
W20260709 12:23:11.399852 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 119055us
I20260709 12:23:11.395699 18606 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
I20260709 12:23:11.293588 21835 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:11.378994 21803 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:11.295558 21783 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 12:23:11.416042 18528 rpcz_store.cc:276] 0709 12:23:10.271854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.272026 (+   172us) service_pool.cc:224] Handling call
0709 12:23:10.272390 (+   364us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:10.273811 (+  1421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:10.273837 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:10.274336 (+   499us) log.cc:844] Serialized 52 byte log entry
0709 12:23:10.324205 (+ 49869us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:10.367932 (+ 43727us) log.cc:844] Serialized 14 byte log entry
0709 12:23:10.534692 (+166760us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b180040f540. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793c02a6 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793f23f3 00007efc793f47c1
0709 12:23:10.540137 (+  5445us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b180040f540. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793f23f3 00007efc793f47c1 00007efc793f4779 00007efc793f4709 00007efc793f46d1 00007efc793f39cd 0000000000388634 0000000000388479 00007efc793d583a
0709 12:23:11.145879 (+605742us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:23:11.400805 (+254926us) spinlock_profiling.cc:243] Waited 8.04 ms on lock 0x7b180040f540. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc7936cc0a 00007efc82aac219 00007efc793f4a40 00007efc793ef4e4 00007efc793ef455 00007efc7fed73c7 00007efc7c4e99a7 00007efc7c4f90bf 00007efc7c4f9038
0709 12:23:11.401011 (+   206us) log.cc:844] Serialized 14 byte log entry
0709 12:23:11.401210 (+   199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.401281 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:11.401320 (+    39us) raft_consensus.cc:1685] finished
0709 12:23:11.401331 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:11.401479 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":868613,"prepare.queue_time_us":1080229,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":10341,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":35908,"spinlock_wait_cycles":39865600,"thread_start_us":49442,"threads_started":1,"wal-append.queue_time_us":119077}
I20260709 12:23:11.375229 21706 consensus_queue.cc:1048] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:23:11.378310 21764 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:11.273883 21829 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:11.462728 21845 log.cc:927] Time spent T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:23:11.463709 21829 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:11.382797 21763 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:11.440311 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1689) took 1004 ms. Trace:
I20260709 12:23:11.307430 21749 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.108s
I20260709 12:23:11.378818 21712 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:11.434158 21834 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:11.401599 21781 raft_consensus.cc:697] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:11.378430 21670 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
W20260709 12:23:11.445856 19209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.438745 21835 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:11.452987 21828 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:11.453384 21599 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:11.460870 21559 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:11.467701 18605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:11.494490 18605 raft_consensus.cc:606] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:11.479988 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:11.478791 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:11.479611 18674 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:23:11.475723 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 197910us
I20260709 12:23:11.496076 18528 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:23:11.496119 18673 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:23:11.498148 18570 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:11.513244 18671 raft_consensus.cc:1275] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:11.469367 21834 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:11.517104 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 80683.8us
I20260709 12:23:11.485658 21835 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:11.533178 21763 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:11.536861 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:11.537981 21559 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:11.538580 21559 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:11.540762 21559 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:11.544634 21833 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:11.520877 21611 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:23:11.545178 21833 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:11.547720 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:11.512048 21823 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:11.550560 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:11.555533 18601 raft_consensus.cc:2393] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 7: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:11.551386 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:11.569372 21712 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.555099 21823 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.469161 21781 consensus_queue.cc:237] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:11.551994 21833 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:11.511901 21801 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:23:11.606524 21813 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.627992 18600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:11.628671 18600 raft_consensus.cc:606] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:11.628984 18600 raft_consensus.cc:614] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:11.606469 21734 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:11.607311 21823 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:11.630811 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 94635.6us
I20260709 12:23:11.634907 18671 raft_consensus.cc:1240] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:11.606645 21712 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:11.639874 21812 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.618366 21803 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:11.661047 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:11.663431 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:11.664242 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:11.633257 21734 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:11.632012 21813 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:11.675369 21549 consensus_meta.cc:287] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.000s
I20260709 12:23:11.689774 21654 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:11.690472 21654 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:11.693583 21654 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:11.667963 21812 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:11.671383 21801 consensus_queue.cc:1059] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:23:11.706295 21712 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:11.706650 21734 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:11.707198 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:11.717621 21813 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:11.720892 21835 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:11.723340 21549 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:11.724565 18675 raft_consensus.cc:1275] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:23:11.726478 18529 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:11.699258 21812 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:11.733438 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 1690) took 1282 ms. Trace:
I20260709 12:23:11.730446 21734 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.735668 21734 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:11.737968 21837 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:11.738511 21837 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:11.723444 21835 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:11.741125 18673 raft_consensus.cc:2410] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:23:11.741358 21837 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:11.742933 21801 raft_consensus.cc:3055] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:11.743330 21801 raft_consensus.cc:740] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:11.744184 21801 consensus_queue.cc:260] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:11.745602 21801 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:11.465184 18526 rpcz_store.cc:276] 0709 12:23:10.436048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.449684 (+ 13636us) service_pool.cc:224] Handling call
0709 12:23:10.450038 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:10.450372 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:10.450399 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:10.450805 (+   406us) log.cc:844] Serialized 26 byte log entry
0709 12:23:10.585146 (+134341us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:11.420327 (+835181us) log.cc:844] Serialized 14 byte log entry
0709 12:23:11.439962 (+ 19635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.440056 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:11.440106 (+    50us) raft_consensus.cc:1685] finished
0709 12:23:11.440123 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:11.440254 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":842253,"prepare.queue_time_us":857482,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":6298,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":4272,"thread_start_us":133929,"threads_started":1,"wal-append.queue_time_us":220506}
I20260709 12:23:11.752381 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:11.753262 18528 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:11.768347 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:11.769850 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:11.770505 19239 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:11.771729 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:11.774355 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:11.774962 18600 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:11.777592 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:11.779083 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:11.779119 19239 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:11.735460 18523 rpcz_store.cc:276] 0709 12:23:10.451381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.452027 (+   646us) service_pool.cc:224] Handling call
0709 12:23:10.452350 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:10.452641 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:10.452666 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:10.453065 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 12:23:10.604518 (+151453us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:11.625689 (+1021171us) log.cc:844] Serialized 14 byte log entry
0709 12:23:11.733118 (+107429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.733188 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:11.733233 (+    45us) raft_consensus.cc:1685] finished
0709 12:23:11.733244 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:11.733363 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":914645,"prepare.queue_time_us":866402,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":123910,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":14367,"thread_start_us":336112,"threads_started":2,"wal-append.queue_time_us":273490}
I20260709 12:23:11.785809 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:11.790191 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:11.790571 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:11.791648 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:11.792237 18599 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:23:11.793198 18597 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:11.800529 18606 raft_consensus.cc:2393] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 8: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:11.803519 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:11.806288 21803 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:11.807421 18426 catalog_manager.cc:5697] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 3 to 6, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 6 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:11.808230 21813 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.808929 21813 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:11.812343 21813 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:11.820138 18675 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:23:11.829270 21734 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:11.832453 21858 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:11.833071 21858 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:11.834398 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:11.835284 21858 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:11.836355 21795 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.836831 21795 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:11.838833 21795 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:11.839298 21795 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:11.839707 21795 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:11.844053 21795 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:11.845583 18603 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:11.809289 18426 catalog_manager.cc:5697] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 7 to 8, leader changed from 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 8 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:11.850013 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:11.850869 21484 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:11.850934 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:11.858958 18644 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:11.860065 21688 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:11.860731 21688 raft_consensus.cc:697] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:11.861986 21688 consensus_queue.cc:237] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:11.873996 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:11.874707 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:11.874742 18530 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:11.876817 18494 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:11.878669 21858 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:11.879285 21858 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:11.879427 18521 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:11.879835 21858 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:11.884271 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:11.898849 21586 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:11.901136 21823 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:11.902567 18604 raft_consensus.cc:2393] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 7: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:11.903358 18644 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:11.904408 21817 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:11.904827 21817 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.904933 21800 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:11.905246 18521 raft_consensus.cc:1275] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:11.905198 21817 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:11.909690 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 55884.9us
I20260709 12:23:11.921887 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:11.923656 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:11.923914 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:11.924412 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:11.924773 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:11.926362 18524 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:23:11.924561 18522 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:23:11.924664 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:11.925839 18521 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:23:11.934469 18529 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:11.936018 18644 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:11.931945 21817 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:11.939788 21817 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:11.942390 18679 raft_consensus.cc:1240] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:11.939975 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:11.947443 19239 raft_consensus.cc:1240] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 12:23:11.951435 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 52799.4us
I20260709 12:23:11.956346 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:11.961850 18528 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
I20260709 12:23:11.962945 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:11.963835 18530 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:11.963575 19212 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
W20260709 12:23:11.960005 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 48842.8us
I20260709 12:23:11.985603 18644 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:11.986035 18426 catalog_manager.cc:5697] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 2 to 5, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 5 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:11.987879 18572 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:11.987861 18426 catalog_manager.cc:5697] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 6 to 8, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 8 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:11.990387 18526 raft_consensus.cc:1240] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9. Ops: []
W20260709 12:23:12.005759 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.012152 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:11.949368 21813 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:12.025722 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:12.020915 18426 catalog_manager.cc:5697] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:11.985288 21800 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:12.012817 21780 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:12.041373 18494 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:11.991496 21823 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:12.014354 21834 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.064036 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:12.068632 18521 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:12.077051 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:12.080536 18528 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:12.067867 18494 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:12.122316 18521 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:12.126022 18572 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:12.127454 18494 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:12.129134 21762 consensus_queue.cc:1048] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:12.129817 21785 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.130393 21785 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:12.081648 21727 raft_consensus.cc:476] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Not starting pre-election -- already a leader
I20260709 12:23:12.082310 21764 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:12.166468 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:12.167407 21794 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:12.167915 21794 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.168263 21794 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:12.142999 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:12.137224 18528 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:12.108178 21834 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:12.189345 21636 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:12.084290 21812 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:23:12.190747 21868 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:12.188218 21816 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:23:12.122097 21830 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:12.195662 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 84912.4us
I20260709 12:23:12.065380 21800 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:12.110034 21439 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:12.111114 21780 raft_consensus.cc:697] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:12.154443 21856 raft_consensus.cc:2804] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:23:12.210285 21876 log.cc:927] Time spent T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:23:12.211199 18530 raft_consensus.cc:2393] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 8: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
W20260709 12:23:12.200548 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 63109.3us
W20260709 12:23:12.236027 21857 log.cc:927] Time spent T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:23:12.132807 21785 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:12.143113 21762 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:12.265376 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:12.268191 18646 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:12.269680 18646 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:12.270453 21855 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:23:12.242965 21879 log.cc:927] Time spent T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.110s	user 0.001s	sys 0.001s
I20260709 12:23:12.271706 18646 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:12.250627 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:12.271193 21855 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:12.294567 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:12.297922 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 92180.5us
I20260709 12:23:12.292812 21868 raft_consensus.cc:697] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:12.303869 21868 consensus_queue.cc:237] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:12.212396 21439 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:12.266808 21856 raft_consensus.cc:697] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:12.309018 21856 consensus_queue.cc:237] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:12.310519 21611 consensus_queue.cc:1059] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:12.311331 21611 consensus_queue.cc:1243] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer a0dee333a83a45f1ab0c1bb6d094afd1 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:23:12.318809 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 47200.6us
I20260709 12:23:12.319707 18646 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:12.333671 18646 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:12.333827 19239 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
W20260709 12:23:12.332171 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 90453.6us
I20260709 12:23:12.323490 21727 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:12.340649 21727 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:12.341068 21727 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:12.318339 21199 raft_consensus.cc:3055] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:12.317062 21828 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:12.202145 21636 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:12.354002 18597 raft_consensus.cc:1275] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:23:12.358937 18597 pending_rounds.cc:85] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9: Aborting all ops after (but not including) 4
I20260709 12:23:12.359300 18597 pending_rounds.cc:107] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:23:12.359596 18597 raft_consensus.cc:2889] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:12.363190 18494 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:12.379063 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:12.350986 21199 raft_consensus.cc:740] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:12.339543 21855 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:12.428453 21855 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:12.428929 21855 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:12.420652 21688 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:12.420823 21801 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.372897 21802 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:12.373257 21706 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:23:12.426000 21873 log.cc:927] Time spent T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.190s	user 0.001s	sys 0.001s
I20260709 12:23:12.436513 21688 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.385411 21634 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:12.445595 21688 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:12.332412 21780 consensus_queue.cc:237] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:12.440500 21802 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:12.482515 21634 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:12.440884 21801 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:12.514737 21883 log.cc:927] Time spent T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.108s	user 0.000s	sys 0.004s
I20260709 12:23:12.445605 21706 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:12.375962 21828 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:12.523209 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:12.524946 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:12.525279 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 225701us
I20260709 12:23:12.531105 18673 raft_consensus.cc:1275] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:12.531659 21802 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:12.527359 18570 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:12.513994 21634 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:12.539450 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:12.539680 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 206174us
I20260709 12:23:12.541653 18677 raft_consensus.cc:2393] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 8: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:12.543433 18646 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:12.544970 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:12.563297 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:12.543726 21858 consensus_meta.cc:287] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.663s	user 0.013s	sys 0.000s
I20260709 12:23:12.572082 18570 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:12.568109 18646 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:12.543305 21869 raft_consensus.cc:2749] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:12.596680 21801 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:12.597524 21706 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:12.599222 21828 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:12.568361 21892 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:12.602334 21794 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:12.617871 21855 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:12.607170 21814 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:12.632951 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:12.577167 21858 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:12.632459 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 48443.2us
I20260709 12:23:12.633616 18676 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:12.614209 21749 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:12.643061 18570 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:12.651868 18603 raft_consensus.cc:2393] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 10: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:12.665143 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:12.668596 18521 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:12.636865 21636 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:12.682940 21813 consensus_meta.cc:287] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.651s	user 0.010s	sys 0.000s
I20260709 12:23:12.684465 21794 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:12.686172 21855 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:12.688625 21634 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:12.677090 21889 raft_consensus.cc:2749] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:12.691236 21831 raft_consensus.cc:993] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:23:12.747575 21654 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:12.747979 21831 raft_consensus.cc:1081] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Signalling peer a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:23:12.748234 21654 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:12.747993 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:12.694410 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:12.750183 18606 raft_consensus.cc:2393] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 7: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:12.750370 21654 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:12.753194 21886 log.cc:927] Time spent T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.437s	user 0.000s	sys 0.003s
I20260709 12:23:12.753338 21634 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:12.707070 21688 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:12.697144 21749 raft_consensus.cc:697] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:12.757493 21749 consensus_queue.cc:237] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:12.758693 21887 log.cc:927] Time spent T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.442s	user 0.000s	sys 0.001s
I20260709 12:23:12.718333 18570 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:12.762460 18673 raft_consensus.cc:2393] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 7: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
W20260709 12:23:12.725507 21900 log.cc:927] Time spent T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:23:12.764389 21688 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:12.730024 21439 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:12.730479 21858 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:12.734525 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:12.739279 21803 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:12.774888 18522 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:23:12.775159 21800 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:12.774951 21803 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:12.663748 21727 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:12.744604 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:12.726811 21834 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:12.764482 21841 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:12.765232 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:12.769338 18680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:40802
I20260709 12:23:12.772063 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:12.800413 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:12.779593 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:12.635491 21868 consensus_queue.cc:1059] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:23:12.802742 18602 raft_consensus.cc:2393] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 8: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:12.785387 21803 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:12.825667 18677 raft_consensus.cc:1240] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:12.699879 21813 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:12.829983 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:12.825379 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:12.834980 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:12.837278 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:12.830266 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:12.841523 18602 raft_consensus.cc:2410] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:23:12.842070 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 44755.5us
I20260709 12:23:12.844738 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:12.846778 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:12.800081 21841 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.862671 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:12.822160 21727 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:12.805675 18680 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:12.872484 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:12.877673 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:12.877188 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:12.855782 18674 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:23:12.804941 21439 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:12.885196 18494 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:12.887331 18528 raft_consensus.cc:1275] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:12.886181 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:12.886718 18522 raft_consensus.cc:2393] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 7: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:12.889261 18494 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:12.878283 18680 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:12.891829 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:12.817309 21765 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:12.897383 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:12.821743 21834 consensus_queue.cc:1048] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:23:12.876228 21841 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:12.894011 21837 raft_consensus.cc:2749] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:12.902845 21836 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:12.913951 21817 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.922999 18646 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:12.923276 21817 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:12.925501 21817 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:12.932224 18646 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:12.933256 21727 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:12.933441 21654 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:12.907691 21765 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:12.935810 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:12.936787 18675 raft_consensus.cc:2393] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 9: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:12.937454 21765 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:12.949836 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:12.953249 18602 raft_consensus.cc:1275] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:23:12.933604 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 182373us
I20260709 12:23:12.919677 18680 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:12.960424 18494 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:12.976334 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:12.986416 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:12.987509 18529 raft_consensus.cc:2393] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 10: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:12.900594 21439 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:12.973199 21855 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.990767 18494 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:12.982317 21903 log.cc:927] Time spent T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:23:13.002642 18494 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:13.004515 21836 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:13.004843 21439 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:12.991875 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:12.918883 21634 consensus_queue.cc:1048] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:23:12.982095 21831 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.007223 21831 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:13.008872 18494 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:13.009704 21764 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:13.006269 18530 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:13.012213 18646 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:13.013151 21439 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:13.013625 21439 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.013433 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:13.016202 21439 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:13.021641 18572 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:12.973774 21817 consensus_queue.cc:1048] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:23:13.023427 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:13.024091 21733 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:13.024317 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:12.976430 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:13.026571 18646 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:13.027667 21817 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:13.027446 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:12.990372 21821 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:13.030776 21855 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:13.059464 21855 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:13.031035 21793 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:12.899569 18521 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:23:13.064761 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:13.065312 18646 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:13.065471 18601 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:13.065662 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:13.028501 19239 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:13.074908 18644 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:13.032743 21895 consensus_queue.cc:1048] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 12:23:13.091159 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 370260us
I20260709 12:23:13.178373 18494 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:13.193128 19239 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:13.238956 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:13.088043 21835 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:23:13.260627 21911 log.cc:927] Time spent T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
W20260709 12:23:13.261965 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 170308us
I20260709 12:23:13.274691 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:13.277597 21915 log.cc:927] Time spent T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.227s	user 0.000s	sys 0.000s
W20260709 12:23:13.278443 21914 log.cc:927] Time spent T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.215s	user 0.000s	sys 0.000s
W20260709 12:23:13.279187 21913 log.cc:927] Time spent T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 12:23:13.235412 21898 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:13.312037 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:13.344841 19243 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:13.321549 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:13.345940 18521 raft_consensus.cc:1240] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:13.356024 18524 raft_consensus.cc:1275] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:13.302291 21835 raft_consensus.cc:697] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:13.237982 21836 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:23:13.339516 21919 log.cc:927] Time spent T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:23:13.356230 21898 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.382690 21836 raft_consensus.cc:697] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:13.371063 21658 consensus_queue.cc:1059] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:23:13.397116 21898 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:13.366436 21439 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:13.417356 21835 consensus_queue.cc:237] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:13.417630 21199 consensus_queue.cc:260] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:13.420136 21836 consensus_queue.cc:237] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:13.429283 21920 log.cc:927] Time spent T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:23:13.420718 21549 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:13.436812 21549 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:13.443526 21910 raft_consensus.cc:3055] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:13.444212 21910 raft_consensus.cc:740] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:13.445323 21910 consensus_queue.cc:260] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:13.446666 21910 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:13.446679 21898 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:13.449584 21896 log.cc:927] Time spent T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.414s	user 0.005s	sys 0.001s
I20260709 12:23:13.449903 21898 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:13.428107 21841 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:13.454421 21841 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:13.455168 21549 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:13.466548 21831 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:13.523365 18597 raft_consensus.cc:2368] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10.
I20260709 12:23:13.528926 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:13.530215 18521 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:23:13.533319 18603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40948 (request call id 1796) took 1505 ms (client timeout 1911 ms). Trace:
W20260709 12:23:13.533978 18603 rpcz_store.cc:269] 0709 12:23:12.028066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.029065 (+   999us) service_pool.cc:224] Handling call
0709 12:23:12.166324 (+137259us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b5800102f98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:23:13.532848 (+1366524us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b54002f5154. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:13.533106 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1123903616}
I20260709 12:23:13.537774 18494 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:13.546419 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 144064us
I20260709 12:23:13.548769 18644 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:13.542011 18530 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:23:13.555188 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 180569us
I20260709 12:23:13.557685 18644 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:13.569566 21439 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:13.574098 21817 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:13.576282 21855 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:13.577507 19243 raft_consensus.cc:1240] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:23:13.580538 18675 raft_consensus.cc:2368] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9.
I20260709 12:23:13.585163 21199 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:13.586231 21586 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:13.586357 21812 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:13.588306 21814 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:13.592520 21659 consensus_queue.cc:1048] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:13.594861 21828 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:13.598680 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:13.599543 21816 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:13.615000 21661 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:23:13.615213 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.622459 18521 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:13.595633 21828 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:13.626645 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 69283.8us
I20260709 12:23:13.625936 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:13.633142 21749 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:13.587587 21812 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:13.648766 21733 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:13.649714 21733 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:13.631578 21661 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:13.656554 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:13.655226 21783 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:13.657986 21661 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:13.657673 21783 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:13.659641 21828 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:13.660899 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:13.661759 19211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.675407 21783 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:13.677192 21733 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:13.678942 18572 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:13.682368 21734 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:13.683032 21734 raft_consensus.cc:697] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:13.683558 18677 raft_consensus.cc:1240] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:13.685463 18671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1704) took 1162 ms. Trace:
I20260709 12:23:13.685094 21734 consensus_queue.cc:237] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:13.685966 18671 rpcz_store.cc:276] 0709 12:23:12.523373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.523483 (+   110us) service_pool.cc:224] Handling call
0709 12:23:12.523793 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:12.528097 (+  4304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:12.528145 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:12.528652 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 12:23:13.684407 (+1155755us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b54003276a0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c449090 00007efc7c4566b8 00007efc7c4df92b 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c
0709 12:23:13.684623 (+   216us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:13.684747 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.684869 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:13.684941 (+    72us) raft_consensus.cc:1685] finished
0709 12:23:13.684958 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:13.685245 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3864,"raft.queue_time_us":5974,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":94275456,"thread_start_us":96129,"threads_started":1,"wal-append.queue_time_us":88982,"wal-append.run_cpu_time_us":2133,"wal-append.run_wall_time_us":1060747}
I20260709 12:23:13.691737 18680 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:13.693702 18604 raft_consensus.cc:1275] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:13.699383 21611 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:13.706702 21611 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:13.709372 21611 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:13.710795 21812 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:13.596236 21586 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:13.715487 21586 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:13.717674 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:13.725775 18605 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:13.727228 18605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 1809) took 1062 ms. Trace:
I20260709 12:23:13.727571 18605 rpcz_store.cc:276] 0709 12:23:12.664828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.665256 (+   428us) service_pool.cc:224] Handling call
0709 12:23:12.678876 (+ 13620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:13.726243 (+1047367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.726958 (+   715us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000f0d54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:13.727155 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2406316288}
I20260709 12:23:13.734755 18426 catalog_manager.cc:5697] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 5 to 7, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 7 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:13.743738 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:13.752257 21792 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.753206 21792 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:23:13.758317 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:13.760211 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:13.738328 18426 catalog_manager.cc:5697] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 5 to 6, leader changed from 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 6 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:13.765327 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:13.765094 18426 catalog_manager.cc:5697] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 4 to 6, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 6 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:13.766690 21792 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:13.767815 18521 raft_consensus.cc:1275] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:13.806207 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:13.809093 18675 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:13.806336 19210 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:13.811576 21828 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:13.812019 21828 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:13.812158 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:13.812480 21828 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:13.818370 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:13.821319 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:13.822247 18526 raft_consensus.cc:2410] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:23:13.832990 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:13.834761 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:13.835541 19246 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:13.838872 18680 raft_consensus.cc:1217] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Deduplicated request from leader. Original: 8.8->[10.9-10.9]   Dedup: 10.9->[]
I20260709 12:23:13.839473 18680 raft_consensus.cc:1240] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:23:13.840786 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:13.841943 18675 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:13.852214 18522 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:13.866537 18680 raft_consensus.cc:1240] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 12:23:13.883291 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.902396 18494 leader_election.cc:400] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10.
I20260709 12:23:13.902848 18494 leader_election.cc:403] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:13.903033 19246 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:13.906087 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:13.908983 18522 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:13.910547 18605 raft_consensus.cc:3055] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:13.912201 21934 raft_consensus.cc:2749] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10.
I20260709 12:23:13.910969 18605 raft_consensus.cc:740] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:13.934055 18605 consensus_queue.cc:260] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:13.961939 18597 raft_consensus.cc:1275] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:13.963434 18605 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:14.008708 18525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2154) took 1251 ms. Trace:
I20260709 12:23:14.013598 18525 rpcz_store.cc:276] 0709 12:23:12.657471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.658437 (+   966us) service_pool.cc:224] Handling call
0709 12:23:12.658927 (+   490us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:12.659266 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:12.659290 (+    24us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:12.669517 (+ 10227us) log.cc:844] Serialized 52 byte log entry
0709 12:23:12.931272 (+261755us) spinlock_profiling.cc:243] Waited 5.73 ms on lock 0x7b48003603d8. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc81408aa1 00007efc813ffb37 00007efc813ff9ca 00007efc814f726f 00007efc814f6f37 00007efc8150b55c 00007efc8150b508 00007efc8150b488 00007efc8150b443 00007efc8150a6ec 00007efc80434a96
0709 12:23:13.095193 (+163921us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:13.249458 (+154265us) log.cc:844] Serialized 14 byte log entry
0709 12:23:13.275934 (+ 26476us) log.cc:844] Serialized 14 byte log entry
0709 12:23:13.546495 (+270561us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b180029f6e0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793d4e07 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793ef455 00007efc7c4d7060 00007efc7c4e9716 00007efc7c4fa287 00007efc7c4fa208
0709 12:23:13.841592 (+295097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.857312 (+ 15720us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:13.899820 (+ 42508us) raft_consensus.cc:1685] finished
0709 12:23:13.899834 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:13.909105 (+  9271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25785,"prepare.queue_time_us":179896,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":19196,"raft.queue_time_us":27716,"raft.run_cpu_time_us":3631,"raft.run_wall_time_us":271367,"spinlock_wait_cycles":106891392,"thread_start_us":384076,"threads_started":2,"wal-append.queue_time_us":359972}
W20260709 12:23:14.043844 19211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.044281 18605 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:14.054744 21682 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
W20260709 12:23:14.067520 21938 log.cc:927] Time spent T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:23:14.067634 21682 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:14.068912 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 66337.2us
I20260709 12:23:14.070036 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:14.070075 21682 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:14.056730 21783 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.089527 21682 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:14.091605 18494 leader_election.cc:400] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9.
I20260709 12:23:14.109306 18646 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:23:14.114645 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 78411.7us
I20260709 12:23:14.091681 21783 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:14.138859 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 64699.2us
I20260709 12:23:14.140657 21599 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:14.140810 21895 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:23:14.141360 21599 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:14.144343 21637 consensus_queue.cc:1059] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:14.144716 21817 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:14.145471 21764 raft_consensus.cc:3055] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:14.145825 21764 raft_consensus.cc:740] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:23:14.152936 18423 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47728 (request call id 209) took 19617 ms (client timeout 15000 ms). Trace:
I20260709 12:23:14.160751 18644 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:14.143600 21599 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:14.146950 21764 consensus_queue.cc:260] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:14.190079 18570 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:14.214819 21549 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:14.205489 21803 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:14.216599 21803 raft_consensus.cc:697] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:14.217909 21803 consensus_queue.cc:237] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:14.227115 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.230538 21199 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:14.223680 21940 log.cc:927] Time spent T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.144s	user 0.004s	sys 0.000s
I20260709 12:23:14.225232 21830 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.224143 21783 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:14.244199 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 144419us
W20260709 12:23:14.245988 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 103891us
I20260709 12:23:14.266345 19246 raft_consensus.cc:1240] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9. Ops: []
W20260709 12:23:14.276147 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 115471us
I20260709 12:23:14.277314 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:14.277864 21934 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:14.278571 21934 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:14.279722 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:14.237879 21828 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:14.153452 18423 rpcz_store.cc:269] 0709 12:22:54.534912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.535154 (+   242us) service_pool.cc:224] Handling call
0709 12:23:14.152647 (+19617493us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:10.190994 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:10.253567 (+ 62573us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:10.253617 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:23:10.253643 (+    26us) tablet.cc:662] Decoding operations
0709 12:23:10.254610 (+   967us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:10.254719 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:10.254759 (+    40us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:23:10.393999 (+139240us) tablet.cc:701] Row locks acquired
0709 12:23:10.397110 (+  3111us) write_op.cc:260] PREPARE: finished
0709 12:23:10.411593 (+ 14483us) write_op.cc:270] Start()
0709 12:23:10.418454 (+  6861us) write_op.cc:276] Timestamp: P: 1783599790404236 usec, L: 0
0709 12:23:10.420570 (+  2116us) op_driver.cc:348] REPLICATION: starting
0709 12:23:10.504939 (+ 84369us) log.cc:844] Serialized 2496 byte log entry
0709 12:23:11.211948 (+707009us) op_driver.cc:464] REPLICATION: finished
0709 12:23:11.437690 (+225742us) write_op.cc:301] APPLY: starting
0709 12:23:11.445513 (+  7823us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:11.498576 (+ 53063us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:11.518376 (+ 19800us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:11.538760 (+ 20384us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:11.538975 (+   215us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:23:11.539017 (+    42us) write_op.cc:312] APPLY: finished
0709 12:23:11.539267 (+   250us) log.cc:844] Serialized 53 byte log entry
0709 12:23:11.539454 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:11.539563 (+   109us) write_op.cc:454] Released schema lock
0709 12:23:11.539608 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:11.566315 (+ 26707us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:11.568733 (+  2418us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1046241,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":190740,"apply.run_cpu_time_us":5684,"apply.run_wall_time_us":133900,"num_ops":6,"prepare.queue_time_us":125008,"prepare.run_cpu_time_us":14959,"prepare.run_wall_time_us":416784,"raft.queue_time_us":106861,"raft.run_cpu_time_us":20195,"raft.run_wall_time_us":77832,"replication_time_us":791223,"thread_start_us":295622,"threads_started":4,"wal-append.queue_time_us":196954,"wal-append.run_cpu_time_us":17961,"wal-append.run_wall_time_us":1833329}]]}
I20260709 12:23:14.287230 21634 consensus_queue.cc:1059] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:14.289199 18528 raft_consensus.cc:1275] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:23:14.299125 21634 raft_consensus.cc:3055] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:14.300038 21828 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:14.267673 21830 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:14.299674 21634 raft_consensus.cc:740] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:23:14.324250 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 45985.3us
W20260709 12:23:14.324034 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 46425.7us
W20260709 12:23:14.325623 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 81783.1us
I20260709 12:23:14.332753 18570 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:23:14.342201 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.322046 21586 consensus_queue.cc:1059] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:23:14.344713 18521 raft_consensus.cc:1275] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:14.353487 21634 consensus_queue.cc:260] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:14.355106 21634 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:14.357105 21749 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:14.357697 21764 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:14.357941 21749 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:14.339685 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:14.361199 21749 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:14.365067 21934 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:14.384701 18644 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:14.386065 21604 raft_consensus.cc:3055] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:14.386656 21604 raft_consensus.cc:740] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:14.388029 21604 consensus_queue.cc:260] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:14.391008 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.380380 21783 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:14.405601 21952 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:14.408164 21830 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:14.414583 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 81308.3us
I20260709 12:23:14.402555 21734 consensus_queue.cc:1048] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:23:14.425726 21948 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.426303 21948 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:14.423780 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.432487 21948 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:14.434230 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 111492us
I20260709 12:23:14.454449 21604 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:14.456872 18671 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:14.456825 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:14.457870 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 115156us
I20260709 12:23:14.462932 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:14.466223 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:14.466248 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:14.467760 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:14.462056 18644 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:14.478322 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:14.480806 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:14.484315 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:14.485481 21895 raft_consensus.cc:2749] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:14.495131 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:14.495689 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:14.496645 18680 raft_consensus.cc:2410] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:23:14.490008 18671 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:23:14.500394 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:14.501297 18528 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:23:14.501870 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:14.506949 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:14.509064 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:14.509634 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:14.509773 18603 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
W20260709 12:23:14.510120 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 49668.6us
I20260709 12:23:14.509161 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:14.511157 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:14.510478 18674 raft_consensus.cc:2393] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 5: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:14.512352 18644 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:14.514178 18605 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:14.537552 21599 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:14.538077 21812 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.550315 21812 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:14.555896 18676 raft_consensus.cc:1275] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:14.503645 21952 consensus_queue.cc:1048] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:23:14.559342 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:14.562357 21950 consensus_queue.cc:1048] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:14.587559 21599 raft_consensus.cc:697] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:14.609072 18570 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:14.610162 21199 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:14.610589 18570 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:14.612473 21792 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:14.589425 21734 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:14.617170 18570 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:14.622579 18570 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:14.603840 21549 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.623582 21785 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:14.627283 18604 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:23:14.607767 21812 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:14.628284 21734 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:14.654866 21734 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:14.595600 21599 consensus_queue.cc:237] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:14.621524 21817 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:14.663511 21817 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:14.666268 21817 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:14.644030 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:14.647701 21549 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:14.667614 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 105695us
I20260709 12:23:14.668964 21549 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:14.648473 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:14.669893 18601 raft_consensus.cc:2393] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 8: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:14.632064 21783 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:14.678643 18672 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:23:14.679986 21786 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.681118 21786 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:14.688663 21786 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:14.690220 19210 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:14.693045 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:14.693425 21484 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:14.693785 18528 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 6.
I20260709 12:23:14.695073 19212 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:14.697429 21962 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:14.697947 21962 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.698357 21962 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:14.705998 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:14.707499 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:14.708076 18570 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:14.707489 21783 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:23:14.710311 21783 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:14.717444 19210 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:14.720034 21484 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:14.720623 21484 raft_consensus.cc:697] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 8 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:14.721616 21484 consensus_queue.cc:237] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:14.719827 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 180284us
I20260709 12:23:14.730731 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:14.734076 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:14.737620 18570 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:14.738943 18570 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:14.748667 21734 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:14.749161 21734 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:14.749614 21734 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:14.750257 21199 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:14.750810 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:14.755681 21962 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:14.759027 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:14.759781 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:14.767318 18605 raft_consensus.cc:1275] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:23:14.772900 18426 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60812 (request call id 107) took 6100 ms. Trace:
I20260709 12:23:14.773077 21734 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:14.774077 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:14.775291 21734 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:14.789544 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:14.792192 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:14.792685 21962 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:14.792927 18529 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:14.794422 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:14.773557 18426 rpcz_store.cc:276] 0709 12:23:08.672345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:08.688973 (+ 16628us) service_pool.cc:224] Handling call
0709 12:23:14.772818 (+6083845us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:14.115413 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:14.153632 (+ 38219us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:14.153695 (+    63us) write_op.cc:435] Acquired schema lock
0709 12:23:14.153726 (+    31us) tablet.cc:662] Decoding operations
0709 12:23:14.154754 (+  1028us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:14.154833 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:14.154872 (+    39us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:23:14.194530 (+ 39658us) tablet.cc:701] Row locks acquired
0709 12:23:14.194579 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:23:14.194768 (+   189us) write_op.cc:270] Start()
0709 12:23:14.194920 (+   152us) write_op.cc:276] Timestamp: P: 1783599794194685 usec, L: 0
0709 12:23:14.194939 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:23:14.241246 (+ 46307us) log.cc:844] Serialized 3242 byte log entry
0709 12:23:14.717104 (+475858us) op_driver.cc:464] REPLICATION: finished
0709 12:23:14.726005 (+  8901us) write_op.cc:301] APPLY: starting
0709 12:23:14.726110 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:14.726316 (+   206us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:14.726449 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:14.754569 (+ 28120us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:14.754895 (+   326us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:23:14.754946 (+    51us) write_op.cc:312] APPLY: finished
0709 12:23:14.758105 (+  3159us) log.cc:844] Serialized 65 byte log entry
0709 12:23:14.759970 (+  1865us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:14.760109 (+   139us) write_op.cc:454] Released schema lock
0709 12:23:14.760179 (+    70us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":1845429,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":6177,"apply.run_cpu_time_us":3364,"apply.run_wall_time_us":38910,"num_ops":8,"prepare.queue_time_us":176812,"prepare.run_cpu_time_us":8737,"prepare.run_wall_time_us":217039,"raft.queue_time_us":168544,"replication_time_us":521997,"spinlock_wait_cycles":11261824,"thread_start_us":366437,"threads_started":4,"wal-append.queue_time_us":147801}]]}
W20260709 12:23:14.812521 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 52868.8us
I20260709 12:23:14.825111 21734 consensus_queue.cc:1048] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:14.836187 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:14.832032 21783 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:14.845515 18494 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:14.870061 21948 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:14.870507 21948 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:14.870874 21948 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:14.881964 18529 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
I20260709 12:23:14.882688 18494 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:14.884368 21599 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:14.886185 21764 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:14.886111 21599 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:14.886729 21764 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:14.887293 21764 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:14.888561 21599 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:14.886224 19212 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:14.890141 21786 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:14.890667 21786 raft_consensus.cc:697] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:14.891557 21786 consensus_queue.cc:237] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:14.894572 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:14.895671 18604 raft_consensus.cc:1275] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:14.896371 18494 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:14.884240 21948 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:14.898583 18644 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:14.903918 18644 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:14.907256 21817 raft_consensus.cc:2749] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:14.908557 18427 catalog_manager.cc:5697] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 5 to 8, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 8 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:14.910019 21817 consensus_queue.cc:1048] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:14.910274 18427 catalog_manager.cc:5697] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 3 to 6, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 6 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:14.912256 18644 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:14.911830 21599 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:14.913045 21953 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:14.923353 21953 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:14.923840 21953 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:14.923470 18570 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:14.927794 21959 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:14.913712 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:14.914611 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:14.916209 21855 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:14.930547 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:14.930677 21855 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:14.917791 21948 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:14.932513 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:14.938916 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:14.936560 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:14.941728 18603 raft_consensus.cc:1240] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:14.945070 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:14.945355 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:14.953059 18644 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:14.956948 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:14.964998 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:14.968835 18528 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:14.941604 21599 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:14.941361 21855 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:14.982514 18570 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:14.982802 21764 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:14.985841 18570 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:14.993944 18522 raft_consensus.cc:1240] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:14.994881 18494 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:14.987026 21803 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:14.992871 21812 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:15.016882 21783 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:15.032228 21586 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:15.034739 21586 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:15.035884 21821 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:15.006178 21952 consensus_queue.cc:1059] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:23:15.057667 18427 catalog_manager.cc:5697] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 6 to 7, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 7 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:15.060679 21764 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:15.019904 21828 consensus_queue.cc:1059] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:23:15.072463 21953 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:15.075316 21953 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:15.060545 18427 catalog_manager.cc:5697] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:15.082046 18427 catalog_manager.cc:5697] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:15.087144 21855 raft_consensus.cc:3055] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:15.090495 21855 raft_consensus.cc:740] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:15.091120 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:15.091814 21586 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:15.091459 21855 consensus_queue.cc:260] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:15.092784 21855 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:15.094286 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 141304us
W20260709 12:23:15.100179 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 77191.7us
I20260709 12:23:15.116250 18522 raft_consensus.cc:1275] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:15.117111 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:15.117693 18602 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:15.122426 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:15.124176 18427 catalog_manager.cc:5697] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 5 to 7, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 7 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:15.132472 18427 catalog_manager.cc:5697] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 5 to 7, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 7 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:15.141916 18427 catalog_manager.cc:5697] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:15.143486 18644 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:15.144400 21549 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:15.144855 21599 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:15.144968 18644 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:15.145591 21599 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:15.150671 21962 raft_consensus.cc:3055] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:15.151151 21962 raft_consensus.cc:740] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
W20260709 12:23:15.138444 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 64935.5us
W20260709 12:23:15.138402 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 66556.2us
I20260709 12:23:15.156404 18522 raft_consensus.cc:1275] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:23:15.145823 21549 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:15.162379 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:15.168604 18602 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:15.171500 18494 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:15.172936 18597 raft_consensus.cc:1240] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:23:15.173193 21549 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.177556 21549 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:15.133991 21895 consensus_queue.cc:1059] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:23:15.162562 21828 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:23:15.182123 21962 consensus_queue.cc:260] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:15.183904 21895 raft_consensus.cc:3055] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:15.184331 21895 raft_consensus.cc:740] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:15.184454 21962 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:15.185196 21895 consensus_queue.cc:260] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:15.186435 21895 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:15.188022 21982 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:15.188611 21982 raft_consensus.cc:697] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:15.189870 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:15.190506 18525 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:23:15.191838 18646 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:15.192648 21817 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:15.193064 21817 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.193431 21817 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:15.193440 18528 raft_consensus.cc:2955] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 3 to 6, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:15.189551 21982 consensus_queue.cc:237] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:15.199131 21981 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:15.203845 21981 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:15.206137 21981 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:15.209204 18603 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:23:15.210228 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:15.214525 18494 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:15.234843 19243 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:15.236913 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:15.244421 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:15.238430 21549 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:15.246480 18644 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:15.248265 21749 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:15.248344 18644 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:15.249996 21981 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:15.251636 21952 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:15.253185 21817 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:15.257651 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:15.264173 21982 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:15.265017 21982 raft_consensus.cc:697] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:15.266701 18570 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:15.266031 21982 consensus_queue.cc:237] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:15.278496 21734 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:15.289889 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:15.326313 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:15.327155 18680 raft_consensus.cc:2368] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6.
I20260709 12:23:15.368310 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:15.369001 18603 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:23:15.374354 18675 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
W20260709 12:23:15.384575 21989 log.cc:927] Time spent T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:23:15.402074 18494 leader_election.cc:400] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6.
I20260709 12:23:15.403942 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:15.404575 18597 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:15.397819 21830 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.419799 21830 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:15.421914 21830 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:15.406481 21604 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:15.423064 21604 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:15.426026 21604 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:15.427316 18521 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:23:15.429241 21983 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:15.399232 21817 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:15.445780 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:15.447329 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:15.448601 18521 raft_consensus.cc:2368] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7.
I20260709 12:23:15.454862 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:15.461112 18597 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:23:15.463816 18524 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:23:15.465886 18524 pending_rounds.cc:85] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 8
I20260709 12:23:15.465284 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:15.467247 18572 leader_election.cc:400] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7.
I20260709 12:23:15.467707 18572 leader_election.cc:403] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:15.466131 18524 pending_rounds.cc:107] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:23:15.472415 18524 raft_consensus.cc:2889] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:15.466782 18677 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
I20260709 12:23:15.477001 21785 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:23:15.485090 21992 log.cc:927] Time spent T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:23:15.488169 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 153213us
I20260709 12:23:15.493233 18599 raft_consensus.cc:1275] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:23:15.495541 18644 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:15.503206 21803 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:15.505026 21803 raft_consensus.cc:697] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:15.513824 21984 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:15.506299 21803 consensus_queue.cc:237] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:15.526517 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 56671.6us
I20260709 12:23:15.527681 18680 raft_consensus.cc:1275] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:23:15.533006 18494 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:15.541712 21786 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:15.548870 21599 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:15.550525 21953 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:15.557667 21953 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.558058 21953 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:15.560441 18599 raft_consensus.cc:2955] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 3 to 6, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:15.578140 18677 raft_consensus.cc:2955] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 3 to 6, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:15.596712 18604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:15.598609 18604 raft_consensus.cc:606] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:15.599107 18604 raft_consensus.cc:614] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:15.580047 21785 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7.
I20260709 12:23:15.603245 18602 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:23:15.609175 18602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:15.609907 18602 raft_consensus.cc:606] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:15.610297 18602 raft_consensus.cc:614] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:15.634729 18604 raft_consensus.cc:1275] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:23:15.635535 18597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:15.636127 18597 raft_consensus.cc:606] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:15.636431 18597 raft_consensus.cc:614] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:15.641638 21982 consensus_queue.cc:1048] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:23:15.644870 21484 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:15.672784 18597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce446d878cef426395147773f6c9a25e"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:15.673590 18597 raft_consensus.cc:606] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:15.663254 21953 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:15.729017 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 54401.3us
I20260709 12:23:15.739662 18677 raft_consensus.cc:1275] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:23:15.743968 21821 consensus_queue.cc:1048] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:15.746500 21953 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:15.747879 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:15.748526 18675 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:15.750110 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:15.774209 21199 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:15.775815 18597 raft_consensus.cc:1240] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:15.778659 18603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:15.779354 18603 raft_consensus.cc:606] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:15.779775 18603 raft_consensus.cc:614] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:15.784783 18675 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:23:15.789104 18494 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:15.774748 21199 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:15.794724 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:15.795070 21199 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:15.797953 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:15.798838 18671 raft_consensus.cc:2368] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11.
I20260709 12:23:15.798739 21960 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:15.799863 21960 raft_consensus.cc:697] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:15.801724 18570 leader_election.cc:400] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11.
I20260709 12:23:15.802058 18570 leader_election.cc:403] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:15.802780 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:15.812533 21199 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:23:15.828460 21199 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11.
I20260709 12:23:15.848382 18680 raft_consensus.cc:1240] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:15.827234 21830 consensus_queue.cc:1059] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:23:15.850229 21982 raft_consensus.cc:3055] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:15.850643 21982 raft_consensus.cc:740] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:15.800727 21960 consensus_queue.cc:237] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:15.851563 21982 consensus_queue.cc:260] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:15.858969 21982 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:15.909721 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:15.910863 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:15.912002 18426 catalog_manager.cc:5697] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 3 to 6, term changed from 6 to 8, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.914201 18426 catalog_manager.cc:5697] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 6 to 7, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 7 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.916829 18426 catalog_manager.cc:5697] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 2 to 3, leader changed from 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 3 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:15.920286 18426 catalog_manager.cc:5697] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:15.924096 21604 raft_consensus.cc:993] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:23:15.926581 18426 catalog_manager.cc:5697] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 5 to 7, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 7 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:15.927464 21604 raft_consensus.cc:1081] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Signalling peer a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:23:15.928301 18426 catalog_manager.cc:5697] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.930315 18673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce446d878cef426395147773f6c9a25e"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:40802
I20260709 12:23:15.931079 18673 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:15.931496 18673 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:15.936695 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 47742.4us
I20260709 12:23:15.959988 18673 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:15.963140 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:15.963795 18529 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:15.972247 18529 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:23:15.974303 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:15.975100 18604 raft_consensus.cc:3055] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:15.975409 18604 raft_consensus.cc:740] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:15.976359 18604 consensus_queue.cc:260] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:15.977675 18604 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:15.994314 18673 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:15.996855 18646 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:15.999879 18426 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60812 (request call id 108) took 1076 ms. Trace:
I20260709 12:23:16.005846 21803 raft_consensus.cc:2804] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:16.007939 21803 raft_consensus.cc:697] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:16.009219 21803 consensus_queue.cc:237] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:16.013012 18604 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:23:16.006990 18426 rpcz_store.cc:276] 0709 12:23:14.923816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.923967 (+   151us) service_pool.cc:224] Handling call
0709 12:23:15.963896 (+1039929us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:15.963927 (+    31us) write_op.cc:454] Released schema lock
0709 12:23:15.999783 (+ 35856us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:15.950799 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:15.951407 (+   608us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:15.951444 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:23:15.951470 (+    26us) tablet.cc:662] Decoding operations
0709 12:23:15.952321 (+   851us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:15.952387 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:15.952426 (+    39us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:23:15.952982 (+   556us) tablet.cc:701] Row locks acquired
0709 12:23:15.953002 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:23:15.953175 (+   173us) write_op.cc:270] Start()
0709 12:23:15.953299 (+   124us) write_op.cc:276] Timestamp: P: 1783599795953127 usec, L: 0
0709 12:23:15.953325 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:23:15.954008 (+   683us) log.cc:844] Serialized 2534 byte log entry
0709 12:23:15.956031 (+  2023us) op_driver.cc:464] REPLICATION: finished
0709 12:23:15.956508 (+   477us) write_op.cc:301] APPLY: starting
0709 12:23:15.956583 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:15.956747 (+   164us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:15.956854 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:15.957635 (+   781us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:15.957820 (+   185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:23:15.957864 (+    44us) write_op.cc:312] APPLY: finished
0709 12:23:15.958096 (+   232us) log.cc:844] Serialized 53 byte log entry
0709 12:23:15.958255 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:15.958370 (+   115us) write_op.cc:454] Released schema lock
0709 12:23:15.958423 (+    53us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":117114,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":249,"apply.run_cpu_time_us":2198,"apply.run_wall_time_us":2198,"num_ops":6,"prepare.queue_time_us":16709,"prepare.run_cpu_time_us":3538,"prepare.run_wall_time_us":4136,"replication_time_us":2573,"spinlock_wait_cycles":105344}]]}
W20260709 12:23:16.017570 18427 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47708 (request call id 172) took 12725 ms (client timeout 15000 ms). Trace:
I20260709 12:23:16.033422 18424 catalog_manager.cc:5697] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:16.040234 18424 catalog_manager.cc:5697] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 6 to 8, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 8 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:16.044657 18424 catalog_manager.cc:5697] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 7 to 8, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 8 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:16.020743 18427 rpcz_store.cc:269] 0709 12:23:03.292699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.295969 (+  3270us) service_pool.cc:224] Handling call
0709 12:23:16.017487 (+12721518us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:15.416407 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:15.416977 (+   570us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:15.417011 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:23:15.417029 (+    18us) tablet.cc:662] Decoding operations
0709 12:23:15.417890 (+   861us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:15.417949 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:15.417975 (+    26us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:23:15.418595 (+   620us) tablet.cc:701] Row locks acquired
0709 12:23:15.418609 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:23:15.418759 (+   150us) write_op.cc:270] Start()
0709 12:23:15.418863 (+   104us) write_op.cc:276] Timestamp: P: 1783599795418712 usec, L: 0
0709 12:23:15.418879 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:23:15.474201 (+ 55322us) log.cc:844] Serialized 3282 byte log entry
0709 12:23:15.598934 (+124733us) op_driver.cc:464] REPLICATION: finished
0709 12:23:15.685731 (+ 86797us) write_op.cc:301] APPLY: starting
0709 12:23:15.685826 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:15.686068 (+   242us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:15.686226 (+   158us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:15.687284 (+  1058us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:15.687507 (+   223us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:23:15.687553 (+    46us) write_op.cc:312] APPLY: finished
0709 12:23:15.687918 (+   365us) log.cc:844] Serialized 65 byte log entry
0709 12:23:15.688725 (+   807us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:15.688857 (+   132us) write_op.cc:454] Released schema lock
0709 12:23:15.688917 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:15.689330 (+   413us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:15.689366 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":29486,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":86530,"apply.run_cpu_time_us":2925,"apply.run_wall_time_us":3550,"num_ops":8,"prepare.queue_time_us":221489,"prepare.run_cpu_time_us":3588,"prepare.run_wall_time_us":58134,"replication_time_us":179875,"thread_start_us":227238,"threads_started":2}]]}
I20260709 12:23:16.081295 18424 catalog_manager.cc:5697] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 4 to 12, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 12 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:16.127328 18424 catalog_manager.cc:5697] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 5 to 8, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 8 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:16.130558 18424 catalog_manager.cc:5697] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:16.244526 18424 catalog_manager.cc:5697] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 4 to 5, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 5 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:16.246627 21682 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:16.247227 21682 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:16.246948 18424 catalog_manager.cc:5697] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 5 to 7, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 7 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:16.248867 18424 catalog_manager.cc:5697] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 3 to 10, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 10 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:16.249644 21682 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:16.250263 18424 catalog_manager.cc:5697] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 4 to 6, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 6 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
W20260709 12:23:16.254033 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 112908us
I20260709 12:23:16.266427 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:16.269184 18602 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:23:16.282413 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:16.344785 19243 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:23:16.321483 18528 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:23:16.345660 18528 pending_rounds.cc:85] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 4
I20260709 12:23:16.345907 18528 pending_rounds.cc:107] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:23:16.346127 18528 raft_consensus.cc:2889] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:16.344316 18604 raft_consensus.cc:2393] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 6: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:16.356642 18424 catalog_manager.cc:5697] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 7 to 8, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 8 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:16.355293 18644 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:16.359503 18424 catalog_manager.cc:5697] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 3 to 5, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 5 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:16.362298 21599 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:16.366885 21599 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:16.367388 21599 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:16.373929 18424 catalog_manager.cc:5697] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:16.358100 21803 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:23:16.380793 18424 catalog_manager.cc:5697] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 5 to 12, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 12 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:16.378993 21682 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:23:16.387682 18604 raft_consensus.cc:1275] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:23:16.391812 18424 catalog_manager.cc:5697] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 6 to 9, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 9 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:16.389639 21960 consensus_queue.cc:1048] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:23:16.394847 18424 catalog_manager.cc:5697] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 1 to 6, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 6 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:16.415081 18603 raft_consensus.cc:1275] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:16.417639 21817 consensus_queue.cc:1048] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:16.440565 21599 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:16.443943 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:16.444645 18597 raft_consensus.cc:2393] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 6: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:16.447410 21599 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:16.448504 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:16.452802 18671 raft_consensus.cc:1275] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:23:16.454401 21982 consensus_queue.cc:1048] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:16.476714 19243 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:23:16.478477 18644 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:16.483645 21682 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:16.489042 21682 raft_consensus.cc:697] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:16.492107 18525 raft_consensus.cc:1275] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:16.494050 21817 consensus_queue.cc:1048] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:23:16.578589 22010 log.cc:927] Time spent T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:23:16.490391 21682 consensus_queue.cc:237] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:16.609018 22015 log.cc:927] Time spent T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 12:23:16.624166 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 97769.2us
I20260709 12:23:16.658212 21785 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:16.658843 21785 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:16.661137 21785 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:16.667601 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:16.668587 18673 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
W20260709 12:23:16.675452 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 96954us
I20260709 12:23:16.678078 18570 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:16.683723 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:16.684569 18529 raft_consensus.cc:2393] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 11: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:16.687534 21959 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:16.689239 21959 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:16.689698 21959 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:16.702859 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 74496.2us
I20260709 12:23:16.701977 21959 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:16.776096 21785 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:16.805557 22029 log.cc:927] Time spent T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:23:16.885131 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 144065us
W20260709 12:23:16.930507 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 198476us
I20260709 12:23:16.857522 21785 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:16.944582 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 261510us
I20260709 12:23:16.965132 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:16.965963 18524 raft_consensus.cc:2393] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 11: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
W20260709 12:23:17.030473 22033 log.cc:927] Time spent T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:23:17.015374 21959 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:17.035554 21785 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:17.071426 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:23:17.108188 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 144606us
I20260709 12:23:17.114202 22020 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.114926 22020 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:17.115574 18673 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
I20260709 12:23:17.117625 22020 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:17.122067 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:17.122730 18600 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:23:17.124133 18494 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:17.125129 22020 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:17.125592 22020 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.125959 22020 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:17.131410 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 181702us
I20260709 12:23:17.135839 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:17.135891 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:17.188242 19243 raft_consensus.cc:1275] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:23:17.222510 18600 raft_consensus.cc:1275] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:23:17.225569 18426 catalog_manager.cc:5697] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:17.234468 18426 catalog_manager.cc:5697] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 7 to 9, leader changed from 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 9 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:17.235648 18570 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:17.255923 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:17.256950 18677 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:23:17.238907 22030 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:17.219492 22020 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:17.298408 18600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:17.302734 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:17.303404 19243 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:23:17.305799 18570 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:17.299266 18600 raft_consensus.cc:606] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:17.264907 22046 consensus_queue.cc:1048] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:23:17.315070 18602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6874b99e69744371a73c71762816db62"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:17.315732 18602 raft_consensus.cc:606] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:17.315395 21599 consensus_queue.cc:1048] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:17.323611 22047 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:17.324156 22047 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.324488 22047 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:17.336540 21959 raft_consensus.cc:993] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:23:17.337131 21959 raft_consensus.cc:1081] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
W20260709 12:23:17.340139 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 44958.1us
I20260709 12:23:17.341020 18524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:23:17.341524 18524 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:17.341840 18524 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:17.318544 22030 raft_consensus.cc:697] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:17.387933 22020 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:17.400039 18600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2586476710143e281df940fcb3d3238"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:17.400835 18600 raft_consensus.cc:606] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:17.403477 18600 raft_consensus.cc:614] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:17.416669 22047 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:17.418058 18604 raft_consensus.cc:1240] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:23:17.418807 22030 consensus_queue.cc:237] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:17.427484 18426 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60812 (request call id 109) took 1398 ms. Trace:
I20260709 12:23:17.427923 18426 rpcz_store.cc:276] 0709 12:23:16.029077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:16.034117 (+  5040us) service_pool.cc:224] Handling call
0709 12:23:17.427417 (+1393300us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:17.329539 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:17.332065 (+  2526us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:17.332114 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:23:17.335354 (+  3240us) tablet.cc:662] Decoding operations
0709 12:23:17.336001 (+   647us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:17.336109 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:17.336154 (+    45us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:23:17.336592 (+   438us) tablet.cc:701] Row locks acquired
0709 12:23:17.336618 (+    26us) write_op.cc:260] PREPARE: finished
0709 12:23:17.336807 (+   189us) write_op.cc:270] Start()
0709 12:23:17.336930 (+   123us) write_op.cc:276] Timestamp: P: 1783599797336759 usec, L: 0
0709 12:23:17.336952 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:23:17.337661 (+   709us) log.cc:844] Serialized 925 byte log entry
0709 12:23:17.352800 (+ 15139us) op_driver.cc:464] REPLICATION: finished
0709 12:23:17.379520 (+ 26720us) write_op.cc:301] APPLY: starting
0709 12:23:17.379609 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:17.379733 (+   124us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:17.379836 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:17.380109 (+   273us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:17.380263 (+   154us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:23:17.380308 (+    45us) write_op.cc:312] APPLY: finished
0709 12:23:17.380621 (+   313us) log.cc:844] Serialized 29 byte log entry
0709 12:23:17.380939 (+   318us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:17.381173 (+   234us) write_op.cc:454] Released schema lock
0709 12:23:17.381218 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:17.381587 (+   369us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:17.381615 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":240,"mutex_wait_us":83369,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":21511,"apply.run_cpu_time_us":2056,"apply.run_wall_time_us":2056,"num_ops":2,"prepare.queue_time_us":89855,"prepare.run_cpu_time_us":3546,"prepare.run_wall_time_us":8458,"replication_time_us":15693,"thread_start_us":27065,"threads_started":1}]]}
I20260709 12:23:17.432900 18604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:17.433748 18604 raft_consensus.cc:606] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:17.434203 18604 raft_consensus.cc:614] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:23:17.435667 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 93759.5us
I20260709 12:23:17.463688 18524 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:17.469905 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:17.470518 22046 consensus_queue.cc:1059] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:17.503554 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:17.504336 18677 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:17.501278 18524 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:17.523411 18677 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 12.
I20260709 12:23:17.508006 22031 raft_consensus.cc:3055] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:17.535022 18604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:17.535812 18604 raft_consensus.cc:606] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:17.536268 18604 raft_consensus.cc:614] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:17.533438 22031 raft_consensus.cc:740] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:17.558220 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:17.558220 22031 consensus_queue.cc:260] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:17.559554 22031 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:17.578698 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:17.602552 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:17.605579 18423 catalog_manager.cc:5697] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 6 to 7, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 7 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:17.619566 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 82480.9us
I20260709 12:23:17.618113 22047 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:17.626034 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:23:17.621511 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 79398.4us
I20260709 12:23:17.626914 18677 raft_consensus.cc:2410] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:23:17.633097 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:17.645444 18570 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:17.646773 21959 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:17.654371 18423 catalog_manager.cc:5697] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 5 to 8, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 8 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:17.669230 18494 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:17.667248 18423 catalog_manager.cc:5697] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 3 to 9, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 9 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:17.673264 18424 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47714 (request call id 193) took 6988 ms. Trace:
I20260709 12:23:17.673658 18424 rpcz_store.cc:276] 0709 12:23:10.689368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.702971 (+ 13603us) service_pool.cc:224] Handling call
0709 12:23:17.673207 (+6970236us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:16.591265 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:16.611642 (+ 20377us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:16.611684 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:23:16.611700 (+    16us) tablet.cc:662] Decoding operations
0709 12:23:16.613123 (+  1423us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:16.613184 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:16.613214 (+    30us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:23:16.657271 (+ 44057us) tablet.cc:701] Row locks acquired
0709 12:23:16.657292 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:23:16.657451 (+   159us) write_op.cc:270] Start()
0709 12:23:16.657772 (+   321us) write_op.cc:276] Timestamp: P: 1783599796657392 usec, L: 0
0709 12:23:16.657810 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:23:16.658809 (+   999us) log.cc:844] Serialized 6406 byte log entry
0709 12:23:16.974812 (+316003us) op_driver.cc:464] REPLICATION: finished
0709 12:23:17.141746 (+166934us) write_op.cc:301] APPLY: starting
0709 12:23:17.141837 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:17.142133 (+   296us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:17.142265 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:17.173945 (+ 31680us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:17.174219 (+   274us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:23:17.174270 (+    51us) write_op.cc:312] APPLY: finished
0709 12:23:17.174609 (+   339us) log.cc:844] Serialized 113 byte log entry
0709 12:23:17.174780 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:17.174945 (+   165us) write_op.cc:454] Released schema lock
0709 12:23:17.174998 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:17.175357 (+   359us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:17.175396 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26221,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":162814,"apply.run_cpu_time_us":6866,"apply.run_wall_time_us":33595,"num_ops":16,"prepare.queue_time_us":103777,"prepare.run_cpu_time_us":5929,"prepare.run_wall_time_us":73902,"replication_time_us":286068,"thread_start_us":144238,"threads_started":2}]]}
I20260709 12:23:17.672469 18423 catalog_manager.cc:5697] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 5 to 9, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 9 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:17.685882 21959 raft_consensus.cc:993] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:23:17.686426 21959 raft_consensus.cc:1081] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:23:17.688102 18524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6874b99e69744371a73c71762816db62"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:23:17.688658 18524 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:17.689019 18524 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:17.674085 22022 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:17.690348 22022 raft_consensus.cc:697] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:17.694798 22022 consensus_queue.cc:237] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:17.680864 18423 catalog_manager.cc:5697] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 6 to 7, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 7 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:17.700457 18524 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:17.702407 18524 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:17.703820 18423 catalog_manager.cc:5697] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 3 to 6, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 6 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:17.707196 18423 catalog_manager.cc:5697] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:17.709218 18423 catalog_manager.cc:5697] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 7 to 10, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 10 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:17.714385 18423 catalog_manager.cc:5697] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:17.727993 19239 consensus_queue.cc:237] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:17.735441 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 66305.1us
I20260709 12:23:17.741254 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:17.741932 18677 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:17.751493 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:17.752146 18671 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:17.759833 18677 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:17.766841 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:17.766917 18671 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:17.767534 18603 raft_consensus.cc:3055] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:17.767876 18603 raft_consensus.cc:740] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:17.768525 18603 consensus_queue.cc:260] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:17.769241 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:17.769796 18603 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:17.769838 18604 raft_consensus.cc:3055] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:17.778262 18604 raft_consensus.cc:740] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:17.778957 18604 consensus_queue.cc:260] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:17.802070 18604 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:17.808914 18521 raft_consensus.cc:1240] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:17.822502 18426 catalog_manager.cc:5697] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 5 to 6, leader changed from 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 6 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:17.828315 18680 raft_consensus.cc:1275] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:23:17.832882 22051 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:17.840500 18600 raft_consensus.cc:1275] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:23:17.845707 21659 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:17.850504 18604 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:17.850653 18603 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:17.903012 18427 catalog_manager.cc:5697] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 7 to 8, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 8 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:17.916401 18427 catalog_manager.cc:5697] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:17.918313 18427 catalog_manager.cc:5697] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 7 to 11, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 11 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:17.932206 18524 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:17.933736 18423 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47728 (request call id 210) took 3343 ms. Trace:
I20260709 12:23:17.934065 18423 rpcz_store.cc:276] 0709 12:23:14.590505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.592917 (+  2412us) service_pool.cc:224] Handling call
0709 12:23:14.713366 (+120449us) spinlock_profiling.cc:243] Waited 65.8 ms on lock 0x7b54002175d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c449090 00007efc7c4e7f3a 00007efc8229de9c 00007efc8239c04e 00007efc8085d2a4 00007efc8085d232 00007efc8085d161 00007efc8085d0dc 00007efc8085c392 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:17.933635 (+3220269us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:17.738058 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:17.738580 (+   522us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:17.738617 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:23:17.738634 (+    17us) tablet.cc:662] Decoding operations
0709 12:23:17.739549 (+   915us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:17.739612 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:17.739640 (+    28us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:23:17.740428 (+   788us) tablet.cc:701] Row locks acquired
0709 12:23:17.740443 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:23:17.740581 (+   138us) write_op.cc:270] Start()
0709 12:23:17.740710 (+   129us) write_op.cc:276] Timestamp: P: 1783599797740536 usec, L: 0
0709 12:23:17.740728 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:23:17.741346 (+   618us) log.cc:844] Serialized 3669 byte log entry
0709 12:23:17.787623 (+ 46277us) op_driver.cc:464] REPLICATION: finished
0709 12:23:17.788114 (+   491us) write_op.cc:301] APPLY: starting
0709 12:23:17.788191 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:17.788426 (+   235us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:17.788520 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:17.789388 (+   868us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:17.789602 (+   214us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:23:17.789647 (+    45us) write_op.cc:312] APPLY: finished
0709 12:23:17.789927 (+   280us) log.cc:844] Serialized 71 byte log entry
0709 12:23:17.790109 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:17.790249 (+   140us) write_op.cc:454] Released schema lock
0709 12:23:17.790318 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:17.790625 (+   307us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:17.790653 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":87551,"reported_tablets":52,"spinlock_wait_cycles":151330560,"child_traces":[["op",{"apply.queue_time_us":277,"apply.run_cpu_time_us":2487,"apply.run_wall_time_us":2487,"num_ops":9,"prepare.queue_time_us":130,"prepare.run_cpu_time_us":3630,"prepare.run_wall_time_us":39905,"replication_time_us":46741}]]}
I20260709 12:23:17.938025 22047 consensus_queue.cc:1059] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:17.928566 18427 catalog_manager.cc:5697] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:17.950013 18427 catalog_manager.cc:5697] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 7 to 11, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 11 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.949059 18494 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:17.955291 22052 raft_consensus.cc:2804] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:17.955986 22052 raft_consensus.cc:697] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:17.957046 22052 consensus_queue.cc:237] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:17.960625 22051 raft_consensus.cc:2955] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 6 to 8, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:17.953896 18494 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:17.945668 22047 consensus_queue.cc:1243] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer 2f9872512f1646bc835906bd0e98c6a7 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:23:17.964490 18677 raft_consensus.cc:2955] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 6 to 8, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:17.973887 22030 raft_consensus.cc:3055] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:17.974522 22030 raft_consensus.cc:740] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:17.974000 18600 raft_consensus.cc:2955] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 6 to 8, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:17.979941 18676 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:17.981356 22072 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:17.981964 22072 raft_consensus.cc:697] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:17.982842 22072 consensus_queue.cc:237] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:17.992008 22030 consensus_queue.cc:260] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:17.993587 22030 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:18.070549 18427 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47708 (request call id 173) took 1756 ms. Trace:
I20260709 12:23:18.073909 18423 catalog_manager.cc:5697] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 2 to 6, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 6 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:18.076831 18423 catalog_manager.cc:5697] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 4 to 5, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 5 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:18.082612 18423 catalog_manager.cc:5697] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 10 to 11, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 11 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.071053 18427 rpcz_store.cc:276] 0709 12:23:16.314320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:16.314490 (+   170us) service_pool.cc:224] Handling call
0709 12:23:18.070470 (+1755980us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:17.983135 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:17.983687 (+   552us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:17.983717 (+    30us) write_op.cc:435] Acquired schema lock
0709 12:23:17.983733 (+    16us) tablet.cc:662] Decoding operations
0709 12:23:17.984421 (+   688us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:17.984481 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:17.984510 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:23:17.985044 (+   534us) tablet.cc:701] Row locks acquired
0709 12:23:17.985067 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:23:17.985189 (+   122us) write_op.cc:270] Start()
0709 12:23:17.985294 (+   105us) write_op.cc:276] Timestamp: P: 1783599797985149 usec, L: 0
0709 12:23:17.985324 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:23:17.999241 (+ 13917us) log.cc:844] Serialized 2109 byte log entry
0709 12:23:18.001318 (+  2077us) op_driver.cc:464] REPLICATION: finished
0709 12:23:18.001607 (+   289us) write_op.cc:301] APPLY: starting
0709 12:23:18.001686 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:18.001833 (+   147us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:18.001963 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:18.002470 (+   507us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:18.002642 (+   172us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:23:18.002683 (+    41us) write_op.cc:312] APPLY: finished
0709 12:23:18.002897 (+   214us) log.cc:844] Serialized 47 byte log entry
0709 12:23:18.003069 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:18.003166 (+    97us) write_op.cc:454] Released schema lock
0709 12:23:18.003223 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:18.003676 (+   453us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b54002175d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dae28 00007efc7ff15581 00007efc7ff14d58 00007efc7ff199f1 00007efc7ff199a9 00007efc7ff19939 00007efc7ff19901 00007efc7ff18b2d 0000000000388634 0000000000388479
0709 12:23:18.003891 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:18.003921 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11100,"reported_tablets":41,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":106,"apply.run_cpu_time_us":1883,"apply.run_wall_time_us":1939,"mutex_wait_us":70,"num_ops":5,"prepare.queue_time_us":278,"prepare.run_cpu_time_us":5984,"prepare.run_wall_time_us":20752,"replication_time_us":15868,"spinlock_wait_cycles":29180288}]]}
I20260709 12:23:18.097869 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6ddef1433d2344c9a83050fe07ac225b with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:23:17.993777 22063 consensus_queue.cc:1175] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" responder_term: 12 status { last_received { term: 10 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:23:18.144716 22077 log.cc:927] Time spent T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 12:23:18.202195 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 81036.7us
I20260709 12:23:18.187079 18427 catalog_manager.cc:5697] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index 6 to 8, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New cstate: current_term: 8 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:18.243400 18671 raft_consensus.cc:1275] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:23:18.254225 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 52598.6us
I20260709 12:23:18.253015 22068 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:23:18.306716 18603 raft_consensus.cc:1275] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:23:18.307216 18603 pending_rounds.cc:85] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9: Aborting all ops after (but not including) 6
I20260709 12:23:18.307518 18603 pending_rounds.cc:107] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:23:18.307852 18603 raft_consensus.cc:2889] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:18.309989 22020 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:18.332245 18512 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ddef1433d2344c9a83050fe07ac225b with delete_type TABLET_DATA_TOMBSTONED (TS 2f9872512f1646bc835906bd0e98c6a7 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:57364
I20260709 12:23:18.337473 18426 catalog_manager.cc:5697] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 7 to 8, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 8 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.339555 18426 catalog_manager.cc:5697] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 6 to 7, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 7 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.341928 18426 catalog_manager.cc:5697] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 11 to 12, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 12 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.389909 18602 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:18.393638 22020 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:18.459157 18680 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:18.468751 22087 tablet_replica.cc:333] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:23:18.470187 22087 raft_consensus.cc:2243] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:18.476001 22087 raft_consensus.cc:2272] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:18.480015 22072 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:18.481182 22087 ts_tablet_manager.cc:1916] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:18.485941 18680 raft_consensus.cc:1275] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:23:18.487933 22072 consensus_queue.cc:1048] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:18.546406 22087 ts_tablet_manager.cc:1929] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.7
I20260709 12:23:18.570896 22087 log.cc:1199] T 6ddef1433d2344c9a83050fe07ac225b P 2f9872512f1646bc835906bd0e98c6a7: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-0-root/wals/6ddef1433d2344c9a83050fe07ac225b
I20260709 12:23:18.580967 18413 catalog_manager.cc:5028] TS 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): tablet 6ddef1433d2344c9a83050fe07ac225b (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:23:18.583822 18603 raft_consensus.cc:1275] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:23:18.598481 21960 consensus_queue.cc:1048] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:23:18.823544 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:18.997903 22083 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.998574 22083 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:19.002681 22083 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:19.003125 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:20.299655 22097 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:20.300479 22097 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.303169 22097 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:20.334445 22097 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:20.335070 22097 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.411127 22097 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:20.426968 22063 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:23:20.429114 18627 debug-util.cc:398] Leaking SignalData structure 0x7b080016bec0 after lost signal to thread 17349
I20260709 12:23:20.436228 22097 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.436859 22097 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.439182 22025 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:20.439834 22025 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.440024 22063 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.441386 22098 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:20.441941 22063 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:20.441952 22025 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:20.450037 22025 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:20.450765 22025 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.452291 22096 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:20.455890 22096 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.453759 22063 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.466256 22103 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:20.459276 22096 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:20.459604 22098 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.510193 22025 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:20.527412 21785 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.528087 21785 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.528779 22097 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:20.529335 22097 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.529778 22097 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.530253 21785 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:20.530783 21785 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:20.515321 22096 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:20.531976 22096 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.534789 22069 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:20.535379 22069 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.535984 22099 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.536516 22099 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.537992 22069 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:20.508867 22063 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.542089 22063 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:20.509040 22103 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.531239 21785 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.544925 22103 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:20.534847 22096 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:20.545915 22097 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:20.546491 22097 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:20.539435 22099 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:20.512988 22098 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:20.547204 21785 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:20.552968 22103 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:20.564018 22102 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.548576 22097 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.585250 22096 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.588058 22112 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.589340 22113 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:20.590544 22114 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:20.591780 22115 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:20.564345 22099 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:20.575340 22063 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:20.599203 22105 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:20.599315 22111 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:20.594842 22107 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:20.595065 22025 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:20.607887 22115 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.610481 22098 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:20.620832 22098 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.622198 22025 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.622684 22109 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.624217 21785 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.624294 22025 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:20.624900 21785 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.626201 22115 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:20.627002 21785 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:20.597101 22081 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:20.627379 22115 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:20.600910 22113 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.627915 22115 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.629976 22113 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:20.595350 22072 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:20.630731 22106 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:20.631660 22115 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:20.631358 22106 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.633628 22106 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:20.627986 22110 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:20.600770 22114 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.634320 22097 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:20.634909 22081 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.636013 22107 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.630546 22072 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.606838 22099 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.613976 22104 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:20.592695 22103 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.607610 22100 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:20.598088 22096 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.611410 22112 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.623210 22109 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.648000 22097 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:20.639276 22110 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.608660 22063 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.599951 22105 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.667789 22118 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.668229 22106 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:20.668267 22123 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:20.673025 22121 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:20.610190 22111 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.656138 22098 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:20.595472 22102 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.683089 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:20.684691 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:20.687614 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:20.688539 18604 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:23:20.693970 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:20.681310 22106 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.681455 22121 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.694936 18602 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:23:20.715837 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:20.655401 22104 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.721689 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:20.669430 22097 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.686148 22098 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.657058 22100 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.725626 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:20.727342 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:20.727737 22114 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:20.728776 19239 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:23:20.682181 22118 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.733590 18494 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:20.733908 22118 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:20.734493 22118 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:20.735024 22118 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.737069 22118 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:20.737496 18494 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:20.737609 22114 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.737515 22118 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.738576 22114 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.684480 22123 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.730188 21785 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:20.750520 22109 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:20.750881 22096 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:20.750459 21785 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.752727 22100 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:20.753330 22100 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:20.754029 22100 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.755587 22122 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:20.756301 22081 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:20.756377 22122 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.758133 22097 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:20.758687 22081 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:20.739693 22098 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.741653 22106 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:20.762418 22098 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:20.763397 22103 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:20.764510 22111 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:20.765830 22102 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:20.759433 22122 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:20.730368 22113 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:20.738821 22118 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.777802 22116 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:20.778755 22116 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.759586 22081 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:20.784267 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 45593.7us
I20260709 12:23:20.785363 18494 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:20.789093 22110 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:20.790040 22123 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:20.790232 22105 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:20.791076 22099 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:20.742699 22119 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:20.749375 22112 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:20.807355 22129 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:20.807884 22129 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.808230 22129 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:20.779284 22113 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.837704 22102 raft_consensus.cc:2804] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:20.838229 22102 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:20.838616 22102 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:20.842015 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 56772.1us
I20260709 12:23:20.842357 22109 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:20.842692 22124 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:20.842998 22109 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.843196 22124 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.845410 22124 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:20.846036 22124 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:20.846552 22124 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.848569 22124 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:20.853580 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:20.854514 18605 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:23:20.852233 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:20.851636 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:20.849349 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:20.850405 22068 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.852737 22020 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.852936 22100 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:20.849319 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:20.854975 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:20.855638 18599 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:20.852317 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:20.850533 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:20.857273 18627 debug-util.cc:398] Leaking SignalData structure 0x7b080036f740 after lost signal to thread 18461
I20260709 12:23:20.899510 18600 raft_consensus.cc:2468] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 3.
W20260709 12:23:20.900978 18627 debug-util.cc:398] Leaking SignalData structure 0x7b080039af00 after lost signal to thread 18554
I20260709 12:23:20.796765 22121 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:20.843487 22027 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:20.803081 22126 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:20.799017 22072 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:20.901558 18604 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 12.
I20260709 12:23:20.802124 22052 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.820295 22105 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:20.918015 18677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:23:20.918776 18677 raft_consensus.cc:606] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:20.862185 22111 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:20.920982 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:20.912005 22027 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.923692 22027 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:20.922479 18680 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:20.915985 21959 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.929240 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:20.929857 18680 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:20.916061 22125 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:20.934403 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:20.932027 21959 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.944060 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:20.930393 22111 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.801654 22119 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.920789 22100 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:20.937707 22133 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:20.945497 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:20.946305 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:20.913873 22020 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.950917 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:20.954162 18677 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:20.921761 22096 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.958043 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:20.920428 22105 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.960263 19239 raft_consensus.cc:2410] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:23:20.925704 22112 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.956619 22138 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.964164 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:20.964835 18677 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:20.932195 22099 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.908511 22068 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.919072 22052 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.966212 22112 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.970983 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:20.945079 22098 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.968230 19243 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:23:20.917241 22126 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.957265 22114 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:20.977442 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:20.978812 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:20.982575 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:20.982873 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:20.984218 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:20.983258 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:20.961678 22100 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.961756 22133 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.986480 22142 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:20.947891 22125 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:20.993077 22020 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:20.993768 22140 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:20.994230 22141 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:20.968335 22103 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:20.972502 22115 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.999241 22081 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:23:20.974254 22134 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:20.962877 22096 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:21.000332 22109 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.000238 22136 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:21.001294 22098 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.001987 22082 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:21.002281 22126 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:20.979717 22099 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.003578 22135 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:21.003916 22052 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.004112 22116 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:21.005607 22112 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.005833 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:21.028712 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:21.103690 19247 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:23:21.104377 22140 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.105666 22063 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:21.101104 22036 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:21.106748 22140 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:21.107158 22036 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:21.107595 22096 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:21.107514 22115 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.109313 22036 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.109421 22104 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.109593 22115 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.103354 22103 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.109818 22125 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:21.111682 22103 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:21.112398 22141 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.114756 22141 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:20.971727 22121 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:21.115041 22136 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.115971 22121 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.117086 22107 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.005777 22068 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.118016 22136 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:21.118598 22142 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:21.120134 22099 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.120857 22135 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:21.122355 18644 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.240.130:37079 timed out after 2.091s (SENT) [suppressed 2 similar messages]
I20260709 12:23:21.061280 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.125937 18673 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
W20260709 12:23:21.124619 18627 debug-util.cc:398] Leaking SignalData structure 0x7b08003c0540 after lost signal to thread 18630
W20260709 12:23:21.137689 18627 debug-util.cc:398] Leaking SignalData structure 0x7b080024e980 after lost signal to thread 18705
W20260709 12:23:21.138921 18627 debug-util.cc:398] Leaking SignalData structure 0x7b0800165c40 after lost signal to thread 19274
I20260709 12:23:21.105782 22098 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.005667 22119 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:21.130928 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.133613 18570 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:21.154918 18570 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:21.027649 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:20.967882 22124 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:21.030190 18494 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:21.028174 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:21.157573 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.159969 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:21.135033 22129 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:21.163127 18675 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
I20260709 12:23:21.165413 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.037218 22111 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:21.027575 21959 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.168987 18677 raft_consensus.cc:2410] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:23:21.118045 22121 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:21.171909 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.183418 18671 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:23:21.030434 22110 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:21.058427 22118 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.167037 22124 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.174053 22133 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:21.174901 21785 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.124809 22105 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:21.131289 22135 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:21.031328 22127 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:21.110868 22082 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:21.196277 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.030789 22027 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.177042 22102 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:21.179425 22115 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:21.201704 18680 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:23:21.187845 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.189903 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:21.190071 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 159976us
I20260709 12:23:21.205453 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:21.205897 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.206471 18529 raft_consensus.cc:2468] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 3.
I20260709 12:23:21.200058 22118 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:21.207571 22118 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:21.207953 22118 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:21.136114 22134 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.209353 22144 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:21.210071 22134 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.209882 22144 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.211489 22143 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:21.212483 22113 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:21.213217 22082 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:21.213335 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.191947 22123 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:21.213933 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.214232 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.214545 18525 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:23:21.214360 22123 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:20.973815 22138 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.216455 22123 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.162832 22098 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:21.180303 22030 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:21.183992 22119 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:21.166828 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.202448 18600 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 11.
I20260709 12:23:21.203419 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:21.223690 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.224308 18671 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:21.219045 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.217247 22100 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:21.203248 22115 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:21.230880 22115 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:21.230950 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.200461 18677 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:21.221421 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.220903 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.231683 18528 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:21.233984 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.234527 18528 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:21.234637 22027 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.235388 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.215492 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.236511 22141 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:21.236672 22133 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:21.237093 22141 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.237260 22133 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.238890 21785 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:21.239171 22141 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.239444 21785 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.240895 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.199915 22127 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.250211 22147 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:21.250594 18678 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:21.225550 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.229051 22149 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:21.261452 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:21.261875 22127 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:21.262331 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:21.229342 22142 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:21.229528 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.213945 22102 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:21.229799 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.264607 18529 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:23:21.229918 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.223232 22098 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:21.230363 22124 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:21.239902 22072 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:21.224990 18522 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:21.251821 18600 raft_consensus.cc:2393] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 7: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:21.252125 18530 raft_consensus.cc:1240] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:21.255717 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:21.260587 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:21.250707 22141 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:21.261518 21785 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.212052 22143 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:21.190372 22110 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.222267 22030 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:21.262162 22149 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.269490 22146 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:21.272104 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:21.263549 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 58359.2us
I20260709 12:23:21.272876 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.273452 22098 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:21.262544 22052 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:21.323889 22138 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.215987 22144 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.276176 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.263666 22147 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.275559 18572 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:21.278884 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.322618 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:21.328322 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.330562 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:21.336899 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.336230 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.321370 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.360265 18494 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:23:21.355248 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 232893us
I20260709 12:23:21.300979 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.357695 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.278975 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.357352 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.239382 22133 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.387773 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:21.388289 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 112816us
I20260709 12:23:21.388417 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.389144 18671 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:21.389498 18572 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:21.251024 22107 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:21.330004 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.378520 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.384179 19210 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:21.395552 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.378432 18677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:23:21.278033 22072 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.396073 18674 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:21.392371 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.393954 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.328855 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:21.358487 22141 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.387349 18494 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:21.410300 22129 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:21.411207 22118 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.411525 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.412097 22141 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.330719 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:21.413347 22118 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.329197 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:21.398391 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.407850 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.415688 18675 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:23:21.409385 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.359764 22146 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.399442 22143 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:21.399645 22113 raft_consensus.cc:2804] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:21.420578 22113 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:21.421010 22113 raft_consensus.cc:3060] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:21.415025 22144 raft_consensus.cc:2804] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:21.421993 22144 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:21.422386 22144 raft_consensus.cc:3060] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:21.400040 21959 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:21.401191 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.424055 21959 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:21.424500 21959 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:21.418699 22036 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:21.424983 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.425370 22036 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:21.425638 18526 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:21.426113 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.426576 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.427145 18526 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:23:21.427198 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.402557 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.401517 18572 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:21.404050 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.353760 22142 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:21.225598 22119 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:21.428522 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.428740 18572 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:21.429137 18528 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:21.430009 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.430114 18572 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:21.430315 22119 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.430703 18528 raft_consensus.cc:2393] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 6: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:21.430778 22139 consensus_queue.cc:1059] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:21.403258 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.431610 22101 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:21.432000 19244 raft_consensus.cc:2468] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:23:21.432130 22101 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:21.409471 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.432515 22101 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:21.432976 18673 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:21.409694 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:21.434707 22150 raft_consensus.cc:3055] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:21.435118 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.432451 22099 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:21.435668 22145 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:21.436026 22099 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:21.432646 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.436502 22146 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.436617 22099 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:21.437062 18521 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:21.410272 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.417989 18494 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:21.419296 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.419986 22072 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.419943 22102 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:21.440083 22072 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:21.440150 22102 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:21.440658 22072 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:21.440748 22102 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:21.414716 22149 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.435865 18526 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:21.441162 22072 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:21.447522 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.449565 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.425779 22036 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:21.359658 22052 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:21.435148 22150 raft_consensus.cc:740] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:21.414505 22107 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.439680 22147 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.453940 18572 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:21.454005 18523 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:21.431643 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.456930 18528 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:21.457139 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.354380 22030 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:21.460673 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.461302 18597 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:21.398173 18677 raft_consensus.cc:606] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Received request to transfer leadership to TS c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:21.462957 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.465631 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.428743 22142 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.467846 22149 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:21.468286 22149 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:21.468463 18529 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:23:21.468699 22149 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:21.468464 22115 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:21.471030 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.471983 22115 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:21.473394 22110 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:21.472190 18604 raft_consensus.cc:2393] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 7: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:21.476111 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.478015 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.478423 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.479063 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.479449 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.480109 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.480463 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.481696 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.483242 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.464959 18572 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:21.484993 18572 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:21.490091 18572 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:21.436192 22145 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:21.499775 22069 raft_consensus.cc:2804] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:21.500237 22069 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:21.500392 22144 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:21.501426 22096 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:21.500252 22052 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:21.502801 22036 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:21.500945 22069 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:21.505517 22036 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.506090 22072 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.407809 18570 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:21.522440 22096 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:21.497747 22115 raft_consensus.cc:2804] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:21.524231 22115 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:21.499079 22145 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:21.524767 22115 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:21.543032 22142 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.453015 22150 consensus_queue.cc:260] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:21.549276 22107 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.590253 22069 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:21.597886 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 168980us
I20260709 12:23:21.503456 22101 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:21.657788 22072 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.753062 22101 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:21.833424 22069 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.795910 21959 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:21.838141 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 430415us
I20260709 12:23:21.839833 21959 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.841424 22113 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:21.842674 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.844631 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.844754 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.846478 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:21.849484 19210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:21.850093 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 360066us
I20260709 12:23:21.850847 18572 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:21.851799 18572 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:21.852702 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.854411 22150 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:21.855685 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.856760 18572 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:21.861526 18570 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:21.863368 21959 raft_consensus.cc:2804] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:21.863837 21959 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:21.863945 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:21.864238 21959 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:21.867276 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.857955 22063 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:21.869164 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.869814 18678 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:21.870716 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.872023 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.872864 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.873137 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.873606 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:21.873965 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.874161 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:21.875304 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.876062 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.876227 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.876309 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:21.877321 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.881814 18494 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:21.882647 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.882726 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.883147 18494 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:21.883363 18671 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:21.853348 18600 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:23:21.884042 18677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:23:21.884778 18677 raft_consensus.cc:606] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:21.885465 22072 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:21.885730 22146 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:21.885871 22072 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:21.886109 18494 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:21.886516 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.876112 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.887620 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.886445 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.888749 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:21.889240 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.889482 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.889637 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.891553 18597 raft_consensus.cc:1240] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:21.894502 18494 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:21.896235 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.897486 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.900408 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:21.902540 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:21.902870 18675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:23:21.903335 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:21.903507 18675 raft_consensus.cc:606] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Received request to transfer leadership to TS c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:21.899864 22052 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:21.905900 22098 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:21.905999 22052 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:21.906352 22098 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:21.906468 22052 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:21.906778 22098 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:21.906925 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:21.909812 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:23:21.886343 22072 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:21.912664 18522 raft_consensus.cc:1240] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:21.911633 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:21.892431 22069 raft_consensus.cc:2804] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:21.915896 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.914078 18494 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:21.914464 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:21.886184 22146 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:21.917069 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.919715 18494 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:21.921620 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:21.921850 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:21.924777 18494 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:21.920931 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:21.926991 22143 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:21.927393 22143 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:21.927814 22143 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:21.927552 21959 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.928933 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:21.929698 21959 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:21.930310 21959 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:21.915822 22069 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:21.931041 22069 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:21.934340 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.936089 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.937951 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.942978 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:21.943704 18674 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
I20260709 12:23:21.946120 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:23:21.947088 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 88994.5us
I20260709 12:23:21.948267 18572 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:21.921073 22146 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:21.927670 22113 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:21.923867 22141 raft_consensus.cc:2804] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:21.950503 18572 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:21.941958 22102 consensus_meta.cc:287] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.501s	user 0.012s	sys 0.000s
I20260709 12:23:21.965147 18572 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:21.953876 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:21.968374 22113 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:21.968919 22113 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:21.969310 22113 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:21.971659 21959 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:21.967460 18644 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:23:21.972952 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 111493us
I20260709 12:23:21.990371 18570 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:21.992173 18570 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:21.949400 22051 consensus_queue.cc:1059] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:23:21.992846 22157 raft_consensus.cc:2804] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:21.972491 22102 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:21.993338 22157 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:21.993549 22051 raft_consensus.cc:3055] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:21.993752 22157 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:21.960965 22144 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:21.994783 18572 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:21.966086 22147 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:21.998773 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.994226 22051 raft_consensus.cc:740] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:22.002651 22063 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:21.978835 21959 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:22.004228 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:21.966132 22141 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:22.004539 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:22.007404 22157 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:21.994258 22124 raft_consensus.cc:2804] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:22.010289 22113 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:22.011173 22099 consensus_meta.cc:287] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.000s
W20260709 12:23:22.014706 22030 consensus_meta.cc:287] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.000s
W20260709 12:23:22.016139 22149 consensus_meta.cc:287] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.547s	user 0.012s	sys 0.000s
I20260709 12:23:22.021246 22101 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:22.045686 22096 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:22.052775 22101 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:22.053242 22096 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:22.053398 22101 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:22.024343 22098 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.030201 19210 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:21.966406 22153 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:22.043665 22124 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
W20260709 12:23:22.044812 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 48754us
W20260709 12:23:22.046855 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 122155us
I20260709 12:23:22.037935 22147 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:22.048825 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:22.066715 22147 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:22.066919 18604 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:23:22.050688 22030 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:22.051800 22102 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.051927 22149 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.055774 19210 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:22.053782 22096 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:22.043637 22141 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:22.066725 18570 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:22.048588 22099 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.069564 22113 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.071261 22098 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.065975 22139 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:22.071638 19242 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:23:22.072355 22051 consensus_queue.cc:260] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:22.085125 22030 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:22.085629 22051 raft_consensus.cc:3060] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:22.091964 18603 raft_consensus.cc:1240] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6. Ops: []
W20260709 12:23:22.069054 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 43891.9us
I20260709 12:23:22.038846 22052 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.043715 21959 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:22.079622 18570 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:22.079591 19210 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:22.082077 22119 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:22.083349 22139 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:22.093748 22146 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.102495 18605 raft_consensus.cc:1240] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:22.068570 22124 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:22.111982 22113 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:22.112474 22113 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:22.112865 22113 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:22.113165 22052 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.115902 22110 raft_consensus.cc:993] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1: : Instructing follower c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:23:22.104503 22139 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:22.118640 19246 raft_consensus.cc:1240] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:22.097365 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 102659us
I20260709 12:23:22.120532 18572 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:22.094813 21785 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:22.121068 22141 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:22.121562 21785 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:22.122001 21785 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:22.122659 22153 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:22.123088 22153 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:22.123288 22141 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:22.123485 22153 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:22.124147 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.125061 22099 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:22.114892 22145 consensus_meta.cc:287] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.002s
I20260709 12:23:22.126552 22145 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.100518 22036 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:22.130026 22157 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:22.131366 18526 raft_consensus.cc:1240] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:22.131655 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.131807 22149 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.133210 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.134231 18530 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:22.136147 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.136806 18528 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:22.139168 22115 consensus_meta.cc:287] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.614s	user 0.007s	sys 0.003s
I20260709 12:23:22.140101 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.140760 22113 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.141649 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.142186 18525 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:22.144366 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.145067 18521 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:22.149091 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.148802 21785 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.117226 22143 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:22.151957 22143 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:22.152722 18529 raft_consensus.cc:1240] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:22.103852 18570 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:23:22.154781 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 51027.9us
I20260709 12:23:22.155015 22036 consensus_queue.cc:1059] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:22.156169 22149 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:22.156857 22036 raft_consensus.cc:3055] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:22.157276 22036 raft_consensus.cc:740] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:22.158519 22036 consensus_queue.cc:260] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:22.158713 22147 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.160799 22036 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:22.155470 18570 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:22.166759 22157 consensus_queue.cc:1059] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:22.169656 22069 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.139613 22115 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:22.200143 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 44773.1us
I20260709 12:23:22.200162 22154 raft_consensus.cc:2804] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:22.200917 22154 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:22.201296 22154 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:22.201452 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:22.201855 22115 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.202392 22115 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:22.204749 22030 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:22.205343 22030 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.170514 22101 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:22.173228 22146 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.175575 18529 raft_consensus.cc:1240] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:22.207417 22030 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.171636 22145 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.207863 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.177661 22096 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:22.208420 18529 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:22.209960 22096 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:22.209815 22154 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.178002 18524 raft_consensus.cc:1240] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:22.212569 22154 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.213145 22113 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.196946 22147 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.184798 22072 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.183377 21959 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.186403 18521 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
I20260709 12:23:22.186887 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.219168 18522 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:22.188206 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.219971 18526 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:22.188464 22158 raft_consensus.cc:1081] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Signalling peer c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:23:22.190807 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.221361 22030 consensus_queue.cc:1059] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:22.222458 22030 raft_consensus.cc:3055] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:22.222793 22030 raft_consensus.cc:740] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:22.190804 22124 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:22.223824 22030 consensus_queue.cc:260] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.225014 22124 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:22.225222 22030 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:22.194605 22153 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.195889 18527 raft_consensus.cc:1240] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:22.227542 22153 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.227977 22101 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:22.232985 18524 raft_consensus.cc:1240] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:22.234406 22072 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.197489 18525 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:22.195677 18530 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
W20260709 12:23:22.198741 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 130720us
I20260709 12:23:22.236627 18522 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:22.238538 18494 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:22.199558 21785 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.200030 22157 raft_consensus.cc:3055] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:22.242405 18494 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:22.242617 22157 raft_consensus.cc:740] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:22.204840 22069 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.180492 22139 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:22.210678 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 115612us
I20260709 12:23:22.244470 22163 raft_consensus.cc:2804] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:22.244912 22163 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:22.245376 22163 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:22.245734 22139 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.247331 18530 raft_consensus.cc:1240] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:22.243500 22157 consensus_queue.cc:260] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.248787 22157 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:22.249382 18530 raft_consensus.cc:1240] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:22.251173 18530 raft_consensus.cc:1240] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:22.252676 18530 raft_consensus.cc:1240] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:22.184159 18528 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:22.213691 18570 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:22.253911 22160 consensus_queue.cc:1059] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:22.254798 18644 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:22.255012 21959 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.255165 22101 raft_consensus.cc:3055] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:22.255560 22101 raft_consensus.cc:740] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:22.255647 18570 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:22.256635 22162 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:22.256489 22101 consensus_queue.cc:260] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.255025 22160 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:22.257330 22153 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:22.257550 22160 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:22.257707 22101 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:22.257813 22153 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:22.258080 22160 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:22.258342 22153 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:22.257580 18570 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:22.259971 21959 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:22.260391 21959 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:22.260794 21959 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:22.262331 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.263723 18572 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:22.264057 18644 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:22.264613 21785 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:22.265117 21785 raft_consensus.cc:697] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:22.266008 21785 consensus_queue.cc:237] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.219964 18529 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:22.266880 22158 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:22.241433 22146 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:22.267643 22146 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:22.268077 22146 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:22.240518 18526 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:22.270005 18572 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:22.270603 19210 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:22.270833 22154 consensus_queue.cc:1059] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:22.271042 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:22.271829 22154 raft_consensus.cc:3055] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:22.271829 22036 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:22.272048 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:22.272361 22069 consensus_queue.cc:1059] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:22.273322 22069 raft_consensus.cc:3055] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:22.273659 22069 raft_consensus.cc:740] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:22.272382 22154 raft_consensus.cc:740] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:22.274946 22154 consensus_queue.cc:260] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.276293 22154 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:22.278272 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:22.279070 22069 consensus_queue.cc:260] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.279995 22113 raft_consensus.cc:2804] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:22.280562 22113 raft_consensus.cc:697] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:22.281575 22113 consensus_queue.cc:237] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.282397 22036 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:22.280402 22069 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:22.285029 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:22.285362 18572 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:22.286373 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.292670 22110 raft_consensus.cc:993] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1: : Instructing follower c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:23:22.293197 22110 raft_consensus.cc:1081] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Signalling peer c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:23:22.293809 22163 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:22.294348 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.296061 22115 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:22.297106 22115 raft_consensus.cc:697] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:22.298183 22115 consensus_queue.cc:237] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.299731 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:22.300189 18644 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:22.302917 22146 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.308686 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.308710 22158 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:22.310407 18572 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:22.310577 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.311347 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.311911 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.312381 22096 raft_consensus.cc:2804] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:22.312681 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.313165 22096 raft_consensus.cc:697] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:22.313409 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:22.313892 18529 raft_consensus.cc:1240] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:22.314112 22096 consensus_queue.cc:237] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.318487 19242 raft_consensus.cc:2468] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:23:22.320457 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.321247 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.321524 18529 raft_consensus.cc:1240] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:22.298434 22153 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.322933 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:22.323508 22139 consensus_queue.cc:1059] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:22.324874 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.324338 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.325879 18530 raft_consensus.cc:1240] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:22.327525 18572 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:22.331292 18572 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:22.331323 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.332259 18572 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:22.333832 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.333992 18644 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:22.335729 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.337121 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.337208 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.338376 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.338443 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.338666 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.339008 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:22.340157 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.340294 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.340999 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.335847 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.341838 18524 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:22.341001 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.343446 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.343209 22154 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:22.346357 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.347157 18527 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:22.347105 22146 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.348181 22030 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:22.348671 22030 raft_consensus.cc:697] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:22.348904 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.349637 22030 consensus_queue.cc:237] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.351831 22101 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:22.352758 22101 raft_consensus.cc:697] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:22.352996 18528 raft_consensus.cc:1240] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:22.329232 22164 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:22.353595 22101 consensus_queue.cc:237] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.354573 22036 consensus_queue.cc:1059] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:22.355715 22051 raft_consensus.cc:3055] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:22.347105 22154 raft_consensus.cc:697] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:22.356068 22051 raft_consensus.cc:740] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:22.356746 22154 consensus_queue.cc:237] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.356977 22051 consensus_queue.cc:260] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:22.357980 22051 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:22.363498 18524 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:23:22.324178 22153 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.364250 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.367957 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.360755 22119 raft_consensus.cc:3055] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:22.369828 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:22.370445 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.371034 18572 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:22.372418 18527 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:22.374068 18572 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:22.375522 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.375608 18605 raft_consensus.cc:1240] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:22.377043 18602 raft_consensus.cc:1240] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:22.377043 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.370726 18644 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:22.370270 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:22.388082 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:22.388854 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.371798 22119 raft_consensus.cc:740] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:22.379621 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:22.380120 22069 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:22.380054 18599 raft_consensus.cc:1240] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:22.404951 18602 raft_consensus.cc:2393] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 7: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:22.400646 18606 raft_consensus.cc:1240] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:22.400818 18528 raft_consensus.cc:1240] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:22.378688 22158 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:22.400919 18601 raft_consensus.cc:1240] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:22.406782 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.403159 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.407665 22069 raft_consensus.cc:697] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:22.403682 22124 consensus_queue.cc:1059] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:23:22.414165 22124 raft_consensus.cc:3055] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:22.414608 22124 raft_consensus.cc:740] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:22.414721 22036 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:22.401902 22162 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:22.415338 22036 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:22.408797 22152 consensus_queue.cc:1059] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:22.408591 22119 consensus_queue.cc:260] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:22.415591 22124 consensus_queue.cc:260] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:22.380472 22157 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:22.410251 22164 consensus_queue.cc:1059] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:22.411213 22158 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:22.409319 22156 consensus_queue.cc:1059] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:22.416889 22163 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:22.424489 22124 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:22.425061 22157 raft_consensus.cc:697] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:22.424492 22156 raft_consensus.cc:3055] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:22.426249 22158 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:22.425936 22156 raft_consensus.cc:740] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:22.427604 22156 consensus_queue.cc:260] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:22.429250 22109 raft_consensus.cc:3055] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:22.429656 22109 raft_consensus.cc:740] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:22.430476 22109 consensus_queue.cc:260] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:22.431031 22157 consensus_queue.cc:237] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.431988 22069 consensus_queue.cc:237] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.412858 18570 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:22.440897 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.440897 18570 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:22.401480 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:22.416390 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.433524 22109 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:22.444416 22153 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:22.433938 22156 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:22.412573 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.436980 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.415697 22162 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:22.442123 19209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.442705 22119 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:22.442992 18570 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:22.418576 22036 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.461795 18527 raft_consensus.cc:1240] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:22.443725 22113 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:22.468389 18570 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:22.412107 22160 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.466826 22162 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:22.485893 18527 raft_consensus.cc:1240] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:22.491566 18570 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:22.471644 22153 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:22.471263 21785 raft_consensus.cc:2804] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:22.498142 18570 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:22.504184 18527 raft_consensus.cc:1240] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:22.506605 18570 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:22.510252 22110 raft_consensus.cc:3055] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:22.510727 22110 raft_consensus.cc:740] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:22.511831 22110 consensus_queue.cc:260] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.513098 21785 raft_consensus.cc:697] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:22.514637 21785 consensus_queue.cc:237] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:22.516327 21959 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.507567 22101 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:22.518471 21959 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.519196 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.497051 22096 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:22.528724 18527 raft_consensus.cc:1240] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:22.533190 22160 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.533977 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:23:22.540035 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 137107us
I20260709 12:23:22.542413 18604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:40948
I20260709 12:23:22.542681 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:22.542531 18601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:40948
I20260709 12:23:22.543074 18604 raft_consensus.cc:476] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Not starting forced leader election -- already a leader
I20260709 12:23:22.543941 18601 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:22.544358 18601 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:22.544844 18602 raft_consensus.cc:1240] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:22.548656 22154 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:22.549263 18602 raft_consensus.cc:1240] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:22.550336 22110 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:22.556097 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.558627 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.566931 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:22.567759 18679 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
I20260709 12:23:22.569839 22164 consensus_queue.cc:1059] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:22.571496 22164 raft_consensus.cc:3055] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:22.572070 22164 raft_consensus.cc:740] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:22.573240 22164 consensus_queue.cc:260] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:22.574887 22164 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:22.582227 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 106275us
I20260709 12:23:22.584160 18602 raft_consensus.cc:1240] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:22.586061 22175 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:22.586661 22175 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.588109 18602 raft_consensus.cc:1240] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:22.575354 18601 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.591076 18602 raft_consensus.cc:1240] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:22.592905 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.594075 18527 raft_consensus.cc:2393] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 12: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:22.601877 18601 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:22.603261 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 54910.6us
I20260709 12:23:22.605304 18570 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:22.609712 18527 raft_consensus.cc:1240] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:22.611153 19210 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:22.607707 18570 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:22.617682 22051 raft_consensus.cc:2804] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:22.618110 22051 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:22.618449 22051 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:22.608512 22069 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:22.628378 22051 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:22.634018 22051 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:22.637846 22124 consensus_queue.cc:1059] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:22.638324 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.639371 22124 consensus_queue.cc:1243] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:23:22.648618 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.649529 18528 raft_consensus.cc:1240] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:22.649789 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.671186 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.650175 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.650924 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.672610 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:22.673411 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.672641 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:22.674499 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.675468 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.676720 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.678335 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.651247 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.679981 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:22.652144 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.653411 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.654369 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.655977 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.681645 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:22.681876 18522 raft_consensus.cc:1240] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:22.659416 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:22.609366 22171 log.cc:927] Time spent T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:23:22.659775 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:22.660534 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:22.662050 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:22.663925 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:22.687404 18599 raft_consensus.cc:2393] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 8: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:22.688711 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:22.683480 18603 raft_consensus.cc:1240] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:22.685336 19246 raft_consensus.cc:1240] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:22.692420 18606 raft_consensus.cc:1240] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:22.696131 22099 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:22.696290 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 88690.3us
I20260709 12:23:22.697326 18570 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:22.698153 22099 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:22.698598 18570 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:22.699366 22099 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:22.704825 18530 raft_consensus.cc:1240] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:22.706297 18525 raft_consensus.cc:1275] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:23:22.706823 22110 raft_consensus.cc:3055] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:22.707192 22110 raft_consensus.cc:740] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:22.712610 18570 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:22.716373 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:22.717933 19241 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
W20260709 12:23:22.719916 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 108913us
I20260709 12:23:22.720764 19246 raft_consensus.cc:2393] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 4: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:22.720489 18570 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:22.721474 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.695168 22158 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.723302 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.723381 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:22.725248 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:22.725630 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.726953 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:22.727345 22170 consensus_queue.cc:1059] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:22.728231 22158 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:22.728341 22170 raft_consensus.cc:3055] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:22.728771 22170 raft_consensus.cc:740] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:22.718355 21785 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:22.722311 22110 consensus_queue.cc:260] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.726524 22030 consensus_queue.cc:1048] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:23:22.731386 22110 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:22.729604 22170 consensus_queue.cc:260] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.729959 22175 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:22.737396 18603 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:22.739296 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.733897 22154 consensus_queue.cc:1059] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:23:22.740648 22173 consensus_queue.cc:1059] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:22.741426 22180 consensus_queue.cc:1059] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:22.749841 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.745028 18601 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:23:22.745662 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:22.746693 18599 raft_consensus.cc:1240] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:22.744257 18602 raft_consensus.cc:1240] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:22.745828 18570 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:22.749832 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:22.750144 18676 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:22.743738 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.753679 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.754477 18677 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:22.753914 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:22.755074 18606 raft_consensus.cc:1240] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:22.756560 18603 raft_consensus.cc:1240] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:22.755004 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:22.755582 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.759019 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.759999 18680 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:22.761458 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:22.741858 22124 consensus_queue.cc:1059] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:23:22.768435 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:22.770936 19210 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:22.748039 22030 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:22.772773 22170 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:22.773046 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:22.774078 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:22.780891 19246 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:23:22.774080 18494 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:22.790472 18677 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4.
I20260709 12:23:22.791843 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.792253 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.792671 18599 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:23:22.793762 19241 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:23:22.793911 18494 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:22.795135 18602 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:22.797606 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.802536 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:22.803335 18672 raft_consensus.cc:3055] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:22.803787 18672 raft_consensus.cc:740] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:22.804476 18672 consensus_queue.cc:260] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.805801 22099 raft_consensus.cc:3055] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:22.806200 22099 raft_consensus.cc:740] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:22.807044 22180 consensus_queue.cc:1243] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:23:22.810053 22052 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:22.812814 18672 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:22.802795 22173 consensus_queue.cc:1243] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:23:22.773388 22069 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:22.799785 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:23:22.836236 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 88416.1us
I20260709 12:23:22.816083 18680 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:23:22.840536 22173 consensus_queue.cc:1059] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:22.840917 19210 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:22.841593 22173 raft_consensus.cc:3055] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:22.841962 22173 raft_consensus.cc:740] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:22.799050 18570 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:22.842922 22173 consensus_queue.cc:260] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.794989 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
W20260709 12:23:22.843822 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 44863.9us
I20260709 12:23:22.844170 22157 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:22.844712 22157 raft_consensus.cc:697] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:22.845574 22157 consensus_queue.cc:237] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:22.846123 18603 raft_consensus.cc:1240] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:22.847448 18598 raft_consensus.cc:1240] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:22.831028 22175 raft_consensus.cc:3055] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:22.850214 22175 raft_consensus.cc:740] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:22.851222 22156 raft_consensus.cc:2804] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:22.851181 22175 consensus_queue.cc:260] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.851884 22156 raft_consensus.cc:697] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:22.852526 22175 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:22.852841 22156 consensus_queue.cc:237] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:22.855711 18671 raft_consensus.cc:1240] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:22.859304 22158 consensus_queue.cc:1059] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:22.860149 22158 consensus_queue.cc:1243] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:22.860438 18524 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:23:22.859491 18530 raft_consensus.cc:1275] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:22.860594 22158 consensus_queue.cc:1059] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:23:22.862972 22164 raft_consensus.cc:3055] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:22.863332 22164 raft_consensus.cc:740] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:22.831827 22162 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:22.798144 22036 consensus_queue.cc:1059] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:23:22.784520 22139 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:22.798386 22152 consensus_queue.cc:1059] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:23:22.807591 22180 raft_consensus.cc:3055] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:23:22.803391 18475 auto_rebalancer.cc:629] Failed to schedule move for tablet c1f654a3c5be411f92ffc5ed5b6b70a1: Illegal state: Replica c7bd71f1f37c45f28b52c154e59356b9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:22.807049 22099 consensus_queue.cc:260] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:22.866789 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.874423 18529 raft_consensus.cc:1275] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:23:22.876148 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:22.885617 18599 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:22.876650 19242 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:22.866389 18674 raft_consensus.cc:2368] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 7. Current term is 8.
I20260709 12:23:22.868487 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:22.892906 19241 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:22.870903 18525 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:23:22.873413 18530 raft_consensus.cc:1275] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:23:22.864264 18524 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:23:22.871073 18672 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:22.901481 18599 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:22.902895 22124 consensus_queue.cc:1243] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:23:22.905676 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 75792.2us
I20260709 12:23:22.891525 18424 catalog_manager.cc:5697] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 5 to 6, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 6 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:22.908810 18424 catalog_manager.cc:5697] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 8 to 9, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 9 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:22.911316 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.913012 18644 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:22.919425 18601 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:22.911073 18424 catalog_manager.cc:5697] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 9 to 10, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 10 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:22.924049 18570 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:22.924326 18679 raft_consensus.cc:1275] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:23:22.925060 18424 catalog_manager.cc:5697] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 5 to 6, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 6 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:22.866401 22036 raft_consensus.cc:3055] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:22.870251 22099 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:22.870144 22154 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:23:22.917727 18676 raft_consensus.cc:3055] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:22.877094 22113 consensus_queue.cc:1048] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:23:22.867503 22152 raft_consensus.cc:3055] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:22.867641 22180 raft_consensus.cc:740] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:22.866652 22182 consensus_queue.cc:1059] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:23:22.904048 22146 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:22.864130 22164 consensus_queue.cc:260] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.932893 18570 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:22.904285 22030 consensus_queue.cc:1048] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:23:22.866057 22173 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:22.867542 22162 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:22.934053 19210 leader_election.cc:400] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 7. Current term is 8.
I20260709 12:23:22.936404 22145 raft_consensus.cc:2749] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:22.936841 18427 catalog_manager.cc:5697] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 3 to 4, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 4 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:22.944556 19241 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:22.945495 18424 catalog_manager.cc:5697] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 6 to 7, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 7 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:22.948176 18676 raft_consensus.cc:740] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:22.944104 22185 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:23:22.947189 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 153367us
I20260709 12:23:22.950455 18524 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:22.863695 22110 consensus_queue.cc:1059] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:23:22.989315 18494 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:22.981832 19210 leader_election.cc:403] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:23:22.990604 18494 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:22.991129 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 57223.9us
I20260709 12:23:22.948693 22152 raft_consensus.cc:740] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:22.993963 18494 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:22.951803 18527 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:23:22.984808 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 52023.5us
I20260709 12:23:22.947729 22036 raft_consensus.cc:740] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:22.986443 18424 catalog_manager.cc:5697] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 6 to 7, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 7 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:22.955991 21959 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:23:22.987951 18676 consensus_queue.cc:260] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.998824 18676 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:22.998620 22164 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:22.999986 22110 consensus_queue.cc:1243] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:23.000903 22146 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:23.001798 22146 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:23.002174 18675 raft_consensus.cc:3055] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:23.002547 18675 raft_consensus.cc:740] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:23.003021 22180 consensus_queue.cc:260] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.983968 22182 consensus_queue.cc:1243] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:23:23.004451 22180 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:23.005167 18671 raft_consensus.cc:3055] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:23.005513 18671 raft_consensus.cc:740] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:23.006238 18671 consensus_queue.cc:260] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:23.007360 18671 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:23.008311 22124 consensus_queue.cc:1175] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2f9872512f1646bc835906bd0e98c6a7" responder_term: 6 status { last_received { term: 5 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:23:23.010326 18676 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:23.013692 18570 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:22.994946 22052 raft_consensus.cc:2804] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:23.016709 22052 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:23:23.016934 22181 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:23:23.017125 22052 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:22.999670 22184 consensus_queue.cc:1059] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:23:22.995185 22119 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 7. Current term is 8.
I20260709 12:23:23.020381 22154 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:22.995388 22160 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:23:23.021793 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:22.991238 22096 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:22.986027 22162 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:23.003453 18675 consensus_queue.cc:260] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:23.033035 22162 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:23.034191 18675 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:23.015532 22185 raft_consensus.cc:697] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:23.035977 22113 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:22.993317 22158 consensus_queue.cc:1243] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:23.013558 18424 catalog_manager.cc:5697] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 10 to 11, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 11 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:23.058048 18424 catalog_manager.cc:5697] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 8 to 9, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 9 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:23.052762 22185 consensus_queue.cc:237] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:23.064324 22188 raft_consensus.cc:3055] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:23.064715 18677 raft_consensus.cc:3055] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:23.064819 22188 raft_consensus.cc:740] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:23.065145 18677 raft_consensus.cc:740] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:22.961958 22157 consensus_queue.cc:1048] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:23:22.968665 22175 consensus_queue.cc:1059] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:23:23.065873 18677 consensus_queue.cc:260] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:22.954542 22069 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:23:23.101320 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:23.102178 18601 raft_consensus.cc:2393] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 8: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:23.088081 18675 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:23:23.050824 18671 raft_consensus.cc:1275] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:23:23.109647 18677 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:23.098330 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 141023us
I20260709 12:23:23.081036 22113 raft_consensus.cc:697] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:23.123062 18677 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:23:23.114526 22110 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:23:23.121156 18646 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:23.101348 22162 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:23.141968 18675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:59840
W20260709 12:23:23.148269 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 115302us
I20260709 12:23:23.160770 18677 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:23:23.132123 22196 log.cc:927] Time spent T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:23:23.164170 19241 raft_consensus.cc:1275] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:23.165154 18646 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:23.129525 22194 raft_consensus.cc:3055] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:23.130918 22175 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:23:23.156895 22170 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:23:23.168210 22154 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:23:23.107616 22188 consensus_queue.cc:260] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:23.168838 22194 raft_consensus.cc:740] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:23:23.177038 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 183163us
I20260709 12:23:23.164016 22145 consensus_queue.cc:1048] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
W20260709 12:23:23.182359 18475 auto_rebalancer.cc:629] Failed to schedule move for tablet e5079e43d75f41f9b2acb31e4798ce95: Illegal state: Replica a0dee333a83a45f1ab0c1bb6d094afd1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:23.163682 21959 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:23:23.187427 22188 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:23.162768 22099 consensus_queue.cc:1048] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:23:23.136142 22113 consensus_queue.cc:237] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:23.163898 22157 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:23:23.187705 22110 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:23.180987 18494 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:23.125033 22036 consensus_queue.cc:260] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:23.209581 18671 raft_consensus.cc:1275] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:23.214818 18677 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:23:23.208794 22110 consensus_queue.cc:1059] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:23:23.217705 18680 raft_consensus.cc:1275] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:23:23.113422 22152 consensus_queue.cc:260] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:23.223140 22110 raft_consensus.cc:3055] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:23.222810 22194 consensus_queue.cc:260] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:23.223548 22110 raft_consensus.cc:740] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:23.211220 18646 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:23.233284 18494 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:23.235527 18494 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:23.237269 18646 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:23.240077 18494 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:23.241920 18675 raft_consensus.cc:606] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:23.259055 18675 raft_consensus.cc:614] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:23.257572 18494 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:23.244233 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 87125.1us
I20260709 12:23:23.272410 18523 raft_consensus.cc:1275] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:23.280081 22157 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:23:23.295619 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:23.356750 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 80111.6us
I20260709 12:23:23.369472 18522 raft_consensus.cc:3055] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:23.369995 18522 raft_consensus.cc:740] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:23.371565 18522 consensus_queue.cc:260] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:23.372968 18522 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:23.389145 22210 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:23.390070 22210 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:23.393354 22210 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:23.395382 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:23.396078 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.238547 22163 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:23.240721 22185 raft_consensus.cc:2749] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:23.274338 18599 consensus_queue.cc:237] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:23:23.267606 22199 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:23.265973 22198 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:23.238927 22154 consensus_queue.cc:1048] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.184s
I20260709 12:23:23.275867 22180 raft_consensus.cc:2749] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:23.414628 22194 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:23.437868 18522 raft_consensus.cc:1275] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:23:23.449946 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:23.456022 18680 raft_consensus.cc:2393] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 13: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:23.418699 22186 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:23.272179 22052 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:23.444120 22113 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:23.479529 21785 consensus_queue.cc:1048] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:23:23.428287 22110 consensus_queue.cc:260] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:23.418905 22205 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:23:23.443370 22146 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:23.625030 18671 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:23.629551 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 179619us
W20260709 12:23:23.645416 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 200479us
I20260709 12:23:23.658895 18671 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:23:23.649964 22206 log.cc:927] Time spent T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.096s	user 0.006s	sys 0.000s
W20260709 12:23:23.689056 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 63113.8us
W20260709 12:23:23.684075 22204 log.cc:927] Time spent T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.160s	user 0.001s	sys 0.006s
W20260709 12:23:23.749784 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 492281us
W20260709 12:23:23.807623 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 56745.8us
I20260709 12:23:23.808558 18494 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:23.819531 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 167184us
W20260709 12:23:23.821571 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.644872 22113 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:23.758426 22209 consensus_queue.cc:1048] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:23:23.838321 22232 consensus_queue.cc:1048] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:23.812888 22162 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.692821 22145 consensus_queue.cc:1048] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.137s
W20260709 12:23:23.822396 22179 log.cc:927] Time spent T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:23:23.833930 22199 consensus_queue.cc:1059] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:23:23.865777 22226 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.866008 22230 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.866477 22226 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:23.868978 22226 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:23.841938 22180 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.866577 22230 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:23.871781 22180 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:23.874173 22180 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:23.848580 22232 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.876344 22232 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:23.849642 22228 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:23.879052 22228 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:23.879544 22232 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:23.883029 22052 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:23.856850 22162 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:23.881278 22228 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:23.961877 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:23.969213 18673 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.000s	sys 0.013s
W20260709 12:23:23.969929 18673 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.000s	sys 0.013s
I20260709 12:23:23.983261 21785 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.984815 21785 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:23.985700 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 177108us
I20260709 12:23:23.986801 22052 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:23.991860 22113 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:23.992494 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:23.993880 21785 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:23.917374 22146 raft_consensus.cc:3055] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:23.997802 22146 raft_consensus.cc:740] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:23.998371 18673 raft_consensus.cc:1275] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:23:23.999557 22146 consensus_queue.cc:260] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:23.993804 19241 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:23:24.001715 22146 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:24.005762 19242 raft_consensus.cc:1275] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:23:23.987417 18494 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:24.050573 22215 raft_consensus.cc:2749] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:24.051019 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 63928us
I20260709 12:23:24.052341 18494 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:24.053438 22215 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:24.064266 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:24.065687 18529 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:23:24.073624 22162 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:24.080683 22194 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.081692 22194 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:24.087186 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.087021 22218 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:24.088153 22218 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:24.120548 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:24.121659 18523 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:23:24.122677 22218 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:24.129489 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:24.134617 18521 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:24.093582 22240 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.093395 22194 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:24.100207 22237 consensus_queue.cc:1048] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:24.097843 22152 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:24.112309 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:24.127892 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:24.143577 18527 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 6.
I20260709 12:23:24.138329 22240 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:24.117707 18528 raft_consensus.cc:1275] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:23:24.159603 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.161836 22036 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:24.162101 22239 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.165345 22110 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:24.168484 18644 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:23:24.172974 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 120925us
I20260709 12:23:24.173360 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:24.174379 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 341486us
I20260709 12:23:24.174718 18674 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 6.
I20260709 12:23:24.176471 22192 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:24.177052 22192 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.177477 22192 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:24.182934 22185 consensus_queue.cc:1048] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:24.185529 18570 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:24.187963 22230 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:24.166810 22239 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:24.233836 18646 leader_election.cc:336] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.506s (SENT)
I20260709 12:23:24.234494 18646 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:24.236039 22233 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:24.237592 22239 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:24.242537 22194 raft_consensus.cc:2749] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:24.243535 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:24.243932 22240 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:24.268747 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 83546.1us
I20260709 12:23:24.272492 18674 raft_consensus.cc:2393] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 8: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:24.285600 22237 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.285703 22233 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:24.286507 22237 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:24.272082 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:24.298980 22185 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.300058 22185 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:24.303260 22152 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:24.304011 22152 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:24.304620 22152 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:24.305279 22185 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:24.312532 22113 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:24.314287 18572 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:24.325136 18572 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:24.326508 22242 raft_consensus.cc:2804] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:24.327023 22242 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.327437 22242 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:24.328200 22226 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:24.328701 22226 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.328464 22101 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:24.329131 22226 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:24.340395 22237 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:24.343942 22230 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.344677 22230 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:24.345589 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:24.346359 19241 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:24.347100 22230 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:24.351852 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.351678 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:24.352006 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 118414us
I20260709 12:23:24.352736 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:24.353245 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:24.356458 18646 leader_election.cc:336] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.528s (SENT)
I20260709 12:23:24.357236 18528 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
I20260709 12:23:24.357477 18646 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:24.353770 19212 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:24.352362 22218 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.359395 22224 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:24.359644 22194 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:24.359897 22218 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:24.362085 18646 leader_election.cc:336] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.575s (SENT)
I20260709 12:23:24.362584 18646 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:24.362895 22218 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:24.363590 22194 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:24.359869 22224 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.364310 22224 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:24.364837 19212 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:24.366353 22109 raft_consensus.cc:2804] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:24.351836 22152 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:24.366946 22109 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.367466 22109 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:24.367458 22245 log.cc:927] Time spent T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.135s	user 0.002s	sys 0.002s
W20260709 12:23:24.371940 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 55751.9us
I20260709 12:23:24.340574 18494 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:24.373566 22146 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:24.383046 19246 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:23:24.384876 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.394280 18644 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:23:24.398337 18646 leader_election.cc:336] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.641s (SENT)
I20260709 12:23:24.398778 18646 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:24.408543 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:24.409387 18522 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:24.413619 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:24.413625 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:24.403338 22185 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:24.380728 22109 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:24.415818 22194 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:24.424669 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:24.426841 22152 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:24.429028 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:24.430655 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:24.430970 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:24.431125 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:24.431524 18526 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:24.432469 18679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:23:24.433158 22233 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:24.433337 18679 raft_consensus.cc:606] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:24.433784 22233 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:24.435583 22239 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.436403 22239 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:24.438230 22220 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.438264 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:24.411173 22230 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.438889 22220 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:24.439812 22227 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:24.439587 22230 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:24.440470 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:24.440653 22227 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:24.441406 18601 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:24.442221 22230 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:24.442902 22227 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:24.443923 22113 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:24.444557 22113 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:24.446830 22113 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:24.447395 22113 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:24.447913 18525 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:24.448323 22240 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.449065 19240 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:24.423204 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:24.456300 22240 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:24.459043 22240 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:24.459118 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:24.450852 19212 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:23:24.461019 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.462249 18678 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 6.
I20260709 12:23:24.420271 22185 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.459411 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:24.467018 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:24.467044 18572 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:24.411232 22226 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:24.469611 18603 raft_consensus.cc:2393] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 6: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:24.465013 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:24.464167 19212 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:24.439087 22239 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:24.474292 19244 raft_consensus.cc:2393] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 7: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:24.475893 18674 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:23:24.473874 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:24.468389 22185 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:24.478137 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:24.484193 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:24.486253 18525 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
W20260709 12:23:24.488644 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 74768.1us
I20260709 12:23:24.473840 22052 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:24.479803 22230 raft_consensus.cc:2804] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:24.474869 22240 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:24.504951 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 106687us
I20260709 12:23:24.505271 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:24.505538 18599 raft_consensus.cc:1275] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:23:24.487950 18427 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60812 (request call id 117) took 1409 ms. Trace:
I20260709 12:23:24.505961 22139 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.504987 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:24.474601 22113 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:24.524554 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:24.519208 18598 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
I20260709 12:23:24.522699 18572 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:24.501081 22152 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:24.484983 22239 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:23:24.505973 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:24.524864 18678 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:24.508000 22233 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:24.510627 22230 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.505273 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:24.536345 19212 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:24.543987 18424 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47714 (request call id 202) took 1675 ms. Trace:
I20260709 12:23:24.547837 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:24.548593 21785 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.548996 18524 raft_consensus.cc:2393] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 9: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:24.549294 21785 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:24.551972 21785 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:24.552980 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:24.553005 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:24.556423 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:24.556815 18526 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:24.558403 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:24.560181 18572 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:24.523218 18570 consensus_peers.cc:597] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 298b8c963d93464e999fee75e74e9781. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:24.564215 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 80625.9us
I20260709 12:23:24.566358 18494 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:24.566422 18671 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:24.536350 22230 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:24.537217 22152 raft_consensus.cc:697] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:24.573938 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:24.563232 21785 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:24.535420 22192 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:24.571563 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:24.568884 22232 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:24.577064 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:24.587716 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.588114 22173 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.591462 22173 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:24.583858 18600 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:23:24.593429 22229 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:24.594084 22229 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.594192 22173 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:24.594501 22229 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:24.595064 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:24.595929 18524 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
W20260709 12:23:24.600667 22252 log.cc:927] Time spent T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:23:24.600605 21785 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.600586 22152 consensus_queue.cc:237] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:24.601938 21785 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:24.610900 22096 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.611580 22096 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:24.614164 22096 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:24.616349 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:24.617093 22113 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:24.617215 18526 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:24.618986 22224 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:24.619700 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:24.620632 18522 raft_consensus.cc:2393] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 7: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:24.621024 22220 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:24.580358 22244 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:24.628108 22244 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.628577 22244 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:24.529141 22139 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:24.577291 22236 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:24.629948 22236 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.579710 22052 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:24.631470 22226 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:24.590116 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:24.634173 18521 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:24.630424 22236 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:24.589054 22256 log.cc:927] Time spent T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:23:24.587270 19239 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:24.632783 19210 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:24.564061 22233 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
W20260709 12:23:24.651042 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 115248us
I20260709 12:23:24.655359 22170 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:24.656170 22170 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:24.658793 21785 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:24.576226 22240 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:24.544512 18424 rpcz_store.cc:276] 0709 12:23:22.780154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.783414 (+  3260us) service_pool.cc:224] Handling call
0709 12:23:24.449729 (+1666315us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:23.928968 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:23.929484 (+   516us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:23.929504 (+    20us) write_op.cc:435] Acquired schema lock
0709 12:23:23.929515 (+    11us) tablet.cc:662] Decoding operations
0709 12:23:23.930068 (+   553us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:23.930105 (+    37us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:23.930122 (+    17us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:23:24.062805 (+132683us) tablet.cc:701] Row locks acquired
0709 12:23:24.062873 (+    68us) write_op.cc:260] PREPARE: finished
0709 12:23:24.063230 (+   357us) write_op.cc:270] Start()
0709 12:23:24.063458 (+   228us) write_op.cc:276] Timestamp: P: 1783599804063137 usec, L: 0
0709 12:23:24.063480 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:23:24.273574 (+210094us) log.cc:844] Serialized 3282 byte log entry
0709 12:23:24.284931 (+ 11357us) op_driver.cc:464] REPLICATION: finished
0709 12:23:24.285457 (+   526us) write_op.cc:301] APPLY: starting
0709 12:23:24.285558 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:24.285779 (+   221us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:24.285872 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:24.286873 (+  1001us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:24.287074 (+   201us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:23:24.287125 (+    51us) write_op.cc:312] APPLY: finished
0709 12:23:24.287400 (+   275us) log.cc:844] Serialized 65 byte log entry
0709 12:23:24.288231 (+   831us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:24.288368 (+   137us) write_op.cc:454] Released schema lock
0709 12:23:24.288418 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:24.322208 (+ 33790us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54002175d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dae28 00007efc7ff15581 00007efc7ff14d58 00007efc7ff199f1 00007efc7ff199a9 00007efc7ff19939 00007efc7ff19901 00007efc7ff18b2d 0000000000388634 0000000000388479
0709 12:23:24.322475 (+   267us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:24.322513 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":72929,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":258,"apply.run_cpu_time_us":2659,"apply.run_wall_time_us":3402,"mutex_wait_us":5223,"num_ops":8,"prepare.queue_time_us":863623,"prepare.run_cpu_time_us":10457,"prepare.run_wall_time_us":393414,"replication_time_us":221315,"spinlock_wait_cycles":332936064}]]}
I20260709 12:23:24.578848 22109 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:24.510530 18427 rpcz_store.cc:276] 0709 12:23:22.930412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.933441 (+  3029us) service_pool.cc:224] Handling call
0709 12:23:24.339658 (+1406217us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:23.204448 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:23.462907 (+258459us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:23.480565 (+ 17658us) write_op.cc:435] Acquired schema lock
0709 12:23:23.488754 (+  8189us) tablet.cc:662] Decoding operations
0709 12:23:23.638388 (+149634us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:23.651662 (+ 13274us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:23.656888 (+  5226us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:23:23.702610 (+ 45722us) tablet.cc:701] Row locks acquired
0709 12:23:23.702652 (+    42us) write_op.cc:260] PREPARE: finished
0709 12:23:23.818932 (+116280us) write_op.cc:270] Start()
0709 12:23:23.826683 (+  7751us) write_op.cc:276] Timestamp: P: 1783599803813638 usec, L: 0
0709 12:23:23.834907 (+  8224us) op_driver.cc:348] REPLICATION: starting
0709 12:23:23.872178 (+ 37271us) log.cc:844] Serialized 539 byte log entry
0709 12:23:24.050660 (+178482us) op_driver.cc:464] REPLICATION: finished
0709 12:23:24.270218 (+219558us) write_op.cc:301] APPLY: starting
0709 12:23:24.270390 (+   172us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:24.270588 (+   198us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:24.270756 (+   168us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:24.271899 (+  1143us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:24.272216 (+   317us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:23:24.272799 (+   583us) write_op.cc:312] APPLY: finished
0709 12:23:24.273144 (+   345us) log.cc:844] Serialized 23 byte log entry
0709 12:23:24.282750 (+  9606us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:24.282855 (+   105us) write_op.cc:454] Released schema lock
0709 12:23:24.282913 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:24.283630 (+   717us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:24.283682 (+    52us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":219189,"apply.run_cpu_time_us":2646,"apply.run_wall_time_us":13234,"num_ops":1,"prepare.queue_time_us":180987,"prepare.run_cpu_time_us":30380,"prepare.run_wall_time_us":751394,"raft.queue_time_us":34935,"raft.run_cpu_time_us":44054,"raft.run_wall_time_us":158896,"replication_time_us":213973,"thread_start_us":335891,"threads_started":4,"wal-append.queue_time_us":139217}]]}
I20260709 12:23:24.679163 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:24.680866 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:24.674726 18572 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:24.664390 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:24.679091 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:24.691442 18572 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:24.673400 18675 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:23:24.693717 18678 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
I20260709 12:23:24.689869 18603 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
W20260709 12:23:24.697304 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 161034us
I20260709 12:23:24.677538 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:24.698850 19246 raft_consensus.cc:2393] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 10: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:24.697340 18674 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:23:24.700690 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:24.699013 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:24.700242 18644 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:24.701368 18678 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:23:24.661376 22237 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:24.703362 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:24.668871 22192 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:24.670719 22139 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:24.706352 18597 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 13
W20260709 12:23:24.706679 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 69204.7us
I20260709 12:23:24.673171 22233 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:24.659678 22170 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:24.695433 22220 raft_consensus.cc:2804] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:24.713287 18680 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:24.705219 22227 raft_consensus.cc:2804] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:24.676009 22194 consensus_queue.cc:1048] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:23:24.732249 18600 raft_consensus.cc:2393] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 4: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:24.727982 18673 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:24.732262 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:24.737567 18530 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:24.735116 18675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:23:24.740051 18675 raft_consensus.cc:606] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Received request to transfer leadership to TS c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:24.740537 18675 raft_consensus.cc:614] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:24.715714 22220 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.755036 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:24.733826 22227 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.702415 22242 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:24.762213 18527 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:24.748562 22170 raft_consensus.cc:2804] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:24.744982 22192 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:24.765277 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 132565us
I20260709 12:23:24.755604 22220 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:24.763372 22227 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:24.771524 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.769452 22170 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.777256 18572 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:24.764117 22101 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.781193 22170 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:24.776242 22192 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:24.784801 22210 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:24.787001 18602 raft_consensus.cc:2393] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 7: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:24.787490 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:24.755189 22233 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:24.785907 18494 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:24.797228 18671 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:23:24.801594 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 101440us
I20260709 12:23:24.769814 22266 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.771806 22173 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.813809 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:24.814568 18527 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:23:24.818501 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:24.852629 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:24.852823 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 73611.6us
I20260709 12:23:24.853354 18673 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 3.
W20260709 12:23:24.853587 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 67851.7us
I20260709 12:23:24.851740 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:24.854776 18675 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:24.809350 22052 consensus_queue.cc:1059] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:23:24.851051 22240 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:24.861030 18570 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:24.856976 22239 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:24.899196 22233 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:24.818902 22215 consensus_queue.cc:1059] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:23:24.899895 22239 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:24.857463 22224 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:24.900290 22185 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:24.892014 22030 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.901376 22242 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:24.901584 22030 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:24.818300 22101 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:24.902736 18679 raft_consensus.cc:1240] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:23:24.879992 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:24.859266 22099 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:24.864341 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:24.905231 19244 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:24.866750 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:24.865581 22186 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:24.906112 19239 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:23:24.906560 22186 raft_consensus.cc:697] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:24.907269 22146 raft_consensus.cc:3055] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:23:24.905304 22267 log.cc:927] Time spent T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:23:24.904678 22099 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:24.881875 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.863899 22173 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:24.886163 18494 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:24.902143 22239 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:24.910511 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.907712 22146 raft_consensus.cc:740] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:24.907599 18677 raft_consensus.cc:1275] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:24.938520 18521 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:24.940969 18530 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
W20260709 12:23:24.866288 22263 log.cc:927] Time spent T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 12:23:24.865164 22259 log.cc:927] Time spent T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:23:24.945362 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:24.944517 18671 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:24.951793 19212 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
W20260709 12:23:24.952852 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 93725.3us
I20260709 12:23:24.952965 18603 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:23:24.907569 22186 consensus_queue.cc:237] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:24.954254 18570 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:24.954908 18674 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:24.954926 18644 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:24.937964 19210 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:24.956660 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:24.889334 22192 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:24.936561 22099 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:24.958998 18675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:23:24.959801 18675 raft_consensus.cc:606] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Received request to transfer leadership to TS c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:24.960402 18675 raft_consensus.cc:614] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:24.859356 22209 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.961593 18522 raft_consensus.cc:2393] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 7: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:24.961977 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:24.936364 22030 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:24.973982 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:24.975095 18644 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:24.968917 18572 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:24.976639 22237 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:24.977192 22237 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.977571 22237 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:24.980007 22192 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:24.980458 22192 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.980801 22192 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:24.982002 22279 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.982654 22279 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:24.976765 22160 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:24.816968 22266 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:24.986945 18597 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 13.
I20260709 12:23:24.988655 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:24.961510 22224 raft_consensus.cc:2804] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:24.990857 22276 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.992897 18570 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:24.990461 18527 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:23:24.961686 22240 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:24.994510 19210 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:24.996723 18644 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:24.999387 18521 raft_consensus.cc:2393] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 13: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:24.948521 22244 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:24.949560 22230 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:25.002372 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:25.009923 18526 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:23:25.003558 19212 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
W20260709 12:23:25.004096 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 203439us
I20260709 12:23:24.991515 22194 raft_consensus.cc:2804] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:24.988242 22160 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:24.991712 22096 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.041348 18570 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:25.001897 22224 raft_consensus.cc:697] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
W20260709 12:23:25.070463 22252 log.cc:927] Time spent T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:23:25.023479 22216 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:25.092317 22216 raft_consensus.cc:697] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:25.092634 22224 consensus_queue.cc:237] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:25.093658 22216 consensus_queue.cc:237] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:25.094784 22275 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.095451 22275 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:25.096374 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:25.071698 22233 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:24.992087 22209 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:25.086220 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 61598.6us
I20260709 12:23:25.060526 22160 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:25.060298 22194 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:25.092381 22285 raft_consensus.cc:2804] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:25.069566 22036 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:25.082717 18606 raft_consensus.cc:2393] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 10: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:24.995683 22240 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:25.000329 22232 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:25.081736 22242 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:24.998129 22276 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:25.130483 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:25.080294 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 194420us
I20260709 12:23:25.140293 22280 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.110827 22285 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:25.141490 22273 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:25.142129 22273 raft_consensus.cc:697] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:25.143903 22036 raft_consensus.cc:697] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:25.110821 22194 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:25.141458 22285 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:25.113961 22242 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:25.147789 22209 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:25.148267 22242 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:25.144855 22244 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:25.179241 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 67675.8us
I20260709 12:23:25.180385 18570 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:25.143077 22273 consensus_queue.cc:237] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:25.193532 21785 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:25.114488 22240 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:25.075973 22146 consensus_queue.cc:260] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:25.218923 19244 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 13.
I20260709 12:23:25.151054 22279 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:25.179086 22233 raft_consensus.cc:697] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:25.226394 18646 leader_election.cc:336] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.529s (SENT)
I20260709 12:23:25.230425 18646 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:25.208926 22185 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:25.220222 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:25.109592 22096 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:25.236352 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 54392us
I20260709 12:23:25.239068 18570 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:25.218097 18494 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:25.229288 22236 consensus_meta.cc:287] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.536s	user 0.006s	sys 0.005s
I20260709 12:23:25.141001 22280 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:25.247618 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 69672.1us
I20260709 12:23:25.248521 22230 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:25.250080 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:25.251871 22145 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:25.252741 22292 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:25.254457 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:25.256326 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:25.257167 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:25.257951 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
W20260709 12:23:25.262530 22278 log.cc:927] Time spent T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:23:25.263317 22289 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.263988 22209 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.309316 22289 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:25.309902 22209 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:25.311197 22229 consensus_meta.cc:287] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.716s	user 0.008s	sys 0.005s
I20260709 12:23:25.264504 22275 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:25.311905 22289 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:25.311659 22229 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:25.265035 22281 raft_consensus.cc:2804] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:25.316740 22281 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:25.317322 22281 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:25.272080 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:25.318061 18603 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4.
I20260709 12:23:25.272382 22266 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:25.274925 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:25.278898 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:25.270849 22099 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:25.323958 22099 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:25.327235 22229 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:25.298563 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 84485.4us
W20260709 12:23:25.312486 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:25.335628 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:25.300100 22292 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:25.337772 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:25.337917 22292 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:25.338474 18675 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 5.
I20260709 12:23:25.339370 22096 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:25.144897 22036 consensus_queue.cc:237] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:25.300479 18679 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:23:25.339520 18646 leader_election.cc:336] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.539s (SENT)
I20260709 12:23:25.264707 22279 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.344031 22285 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:25.344377 22233 consensus_queue.cc:237] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:25.346414 22276 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:25.347127 22292 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:25.272096 22294 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:25.285395 22185 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:25.300211 22145 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:25.436285 18494 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:25.408519 22281 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:25.411195 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:25.460145 18671 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
I20260709 12:23:25.412670 18646 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:25.426823 18679 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:23:25.246909 22170 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:25.455286 19246 raft_consensus.cc:2393] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 5: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:25.453616 18526 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:25.351858 22173 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:25.457156 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 107363us
I20260709 12:23:25.288456 22236 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:25.474298 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 62018.6us
I20260709 12:23:25.451401 22145 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:25.451973 22209 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:25.747464 22242 consensus_meta.cc:287] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.577s	user 0.010s	sys 0.000s
I20260709 12:23:25.764818 18572 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:23:25.645938 22220 consensus_meta.cc:287] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.851s	user 0.010s	sys 0.002s
W20260709 12:23:25.751250 22194 consensus_meta.cc:287] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.606s	user 0.011s	sys 0.000s
I20260709 12:23:25.765785 21785 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:25.766088 22220 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:25.767284 22281 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:25.767300 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:25.509023 22173 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:25.768395 18524 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
W20260709 12:23:25.749305 22160 consensus_meta.cc:287] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.639s	user 0.011s	sys 0.000s
I20260709 12:23:25.556562 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:25.518139 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:25.682726 18602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39798 (request call id 437) took 1238 ms. Trace:
I20260709 12:23:25.770051 18527 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:23:25.649794 22280 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:25.769804 22160 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:25.517215 19241 raft_consensus.cc:2393] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 8: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
W20260709 12:23:25.556401 22265 log.cc:927] Time spent T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:23:25.484325 18494 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:25.773011 22160 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:25.773061 22286 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:25.773746 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 289513us
W20260709 12:23:25.768893 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 429410us
I20260709 12:23:25.768488 22170 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:25.770105 18525 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 6.
I20260709 12:23:25.765911 22194 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:25.764425 22242 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:25.494347 18678 raft_consensus.cc:2393] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 10: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:25.484349 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:25.556165 18672 raft_consensus.cc:1275] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:23:25.770123 18602 rpcz_store.cc:276] 0709 12:23:24.444715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.444864 (+   149us) service_pool.cc:224] Handling call
0709 12:23:25.682423 (+1237559us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54002242d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:25.682605 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712758144}
I20260709 12:23:25.824424 18526 raft_consensus.cc:3060] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:25.784479 18572 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:25.534618 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:25.483616 22237 consensus_meta.cc:287] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.003s
W20260709 12:23:25.482163 22192 consensus_meta.cc:287] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.501s	user 0.012s	sys 0.000s
I20260709 12:23:25.462932 22279 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:25.497706 22227 consensus_meta.cc:287] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.708s	user 0.011s	sys 0.001s
I20260709 12:23:25.516176 22052 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:25.612177 22285 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:25.817198 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 2199) took 1046 ms. Trace:
I20260709 12:23:25.556588 22289 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.511421 19210 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:25.789361 22292 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:25.828516 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:25.800257 22240 consensus_meta.cc:287] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.004s
I20260709 12:23:25.468721 22146 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:25.832257 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 48010.4us
I20260709 12:23:25.833207 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:25.793190 22186 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:25.843565 18599 raft_consensus.cc:1240] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 6. Current term is 7. Ops: []
W20260709 12:23:25.844825 18646 leader_election.cc:336] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.610s (SENT)
W20260709 12:23:25.846648 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:25.849876 18525 raft_consensus.cc:2393] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 10: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:25.846472 18526 raft_consensus.cc:2468] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:23:25.845566 18674 rpcz_store.cc:276] 0709 12:23:24.761526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.818033 (+ 56507us) service_pool.cc:224] Handling call
0709 12:23:25.803542 (+985509us) spinlock_profiling.cc:243] Waited 50.3 ms on lock 0x7b540038b654. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:25.803651 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115626368}
W20260709 12:23:25.850812 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 339479us
I20260709 12:23:25.853514 19210 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:25.839897 22160 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:25.832526 22294 raft_consensus.cc:697] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:25.854681 19210 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:25.851006 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:25.854351 18646 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:25.847731 22289 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:25.818349 22286 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:25.849689 22220 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:25.856462 22233 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.857103 22285 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:25.851711 22052 raft_consensus.cc:697] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:25.866585 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:25.840049 22192 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:25.869305 18494 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:25.870296 22152 raft_consensus.cc:2804] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:25.834949 22237 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:25.860687 22036 raft_consensus.cc:2804] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:25.873418 18602 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:25.845789 22227 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:25.859324 22186 raft_consensus.cc:697] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:25.850209 22240 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:25.878571 22310 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:25.877457 22194 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:25.865553 22170 raft_consensus.cc:2749] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:25.867180 22160 raft_consensus.cc:697] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:25.886487 18600 raft_consensus.cc:1275] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:25.874619 22285 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:25.911231 19240 raft_consensus.cc:2393] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 9: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:25.875669 22036 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:25.876251 22233 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:25.886509 22215 raft_consensus.cc:3055] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:25.887058 22299 ts_tablet_manager.cc:933] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:25.921109 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 80809.2us
I20260709 12:23:25.882438 22152 raft_consensus.cc:697] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:25.912173 22285 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:25.915418 22036 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:25.914899 22224 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:25.930842 22309 log.cc:927] Time spent T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 12:23:25.931489 22307 log.cc:927] Time spent T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:23:25.932052 22242 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:25.953684 18602 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 5.
I20260709 12:23:25.932801 22052 consensus_queue.cc:237] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:25.934089 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:25.934826 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:25.935511 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:25.935935 22233 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:25.936102 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:25.937044 22227 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:25.939149 22237 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:25.922570 22215 raft_consensus.cc:740] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:25.940779 22286 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:25.942041 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:25.926819 22294 consensus_queue.cc:237] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:25.945467 22277 log.cc:927] Time spent T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 1.088s	user 0.003s	sys 0.013s
I20260709 12:23:25.945362 22218 consensus_queue.cc:1048] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:25.848691 22209 raft_consensus.cc:2955] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:23:25.945947 22152 consensus_queue.cc:237] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:25.950268 22186 consensus_queue.cc:237] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:25.982983 22215 consensus_queue.cc:260] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:25.984155 22215 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:25.947965 22160 consensus_queue.cc:237] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:25.949620 22236 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:25.932647 22289 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:25.965024 22192 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:25.995193 22192 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:25.995852 22194 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:25.996217 22192 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:25.996496 22194 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:25.998590 22194 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:25.998661 22192 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:25.999059 22274 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:25.999702 22274 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:26.001808 22274 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:26.004515 22240 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:26.008033 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:23:26.010586 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:25.980216 22101 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:26.016708 18572 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:26.020280 22233 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:26.020933 22233 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.020179 18427 catalog_manager.cc:5697] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 3 to 4, leader changed from 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 4 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:26.021343 22233 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:26.024471 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:26.024995 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:26.025373 18679 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:23:26.025803 18674 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
W20260709 12:23:25.965524 22304 log.cc:927] Time spent T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:23:25.965905 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:25.966424 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:25.966804 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:25.967670 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:23:25.967904 18646 leader_election.cc:336] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.625s (SENT)
I20260709 12:23:26.031273 18646 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:25.968721 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:25.967717 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:25.977541 18522 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:26.033120 18597 raft_consensus.cc:2393] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 8: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:25.973208 19210 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:25.980461 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:26.027526 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:26.037510 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 64383.2us
I20260709 12:23:26.022280 18427 catalog_manager.cc:5697] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 7 to 8, leader changed from 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 8 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:26.041620 18528 raft_consensus.cc:2393] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 9: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:26.044554 18570 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:26.036047 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:26.053395 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:26.056154 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:26.057206 18602 raft_consensus.cc:2393] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 10: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:26.054117 18674 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:23:26.054164 18572 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:26.096818 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:26.098239 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:26.098850 18679 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 4.
I20260709 12:23:26.062016 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:26.100361 18427 catalog_manager.cc:5697] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:26.102842 18644 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:26.104239 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:26.104979 18597 raft_consensus.cc:2393] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 10: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
W20260709 12:23:26.105229 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 46371.2us
I20260709 12:23:26.101303 18671 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
W20260709 12:23:26.108314 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 140495us
I20260709 12:23:26.108633 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:26.098763 18521 raft_consensus.cc:2955] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:23:26.109279 18523 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:26.057597 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:26.113287 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:26.110296 18672 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:26.108146 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:26.112672 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:26.055555 22236 consensus_queue.cc:1059] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
W20260709 12:23:26.166215 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 297038us
I20260709 12:23:26.168164 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:26.043607 22218 raft_consensus.cc:2804] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:23:26.161749 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 52622.2us
W20260709 12:23:26.161947 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 108067us
I20260709 12:23:26.170527 21785 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:26.171890 18606 raft_consensus.cc:2368] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:23:26.062649 22273 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:26.097818 22101 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:26.174542 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:26.113314 18427 catalog_manager.cc:5697] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 5 to 6, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 6 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:26.181552 21785 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:26.104076 22194 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.962517 22224 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:26.112510 22170 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:26.186800 18675 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:23:26.185297 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:26.054112 22274 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:26.200757 18677 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:26.206161 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:26.208026 18646 leader_election.cc:336] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.626s (SENT)
I20260709 12:23:26.208498 18646 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:26.208859 18672 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:26.189704 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:26.202080 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:26.210271 18674 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:26.211580 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:26.212769 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:26.213359 18671 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:26.215396 18606 raft_consensus.cc:2393] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 9: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:26.227700 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:26.115603 22227 consensus_queue.cc:1059] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 12:23:26.230314 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:26.232103 18529 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:23:26.186120 22101 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:26.231448 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:26.234048 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 2196) took 1471 ms. Trace:
I20260709 12:23:26.235006 18677 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:26.235147 18678 rpcz_store.cc:276] 0709 12:23:24.755800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.818235 (+ 62435us) service_pool.cc:224] Handling call
0709 12:23:26.227005 (+1408770us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b540039fb54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:26.227143 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1552336256}
I20260709 12:23:26.242547 18644 leader_election.cc:400] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:23:26.243867 18644 leader_election.cc:403] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:23:26.196142 22315 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.214195 22218 raft_consensus.cc:697] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:26.255554 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:26.198765 22306 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:26.183195 22299 tablet_copy_client.cc:323] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.130:37079
I20260709 12:23:26.260251 18521 raft_consensus.cc:1275] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:26.261212 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:26.262144 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:26.263679 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:26.266636 18672 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:26.268150 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:26.268798 18680 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:26.270470 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:26.271166 18678 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:26.273324 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 73634.3us
I20260709 12:23:26.274470 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:26.275125 18676 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:26.276047 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:26.276607 18676 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:23:26.276783 18672 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:26.277451 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:26.277817 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:26.278429 18672 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:26.282109 19241 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:26.284062 22306 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:26.286298 22306 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:26.287194 18530 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57384 (request call id 2495) took 1329 ms (client timeout 1585 ms). Trace:
I20260709 12:23:26.287545 18672 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
W20260709 12:23:26.287655 18530 rpcz_store.cc:269] 0709 12:23:24.958019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.958497 (+   478us) service_pool.cc:224] Handling call
0709 12:23:26.286981 (+1328484us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b540009a1d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:26.287108 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1865030912}
I20260709 12:23:26.213125 22194 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:26.293229 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:26.294396 22194 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:26.294755 18672 raft_consensus.cc:2393] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 10: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:26.241930 22101 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:26.253402 22240 raft_consensus.cc:3055] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:26.300344 22272 raft_consensus.cc:3055] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:26.300614 22240 raft_consensus.cc:740] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:26.300902 22224 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:26.301049 22272 raft_consensus.cc:740] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:26.301589 22240 consensus_queue.cc:260] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:26.303118 22240 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:26.305866 22036 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:26.308257 22036 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:26.310113 18671 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 5.
I20260709 12:23:26.310801 22170 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 4. Current term is 5.
I20260709 12:23:26.241065 22273 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:26.294414 18680 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
W20260709 12:23:26.317572 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.317749 18522 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:26.318857 18678 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:23:26.319489 18679 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:26.321916 18674 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:26.322427 18676 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:26.331192 18523 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:26.331398 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:26.332468 18529 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
W20260709 12:23:26.333882 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.336540 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:26.337186 18572 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:26.337376 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:26.338467 18680 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:23:26.345809 21785 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:26.346377 21785 raft_consensus.cc:697] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:26.348127 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 147302us
I20260709 12:23:26.348198 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:26.235703 22139 consensus_queue.cc:1048] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 12:23:26.349098 18494 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:26.349548 18604 raft_consensus.cc:1275] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:26.349601 22285 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:26.350608 22215 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:26.351074 18494 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:26.341809 22273 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:23:26.353704 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:26.354357 18600 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:26.355978 22215 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:26.337415 18522 raft_consensus.cc:2393] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 9: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
W20260709 12:23:26.362987 22146 consensus_meta.cc:287] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.000s
I20260709 12:23:26.229724 22274 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:26.220259 22145 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:26.366559 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.366254 18680 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
I20260709 12:23:26.347462 18572 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:26.367277 22224 consensus_queue.cc:1048] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:23:26.383137 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.367615 21785 consensus_queue.cc:237] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:26.369980 19212 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:26.371877 18646 leader_election.cc:336] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.681s (SENT)
I20260709 12:23:26.372450 22285 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:26.384377 18677 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:26.373346 18675 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:26.387096 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:26.387634 18675 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:23:26.390661 18646 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:26.386575 18572 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:26.387423 18644 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:26.392287 19212 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:26.378162 22286 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:26.418149 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 67191.6us
I20260709 12:23:26.416088 22237 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:26.416488 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:26.424371 18527 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:26.421753 18600 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:26.328096 22315 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:26.384140 22194 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:26.400542 22227 raft_consensus.cc:2804] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:26.456794 18675 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
I20260709 12:23:26.457849 18494 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:26.458642 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.418083 22220 raft_consensus.cc:2804] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:26.417506 22273 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:26.413206 22296 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:26.463340 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:26.467535 18524 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:26.428231 22110 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:23:26.469303 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.527496 18570 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:26.530663 18604 raft_consensus.cc:1240] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:23:26.533281 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:26.540426 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 82679.8us
I20260709 12:23:26.467022 22273 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:26.546195 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 174366us
I20260709 12:23:26.428432 22286 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:26.530716 22220 raft_consensus.cc:697] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:26.468753 22194 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:26.549471 22220 consensus_queue.cc:237] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:26.550506 22194 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:26.554744 22233 consensus_meta.cc:287] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.000s
W20260709 12:23:26.555006 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 84666.6us
I20260709 12:23:26.555840 22274 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:26.470112 22306 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 12:23:26.471866 22227 raft_consensus.cc:697] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:26.558426 22322 log.cc:927] Time spent T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:23:26.531342 22146 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:26.570482 18527 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
W20260709 12:23:26.571779 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 44332.4us
I20260709 12:23:26.579276 18570 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:26.580847 18494 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:26.581081 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:26.562062 22273 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:26.579644 19212 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:26.585083 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:26.585938 18646 leader_election.cc:336] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.742s (SENT)
I20260709 12:23:26.589597 18570 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:26.580734 22287 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:26.592173 22287 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:26.592557 22287 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:26.596031 22237 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:26.596872 22237 raft_consensus.cc:697] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:26.598169 22237 consensus_queue.cc:237] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:26.579965 22317 log.cc:927] Time spent T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:23:26.587797 18646 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:26.563524 22311 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:26.462580 22218 consensus_queue.cc:237] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:26.579516 22209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:39794 (request call id 13) took 3358 ms. Trace:
I20260709 12:23:26.606462 22293 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:26.613523 18524 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
I20260709 12:23:26.616477 19212 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:26.613986 22293 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:26.621996 22293 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:26.576269 22233 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:26.625425 22233 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:26.628561 22325 log.cc:927] Time spent T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:23:26.628150 22227 consensus_queue.cc:237] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:26.633685 22145 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:26.634265 22323 log.cc:927] Time spent T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:23:26.637925 18525 raft_consensus.cc:1275] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:26.611032 22209 rpcz_store.cc:276] 0709 12:23:23.221344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.226230 (+  4886us) service_pool.cc:224] Handling call
0709 12:23:23.489518 (+263288us) log.cc:844] Serialized 513 byte log entry
0709 12:23:24.088259 (+598741us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b18002ffa40. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793f23f3 00007efc793f47c1 00007efc793f4779 00007efc793f4709 00007efc793f46d1 00007efc793f39cd 0000000000388634 0000000000388479 00007efc793d583a
0709 12:23:24.179780 (+ 91521us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b18002ffa40. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793f23f3 00007efc793f47c1 00007efc793f4779 00007efc793f4709 00007efc793f46d1 00007efc793f39cd 0000000000388634 0000000000388479 00007efc793d583a
0709 12:23:26.579390 (+2399610us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8796,"raft.queue_time_us":147825,"raft.run_cpu_time_us":2853,"raft.run_wall_time_us":2849,"spinlock_wait_cycles":66128512,"thread_start_us":167841,"threads_started":1,"wal-append.queue_time_us":315454,"wal-append.run_cpu_time_us":1818,"wal-append.run_wall_time_us":1010127}
I20260709 12:23:26.639894 22109 consensus_queue.cc:1048] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:23:26.641220 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 64391.4us
W20260709 12:23:26.641980 18646 leader_election.cc:336] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.757s (SENT)
I20260709 12:23:26.642375 18646 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:26.644718 22110 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:26.607262 22281 raft_consensus.cc:2764] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:23:26.649288 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:26.643630 18646 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.775s (SENT) [suppressed 25 similar messages]
I20260709 12:23:26.613809 18616 tablet_copy_service.cc:140] P c7bd71f1f37c45f28b52c154e59356b9: Received BeginTabletCopySession request for tablet 298b8c963d93464e999fee75e74e9781 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:39798)
W20260709 12:23:26.652223 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 85136.4us
I20260709 12:23:26.674533 18494 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:26.675767 18676 raft_consensus.cc:1275] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:26.619285 22274 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:26.671525 22293 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:26.664111 22285 raft_consensus.cc:2804] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:23:26.677559 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 86382.5us
I20260709 12:23:26.615017 22311 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:26.692233 18570 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:26.689507 22215 raft_consensus.cc:2764] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:23:26.698522 18570 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:26.676779 18616 tablet_copy_service.cc:161] P c7bd71f1f37c45f28b52c154e59356b9: Beginning new tablet copy session on tablet 298b8c963d93464e999fee75e74e9781 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:39798: session id = 8c29c312e4544452b1162d7f81a58cb4-298b8c963d93464e999fee75e74e9781
I20260709 12:23:26.700335 22145 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:26.706933 18570 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:26.695518 22294 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:26.712088 18570 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:26.717041 18570 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:26.719726 18570 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:23:26.719858 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 45485.4us
W20260709 12:23:26.720438 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 76850.9us
I20260709 12:23:26.697866 22285 raft_consensus.cc:697] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:26.712594 22290 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:26.708880 22145 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.718014 22292 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:26.722172 22220 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:23:26.731608 18646 leader_election.cc:336] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.780s (SENT)
I20260709 12:23:26.730336 22227 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:26.732820 22101 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:26.736054 18494 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:26.735531 18646 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:26.737026 22110 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:26.737423 18494 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:26.739382 18602 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:26.730037 22290 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:26.743186 18646 leader_election.cc:336] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.785s (SENT)
I20260709 12:23:26.743848 22101 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:26.751849 22331 log.cc:927] Time spent T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:23:26.769076 22285 consensus_queue.cc:237] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:26.752526 22286 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:26.734041 22220 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.745606 22227 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.771862 22220 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:26.772310 22227 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:26.729893 22145 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:26.728902 22335 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:26.764715 18646 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:26.732156 22292 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.773962 18602 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
W20260709 12:23:26.915298 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:27.497185 18570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.012s	sys 0.040s
I20260709 12:23:27.641444 22346 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:27.757663 18570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.012s	sys 0.040s
W20260709 12:23:27.758334 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 1.0386e+06us
I20260709 12:23:27.758073 22346 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:27.759315 18570 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:27.760480 22346 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:27.716602 22345 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:26.834455 22145 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:27.310554 22109 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.834885 22220 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:26.838162 22227 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:26.818819 22273 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.095196 22220 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:28.095634 22227 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:28.096529 22273 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:28.096793 22173 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:28.097182 22273 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:28.097383 22173 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.097730 22273 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.099102 22173 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:27.712095 22272 consensus_queue.cc:260] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:28.102428 22272 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:26.819319 22279 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:27.472589 22285 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:28.111734 22285 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:28.114202 22285 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:26.813784 22287 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:26.774256 22290 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:28.172029 22286 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:28.174957 22286 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:26.781004 22292 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:28.176568 19244 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 549) took 2136 ms (client timeout 1822 ms). Trace:
W20260709 12:23:28.177189 19244 rpcz_store.cc:269] 0709 12:23:26.040616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.040737 (+   121us) service_pool.cc:224] Handling call
0709 12:23:28.176261 (+2135524us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b5400530f54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:28.176455 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1425423232}
I20260709 12:23:26.812559 22311 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:26.781616 22335 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.182727 22335 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:26.814952 22337 log.cc:927] Time spent T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:23:27.761292 22345 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:27.764698 22347 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:27.769754 18570 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:23:28.187644 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 418115us
I20260709 12:23:28.188377 22345 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:27.879767 22346 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:28.188797 18570 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:28.189356 22346 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:28.190003 18570 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:28.190785 22227 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:27.920909 22351 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.982649 18525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 748) took 1339 ms. Trace:
I20260709 12:23:28.020709 22226 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:28.021564 22349 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.020951 18616 tablet_copy_source_session.cc:215] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:28.040693 22352 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:23:28.042027 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:28.051190 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 1.31375e+06us
I20260709 12:23:28.054155 22146 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:28.056479 22215 raft_consensus.cc:2764] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:23:28.057797 22350 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:28.060753 22145 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:28.071363 22315 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:28.086475 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 1.34323e+06us
I20260709 12:23:28.086534 22274 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:28.087960 22110 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:28.205567 18494 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:28.206104 22110 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.194483 22281 raft_consensus.cc:2804] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:28.207408 22281 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.207782 22281 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:28.208334 22110 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:28.089047 22306 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:28.209101 22306 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.199072 22349 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:28.211195 22306 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:28.089530 22194 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.211974 22194 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.212546 22349 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:28.194329 22279 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:28.213402 22279 raft_consensus.cc:697] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:28.214154 22194 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:28.090953 22109 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:28.214366 22279 consensus_queue.cc:237] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.093182 22353 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:28.099634 22220 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:28.100126 22173 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:28.116464 18529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 745) took 1700 ms. Trace:
I20260709 12:23:28.124507 22273 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:28.224920 22220 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:28.127347 22344 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.225711 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:28.225855 22344 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:28.226482 18528 raft_consensus.cc:2393] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 7: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:28.227156 22220 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:28.227808 22215 raft_consensus.cc:2764] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:23:28.228019 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:28.130215 18672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2231) took 1864 ms. Trace:
I20260709 12:23:28.228907 18521 raft_consensus.cc:2393] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 13: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:28.131837 22354 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:28.133729 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:28.134418 22170 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:28.138660 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:23:28.140216 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.141752 22355 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:28.141861 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:28.143229 18602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40948 (request call id 2084) took 2038 ms (client timeout 2111 ms). Trace:
I20260709 12:23:28.162726 22332 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:28.164642 22294 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:28.165135 22052 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:28.165524 22186 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.173837 22287 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:28.174194 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:28.176698 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:28.181530 18527 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:26.796693 22293 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:28.344383 22052 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.192170 18570 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:23:28.346222 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 154095us
I20260709 12:23:28.346909 18570 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:28.347119 22052 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:28.194633 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.341853 22294 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.191421 22346 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:28.348742 22293 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:28.349241 22293 raft_consensus.cc:697] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:28.191854 18525 rpcz_store.cc:276] 0709 12:23:26.643179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.643416 (+   237us) service_pool.cc:224] Handling call
0709 12:23:26.643844 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:26.645339 (+  1495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.645374 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:26.645939 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 12:23:26.721196 (+ 75257us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:26.721247 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.721329 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:27.982240 (+1260911us) raft_consensus.cc:1685] finished
0709 12:23:27.982268 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:27.982491 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":927,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":74838,"threads_started":1,"wal-append.queue_time_us":135257,"wal-append.run_cpu_time_us":3276,"wal-append.run_wall_time_us":1007941}
I20260709 12:23:28.350090 22293 consensus_queue.cc:237] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.350585 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:28.351001 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:28.351293 18525 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:28.204074 18616 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:39798 (request call id 462) took 1830 ms. Trace:
I20260709 12:23:28.203680 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:28.352537 18530 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:28.352325 18616 rpcz_store.cc:276] 0709 12:23:26.420176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.541320 (+121144us) service_pool.cc:224] Handling call
0709 12:23:28.203977 (+1662657us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:28.352902 22220 raft_consensus.cc:2804] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:28.353467 22220 raft_consensus.cc:697] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:28.354307 22220 consensus_queue.cc:237] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.198153 22351 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:28.204221 22352 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:28.357419 22351 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:28.340129 22315 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:28.352221 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:28.358042 22352 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:28.205080 18646 leader_election.cc:336] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.879s (SENT)
I20260709 12:23:28.358141 22315 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:28.359181 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 154244us
W20260709 12:23:28.359900 18646 leader_election.cc:336] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.880s (SENT)
I20260709 12:23:28.360262 18646 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:28.360463 22315 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:28.342896 22194 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:23:28.361465 18646 leader_election.cc:336] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.902s (SENT)
I20260709 12:23:28.361542 22194 raft_consensus.cc:2749] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:28.361903 18646 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:28.343078 22146 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:28.352620 18570 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:28.223598 22109 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:28.362864 22146 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.220046 22350 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:28.335500 22273 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.365504 22350 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:28.223999 22353 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.365893 22273 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:28.224493 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:28.203825 22226 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:28.224766 22173 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.228237 18528 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:28.133203 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:28.248914 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.332366 22344 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:28.332930 22354 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:28.268720 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 102286us
I20260709 12:23:28.334087 22290 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.221470 18529 rpcz_store.cc:276] 0709 12:23:26.415982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.429283 (+ 13301us) service_pool.cc:224] Handling call
0709 12:23:26.461203 (+ 31920us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:26.528601 (+ 67398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.528649 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:26.540691 (+ 12042us) log.cc:844] Serialized 26 byte log entry
0709 12:23:26.684180 (+143489us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:26.684246 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.684358 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:28.116218 (+1431860us) raft_consensus.cc:1685] finished
0709 12:23:28.116241 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:28.116399 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2665,"raft.queue_time_us":61726,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":9577,"thread_start_us":101886,"threads_started":1,"wal-append.queue_time_us":174700,"wal-append.run_cpu_time_us":17064,"wal-append.run_wall_time_us":1257219}
I20260709 12:23:28.267359 22286 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:28.335523 18599 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:28.336123 18602 rpcz_store.cc:269] 0709 12:23:26.105348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.112932 (+  7584us) service_pool.cc:224] Handling call
0709 12:23:28.143032 (+2030100us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b5400246dd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:28.143161 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1311628160}
I20260709 12:23:28.336875 18606 raft_consensus.cc:2368] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8.
I20260709 12:23:28.334666 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:28.337754 18523 raft_consensus.cc:1275] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:28.229014 18672 rpcz_store.cc:276] 0709 12:23:26.265551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.299238 (+ 33687us) service_pool.cc:224] Handling call
0709 12:23:26.299516 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.391988 (+ 92472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.392015 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:26.392064 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:26.392111 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:28.129924 (+1737813us) spinlock_profiling.cc:243] Waited 92.2 ms on lock 0x7b54003a1454. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:28.129974 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:28.130120 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212118272}
W20260709 12:23:28.340417 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 198634us
I20260709 12:23:28.342054 18494 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:28.343580 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:28.343820 21785 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.343953 22227 raft_consensus.cc:697] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:28.369836 18530 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:28.322469 22347 raft_consensus.cc:697] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:28.370990 22311 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.374230 22215 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:28.341284 22186 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:28.385728 21785 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:28.365509 22146 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:28.372216 22306 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.371315 22110 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:28.391983 18570 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:28.382100 22351 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:28.392470 22358 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:28.392524 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 55380.8us
I20260709 12:23:28.371047 22335 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.339895 22170 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.375792 22194 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:28.398810 22186 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:28.398903 22226 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:28.399406 22145 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:28.394788 22311 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.403394 21785 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:28.408720 18599 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:28.401829 18572 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:28.414968 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:28.422387 18675 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:23:28.423367 22347 consensus_queue.cc:237] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.425410 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:28.421183 22344 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:28.426020 18671 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:23:28.426249 22344 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:28.427476 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.434154 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:28.341917 22332 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:28.435966 18680 raft_consensus.cc:1275] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:23:28.443583 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.451545 18674 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:23:28.455760 18675 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:28.456087 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:28.456802 18674 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:23:28.396204 22052 raft_consensus.cc:2764] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:23:28.398903 22273 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:28.412218 22146 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:28.464422 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:28.464612 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:28.465167 18677 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:28.459857 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:28.467586 18680 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:28.465185 18672 raft_consensus.cc:2368] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8.
I20260709 12:23:28.460002 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:28.341003 22355 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.473371 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:28.476019 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:28.396646 22215 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.421706 22351 raft_consensus.cc:697] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:28.427037 22349 raft_consensus.cc:2764] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:23:28.474174 19246 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:28.478289 19247 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:28.480930 18675 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:28.446513 22226 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:28.408226 22306 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.488863 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:28.489565 18677 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
W20260709 12:23:28.485989 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 99207us
I20260709 12:23:28.486200 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:28.490502 18678 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:28.483247 18674 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:28.491261 18680 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 14.
I20260709 12:23:28.492724 18671 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:28.473186 22361 raft_consensus.cc:2804] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:28.508443 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:28.473109 22353 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:28.446059 22194 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.514001 22306 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:28.514647 18676 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:28.478242 22146 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:28.518035 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:28.485507 22345 consensus_queue.cc:1048] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:23:28.418165 22358 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:28.519924 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:28.526081 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:28.636670 18677 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:23:28.522330 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:28.637421 18675 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:23:28.529018 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:28.511121 22361 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:28.640030 22361 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:28.596347 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 213082us
I20260709 12:23:28.526659 18678 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:28.644855 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:28.651433 18677 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
W20260709 12:23:28.644071 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 136676us
I20260709 12:23:28.655905 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:28.522127 22356 log.cc:927] Time spent T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:23:28.662931 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:28.669130 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:28.506383 22346 consensus_queue.cc:1048] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.157s
I20260709 12:23:28.693199 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:28.524140 22351 consensus_queue.cc:237] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.523986 22173 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:28.691468 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:28.523471 22170 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:28.698228 18521 raft_consensus.cc:1275] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:28.698975 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:28.699572 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:28.699821 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 100373us
I20260709 12:23:28.700368 18599 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
I20260709 12:23:28.488821 22227 consensus_queue.cc:237] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:28.670416 18646 leader_election.cc:336] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.825s (SENT)
I20260709 12:23:28.520645 22290 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:28.523730 22344 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:28.705739 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:28.506656 22226 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:28.709383 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:28.522137 22355 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:28.706707 18600 raft_consensus.cc:1275] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:28.736675 18523 raft_consensus.cc:2393] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 10: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:28.708971 19210 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:28.710616 22215 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:28.710734 22311 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:28.745776 22376 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:28.746251 22376 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:28.746671 22376 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:28.747989 18606 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:23:28.711738 22332 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:28.713174 22146 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:28.716106 22358 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:28.657074 22375 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:28.717381 22354 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:28.717950 22294 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:28.719530 18672 raft_consensus.cc:1275] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:28.724376 22335 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:28.725320 22194 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:28.728710 18530 raft_consensus.cc:1275] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:28.728001 18570 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:28.707041 18646 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:28.719589 22281 consensus_meta.cc:287] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.001s
I20260709 12:23:28.752417 18600 raft_consensus.cc:1240] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:28.716632 22292 consensus_meta.cc:287] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.540s	user 0.008s	sys 0.001s
W20260709 12:23:28.755501 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 281019us
W20260709 12:23:28.750686 18701 debug-util.cc:398] Leaking SignalData structure 0x7b08000a5240 after lost signal to thread 17349
W20260709 12:23:28.765408 18701 debug-util.cc:398] Leaking SignalData structure 0x7b08001acc80 after lost signal to thread 18461
W20260709 12:23:28.766484 18701 debug-util.cc:398] Leaking SignalData structure 0x7b08001ddd80 after lost signal to thread 18554
W20260709 12:23:28.766739 18701 debug-util.cc:398] Leaking SignalData structure 0x7b08001fc7c0 after lost signal to thread 18555
W20260709 12:23:28.767580 18701 debug-util.cc:398] Leaking SignalData structure 0x7b0800368e80 after lost signal to thread 18630
W20260709 12:23:28.768525 18701 debug-util.cc:398] Leaking SignalData structure 0x7b080039efa0 after lost signal to thread 18705
W20260709 12:23:28.768882 18701 debug-util.cc:398] Leaking SignalData structure 0x7b080035ada0 after lost signal to thread 18706
W20260709 12:23:28.770478 18701 debug-util.cc:398] Leaking SignalData structure 0x7b08003acd20 after lost signal to thread 19274
W20260709 12:23:28.770731 18701 debug-util.cc:398] Leaking SignalData structure 0x7b0800330b60 after lost signal to thread 19275
I20260709 12:23:28.772399 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:28.772171 19212 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:28.775287 18570 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:28.756268 22358 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.779253 18570 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:28.781767 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:28.798722 18673 raft_consensus.cc:1240] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:28.914741 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:28.915680 19243 raft_consensus.cc:2410] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:23:28.844355 18602 raft_consensus.cc:1240] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 6. Current term is 8. Ops: []
I20260709 12:23:28.916234 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:28.869170 18672 raft_consensus.cc:1240] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:28.844529 18604 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 12. Current term is 14. Ops: []
I20260709 12:23:28.917366 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:28.917459 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:28.917680 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:28.918069 18671 raft_consensus.cc:2393] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 9: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:28.918346 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:28.919032 18604 raft_consensus.cc:2368] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9.
I20260709 12:23:28.824869 22346 consensus_queue.cc:1048] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 12:23:28.835271 18606 raft_consensus.cc:1240] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:28.822559 22358 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:28.769114 22281 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.921389 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:28.922642 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:28.806315 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:28.923249 18599 raft_consensus.cc:1240] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 9. Ops: []
I20260709 12:23:28.923817 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:28.924703 18606 raft_consensus.cc:2393] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 9: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:28.924904 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:28.852434 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:28.926210 18599 raft_consensus.cc:1240] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:28.926596 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:28.846131 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:28.927384 18599 raft_consensus.cc:1240] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:28.919627 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:28.918871 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:28.826575 18679 raft_consensus.cc:2955] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:23:28.846908 19244 raft_consensus.cc:1240] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:28.846735 18678 raft_consensus.cc:1240] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:28.771277 22349 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.157s
I20260709 12:23:28.836155 22299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298b8c963d93464e999fee75e74e9781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.865301 18676 raft_consensus.cc:1275] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:23:28.899830 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.937424 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:28.938066 18673 raft_consensus.cc:2393] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 8: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:28.945406 18676 raft_consensus.cc:1240] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:28.859279 18427 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60812 (request call id 118) took 3541 ms. Trace:
I20260709 12:23:28.927908 18680 raft_consensus.cc:2368] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10.
I20260709 12:23:28.844349 18601 raft_consensus.cc:1240] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:28.949047 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:28.950260 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:28.950454 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:28.948093 18427 rpcz_store.cc:276] 0709 12:23:25.317581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.318042 (+   461us) service_pool.cc:224] Handling call
0709 12:23:28.859155 (+3541113us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:26.566707 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:26.634838 (+ 68131us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:26.634898 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:23:26.634913 (+    15us) tablet.cc:662] Decoding operations
0709 12:23:26.635552 (+   639us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:26.635643 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:26.635671 (+    28us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:23:26.636079 (+   408us) tablet.cc:701] Row locks acquired
0709 12:23:26.636097 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:23:26.636243 (+   146us) write_op.cc:270] Start()
0709 12:23:26.636355 (+   112us) write_op.cc:276] Timestamp: P: 1783599806636187 usec, L: 0
0709 12:23:26.636372 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:23:26.637043 (+   671us) log.cc:844] Serialized 1698 byte log entry
0709 12:23:28.374413 (+1737370us) op_driver.cc:464] REPLICATION: finished
0709 12:23:28.415215 (+ 40802us) write_op.cc:301] APPLY: starting
0709 12:23:28.415306 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:28.415473 (+   167us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:28.415570 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:28.506806 (+ 91236us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:28.582070 (+ 75264us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:23:28.603627 (+ 21557us) write_op.cc:312] APPLY: finished
0709 12:23:28.691997 (+ 88370us) log.cc:844] Serialized 41 byte log entry
0709 12:23:28.692214 (+   217us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:28.692328 (+   114us) write_op.cc:454] Released schema lock
0709 12:23:28.692383 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:28.692937 (+   554us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:28.692970 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":40530,"apply.run_cpu_time_us":3483,"apply.run_wall_time_us":277701,"num_ops":4,"prepare.queue_time_us":258714,"prepare.run_cpu_time_us":17997,"prepare.run_wall_time_us":173608,"raft.queue_time_us":187721,"raft.run_cpu_time_us":10765,"raft.run_wall_time_us":40760,"replication_time_us":1737874,"thread_start_us":267802,"threads_started":4,"wal-append.queue_time_us":97538}]]}
I20260709 12:23:28.920343 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:28.952886 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:28.777915 22354 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:28.827255 18600 raft_consensus.cc:1240] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 11. Ops: []
I20260709 12:23:28.845048 18675 raft_consensus.cc:1240] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:23:28.954756 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:28.955441 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:28.955834 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:28.821484 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 151106us
W20260709 12:23:28.956615 18646 leader_election.cc:336] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.834s (SENT)
I20260709 12:23:28.956658 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:28.957100 18646 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:28.821851 22332 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:28.963761 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:28.964010 22332 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:28.922727 22358 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:28.893162 18597 raft_consensus.cc:1240] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:28.840257 22361 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:28.783839 22220 consensus_queue.cc:1048] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.183s
I20260709 12:23:28.966784 18675 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:23:28.967669 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:28.828750 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 49566.7us
I20260709 12:23:28.968312 18677 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:23:28.825870 22373 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:28.941262 22350 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:23:28.969172 22373 raft_consensus.cc:697] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:28.939661 22281 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:28.940456 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:28.970178 22373 consensus_queue.cc:237] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.971040 18678 raft_consensus.cc:2468] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:23:28.968832 18570 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:28.972365 18678 raft_consensus.cc:1275] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:28.972548 22350 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:28.835065 22226 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:28.974119 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.836387 22377 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:28.974748 22377 raft_consensus.cc:697] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:28.974933 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.843991 18603 raft_consensus.cc:1240] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:28.775628 22292 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:28.932725 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:28.968331 22361 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:28.979470 22292 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:28.980252 18598 raft_consensus.cc:1240] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 12. Current term is 14. Ops: []
I20260709 12:23:28.918771 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:28.939615 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:28.928746 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:28.844399 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:28.925436 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:28.939162 18644 leader_election.cc:400] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8.
I20260709 12:23:28.984082 18644 leader_election.cc:403] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:28.984858 22110 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8.
I20260709 12:23:28.984272 18606 raft_consensus.cc:2393] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 8: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
W20260709 12:23:28.985790 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 46795us
I20260709 12:23:28.977533 18570 leader_election.cc:400] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8.
I20260709 12:23:28.986616 18570 leader_election.cc:403] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:23:28.945698 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:28.987350 18644 leader_election.cc:400] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9.
I20260709 12:23:28.987792 18644 leader_election.cc:403] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:28.946591 18673 raft_consensus.cc:1240] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:28.858264 22376 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:28.764199 22375 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:28.873934 18475 auto_rebalancer.cc:629] Failed to schedule move for tablet b52424a465944d0ba861991c593bdc17: Illegal state: Replica a0dee333a83a45f1ab0c1bb6d094afd1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:28.975700 22377 consensus_queue.cc:237] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:29.008499 22375 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:28.836606 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 53978us
I20260709 12:23:28.957695 18521 raft_consensus.cc:1275] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:23:28.844738 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:28.958144 18646 connection.cc:256] RPC call timeout handler was delayed by -1.915635937999923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
W20260709 12:23:28.958976 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.959115 22354 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:28.781103 22348 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:28.958336 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:29.025218 18676 raft_consensus.cc:2468] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:23:28.969050 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:28.973033 22350 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.827808 22291 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:28.958644 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:28.982100 18671 raft_consensus.cc:2393] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 8: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
W20260709 12:23:29.038892 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 51896.2us
I20260709 12:23:28.871031 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:28.987970 18599 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:28.977501 18678 raft_consensus.cc:1275] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:28.991096 18606 raft_consensus.cc:1240] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:28.966553 22332 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:28.993171 18494 connection.cc:256] RPC call timeout handler was delayed by -4.4603257009998742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
I20260709 12:23:28.994022 22292 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8.
I20260709 12:23:28.946525 18424 catalog_manager.cc:5697] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 9 to 10, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 10 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:29.048731 18424 catalog_manager.cc:5697] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:29.002009 18570 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:23:29.050300 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 48398.9us
I20260709 12:23:29.051092 18570 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:29.018182 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:29.042583 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:29.025583 18646 leader_election.cc:336] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.896s (SENT)
I20260709 12:23:29.043344 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.052699 18527 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:29.044143 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:29.046515 18494 connection.cc:256] RPC call timeout handler was delayed by -4.4387257009998393s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
W20260709 12:23:29.053685 18494 connection.cc:256] RPC call timeout handler was delayed by -4.1930257009998968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
W20260709 12:23:29.054023 18494 connection.cc:256] RPC call timeout handler was delayed by -4.1327257009997993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260709 12:23:29.054325 18494 connection.cc:256] RPC call timeout handler was delayed by -4.1192257009997775s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
W20260709 12:23:29.054633 18494 connection.cc:256] RPC call timeout handler was delayed by -4.0778257009997105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
W20260709 12:23:29.054968 18494 connection.cc:256] RPC call timeout handler was delayed by -4.0616257009996843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
W20260709 12:23:29.055261 18494 connection.cc:256] RPC call timeout handler was delayed by -4.027425700999629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
W20260709 12:23:29.055565 18494 connection.cc:256] RPC call timeout handler was delayed by -3.9806257010000081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
W20260709 12:23:29.055941 18494 connection.cc:256] RPC call timeout handler was delayed by -3.972525700999995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
W20260709 12:23:29.056207 18494 connection.cc:256] RPC call timeout handler was delayed by -3.95092570099996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
W20260709 12:23:29.056456 18494 connection.cc:256] RPC call timeout handler was delayed by -3.913125700999899s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2118s for a response
W20260709 12:23:29.056702 18494 connection.cc:256] RPC call timeout handler was delayed by -3.8132257009997375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
I20260709 12:23:29.058856 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.060272 18677 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:29.060454 18570 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:29.061400 18646 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:29.063237 21785 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:29.063720 21785 raft_consensus.cc:697] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:29.039811 22348 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.078698 18570 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:29.079566 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:29.044987 22350 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:29.083006 18521 raft_consensus.cc:3055] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:29.086010 18521 raft_consensus.cc:740] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:29.084496 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:29.084944 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.049017 22110 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9.
I20260709 12:23:29.087092 18521 consensus_queue.cc:260] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:29.098914 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.099689 18529 raft_consensus.cc:2368] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10.
I20260709 12:23:29.025089 22349 consensus_queue.cc:1048] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:23:29.105015 18521 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:29.101565 18644 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:29.039264 22346 consensus_queue.cc:1048] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:23:29.107373 22376 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:29.107458 22274 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:29.109418 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:29.109177 21785 consensus_queue.cc:237] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:29.075829 22351 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:29.110659 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:29.113240 18644 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:29.113999 18570 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:29.117237 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.083626 22348 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:29.097004 22292 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:29.084333 22347 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:29.110030 18600 raft_consensus.cc:2376] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10. Re-sending same reply.
I20260709 12:23:29.069167 22344 consensus_queue.cc:1048] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:23:29.085925 22354 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:29.125092 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.119552 19210 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:29.187109 18521 raft_consensus.cc:1275] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:23:29.126281 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:29.127888 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:29.127979 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 102430us
I20260709 12:23:29.115041 18601 raft_consensus.cc:2376] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8. Re-sending same reply.
I20260709 12:23:29.138667 18644 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:29.188798 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 50213.5us
I20260709 12:23:29.190655 18525 raft_consensus.cc:2368] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8.
I20260709 12:23:29.190893 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.190690 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:29.192363 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 78468.3us
I20260709 12:23:29.194355 18675 raft_consensus.cc:2393] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 9: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:29.118145 22273 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:29.213896 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.237910 18570 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:23:29.241367 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 121863us
I20260709 12:23:29.242154 18525 raft_consensus.cc:3055] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:29.242820 18525 raft_consensus.cc:740] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:23:29.243783 18646 leader_election.cc:336] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.915s (SENT)
I20260709 12:23:29.244359 18646 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:29.237246 18526 raft_consensus.cc:3055] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:29.244517 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:29.244946 18526 raft_consensus.cc:740] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:29.245911 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:29.190622 22399 log.cc:927] Time spent T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.004s
I20260709 12:23:29.247817 22273 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:29.251639 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:29.252327 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:29.252892 18527 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:29.253209 18529 raft_consensus.cc:1275] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:29.256366 22273 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:29.258020 18525 consensus_queue.cc:260] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:29.259076 18525 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:29.137409 22292 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:23:29.279434 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.301889 18644 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:29.135949 22110 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:29.243476 19210 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:29.303237 18527 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 14.
W20260709 12:23:29.305022 22394 log.cc:927] Time spent T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:23:29.300405 22377 raft_consensus.cc:2804] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:29.307806 22346 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:23:29.301436 18526 consensus_queue.cc:260] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:29.312280 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 75271.1us
W20260709 12:23:29.312547 22389 log.cc:927] Time spent T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 12:23:29.312961 22345 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.326010 22332 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:29.193778 22274 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:29.124118 22362 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.179s
W20260709 12:23:29.316670 22387 log.cc:927] Time spent T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:23:29.322147 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 70136.2us
W20260709 12:23:29.330873 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 87502us
I20260709 12:23:29.299988 22369 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:29.336759 18525 raft_consensus.cc:1275] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:29.337496 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.338500 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.371171 18521 raft_consensus.cc:2368] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 13. Current term is 14.
I20260709 12:23:29.303113 22347 raft_consensus.cc:697] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:29.332520 22292 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:29.313141 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.374187 18522 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
W20260709 12:23:29.350071 18646 leader_election.cc:336] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.982s (SENT)
I20260709 12:23:29.357688 18526 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:29.364902 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.332288 22110 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:29.335882 22377 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.335582 22376 raft_consensus.cc:2804] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:29.335210 22306 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:29.379325 18646 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:29.376111 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:29.380362 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 142552us
I20260709 12:23:29.382692 18570 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:23:29.383911 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.395318 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.397068 18526 raft_consensus.cc:1275] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:29.388195 22194 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:29.372815 22351 raft_consensus.cc:697] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:29.388047 22287 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:29.400857 22351 consensus_queue.cc:237] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:29.403987 22347 consensus_queue.cc:237] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:29.379092 22110 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:29.412896 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 62880.5us
W20260709 12:23:29.414072 18646 leader_election.cc:336] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.146s (SENT)
I20260709 12:23:29.414484 18646 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:29.416563 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.416940 22273 raft_consensus.cc:2749] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:29.417325 18527 raft_consensus.cc:2368] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9.
W20260709 12:23:29.415510 18646 connection.cc:256] RPC call timeout handler was delayed by -1.80979920100026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
I20260709 12:23:29.381543 22377 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:29.419781 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.420441 18523 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:23:29.422966 22220 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:29.423301 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.359936 22345 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:29.426712 22287 raft_consensus.cc:697] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:29.427030 18646 leader_election.cc:336] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.039s (SENT)
I20260709 12:23:29.427457 18646 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:29.427786 22287 consensus_queue.cc:237] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:29.428750 22345 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:29.429517 22332 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:29.432089 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.424206 22227 consensus_queue.cc:1048] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:23:29.433463 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 46039.3us
I20260709 12:23:29.434825 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:29.429625 18646 leader_election.cc:336] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.061s (SENT)
I20260709 12:23:29.373863 22274 raft_consensus.cc:697] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:29.442798 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.445713 18572 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:23:29.451596 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.381233 22376 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.455951 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.439463 18646 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:29.461120 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.463423 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.465988 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.466849 18523 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:23:29.468410 21785 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:29.469005 21785 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.469484 21785 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:29.470888 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.471922 18527 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
W20260709 12:23:29.473220 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.397914 22306 raft_consensus.cc:697] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:29.480299 18572 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:29.482154 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.484025 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.389259 22285 consensus_queue.cc:1048] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 12:23:29.456490 22376 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:29.489338 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.490373 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.490999 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:29.491554 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.493129 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:29.498533 18521 raft_consensus.cc:2393] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 10: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:29.499361 18527 raft_consensus.cc:2393] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 10: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:29.500756 18572 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:29.501113 22373 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:29.512600 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:29.513926 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:29.514618 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 85017.5us
W20260709 12:23:29.517503 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 94163.7us
I20260709 12:23:29.517385 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.518421 18570 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:23:29.525175 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:29.526779 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.497690 22332 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:23:29.528448 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 156373us
I20260709 12:23:29.535787 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.535871 19210 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:29.541080 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:29.541764 18600 raft_consensus.cc:1240] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:29.542052 18521 raft_consensus.cc:2393] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 10: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:29.508944 22145 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:29.545522 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:29.546169 18525 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:29.549425 21785 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:29.555263 18601 raft_consensus.cc:1240] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:23:29.556197 18572 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:29.516892 22220 raft_consensus.cc:697] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:29.559913 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:29.566603 22347 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:29.567690 22373 consensus_queue.cc:1048] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:29.567826 22351 consensus_queue.cc:1048] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:29.579578 21785 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:29.555838 22227 consensus_queue.cc:1048] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:23:29.581148 18521 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:23:29.622396 18678 raft_consensus.cc:1275] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:29.594405 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:29.595463 18679 raft_consensus.cc:1275] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:23:29.596019 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:29.624661 19239 raft_consensus.cc:1275] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:23:29.625095 19239 pending_rounds.cc:85] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4: Aborting all ops after (but not including) 7
I20260709 12:23:29.596369 18674 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:29.596645 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:29.626865 18677 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:23:29.610285 18525 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:29.539192 22352 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:29.592733 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:29.556078 22369 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:29.634989 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:29.642886 18671 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:23:29.625435 19239 pending_rounds.cc:107] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:23:29.664098 19239 raft_consensus.cc:2889] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:29.662048 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 106849us
I20260709 12:23:29.664124 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.666713 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.552060 22362 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 12:23:29.674809 18677 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:29.675171 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:29.601485 22346 consensus_queue.cc:1048] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:23:29.688576 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.531810 22274 consensus_queue.cc:237] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:29.694795 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.666188 22352 raft_consensus.cc:697] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:29.641701 22354 consensus_queue.cc:1059] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:23:29.709131 18671 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 14.
I20260709 12:23:29.682912 22332 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.719422 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.719899 22415 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:23:29.713243 22348 consensus_meta.cc:287] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.002s
I20260709 12:23:29.702107 22347 raft_consensus.cc:697] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:29.780673 22408 log.cc:927] Time spent T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 12:23:29.783759 22405 log.cc:927] Time spent T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:23:29.774561 22348 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:29.821581 18600 raft_consensus.cc:2368] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 9. Current term is 10.
W20260709 12:23:29.845016 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:29.787703 22409 log.cc:927] Time spent T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:23:29.616384 22306 consensus_queue.cc:237] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:29.773682 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:29.788424 22350 consensus_meta.cc:287] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.676s	user 0.010s	sys 0.000s
W20260709 12:23:29.793473 22393 log.cc:927] Time spent T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.484s	user 0.005s	sys 0.000s
I20260709 12:23:29.877763 22354 raft_consensus.cc:3055] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:23:29.878106 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 203163us
I20260709 12:23:29.882925 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.883435 19210 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:29.810518 22348 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:29.888813 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.804385 22299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:33388 (request call id 490) took 4550 ms. Trace:
I20260709 12:23:29.721117 22332 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:29.891637 19210 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:23:29.893400 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.897583 22407 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:29.898795 22301 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:29.908143 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.910022 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.716655 22220 consensus_queue.cc:237] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:29.918725 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:29.919059 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.923671 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:29.928282 18525 raft_consensus.cc:2368] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8.
W20260709 12:23:29.929133 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:29.933908 22110 consensus_meta.cc:287] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.000s
I20260709 12:23:29.889357 22352 consensus_queue.cc:237] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:29.941227 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:29.941857 19242 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:29.894771 22299 rpcz_store.cc:276] 0709 12:23:25.253526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.253670 (+   144us) service_pool.cc:224] Handling call
0709 12:23:25.925643 (+671973us) ts_tablet_manager.cc:934] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
0709 12:23:28.735526 (+2809883us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:23:29.126943 (+391417us) tablet_metadata.cc:665] Metadata flushed
0709 12:23:29.185777 (+ 58834us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:23:29.680334 (+494557us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:23:29.720765 (+ 40431us) tablet_replica.cc:206] Creating consensus instance
0709 12:23:29.804160 (+ 83395us) ts_tablet_manager.cc:989] Replica registered.
0709 12:23:29.804253 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":123388,"tablet-copy.queue_time_us":595334,"thread_start_us":333685,"threads_started":2}
I20260709 12:23:29.945914 22299 tablet_copy_client.cc:806] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:29.946735 22299 tablet_copy_client.cc:670] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:29.939285 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:29.842234 22292 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:29.953109 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:29.882853 22350 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:29.968127 22350 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:29.969051 18530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 761) took 1010 ms. Trace:
I20260709 12:23:29.914690 22272 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:29.969844 22272 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:29.970485 22272 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:29.969465 18530 rpcz_store.cc:276] 0709 12:23:28.958747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.958877 (+   130us) service_pool.cc:224] Handling call
0709 12:23:28.959206 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:28.959537 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:28.959568 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:28.960106 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 12:23:29.111822 (+151716us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:29.111859 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.111920 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:29.792866 (+680946us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:23:29.968749 (+175883us) raft_consensus.cc:1685] finished
0709 12:23:29.968767 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:29.968989 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1187,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":135,"spinlock_wait_cycles":27035008,"thread_start_us":151291,"threads_started":1,"wal-append.queue_time_us":348333}
I20260709 12:23:29.977100 22347 consensus_queue.cc:237] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:29.969331 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:29.986501 18570 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:23:30.008733 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 56262.6us
I20260709 12:23:29.878351 22354 raft_consensus.cc:740] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:29.934551 22110 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:30.017484 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:30.023047 18599 raft_consensus.cc:1240] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:30.023489 18675 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:30.018303 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:30.036303 18672 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:23:30.038136 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.041996 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:30.049544 18673 raft_consensus.cc:1275] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:23:30.014377 22279 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:30.059861 18524 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:30.068572 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:30.078370 18570 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:23:30.088187 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:30.051760 22377 consensus_meta.cc:287] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.633s	user 0.008s	sys 0.005s
W20260709 12:23:30.150290 18646 leader_election.cc:336] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.775s (SENT)
I20260709 12:23:30.163115 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:30.254980 18646 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:30.188223 19242 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:30.029747 22401 consensus_queue.cc:1048] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.126s
I20260709 12:23:30.142403 22287 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:30.066999 22290 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
I20260709 12:23:30.047271 22362 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
I20260709 12:23:30.179342 22354 consensus_queue.cc:260] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:30.206652 18676 raft_consensus.cc:1275] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:30.212764 18673 raft_consensus.cc:1275] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:30.215214 22292 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:29.969568 22425 consensus_queue.cc:1059] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 12:23:30.220891 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:30.221220 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:30.222556 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:30.223629 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:30.223945 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:30.224223 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:30.224917 22332 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:30.225500 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:30.226908 22110 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:30.241240 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:30.236917 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 156589us
I20260709 12:23:30.283178 18675 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:30.289194 18494 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:30.308123 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.310575 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:23:30.312625 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:30.313329 18572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.017s	sys 0.042s
I20260709 12:23:30.348070 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:30.405409 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 451190us
W20260709 12:23:30.406409 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:30.413383 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.435890 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:23:30.414244 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.436699 18528 raft_consensus.cc:2393] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 10: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
W20260709 12:23:30.414965 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:30.416021 18572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.017s	sys 0.043s
I20260709 12:23:30.437266 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:30.419454 18526 raft_consensus.cc:2376] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8. Re-sending same reply.
I20260709 12:23:30.415875 18570 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:30.441453 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:30.404704 22291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.032s	sys 0.032s
I20260709 12:23:30.470331 22425 raft_consensus.cc:3055] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:30.475346 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:23:30.474327 22272 consensus_meta.cc:287] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.000s
I20260709 12:23:30.307766 22377 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:30.489710 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:30.478787 18524 raft_consensus.cc:2376] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8. Re-sending same reply.
I20260709 12:23:30.484295 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:30.512247 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 223135us
I20260709 12:23:30.531468 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:30.537110 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:30.532253 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 458388us
I20260709 12:23:30.533516 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:30.532773 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:30.536437 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:30.539872 18528 raft_consensus.cc:2393] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 10: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
W20260709 12:23:30.532003 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 381722us
I20260709 12:23:30.541908 18525 raft_consensus.cc:1240] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10. Ops: []
W20260709 12:23:30.543607 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:30.478325 22291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.033s	sys 0.032s
I20260709 12:23:30.451481 22427 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:30.534559 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 118841us
I20260709 12:23:30.530694 18600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:30.557301 18494 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:30.531078 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:30.493093 22287 raft_consensus.cc:2804] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:30.562883 18600 raft_consensus.cc:606] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:30.511758 22375 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:30.434386 22349 consensus_queue.cc:1048] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.139s
W20260709 12:23:30.551102 22369 consensus_meta.cc:287] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.879s	user 0.009s	sys 0.002s
I20260709 12:23:30.591173 22447 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:30.588393 22446 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:30.598997 18521 raft_consensus.cc:1275] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:23:30.553478 22354 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:30.548626 22272 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:30.534162 22425 raft_consensus.cc:740] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:30.597954 22274 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.621057 22272 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:30.624229 22274 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:30.627157 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.531059 22441 consensus_queue.cc:1059] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
W20260709 12:23:30.614434 22376 consensus_meta.cc:287] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 1.104s	user 0.005s	sys 0.008s
I20260709 12:23:30.604725 22369 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:30.691207 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 113613us
I20260709 12:23:30.719619 22431 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:30.752913 22431 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:30.604996 22447 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:30.762081 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.789671 18599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39798 (request call id 476) took 1218 ms. Trace:
I20260709 12:23:30.790321 18599 rpcz_store.cc:276] 0709 12:23:29.550136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.550357 (+   221us) service_pool.cc:224] Handling call
0709 12:23:29.562306 (+ 11949us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:30.026892 (+464586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:30.743591 (+716699us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b5400126bd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:30.768850 (+ 25259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1047326080}
I20260709 12:23:30.685930 22376 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:30.623564 22425 consensus_queue.cc:260] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:30.802392 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.817595 22447 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:30.825198 22376 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:30.854096 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 138125us
I20260709 12:23:30.855230 18494 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:30.856885 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:23:30.858104 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 165583us
I20260709 12:23:30.859376 22287 raft_consensus.cc:697] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:30.863938 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:30.862426 22448 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:30.870226 18494 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:30.871202 22448 raft_consensus.cc:2749] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:30.875314 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:30.875679 18606 raft_consensus.cc:1275] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:23:30.876627 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:30.860874 22287 consensus_queue.cc:237] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:30.880013 18601 raft_consensus.cc:2393] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 9: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:30.880155 22332 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.884058 22332 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:30.880263 22110 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.886795 22110 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:30.888986 22110 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:30.890102 22274 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:30.891153 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.892119 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:30.853389 22425 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:30.891069 18678 raft_consensus.cc:1240] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:30.895416 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:30.897331 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:30.898936 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:30.899945 18602 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:30.901564 18676 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:30.854226 22400 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.006s	sys 0.013s
I20260709 12:23:30.902745 22110 consensus_queue.cc:1048] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:23:30.908123 18530 raft_consensus.cc:3055] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:30.910372 18530 raft_consensus.cc:740] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:30.910579 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:30.875388 22431 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:30.909360 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 50645.7us
W20260709 12:23:30.912240 22400 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.006s	sys 0.013s
I20260709 12:23:30.920964 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:30.899205 22332 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:30.925395 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:30.925985 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.922948 18530 consensus_queue.cc:260] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:30.941957 19242 raft_consensus.cc:1240] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:30.942180 19244 raft_consensus.cc:1240] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:30.953727 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
W20260709 12:23:30.954071 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.955385 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:30.928436 22377 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:30.928637 22448 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:30.960469 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.916786 22274 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:23:30.966989 18644 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:30.994904 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:30.996088 19246 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:23:30.949011 22452 consensus_queue.cc:1059] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:23:30.984689 22431 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:31.046908 22427 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:31.047814 18680 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:30.998111 22448 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:31.050127 22448 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:31.053361 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.055457 18680 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:30.964308 22332 consensus_queue.cc:1059] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 12:23:30.960687 19210 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:31.063410 18494 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:31.080849 18676 raft_consensus.cc:2468] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
W20260709 12:23:31.081969 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 121363us
I20260709 12:23:31.080734 22456 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:31.084962 22332 raft_consensus.cc:3055] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:31.085124 22447 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:31.085465 22332 raft_consensus.cc:740] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:23:31.085624 22337 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.388s	user 0.014s	sys 0.062s
W20260709 12:23:31.094035 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 531953us
I20260709 12:23:31.063521 22375 consensus_queue.cc:1059] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:23:31.097044 19210 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:23:31.096378 22337 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.399s	user 0.014s	sys 0.063s
I20260709 12:23:31.115814 18644 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:31.094270 22433 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:31.092089 22451 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:31.085757 22447 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:31.093767 22448 consensus_queue.cc:1059] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:23:31.125057 22427 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:31.097836 22301 consensus_queue.cc:1059] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:23:31.152125 22446 raft_consensus.cc:3055] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:31.152572 22446 raft_consensus.cc:740] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:31.152693 22301 raft_consensus.cc:3055] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:31.153121 22301 raft_consensus.cc:740] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:31.153439 22446 consensus_queue.cc:260] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:31.153983 22301 consensus_queue.cc:260] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:31.154867 22446 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:31.155373 22301 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:31.156810 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.122664 22272 raft_consensus.cc:2804] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:23:31.159866 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.160019 22272 raft_consensus.cc:697] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:31.084997 22456 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:31.147887 22427 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.167999 22354 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.168308 22427 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:31.151507 18530 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 14
W20260709 12:23:31.156215 22450 consensus_queue.cc:1175] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" responder_term: 9 status { last_received { term: 8 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:23:31.146026 22448 consensus_queue.cc:1059] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:23:31.179445 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 65830.2us
I20260709 12:23:31.187187 18494 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:31.188688 18494 leader_election.cc:400] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10.
I20260709 12:23:31.189131 18494 leader_election.cc:403] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:23:31.164374 22431 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:31.164129 22110 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:31.160524 22332 consensus_queue.cc:260] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:31.194244 22272 consensus_queue.cc:237] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:31.195315 22332 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:31.196326 22406 log.cc:927] Time spent T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 1.520s	user 0.010s	sys 0.025s
I20260709 12:23:31.186589 22452 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:31.200415 22452 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:31.205546 22447 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:31.206120 22447 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:31.206624 18524 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:23:31.209929 22456 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:31.210244 18529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 763) took 1899 ms. Trace:
I20260709 12:23:31.210290 22291 raft_consensus.cc:3055] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:31.210705 18529 rpcz_store.cc:276] 0709 12:23:29.310662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.316929 (+  6267us) service_pool.cc:224] Handling call
0709 12:23:29.317220 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:29.317554 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:29.317583 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:29.318042 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 12:23:29.451208 (+133166us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:29.451251 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.451329 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:31.195651 (+1744322us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:23:31.209948 (+ 14297us) raft_consensus.cc:1685] finished
0709 12:23:31.209974 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:31.210183 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":708,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":989,"spinlock_wait_cycles":26398976,"thread_start_us":98462,"threads_started":1,"wal-append.queue_time_us":217008}
I20260709 12:23:31.168650 22354 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:31.212400 18530 raft_consensus.cc:1275] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:23:31.230384 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:31.218973 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 90905.5us
I20260709 12:23:31.187126 22375 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:31.266439 22375 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:31.268890 22375 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:31.185448 22430 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.211210 22110 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:31.269865 22430 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:31.271312 22110 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:31.271932 22110 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.272046 22430 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:31.272571 22430 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:31.272403 22110 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:31.273334 22430 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:31.261420 22452 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:31.274475 22452 consensus_queue.cc:1059] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:31.275296 22452 raft_consensus.cc:2804] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:31.275799 22452 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:31.276154 22452 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:31.277992 18572 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:31.283349 18676 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:23:31.287973 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:31.288967 18676 raft_consensus.cc:2393] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 9: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:31.239523 22291 raft_consensus.cc:740] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:31.206634 22447 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:31.291435 22477 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10.
I20260709 12:23:31.292275 22477 raft_consensus.cc:3055] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:31.292042 22291 consensus_queue.cc:260] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:31.292986 22447 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:31.293309 22291 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:31.264328 22427 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:31.289691 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:31.294417 18673 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:23:31.292771 22477 raft_consensus.cc:740] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:23:31.295392 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 129955us
I20260709 12:23:31.303292 18679 raft_consensus.cc:1275] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:31.306944 22402 consensus_queue.cc:1048] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:31.307873 22110 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:31.309378 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:31.330638 22480 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.331475 22480 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:31.334555 22480 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:31.335320 22480 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.214272 22431 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:23:31.353024 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:31.353751 18678 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:31.353350 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:31.354738 18521 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:31.356642 18530 raft_consensus.cc:3055] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:31.357112 18530 raft_consensus.cc:740] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:23:31.367314 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 178797us
I20260709 12:23:31.290560 22434 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:23:31.372707 18530 consensus_queue.cc:260] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:31.373684 18494 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:31.462452 22479 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:31.463322 22110 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:31.463410 22470 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 12:23:31.464053 22110 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:31.467528 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:31.467549 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:31.468430 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:31.501076 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:31.482043 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:31.513157 18676 raft_consensus.cc:2393] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 14: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:31.557466 18678 raft_consensus.cc:2410] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:23:31.515034 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:31.565583 18676 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
I20260709 12:23:31.504336 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:31.572798 19244 raft_consensus.cc:2410] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:23:31.368384 22402 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 12:23:31.356509 22480 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:31.442067 22425 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:31.657158 18646 leader_election.cc:336] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.501s (SENT)
I20260709 12:23:31.657748 18646 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:31.659039 18646 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.503s (SENT) [suppressed 23 similar messages]
W20260709 12:23:31.670306 18646 leader_election.cc:336] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.537s (SENT)
I20260709 12:23:31.670861 18646 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:31.672057 18646 leader_election.cc:336] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.575s (SENT)
W20260709 12:23:31.672951 18646 leader_election.cc:336] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.653s (SENT)
I20260709 12:23:31.673357 18646 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:31.469296 22446 consensus_queue.cc:1059] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.229s
I20260709 12:23:31.654946 22448 raft_consensus.cc:2804] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:31.731630 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:31.750063 19210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.648701 22441 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:31.756487 18678 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
W20260709 12:23:31.764269 22301 consensus_meta.cc:287] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.595s	user 0.005s	sys 0.005s
I20260709 12:23:31.772498 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:31.782223 18678 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
W20260709 12:23:31.775844 19209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.782390 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:31.783412 18602 raft_consensus.cc:2368] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 9. Current term is 10.
I20260709 12:23:31.786805 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:31.787565 18675 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:23:31.788230 22485 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:31.788507 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:31.789009 22485 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:31.789113 18675 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
I20260709 12:23:31.789731 22485 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:31.790037 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:31.790378 22492 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.790989 22492 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:31.776402 22434 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:31.408351 22477 consensus_queue.cc:260] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:31.780601 18600 raft_consensus.cc:1240] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:23:31.781236 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:31.781730 18601 raft_consensus.cc:1240] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:23:31.773965 22481 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.796507 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:31.829907 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:31.755505 22448 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:31.686329 22425 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:31.800763 22332 consensus_meta.cc:287] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.605s	user 0.011s	sys 0.000s
I20260709 12:23:31.792389 22434 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:31.917209 19244 raft_consensus.cc:2468] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 4.
I20260709 12:23:31.902083 22448 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:31.782737 22441 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:31.954622 18673 consensus_meta.cc:287] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.659s	user 0.006s	sys 0.003s
I20260709 12:23:31.961536 22425 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:31.973460 18673 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:31.914180 22427 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:31.979875 22443 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.026445 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:32.026737 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:32.027851 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:32.028156 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:32.032135 18606 raft_consensus.cc:2393] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 11: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
W20260709 12:23:32.032697 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 251332us
I20260709 12:23:32.027549 18602 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
W20260709 12:23:32.039809 18494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.046869 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:32.047320 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:32.020370 22489 log.cc:927] Time spent T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:23:32.064770 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:32.047084 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:32.070474 22441 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:32.112555 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:32.016858 22492 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:32.127727 22434 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:31.912721 22481 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:32.142587 22506 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:32.143172 22506 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:32.146065 22480 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:32.019910 22443 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:32.145494 22506 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:32.155535 22459 log.cc:927] Time spent T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 1.119s	user 0.010s	sys 0.014s
I20260709 12:23:32.180588 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:32.141484 22110 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:32.204514 19209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.221380 18646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.019s	sys 0.005s
W20260709 12:23:31.798331 18493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.017s	sys 0.032s
W20260709 12:23:32.311869 19210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.363875 18493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.195s	user 0.017s	sys 0.033s
W20260709 12:23:32.366228 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.366778 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.367296 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.367928 22506 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:32.368594 22506 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:32.371183 22506 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:32.376436 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 342863us
I20260709 12:23:32.377983 18570 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:32.380175 22382 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:32.380872 22382 raft_consensus.cc:697] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:32.382684 22382 consensus_queue.cc:237] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:32.385947 18646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.019s	sys 0.005s
W20260709 12:23:32.580199 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 907195us
I20260709 12:23:32.388118 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:32.388286 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:32.148841 22504 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:32.228699 22373 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.019s	sys 0.022s
I20260709 12:23:32.150501 22448 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:32.387166 22492 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.575726 22443 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:32.602811 22373 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.134s	user 0.019s	sys 0.023s
I20260709 12:23:32.609313 22110 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.361951 22480 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:32.601662 22446 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:23:32.656728 18572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.009s	sys 0.031s
W20260709 12:23:32.657220 18572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.009s	sys 0.031s
W20260709 12:23:32.600664 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 107994us
W20260709 12:23:32.661275 18494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.008s	sys 0.006s
W20260709 12:23:32.661878 18494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.008s	sys 0.006s
I20260709 12:23:32.687563 18528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2593) took 2138 ms. Trace:
I20260709 12:23:32.629244 22492 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:32.612465 22504 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:32.688752 18528 rpcz_store.cc:276] 0709 12:23:30.537981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.545746 (+  7765us) service_pool.cc:224] Handling call
0709 12:23:30.546042 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:30.601003 (+ 54961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:30.601031 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:30.605277 (+  4246us) log.cc:844] Serialized 26 byte log entry
0709 12:23:30.909823 (+304546us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:30.909861 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:30.909925 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:32.154731 (+1244806us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:23:32.648936 (+494205us) raft_consensus.cc:1685] finished
0709 12:23:32.648968 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:32.674427 (+ 25459us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41275,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":75,"spinlock_wait_cycles":50969344,"thread_start_us":348354,"threads_started":2,"wal-append.queue_time_us":346720}
I20260709 12:23:32.737715 18673 raft_consensus.cc:1275] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:23:32.652356 22480 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:32.650506 22110 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:32.674934 22446 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:32.746656 18673 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:23:32.747709 18570 connection.cc:256] RPC call timeout handler was delayed by -1.5696469409999736s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
I20260709 12:23:32.769919 22433 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:32.770622 22433 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:32.775614 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
W20260709 12:23:32.787569 18644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.071s	user 0.020s	sys 0.087s
I20260709 12:23:32.772696 22513 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.789100 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:32.791559 18644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.075s	user 0.021s	sys 0.087s
I20260709 12:23:32.797155 22335 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.797782 22335 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:32.802897 18570 connection.cc:256] RPC call timeout handler was delayed by -1.2865927689999808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
I20260709 12:23:32.788229 22481 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:32.813046 22451 raft_consensus.cc:3055] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:32.813398 22434 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.813516 22451 raft_consensus.cc:740] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:32.813629 22507 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:32.813962 22434 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:32.814426 22451 consensus_queue.cc:260] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:32.814462 22507 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:32.816088 22514 consensus_queue.cc:1048] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:32.816306 22281 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:32.815634 22451 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:32.817588 22507 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:32.823655 18679 raft_consensus.cc:1275] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:32.810525 22448 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:32.834200 22433 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:32.857558 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:32.858266 18523 raft_consensus.cc:2468] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4.
I20260709 12:23:32.858979 22451 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:32.834477 22487 raft_consensus.cc:3055] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:32.835685 22110 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:32.837879 22492 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:32.838047 22452 consensus_meta.cc:287] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 1.561s	user 0.015s	sys 0.000s
I20260709 12:23:32.840960 19244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33372 (request call id 340) took 1044 ms. Trace:
I20260709 12:23:32.882277 19244 rpcz_store.cc:276] 0709 12:23:31.796115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.796258 (+   143us) service_pool.cc:224] Handling call
0709 12:23:32.840730 (+1044472us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b540044ff54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:32.840871 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273724288}
W20260709 12:23:32.853724 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.883241 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:32.855088 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:32.884405 18524 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
W20260709 12:23:32.863404 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.864089 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 283104us
W20260709 12:23:32.855803 22348 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.019s	sys 0.037s
I20260709 12:23:32.795162 22513 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:32.854923 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:32.891906 18528 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
W20260709 12:23:32.890190 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.893479 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.897267 18646 leader_election.cc:400] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8.
I20260709 12:23:32.898728 18646 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:32.900069 22492 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:32.901512 18646 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:32.902628 22492 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:32.904165 18646 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:32.906733 19209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.880113 22502 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.879374 22448 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:32.878245 22487 raft_consensus.cc:740] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:23:32.890631 22348 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.020s	sys 0.037s
I20260709 12:23:32.859700 22451 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:32.890635 22434 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:32.913978 18646 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:32.891534 22517 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:32.890388 22452 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:32.978049 18494 connection.cc:256] RPC call timeout handler was delayed by -1.4692173449998336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
W20260709 12:23:32.988108 18494 connection.cc:256] RPC call timeout handler was delayed by -1.415217345000201s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
W20260709 12:23:32.988478 18494 connection.cc:256] RPC call timeout handler was delayed by -1.2046173449998605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
I20260709 12:23:32.912679 22502 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:32.914599 22504 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:32.988770 18494 connection.cc:256] RPC call timeout handler was delayed by -1.158717345000241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
W20260709 12:23:32.993055 18494 connection.cc:256] RPC call timeout handler was delayed by -1.1344173450002017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20590000000000003s for a response
W20260709 12:23:32.993383 18494 connection.cc:256] RPC call timeout handler was delayed by -1.1146173450001697s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2081s for a response
I20260709 12:23:32.909780 22109 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:33.002574 19210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.993688 18494 connection.cc:256] RPC call timeout handler was delayed by -1.0192173450000155s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
W20260709 12:23:32.917449 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 108266us
W20260709 12:23:32.930289 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.995126 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 81266.1us
I20260709 12:23:32.915189 22446 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:32.911818 22492 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:23:33.010725 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.011641 18646 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:33.014865 18522 raft_consensus.cc:1240] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:33.023336 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.025620 18646 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:32.915594 22448 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:33.029151 18494 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:32.996551 22481 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:33.033053 18570 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:33.022890 22451 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:33.019646 22504 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:33.004179 22487 consensus_queue.cc:260] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:33.009231 22523 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:33.013990 22480 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:33.090451 22487 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:33.090415 22504 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:23:33.056332 22502 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:33.034534 22291 consensus_meta.cc:287] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 1.741s	user 0.016s	sys 0.000s
I20260709 12:23:33.004774 22109 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:33.090811 22523 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:33.098524 22109 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:33.098874 22523 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:33.099692 19240 raft_consensus.cc:2410] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 12:23:33.078722 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 45780.8us
I20260709 12:23:33.001843 22517 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:33.028050 22110 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:33.056411 22433 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.102039 22433 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:33.089170 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 82676.2us
I20260709 12:23:33.039705 18494 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:33.027956 22461 consensus_queue.cc:1048] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:23:33.100044 22504 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:33.104955 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 65388us
I20260709 12:23:33.111989 22513 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:33.035712 22492 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:33.070192 22451 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:33.113082 18494 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:33.114557 19212 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:33.119469 19212 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:33.120658 19212 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:33.118563 22291 consensus_queue.cc:1048] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:23:33.124141 22522 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:33.124933 22419 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:33.031909 22292 consensus_queue.cc:1048] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:23:33.113876 22523 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:33.135875 22523 raft_consensus.cc:2804] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:33.136260 22523 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:33.136631 22523 raft_consensus.cc:3060] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:33.136535 18494 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:33.132576 22521 log.cc:927] Time spent T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:23:33.133502 22345 raft_consensus.cc:2804] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:33.133801 22517 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:33.134756 22448 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:33.070458 22410 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
W20260709 12:23:33.124994 22520 log.cc:927] Time spent T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:23:33.141255 18570 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:33.115651 22349 consensus_queue.cc:1048] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:23:33.124802 22522 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:33.147131 22345 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.138770 22109 raft_consensus.cc:2804] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:23:33.184455 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 43836.5us
I20260709 12:23:33.139925 22492 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:33.142707 22415 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:23:33.192315 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 51111.4us
W20260709 12:23:33.177640 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 141110us
I20260709 12:23:33.142030 22532 consensus_queue.cc:1059] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:23:33.195850 22447 consensus_queue.cc:1059] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:33.142319 22504 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:33.204499 22452 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:33.176012 22513 consensus_queue.cc:1059] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:23:33.191009 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.211488 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:33.210780 18524 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
W20260709 12:23:33.206544 22512 log.cc:927] Time spent T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:23:33.189456 22345 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:33.224704 19212 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:33.215184 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:33.226517 19244 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:33.217928 22433 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:33.192747 22415 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:33.189635 22109 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:33.236306 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:33.241868 18524 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:23:33.242264 18524 pending_rounds.cc:85] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 4
I20260709 12:23:33.242497 18524 pending_rounds.cc:107] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:23:33.242753 18524 raft_consensus.cc:2889] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:33.246116 22540 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:33.246582 22540 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.246937 22540 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:33.247474 18494 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:33.248205 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 222645us
I20260709 12:23:33.245986 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:33.249462 19244 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:33.249722 18646 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:33.215157 22514 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:33.251216 18646 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:33.251823 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:33.252403 19246 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:33.254874 18646 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:33.241390 22415 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:33.257848 18646 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:33.244773 22109 raft_consensus.cc:3060] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:33.207190 22492 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:33.234668 22446 consensus_queue.cc:1059] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:23:33.273079 18494 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:33.276722 22481 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:33.277081 22299 tablet_copy_client.cc:538] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:33.260334 22480 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:33.273366 22513 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:33.278220 18494 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:33.253690 22502 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:33.278805 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 85416.6us
I20260709 12:23:33.262709 18646 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:33.264528 19210 leader_election.cc:400] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 9. Current term is 10.
W20260709 12:23:33.280413 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:33.282222 18680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 2267) took 3689 ms (client timeout 1699 ms). Trace:
W20260709 12:23:33.283031 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.279779 22478 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:23:33.282856 18680 rpcz_store.cc:269] 0709 12:23:29.591144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.591383 (+   239us) service_pool.cc:224] Handling call
0709 12:23:30.310422 (+719039us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:23:33.280395 (+2969973us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b54004051d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:33.280509 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1462557824}
I20260709 12:23:33.284061 19210 leader_election.cc:403] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:23:33.260938 22514 raft_consensus.cc:697] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:33.285079 18494 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:33.290241 18646 connection.cc:256] RPC call timeout handler was delayed by -1.3737755229999493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
W20260709 12:23:33.290647 18646 connection.cc:256] RPC call timeout handler was delayed by -1.3656755229999362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
W20260709 12:23:33.290940 18646 connection.cc:256] RPC call timeout handler was delayed by -1.3647755229999348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
W20260709 12:23:33.291204 18646 connection.cc:256] RPC call timeout handler was delayed by -1.3638755229999333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
I20260709 12:23:33.286051 19210 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:33.301651 18646 connection.cc:256] RPC call timeout handler was delayed by -1.0435362070002157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
I20260709 12:23:33.303042 18494 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:33.286495 22446 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:33.307467 22511 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:23:33.307669 18494 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:33.308081 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:33.308765 18677 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:23:33.309046 22536 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:33.309211 18494 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:33.311081 22478 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:33.311437 22492 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:33.315267 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.315500 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:33.315953 18524 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:33.315997 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:33.316706 18680 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 6.
I20260709 12:23:33.302115 22502 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.316960 22546 raft_consensus.cc:2749] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:33.317293 18570 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:33.317421 22502 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:33.304136 22531 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:33.287588 22455 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 9. Current term is 10.
I20260709 12:23:33.319235 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:33.300271 22481 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.319568 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.319612 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:33.319916 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.321755 21785 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:33.325466 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.314918 18644 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:33.314302 22478 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:33.326830 18644 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:33.327952 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.312059 22492 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.326304 18606 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 13.
I20260709 12:23:33.321748 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.327231 21785 raft_consensus.cc:697] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:33.300127 22480 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.328913 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.315166 22487 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:33.320521 22536 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.334470 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.333490 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.352847 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.330976 18605 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:23:33.330192 22546 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:33.333525 22487 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:33.322984 22361 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 12:23:33.340077 22543 log.cc:927] Time spent T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:23:33.343339 18672 raft_consensus.cc:1240] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 10. Ops: []
I20260709 12:23:33.361406 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:33.345055 18530 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:33.318934 22530 consensus_queue.cc:1059] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:23:33.337386 21785 consensus_queue.cc:237] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:33.347867 22480 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:33.349125 22292 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:33.366648 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.367403 18601 raft_consensus.cc:2393] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 8: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:33.367079 22292 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:33.329731 22481 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:33.351001 22345 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:33.380620 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.381057 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:33.381793 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.381966 22345 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:33.353438 18525 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:23:33.383065 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.384088 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.384625 18525 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:33.385367 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.324348 22547 consensus_queue.cc:1059] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:23:33.387069 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.356890 18680 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:23:33.357967 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:33.355203 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.389194 18605 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
I20260709 12:23:33.362664 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.365051 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:33.365603 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.371536 18672 raft_consensus.cc:1240] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:23:33.373173 18603 raft_consensus.cc:1240] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 10. Ops: []
I20260709 12:23:33.391235 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.376236 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:33.391803 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.351536 22415 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:33.393445 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.369791 22292 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:33.354257 22546 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.394109 18530 raft_consensus.cc:1275] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:33.400353 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.385874 18525 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:23:33.395690 19244 raft_consensus.cc:2368] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9.
I20260709 12:23:33.397627 18570 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:33.404256 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.362140 22487 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:33.399721 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.406068 18677 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:33.405994 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:33.376726 19210 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:33.400893 18530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2604) took 2059 ms. Trace:
I20260709 12:23:33.404704 18646 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:33.404942 18523 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:33.407689 18530 rpcz_store.cc:276] 0709 12:23:31.341601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.342154 (+   553us) service_pool.cc:224] Handling call
0709 12:23:31.344427 (+  2273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:33.344566 (+2000139us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b580058a9d0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c43b0aa 00007efc7c4bd447 00007efc7c4d5fe7 00007efc7c4d77de 00007efc7c4e1b49 00007efc7c4e2416 00007efc7c4ded8f 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4
0709 12:23:33.400585 (+ 56019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:33.400839 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3960323456}
I20260709 12:23:33.410061 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.410163 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.411569 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.412212 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.412621 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.412810 18523 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:23:33.413379 18524 raft_consensus.cc:2410] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:23:33.354396 22523 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:33.410722 18525 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:33.415609 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.415967 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.416347 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.416993 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:33.334546 22492 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:33.417461 18525 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:23:33.421257 19241 raft_consensus.cc:1240] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:33.421846 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.418020 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:33.418154 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:33.427563 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.420670 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.428452 18523 raft_consensus.cc:2368] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9.
I20260709 12:23:33.430198 22553 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:33.430662 22553 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.431026 22553 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:33.433583 18525 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
I20260709 12:23:33.434760 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.434880 19212 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:33.436165 22547 raft_consensus.cc:2804] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:33.436650 22554 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:33.437114 22547 raft_consensus.cc:697] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:33.437804 22554 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:33.438544 22554 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:33.435479 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.440577 18646 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:33.440580 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:33.442808 18646 leader_election.cc:336] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.520s (SENT)
I20260709 12:23:33.436206 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.443864 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:33.444718 19244 raft_consensus.cc:2393] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 9: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:33.362017 22536 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:33.415278 22511 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:23:33.449543 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.417140 22345 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:33.417487 22478 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:33.438582 22547 consensus_queue.cc:237] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:33.399380 22110 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:33.445189 18646 leader_election.cc:336] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.529s (SENT)
I20260709 12:23:33.468703 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.420472 22446 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.445567 18671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 496) took 3519 ms. Trace:
I20260709 12:23:33.445137 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:33.445168 19210 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:33.483435 18603 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:33.447686 18494 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:33.405792 22546 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:33.484345 18671 rpcz_store.cc:276] 0709 12:23:29.908886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.909029 (+   143us) service_pool.cc:224] Handling call
0709 12:23:29.911526 (+  2497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:29.911872 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:29.911901 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:33.289518 (+3377617us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b2c0001e0b8. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7add8a11 00007efc7ade8372 00007efc7c51aa01 00007efc7c4df43a 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2
0709 12:23:33.300647 (+ 11129us) log.cc:844] Serialized 26 byte log entry
0709 12:23:33.396825 (+ 96178us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:33.396883 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:33.396981 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:33.428418 (+ 31437us) raft_consensus.cc:1685] finished
0709 12:23:33.428436 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:33.428691 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":64533,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":113,"spinlock_wait_cycles":56669568,"thread_start_us":78800,"threads_started":1,"wal-append.queue_time_us":118013}
I20260709 12:23:33.488433 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:33.467386 22502 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:33.364035 22514 consensus_queue.cc:237] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:33.426745 22513 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.464627 22530 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:33.497958 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.445894 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:33.497229 18494 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:33.495268 22538 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:33.468509 22345 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:33.487596 22446 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:33.501292 22480 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:33.489809 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.484972 22523 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:33.499066 22532 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:33.515715 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:33.502251 22448 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:33.517695 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.468165 22478 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:33.523624 18523 raft_consensus.cc:2410] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:23:33.524262 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.526777 22345 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:33.527359 22557 log.cc:927] Time spent T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:23:33.527709 22538 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.542209 22538 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:33.528831 18494 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:33.544400 18494 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:33.545800 18494 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:33.547070 18494 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:33.531032 22530 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:33.532534 22446 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:33.533939 22492 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:33.534247 22532 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:33.535001 22109 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:33.536563 22481 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:23:33.538997 18524 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:33.554204 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:33.564224 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:33.538112 22540 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:33.592170 22558 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:33.594879 18523 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:33.566943 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.598295 18605 raft_consensus.cc:1240] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 11. Ops: []
I20260709 12:23:33.600993 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.549592 22530 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:33.559122 22523 raft_consensus.cc:2804] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:33.564857 22532 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:33.561455 22452 raft_consensus.cc:2749] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:33.559128 22447 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:33.604440 19242 raft_consensus.cc:1240] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:33.607514 22540 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:33.574398 22446 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:33.525763 22513 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:33.593214 22492 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.622407 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.627255 22478 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:33.610651 22530 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:33.649061 18603 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
I20260709 12:23:33.610958 22523 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:33.653728 18525 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:33.624181 22446 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:33.622905 22447 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:33.661825 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.664018 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.662374 22447 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:33.656251 22523 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:33.665625 18604 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
W20260709 12:23:33.693578 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.663185 22446 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:33.640152 22492 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:33.723320 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.728415 18605 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 11.
W20260709 12:23:33.756273 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.719321 22536 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:33.656776 22487 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:33.801152 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.803318 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:33.809605 18603 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:33.807933 22345 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:33.928813 18678 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.012s	sys 0.055s
W20260709 12:23:33.929338 18678 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.012s	sys 0.055s
W20260709 12:23:33.932453 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.075269 18671 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.010s	sys 0.034s
W20260709 12:23:34.075708 18671 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.010s	sys 0.034s
W20260709 12:23:34.076488 18680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.018s	sys 0.017s
W20260709 12:23:34.076836 18680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.018s	sys 0.017s
W20260709 12:23:34.077378 18679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.020s	sys 0.065s
W20260709 12:23:34.077811 18679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.020s	sys 0.065s
I20260709 12:23:33.995362 22478 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:34.149479 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 506) took 2510 ms. Trace:
I20260709 12:23:34.149942 18676 rpcz_store.cc:276] 0709 12:23:31.638974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.639125 (+   151us) service_pool.cc:224] Handling call
0709 12:23:31.639478 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:31.652000 (+ 12522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:31.652038 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:31.652079 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:31.652104 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.149221 (+2497117us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b54001c0a54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:34.149268 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.149414 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28310272}
I20260709 12:23:34.083132 22109 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:34.154477 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:34.106134 22478 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:34.166594 18644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.034s	sys 0.055s
W20260709 12:23:34.167057 18644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.034s	sys 0.055s
W20260709 12:23:34.165033 22461 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.018s	sys 0.080s
I20260709 12:23:34.171892 22487 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:34.171530 22461 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.018s	sys 0.081s
I20260709 12:23:34.173192 22299 tablet_bootstrap.cc:492] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:23:34.174165 22487 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.174865 22487 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:34.167423 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 840581us
I20260709 12:23:34.176232 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:34.176568 18522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 777) took 1804 ms. Trace:
W20260709 12:23:34.177273 21785 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.038s	sys 0.057s
W20260709 12:23:34.178766 21785 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.038s	sys 0.057s
I20260709 12:23:34.181941 18599 raft_consensus.cc:1240] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:34.176232 18644 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:23:34.163326 22546 consensus_meta.cc:287] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.657s	user 0.010s	sys 0.002s
I20260709 12:23:34.176910 18522 rpcz_store.cc:276] 0709 12:23:32.372542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.372687 (+   145us) service_pool.cc:224] Handling call
0709 12:23:32.373044 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:33.030435 (+657391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.176320 (+1145885us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b5400287154. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:34.176507 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1465775872}
W20260709 12:23:34.192714 18672 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.001s	sys 0.095s
W20260709 12:23:34.193244 18672 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.001s	sys 0.095s
I20260709 12:23:34.162106 22513 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:34.170249 22553 consensus_meta.cc:287] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.737s	user 0.014s	sys 0.000s
W20260709 12:23:34.168396 22538 consensus_meta.cc:287] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.625s	user 0.006s	sys 0.006s
W20260709 12:23:34.165995 22554 consensus_meta.cc:287] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.727s	user 0.006s	sys 0.009s
W20260709 12:23:34.221199 18675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.011s	sys 0.027s
W20260709 12:23:34.221669 18675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.011s	sys 0.027s
I20260709 12:23:34.226683 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:34.227669 18672 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:34.209725 22514 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.020s	sys 0.026s
W20260709 12:23:34.228767 22471 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.001s	sys 0.014s
W20260709 12:23:34.234186 22471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.001s	sys 0.014s
W20260709 12:23:34.220588 22410 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.012s	sys 0.025s
I20260709 12:23:34.247704 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:34.265654 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.245476 22410 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.013s	sys 0.025s
I20260709 12:23:34.275112 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:34.232169 22492 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:34.208907 22553 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:34.199154 22546 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:34.212198 22538 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:34.292749 22538 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:34.297226 22430 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:34.302472 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.306773 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:34.307425 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.308888 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:34.243201 22559 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:34.310942 22559 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.311345 22559 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:34.315248 19210 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:34.320117 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:34.280805 22530 consensus_meta.cc:287] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.004s
I20260709 12:23:34.321193 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:34.323128 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:34.218559 22554 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:34.331089 22554 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:34.247542 22514 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.021s	sys 0.027s
I20260709 12:23:34.334515 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:34.336144 22487 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:34.337704 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:34.373486 18676 raft_consensus.cc:2368] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10.
I20260709 12:23:34.374773 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:34.375625 18673 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:34.317188 22345 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:34.380643 18601 raft_consensus.cc:1240] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 10. Ops: []
I20260709 12:23:34.389709 18644 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:34.333056 22530 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:34.397260 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:34.378777 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 63604us
I20260709 12:23:34.410936 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:34.396672 22478 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:34.455366 22554 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:34.461063 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:34.401391 22538 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:34.398255 22562 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:34.493134 22538 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:34.507826 22567 log.cc:927] Time spent T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 12:23:34.508981 22547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.054s	sys 0.099s
I20260709 12:23:34.510373 22538 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:34.542520 18494 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.051s	sys 0.107s
W20260709 12:23:34.544802 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.545687 18569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.016s	sys 0.032s
W20260709 12:23:34.546720 18678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.002s	sys 0.057s
W20260709 12:23:34.567337 18569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.016s	sys 0.032s
W20260709 12:23:34.568783 18494 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.051s	sys 0.108s
W20260709 12:23:34.569546 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 966375us
W20260709 12:23:34.566444 18678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.002s	sys 0.058s
W20260709 12:23:34.576841 22566 log.cc:927] Time spent T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.075s	user 0.002s	sys 0.000s
I20260709 12:23:34.578637 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2324) took 1132 ms. Trace:
W20260709 12:23:34.551963 22420 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 3.244s	user 0.016s	sys 0.040s
I20260709 12:23:34.509994 22546 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:34.545888 18570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.002s	sys 0.010s
W20260709 12:23:34.551177 22376 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.515s	user 0.079s	sys 0.085s
I20260709 12:23:34.556296 18598 raft_consensus.cc:2393] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 6: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
W20260709 12:23:34.512414 22547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.054s	sys 0.100s
W20260709 12:23:34.500633 22446 consensus_meta.cc:287] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.704s	user 0.013s	sys 0.010s
I20260709 12:23:34.591024 22562 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:34.592971 22420 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.286s	user 0.017s	sys 0.040s
W20260709 12:23:34.602795 18570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.003s	sys 0.010s
W20260709 12:23:34.614849 22569 log.cc:927] Time spent T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.120s	user 0.001s	sys 0.001s
W20260709 12:23:34.604120 22376 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.568s	user 0.080s	sys 0.085s
W20260709 12:23:34.632052 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 831847us
W20260709 12:23:34.639389 22564 log.cc:927] Time spent T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:23:34.640800 22530 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:34.644007 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 46676.1us
I20260709 12:23:34.651837 18529 raft_consensus.cc:3055] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:34.652485 18529 raft_consensus.cc:740] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:23:34.657243 22574 log.cc:927] Time spent T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.100s	user 0.001s	sys 0.001s
W20260709 12:23:34.658284 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 50971.6us
I20260709 12:23:34.626636 22446 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:34.663937 22562 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:34.664846 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:34.666306 19246 raft_consensus.cc:2393] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 11: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:34.666540 22446 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:34.663650 19247 raft_consensus.cc:1240] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:34.669088 22376 raft_consensus.cc:3055] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:34.669767 22376 raft_consensus.cc:740] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:34.670344 18599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 1917) took 1307 ms. Trace:
I20260709 12:23:34.671203 22465 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:34.669828 22439 consensus_queue.cc:1059] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:34.673736 22439 raft_consensus.cc:3055] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:34.674297 22439 raft_consensus.cc:740] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:34.674682 18671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2326) took 1204 ms. Trace:
I20260709 12:23:34.676318 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:34.676597 22572 log.cc:927] Time spent T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:23:34.675268 18671 rpcz_store.cc:276] 0709 12:23:33.470094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.498914 (+ 28820us) service_pool.cc:224] Handling call
0709 12:23:33.501137 (+  2223us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:33.501485 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:33.501516 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:33.503249 (+  1733us) log.cc:844] Serialized 26 byte log entry
0709 12:23:34.076089 (+572840us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:34.076129 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.076201 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:34.674136 (+597935us) raft_consensus.cc:1685] finished
0709 12:23:34.674185 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.674451 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15562,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":3386,"thread_start_us":572404,"threads_started":1,"wal-append.queue_time_us":820321}
I20260709 12:23:34.579528 18680 rpcz_store.cc:276] 0709 12:23:33.445845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.446049 (+   204us) service_pool.cc:224] Handling call
0709 12:23:33.462932 (+ 16883us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:33.463348 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:33.463390 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:33.467991 (+  4601us) log.cc:844] Serialized 26 byte log entry
0709 12:23:34.077178 (+609187us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:34.077222 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.077294 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:34.549749 (+472455us) raft_consensus.cc:1685] finished
0709 12:23:34.549821 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.578195 (+ 28374us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50871,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":6299,"thread_start_us":608793,"threads_started":1,"wal-append.queue_time_us":799280}
I20260709 12:23:34.670871 18599 rpcz_store.cc:276] 0709 12:23:33.363066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.363194 (+   128us) service_pool.cc:224] Handling call
0709 12:23:33.363455 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:34.182544 (+819089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.669766 (+487222us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b54002b93d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:34.670101 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1881657600}
I20260709 12:23:34.671882 22376 consensus_queue.cc:260] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:34.670071 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:34.654567 18529 consensus_queue.cc:260] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:34.690164 18529 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:34.697192 22576 log.cc:927] Time spent T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:23:34.703660 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2322) took 1287 ms. Trace:
I20260709 12:23:34.708583 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:34.710783 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:34.720709 22220 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:34.720904 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:34.721841 18603 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:23:34.724004 22562 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:34.711714 18671 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:23:34.714424 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:34.726234 22439 consensus_queue.cc:260] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:34.714670 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2320) took 1305 ms. Trace:
I20260709 12:23:34.728308 22439 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:34.728358 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.730007 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 60285.2us
I20260709 12:23:34.728116 18679 rpcz_store.cc:276] 0709 12:23:33.408667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.408853 (+   186us) service_pool.cc:224] Handling call
0709 12:23:33.409140 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:34.078218 (+669078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:34.078250 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:34.102385 (+ 24135us) log.cc:844] Serialized 26 byte log entry
0709 12:23:34.548081 (+445696us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:34.637607 (+ 89526us) log.cc:844] Serialized 14 byte log entry
0709 12:23:34.680811 (+ 43204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.683916 (+  3105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:34.702261 (+ 18345us) raft_consensus.cc:1685] finished
0709 12:23:34.702300 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.714433 (+ 12133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8735,"prepare.queue_time_us":110683,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":53,"raft.queue_time_us":71897,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":4770,"thread_start_us":1186486,"threads_started":3,"wal-append.queue_time_us":532852}
I20260709 12:23:34.734366 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:34.735348 18494 leader_election.cc:400] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879) with higher term. Message: Invalid argument: T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9.
I20260709 12:23:34.742251 18494 leader_election.cc:403] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:34.743135 22530 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879) with higher term. Message: Invalid argument: T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9.
W20260709 12:23:34.745205 22482 log.cc:927] Time spent T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 3.415s	user 0.017s	sys 0.033s
I20260709 12:23:34.745755 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:34.746630 18526 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:23:34.713506 22451 raft_consensus.cc:3055] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:34.750499 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:34.751865 18522 raft_consensus.cc:2410] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:23:34.756295 18603 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:34.749356 22451 raft_consensus.cc:740] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:34.753592 22376 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:34.758461 18529 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:23:34.704598 18678 rpcz_store.cc:276] 0709 12:23:33.416272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.416405 (+   133us) service_pool.cc:224] Handling call
0709 12:23:33.420498 (+  4093us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:33.929782 (+509284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:33.929842 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:34.000132 (+ 70290us) log.cc:844] Serialized 26 byte log entry
0709 12:23:34.572600 (+572468us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:34.636685 (+ 64085us) log.cc:844] Serialized 14 byte log entry
0709 12:23:34.644841 (+  8156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.673946 (+ 29105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:34.702148 (+ 28202us) raft_consensus.cc:1685] finished
0709 12:23:34.702167 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.703578 (+  1411us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1951,"prepare.queue_time_us":86866,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":63,"raft.queue_time_us":27464,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":31510,"thread_start_us":1143741,"threads_started":3,"wal-append.queue_time_us":630976}
I20260709 12:23:34.769263 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:34.769124 22530 consensus_queue.cc:1059] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:34.770514 22530 consensus_queue.cc:1243] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:34.770577 19243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33372 (request call id 344) took 1389 ms. Trace:
I20260709 12:23:34.771314 22530 raft_consensus.cc:3055] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:34.771921 22553 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:34.772027 22530 raft_consensus.cc:740] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:34.773495 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:34.774425 18680 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 12.
I20260709 12:23:34.774194 22530 consensus_queue.cc:260] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:34.762027 22451 consensus_queue.cc:260] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:34.778406 22451 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:23:34.771196 19243 rpcz_store.cc:276] 0709 12:23:33.380935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.382871 (+  1936us) service_pool.cc:224] Handling call
0709 12:23:34.768953 (+1386082us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b5800003c98. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baeee 000000000036eb39 00007efc8142e1e0 00007efc814f70c4 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:23:34.770498 (+  1545us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2835200}
W20260709 12:23:34.786209 22523 consensus_meta.cc:287] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 1.060s	user 0.016s	sys 0.003s
I20260709 12:23:34.786947 22523 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:34.790779 19210 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:34.792148 22547 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:34.792646 22547 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.793045 22547 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:34.795763 22415 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:34.777966 22538 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:34.786291 22335 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:34.764632 18529 pending_rounds.cc:85] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 4
I20260709 12:23:34.804687 18529 pending_rounds.cc:107] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:23:34.805130 18529 raft_consensus.cc:2889] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:34.806028 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:34.807039 18522 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:34.807411 18523 raft_consensus.cc:1240] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:34.808941 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:34.809772 18523 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
W20260709 12:23:34.806005 18672 consensus_meta.cc:287] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.010s
I20260709 12:23:34.810770 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:34.812317 18523 raft_consensus.cc:2393] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 5: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:34.811483 18672 raft_consensus.cc:2468] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 5.
W20260709 12:23:34.826411 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.831970 22375 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:23:34.834749 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:34.834045 18529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2605) took 3484 ms. Trace:
I20260709 12:23:34.838707 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:34.839648 18526 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:34.836558 18529 rpcz_store.cc:276] 0709 12:23:31.345867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.346063 (+   196us) service_pool.cc:224] Handling call
0709 12:23:31.346462 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:34.651431 (+3304969us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54002ad8a0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c456dc0 00007efc7c4e11c0 00007efc7c4e2231 00007efc7c4ded8f 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c
0709 12:23:34.826524 (+175093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.830280 (+  3756us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":639364992}
I20260709 12:23:34.841246 18523 raft_consensus.cc:3060] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:34.845887 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.847297 18525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2036) took 1512 ms. Trace:
I20260709 12:23:34.856408 18525 rpcz_store.cc:276] 0709 12:23:33.335165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.435962 (+100797us) service_pool.cc:224] Handling call
0709 12:23:34.846845 (+1410883us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54002c6d54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:34.847081 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":481759616}
I20260709 12:23:34.859395 18601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 1920) took 1487 ms. Trace:
W20260709 12:23:34.861603 22584 log.cc:927] Time spent T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:23:34.861123 18601 rpcz_store.cc:276] 0709 12:23:33.372275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.373030 (+   755us) service_pool.cc:224] Handling call
0709 12:23:33.373282 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:34.381139 (+1007857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.858842 (+477703us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002a0dd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:34.859220 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2315910016}
I20260709 12:23:34.863392 18606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 2124) took 1502 ms. Trace:
I20260709 12:23:34.849074 18524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2038) took 1509 ms. Trace:
I20260709 12:23:34.864015 18524 rpcz_store.cc:276] 0709 12:23:33.339167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.420435 (+ 81268us) service_pool.cc:224] Handling call
0709 12:23:34.848660 (+1428225us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54002d64d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:34.848871 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254194048}
I20260709 12:23:34.863874 18606 rpcz_store.cc:276] 0709 12:23:33.360406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.360665 (+   259us) service_pool.cc:224] Handling call
0709 12:23:33.361021 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:33.370064 (+  9043us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:33.370118 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:33.380387 (+ 10269us) log.cc:844] Serialized 26 byte log entry
0709 12:23:34.674715 (+1294328us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b18003b1b20. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793d4e07 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793f1c02 00007efc7c07920b 00007efc7c07ed23 00007efc7c07f0d1 00007efc7c49aa0f
0709 12:23:34.702113 (+ 27398us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:34.702173 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.704801 (+  2628us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:34.862890 (+158089us) raft_consensus.cc:1685] finished
0709 12:23:34.862909 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.863214 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5007,"raft.queue_time_us":825,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":12265,"spinlock_wait_cycles":35009280,"thread_start_us":12537,"threads_started":1,"wal-append.queue_time_us":1415402}
I20260709 12:23:34.849584 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:34.852176 22451 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:34.866946 18678 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:34.867110 22451 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:34.869616 22451 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:34.853508 22478 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:34.833693 22447 consensus_meta.cc:287] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 1.098s	user 0.017s	sys 0.011s
I20260709 12:23:34.870611 22447 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:34.871621 22431 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:34.872887 22447 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:34.874835 22425 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.875578 22425 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:34.877353 22538 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:34.870569 22478 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:34.848713 22532 consensus_meta.cc:287] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 1.211s	user 0.014s	sys 0.011s
I20260709 12:23:34.877990 18679 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:34.878269 22425 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:34.886500 19246 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:34.884970 19243 raft_consensus.cc:1240] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:34.886513 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:23:34.879593 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 46483.8us
I20260709 12:23:34.830305 22530 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:23:34.905262 18678 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:34.907275 18679 raft_consensus.cc:2393] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 11: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:34.907611 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:34.885236 22369 consensus_queue.cc:1059] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
W20260709 12:23:34.908718 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.910022 18522 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
W20260709 12:23:34.910928 22583 log.cc:927] Time spent T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:23:34.911015 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:34.912525 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:34.880417 22532 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:34.878026 22477 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:34.914217 18523 raft_consensus.cc:1275] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:34.880088 22478 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:34.926155 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:34.928000 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:34.931921 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:34.932876 18600 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:34.933619 19240 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33372 (request call id 337) took 3465 ms (client timeout 3337 ms). Trace:
W20260709 12:23:34.934079 19240 rpcz_store.cc:269] 0709 12:23:31.467726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.468138 (+   412us) service_pool.cc:224] Handling call
0709 12:23:34.933191 (+3465053us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54006301d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:34.933415 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3651877248}
W20260709 12:23:34.937706 22565 log.cc:927] Time spent T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.429s	user 0.002s	sys 0.000s
I20260709 12:23:34.940017 18675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2325) took 1479 ms. Trace:
W20260709 12:23:34.941215 22570 log.cc:927] Time spent T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.433s	user 0.000s	sys 0.000s
I20260709 12:23:34.941309 22547 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:34.943993 22506 consensus_queue.cc:1059] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:23:34.944885 22506 consensus_queue.cc:1243] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:34.945111 22532 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:34.947939 22547 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:34.926471 22431 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:34.928886 22451 consensus_queue.cc:1059] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:23:34.952692 22431 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:34.953635 19239 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:23:34.954605 22522 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:34.955838 22523 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:34.918306 22538 consensus_queue.cc:1059] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:23:34.956368 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2327) took 1467 ms. Trace:
I20260709 12:23:34.924871 22447 consensus_queue.cc:1059] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:23:34.956800 18679 rpcz_store.cc:276] 0709 12:23:33.489405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.920853 (+1431448us) service_pool.cc:224] Handling call
0709 12:23:34.955485 (+ 34632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:34.956014 (+   529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:34.956040 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:34.956084 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:34.956113 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.956175 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.956286 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:34.957715 22447 consensus_queue.cc:1243] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:34.958276 22447 raft_consensus.cc:3055] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:34.958279 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:34.958822 22447 raft_consensus.cc:740] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:34.957295 22538 raft_consensus.cc:3055] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:34.961076 22536 consensus_queue.cc:1048] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:34.961804 22538 raft_consensus.cc:740] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:34.945003 22531 raft_consensus.cc:3055] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:34.974974 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:34.975153 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:34.955497 22431 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:34.971592 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:34.952726 22451 consensus_queue.cc:1243] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:34.974377 18671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2329) took 1472 ms. Trace:
I20260709 12:23:34.981483 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:34.984689 18523 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:23:34.999117 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:34.984396 18671 rpcz_store.cc:276] 0709 12:23:33.502198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.924789 (+1422591us) service_pool.cc:224] Handling call
0709 12:23:34.945973 (+ 21184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:34.946324 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:34.946624 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 12:23:34.973858 (+ 27234us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:34.973944 (+    86us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:34.974036 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.974132 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.974275 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":655,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":140,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":26393,"threads_started":1,"wal-append.queue_time_us":26545}
I20260709 12:23:35.025404 18600 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:23:34.940578 18675 rpcz_store.cc:276] 0709 12:23:33.460207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.460345 (+   138us) service_pool.cc:224] Handling call
0709 12:23:33.460714 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:33.461127 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:33.461167 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:33.466320 (+  5153us) log.cc:844] Serialized 26 byte log entry
0709 12:23:34.224398 (+758078us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:34.224472 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.224584 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:34.936835 (+712251us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:23:34.939431 (+  2596us) raft_consensus.cc:1685] finished
0709 12:23:34.939452 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.939768 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38314,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":3685,"spinlock_wait_cycles":5884160,"thread_start_us":736028,"threads_started":1,"wal-append.queue_time_us":1013712}
W20260709 12:23:35.031879 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.031857 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:35.024613 22559 consensus_meta.cc:287] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.558s	user 0.012s	sys 0.004s
I20260709 12:23:35.033418 22559 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:34.962987 22538 consensus_queue.cc:260] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:35.032137 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2330) took 1527 ms. Trace:
I20260709 12:23:35.039826 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:34.993372 18427 catalog_manager.cc:5697] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.041736 22538 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:34.980414 22531 raft_consensus.cc:740] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:35.044205 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2296) took 3747 ms. Trace:
I20260709 12:23:35.045027 22531 consensus_queue.cc:260] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:35.046545 22531 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:23:35.049242 18676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 2333) took 1490 ms (client timeout 1568 ms). Trace:
W20260709 12:23:35.049790 18676 rpcz_store.cc:269] 0709 12:23:33.559156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.151461 (+592305us) service_pool.cc:224] Handling call
0709 12:23:35.048776 (+897315us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54000bf4d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:35.049053 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449196288}
I20260709 12:23:35.052067 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:35.052187 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 1.57168e+06us
W20260709 12:23:35.053215 18646 leader_election.cc:336] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.840s (SENT)
I20260709 12:23:35.053619 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:35.053732 18646 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:35.054774 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:35.055894 18525 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
I20260709 12:23:35.056720 22382 consensus_queue.cc:1059] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:35.052295 18673 raft_consensus.cc:2393] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 10: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:35.038082 18679 rpcz_store.cc:276] 0709 12:23:33.504526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.959458 (+1454932us) service_pool.cc:224] Handling call
0709 12:23:34.959940 (+   482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:34.960374 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:34.960719 (+   345us) log.cc:844] Serialized 14 byte log entry
0709 12:23:35.031735 (+ 71016us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:35.031814 (+    79us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:35.031864 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.031930 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.032045 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1141,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":6068,"thread_start_us":21064,"threads_started":1}
I20260709 12:23:35.044724 18674 rpcz_store.cc:276] 0709 12:23:31.296127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.296297 (+   170us) service_pool.cc:224] Handling call
0709 12:23:31.296772 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:31.376313 (+ 79541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:31.376361 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:31.376420 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:31.376471 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.043303 (+3666832us) spinlock_profiling.cc:243] Waited 79.3 ms on lock 0x7b54000bdbd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:35.043563 (+   260us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.043883 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182285184}
I20260709 12:23:35.060117 18606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:35.062036 18600 raft_consensus.cc:3060] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:35.062176 18606 raft_consensus.cc:606] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:35.063553 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:35.064409 22362 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:35.065223 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:35.065795 22553 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:35.066387 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:35.066812 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:35.067876 18675 raft_consensus.cc:1240] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:35.068535 18675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2334) took 1466 ms. Trace:
I20260709 12:23:35.068825 18675 rpcz_store.cc:276] 0709 12:23:33.602606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.067142 (+1464536us) service_pool.cc:224] Handling call
0709 12:23:35.067561 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.068286 (+   725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.068456 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:35.069393 19242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33388 (request call id 530) took 1713 ms. Trace:
I20260709 12:23:35.069788 19242 rpcz_store.cc:276] 0709 12:23:33.355429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.355575 (+   146us) service_pool.cc:224] Handling call
0709 12:23:33.357378 (+  1803us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:33.620559 (+263181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.068958 (+1448399us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b540044ff54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:35.069207 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":567653760}
I20260709 12:23:35.070712 18675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2335) took 1448 ms. Trace:
I20260709 12:23:35.067386 22354 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:35.071165 18675 rpcz_store.cc:276] 0709 12:23:33.622579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.069688 (+1447109us) service_pool.cc:224] Handling call
0709 12:23:35.070099 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.070412 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:35.070436 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:35.070492 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:35.070518 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.070566 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.070656 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:35.072398 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:35.065445 22411 raft_consensus.cc:3055] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:35.073889 22411 raft_consensus.cc:740] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:35.075438 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.075587 18527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2618) took 2116 ms. Trace:
I20260709 12:23:35.076651 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2332) took 1550 ms. Trace:
W20260709 12:23:35.080892 18598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40948 (request call id 2130) took 1600 ms (client timeout 1854 ms). Trace:
W20260709 12:23:35.081346 18598 rpcz_store.cc:269] 0709 12:23:33.480447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.480673 (+   226us) service_pool.cc:224] Handling call
0709 12:23:35.080618 (+1599945us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540041d554. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:35.080807 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2345624832}
I20260709 12:23:35.083314 18597 raft_consensus.cc:1240] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:23:35.076122 18527 rpcz_store.cc:276] 0709 12:23:32.958842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.058776 (+ 99934us) service_pool.cc:224] Handling call
0709 12:23:33.085516 (+ 26740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:33.094843 (+  9327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:33.094875 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:33.094915 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:33.094945 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.075074 (+1980129us) spinlock_profiling.cc:243] Waited 9.11 ms on lock 0x7b5400431f54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:35.075141 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.075389 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20956032}
I20260709 12:23:35.078019 18521 raft_consensus.cc:2410] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:23:35.078809 18676 rpcz_store.cc:276] 0709 12:23:33.525823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.050969 (+1525146us) service_pool.cc:224] Handling call
0709 12:23:35.051505 (+   536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.074015 (+ 22510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:35.076288 (+  2273us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:35.076347 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:35.076390 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.076450 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.076570 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:35.072681 22545 log.cc:927] Time spent T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 1.876s	user 0.010s	sys 0.002s
I20260709 12:23:35.065092 22362 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:35.075327 22411 consensus_queue.cc:260] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:35.101109 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 47951.1us
I20260709 12:23:35.101646 18676 raft_consensus.cc:1240] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 9. Ops: []
I20260709 12:23:35.104429 18526 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 11.
I20260709 12:23:35.108158 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1921) took 1248 ms. Trace:
I20260709 12:23:35.108541 18600 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 12.
I20260709 12:23:35.108768 18676 rpcz_store.cc:276] 0709 12:23:33.859943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.087068 (+1227125us) service_pool.cc:224] Handling call
0709 12:23:35.101308 (+ 14240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.107774 (+  6466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.108071 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:35.113134 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:35.114923 18676 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:23:35.107230 18523 raft_consensus.cc:2468] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 12.
I20260709 12:23:35.115767 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2328) took 1607 ms. Trace:
I20260709 12:23:35.116245 18678 rpcz_store.cc:276] 0709 12:23:33.498942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.920671 (+1421729us) service_pool.cc:224] Handling call
0709 12:23:34.983066 (+ 62395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.105950 (+122884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:35.105978 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:35.106021 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:35.106049 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.106117 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.106227 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:35.129549 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:35.119777 19212 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:35.132978 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:34.979899 22447 consensus_queue.cc:260] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:35.136080 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:35.135313 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 171020us
W20260709 12:23:35.140290 18646 leader_election.cc:336] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.918s (SENT)
W20260709 12:23:35.140684 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.141745 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:35.145215 18678 raft_consensus.cc:1240] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 9. Ops: []
I20260709 12:23:35.146056 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1922) took 1285 ms. Trace:
I20260709 12:23:35.146461 18678 rpcz_store.cc:276] 0709 12:23:33.860303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.121308 (+1261005us) service_pool.cc:224] Handling call
0709 12:23:35.144861 (+ 23553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.145741 (+   880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.145988 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:35.152067 22483 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:35.152572 22488 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:35.153129 22483 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:35.153545 22488 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:35.156121 18572 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:35.157588 22440 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:35.158056 22440 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:35.158509 22440 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:35.160177 18528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2611) took 2251 ms. Trace:
I20260709 12:23:35.160610 18528 rpcz_store.cc:276] 0709 12:23:32.909049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.912489 (+  3440us) service_pool.cc:224] Handling call
0709 12:23:32.912863 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:33.073159 (+160296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:33.073222 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:33.105623 (+ 32401us) log.cc:844] Serialized 26 byte log entry
0709 12:23:33.187990 (+ 82367us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:33.188030 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:33.188097 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:35.071435 (+1883338us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:23:35.142893 (+ 71458us) raft_consensus.cc:1685] finished
0709 12:23:35.142915 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.159985 (+ 17070us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109521,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":6711,"spinlock_wait_cycles":27460992,"thread_start_us":216283,"threads_started":2,"wal-append.queue_time_us":72052}
I20260709 12:23:35.108598 22477 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:35.164283 22477 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:35.167179 22477 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:35.169505 22362 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:35.172655 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:35.172788 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:35.173152 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:35.171705 19212 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:35.174104 18602 raft_consensus.cc:2393] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 10: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:35.174410 22522 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:35.174986 22522 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:35.175478 22522 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:35.179824 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:35.173451 18603 raft_consensus.cc:2393] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 6: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
W20260709 12:23:35.131314 22556 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.004s	sys 0.008s
I20260709 12:23:35.188438 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:35.182221 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:35.134369 22559 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:35.182684 18646 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:35.203425 19212 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
W20260709 12:23:35.204741 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 168709us
I20260709 12:23:35.147606 22527 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:23:35.191246 22556 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.005s	sys 0.008s
I20260709 12:23:35.195866 22411 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:35.217198 19212 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
W20260709 12:23:35.218340 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.220666 18678 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
W20260709 12:23:35.222095 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.224262 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:35.225279 19239 raft_consensus.cc:2393] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 10: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:35.189867 22440 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:35.229521 22440 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:35.221903 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:35.231024 22487 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:35.231287 19247 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:35.200557 22354 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:35.209309 22506 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:35.231849 22487 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:35.232178 22354 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:35.232342 22506 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:35.234270 22487 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:35.234398 22354 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:35.238286 22376 raft_consensus.cc:2804] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:35.238984 22376 raft_consensus.cc:697] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 12 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:35.239863 22487 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:35.240093 22376 consensus_queue.cc:237] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:35.241003 22487 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:35.234398 22506 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:35.197233 22483 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:35.207459 22553 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:35.207510 22530 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:35.244163 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:35.255401 18676 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:35.220230 22536 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:35.256641 18644 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:35.257300 18427 catalog_manager.cc:5697] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.259232 22425 raft_consensus.cc:3055] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:35.259438 18675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2336) took 1605 ms. Trace:
I20260709 12:23:35.266130 18671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2331) took 1759 ms. Trace:
I20260709 12:23:35.211324 22478 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:35.260711 18673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50938 (request call id 514) took 1064 ms. Trace:
I20260709 12:23:35.270972 18673 rpcz_store.cc:276] 0709 12:23:34.196187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.387384 (+191197us) service_pool.cc:224] Handling call
0709 12:23:35.260468 (+873084us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b5400358ed4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:35.260654 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1466518400}
I20260709 12:23:35.271025 22478 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:35.271682 22525 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:35.272326 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:35.272313 22525 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:35.272800 22532 raft_consensus.cc:3055] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:35.273243 22532 raft_consensus.cc:740] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:35.273531 22478 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:35.273684 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:35.274513 18673 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:35.275142 18528 raft_consensus.cc:1275] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:35.276547 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:35.276880 22525 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:35.264829 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 53004.5us
I20260709 12:23:35.278151 18530 raft_consensus.cc:1275] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:23:35.278512 18530 pending_rounds.cc:85] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 4
I20260709 12:23:35.278546 18572 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:35.279647 22471 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:35.281121 22495 consensus_queue.cc:1059] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:35.281632 18677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2313) took 1924 ms. Trace:
I20260709 12:23:35.265755 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:35.270368 22425 raft_consensus.cc:740] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:35.281997 18677 rpcz_store.cc:276] 0709 12:23:33.356753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.358875 (+  2122us) service_pool.cc:224] Handling call
0709 12:23:33.359202 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:33.406561 (+ 47359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.281159 (+1874598us) spinlock_profiling.cc:243] Waited 46.5 ms on lock 0x7b54003a0a54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:35.281467 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106951040}
I20260709 12:23:35.282665 18494 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:35.283211 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:35.282835 22425 consensus_queue.cc:260] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:35.284130 18494 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:35.284353 22425 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:35.285558 18494 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:35.277179 18521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2022) took 1963 ms (client timeout 1529 ms). Trace:
I20260709 12:23:35.221794 22527 raft_consensus.cc:697] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:35.287765 22451 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:35.288625 22451 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:35.289412 22451 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:35.289870 22563 log.cc:927] Time spent T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.782s	user 0.003s	sys 0.000s
I20260709 12:23:35.278867 18530 pending_rounds.cc:107] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 9.5
W20260709 12:23:35.286572 18521 rpcz_store.cc:269] 0709 12:23:33.314480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.314610 (+   130us) service_pool.cc:224] Handling call
0709 12:23:35.276912 (+1962302us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54000997d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:35.277093 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4030061952}
I20260709 12:23:35.290796 18530 raft_consensus.cc:2889] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:35.267153 19247 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:35.263659 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2338) took 1466 ms. Trace:
I20260709 12:23:35.269011 18671 rpcz_store.cc:276] 0709 12:23:33.506603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.033728 (+1527125us) service_pool.cc:224] Handling call
0709 12:23:35.034275 (+   547us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:35.034837 (+   562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:35.034860 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:35.035478 (+   618us) log.cc:844] Serialized 26 byte log entry
0709 12:23:35.212078 (+176600us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:35.212123 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.212205 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:35.265932 (+ 53727us) raft_consensus.cc:1685] finished
0709 12:23:35.265951 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.266076 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3044,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":8861,"thread_start_us":172152,"threads_started":1,"wal-append.queue_time_us":225060}
I20260709 12:23:35.291988 18674 rpcz_store.cc:276] 0709 12:23:33.797632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.262634 (+1465002us) service_pool.cc:224] Handling call
0709 12:23:35.263073 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.263328 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:35.263355 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:35.263393 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:35.263426 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.263482 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.263603 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:35.268092 18675 rpcz_store.cc:276] 0709 12:23:33.654029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.072508 (+1418479us) service_pool.cc:224] Handling call
0709 12:23:35.087898 (+ 15390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:35.114297 (+ 26399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:35.114326 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:35.114957 (+   631us) log.cc:844] Serialized 26 byte log entry
0709 12:23:35.205325 (+ 90368us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:35.205366 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.205449 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:35.259182 (+ 53733us) raft_consensus.cc:1685] finished
0709 12:23:35.259214 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.259378 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4030,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":12703,"thread_start_us":89903,"threads_started":1,"wal-append.queue_time_us":142164}
W20260709 12:23:35.295027 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 157808us
I20260709 12:23:35.295423 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:35.295662 18674 raft_consensus.cc:1240] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:35.297936 22530 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:35.287495 22527 consensus_queue.cc:237] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:35.299341 18678 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:23:35.298812 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1923) took 1438 ms. Trace:
I20260709 12:23:35.300179 22530 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:35.300541 19241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33388 (request call id 532) took 1926 ms. Trace:
I20260709 12:23:35.297775 22536 raft_consensus.cc:697] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:35.301185 18678 raft_consensus.cc:1240] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:23:35.301950 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1927) took 1439 ms. Trace:
I20260709 12:23:35.301873 22536 consensus_queue.cc:237] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:35.302420 18678 rpcz_store.cc:276] 0709 12:23:33.862277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.300587 (+1438310us) service_pool.cc:224] Handling call
0709 12:23:35.300957 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:35.301711 (+   754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.301895 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:35.303854 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.299974 18674 rpcz_store.cc:276] 0709 12:23:33.860603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.295011 (+1434408us) service_pool.cc:224] Handling call
0709 12:23:35.295387 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.298537 (+  3150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.298741 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:35.297775 22369 consensus_queue.cc:1048] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:23:35.305789 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 83685.2us
I20260709 12:23:35.305781 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 515) took 1096 ms. Trace:
W20260709 12:23:35.307056 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.307348 22354 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:35.306814 18674 rpcz_store.cc:276] 0709 12:23:34.209310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.304724 (+1095414us) service_pool.cc:224] Handling call
0709 12:23:35.305153 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.305467 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:35.305496 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:35.305534 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:35.305561 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.305616 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.305724 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:35.309744 22354 raft_consensus.cc:697] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:35.310200 18675 raft_consensus.cc:1240] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 10. Ops: []
I20260709 12:23:35.310878 22354 consensus_queue.cc:237] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:35.315688 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 516) took 1075 ms. Trace:
I20260709 12:23:35.297372 18672 raft_consensus.cc:1240] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:23:35.310881 18675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1924) took 1450 ms. Trace:
W20260709 12:23:35.365859 22594 log.cc:927] Time spent T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
W20260709 12:23:35.374317 22596 log.cc:927] Time spent T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:23:35.377946 22487 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:35.343513 22299 log.cc:927] Time spent T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:23:35.436933 22522 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:35.445601 22522 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:35.461509 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.462183 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.466751 19210 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:35.468170 22522 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:35.469523 19210 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:35.494112 19210 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:35.495421 22538 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:35.496136 22538 raft_consensus.cc:697] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
W20260709 12:23:35.496327 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.497179 22538 consensus_queue.cc:237] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:35.493566 22522 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:35.530041 18678 raft_consensus.cc:1217] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Deduplicated request from leader. Original: 8.4->[9.5-9.5]   Dedup: 9.5->[]
I20260709 12:23:35.530704 18678 raft_consensus.cc:1240] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:23:35.575623 18530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 2026) took 2245 ms. Trace:
I20260709 12:23:35.584556 18530 rpcz_store.cc:276] 0709 12:23:33.330185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.482333 (+152148us) service_pool.cc:224] Handling call
0709 12:23:35.277627 (+1795294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.574046 (+296419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.575329 (+  1283us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54000997d0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:35.575498 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4127724416}
W20260709 12:23:35.597719 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.601416 22532 consensus_queue.cc:260] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:35.610392 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.617278 22559 consensus_queue.cc:1059] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:35.621523 22556 raft_consensus.cc:3055] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:35.622099 22556 raft_consensus.cc:740] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:35.623100 22556 consensus_queue.cc:260] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:35.639219 18672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1926) took 1777 ms. Trace:
I20260709 12:23:35.641898 18672 rpcz_store.cc:276] 0709 12:23:33.861937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.296544 (+1434607us) service_pool.cc:224] Handling call
0709 12:23:35.297005 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:35.638639 (+341634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.639012 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:35.603444 22532 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:23:35.653841 18427 catalog_manager.cc:5697] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.648418 18644 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:35.673539 19242 raft_consensus.cc:1240] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:35.677177 22562 raft_consensus.cc:2764] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:23:35.681761 19209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.686144 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.715615 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 67192.8us
I20260709 12:23:35.729090 18644 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:35.735026 18680 raft_consensus.cc:1240] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 5. Current term is 6. Ops: []
W20260709 12:23:35.733987 18646 leader_election.cc:336] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.021s (SENT)
I20260709 12:23:35.736682 18646 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:35.740764 22431 raft_consensus.cc:2749] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:35.740681 22562 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:35.752935 18679 raft_consensus.cc:1275] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:23:35.753908 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2337) took 2077 ms. Trace:
I20260709 12:23:35.755900 18679 rpcz_store.cc:276] 0709 12:23:33.676958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.719710 (+2042752us) service_pool.cc:224] Handling call
0709 12:23:35.752543 (+ 32833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.753585 (+  1042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.753842 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:35.761881 18427 catalog_manager.cc:5697] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:35.764729 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.765261 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.769559 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:35.770247 18530 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:35.776264 18424 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47728 (request call id 219) took 9427 ms. Trace:
I20260709 12:23:35.300923 19241 rpcz_store.cc:276] 0709 12:23:33.374459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.374605 (+   146us) service_pool.cc:224] Handling call
0709 12:23:33.382136 (+  7531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:33.422644 (+ 40508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.300149 (+1877505us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b54005c12d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:35.300380 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89562880}
W20260709 12:23:35.788489 18570 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.007s	sys 0.007s
W20260709 12:23:35.788906 18570 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.007s	sys 0.007s
W20260709 12:23:35.789182 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 574646us
I20260709 12:23:35.777743 18427 catalog_manager.cc:5697] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:35.836863 22411 consensus_meta.cc:287] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.597s	user 0.013s	sys 0.001s
I20260709 12:23:35.742645 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 518) took 1433 ms. Trace:
I20260709 12:23:35.954972 18680 rpcz_store.cc:276] 0709 12:23:34.302137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.734320 (+1432183us) service_pool.cc:224] Handling call
0709 12:23:35.734765 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.735513 (+   748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.735718 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:35.944396 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 215993us
I20260709 12:23:35.735297 19246 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
W20260709 12:23:35.945089 18646 leader_election.cc:336] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.037s (SENT)
I20260709 12:23:35.959148 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:35.959957 18680 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:23:35.960965 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2340) took 1081 ms. Trace:
I20260709 12:23:35.961587 18680 rpcz_store.cc:276] 0709 12:23:34.879105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.955929 (+1076824us) service_pool.cc:224] Handling call
0709 12:23:35.959368 (+  3439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.960570 (+  1202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.960887 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:35.949596 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.964408 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.969420 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 165068us
I20260709 12:23:35.975842 22523 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.975980 22375 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:35.984442 22523 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:35.984608 22375 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:35.986990 22523 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:35.987066 22375 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:35.980549 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2341) took 1100 ms. Trace:
I20260709 12:23:35.994503 18680 rpcz_store.cc:276] 0709 12:23:34.880004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.964077 (+1084073us) service_pool.cc:224] Handling call
0709 12:23:35.965601 (+  1524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.967311 (+  1710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:35.967455 (+   144us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:35.967900 (+   445us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:35.968177 (+   277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.969252 (+  1075us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.980460 (+ 11208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:36.006347 22447 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:35.987649 22523 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.323390 18676 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
W20260709 12:23:36.010159 18646 leader_election.cc:336] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.071s (SENT)
W20260709 12:23:36.020484 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:36.025137 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 321544us
I20260709 12:23:36.013559 18646 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:36.032665 22350 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:36.036041 22279 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:36.035336 22350 consensus_queue.cc:1048] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:23:36.010847 22523 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:36.052265 22523 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:36.030792 18427 catalog_manager.cc:5697] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:36.062528 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.030795 19210 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:36.070152 18524 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:23:36.070592 18524 pending_rounds.cc:85] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 5
I20260709 12:23:36.070860 18524 pending_rounds.cc:107] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:23:36.071130 18524 raft_consensus.cc:2889] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:36.073491 18597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39798 (request call id 500) took 1160 ms. Trace:
I20260709 12:23:36.073990 18597 rpcz_store.cc:276] 0709 12:23:34.912748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.920227 (+  7479us) service_pool.cc:224] Handling call
0709 12:23:35.082911 (+162684us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:35.083827 (+   916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:36.073215 (+989388us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b540041d550. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:36.073416 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351296896}
I20260709 12:23:36.092159 18524 raft_consensus.cc:1275] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:23:36.094779 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.099319 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1936) took 1999 ms. Trace:
I20260709 12:23:36.099809 18678 rpcz_store.cc:276] 0709 12:23:34.100122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.303204 (+1203082us) service_pool.cc:224] Handling call
0709 12:23:35.303611 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:35.531074 (+227463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:36.098985 (+567911us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54001f2554. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:36.099221 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520215808}
W20260709 12:23:36.110566 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.114646 22556 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:36.118566 18526 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:36.120656 22559 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:36.121380 22559 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:36.130285 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 99594.8us
I20260709 12:23:36.132602 19210 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:36.130751 18530 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:23:36.129791 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2339) took 1291 ms. Trace:
I20260709 12:23:36.136392 18679 rpcz_store.cc:276] 0709 12:23:34.838282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.757694 (+919412us) service_pool.cc:224] Handling call
0709 12:23:36.026164 (+268470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:36.068265 (+ 42101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:36.068297 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:36.068345 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:36.129461 (+ 61116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:36.129552 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:36.129704 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41926,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118}
W20260709 12:23:36.152241 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.157024 22272 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:23:36.157828 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 147852us
I20260709 12:23:36.160913 18526 raft_consensus.cc:1275] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:23:36.163512 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.165673 19212 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:36.151556 22538 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:36.191193 22527 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:36.215646 22527 raft_consensus.cc:697] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:36.216111 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:36.216738 22527 consensus_queue.cc:237] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:36.218655 18526 raft_consensus.cc:1240] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:36.219802 22538 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.220090 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:36.169561 22562 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:36.220862 18529 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:36.169741 22272 consensus_queue.cc:1048] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:23:36.192130 22559 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:36.221768 18530 raft_consensus.cc:1240] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:36.176921 18646 connection.cc:256] RPC call timeout handler was delayed by -1.4887261250000847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2391s for a response
I20260709 12:23:36.178522 22376 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
W20260709 12:23:36.222649 18646 connection.cc:256] RPC call timeout handler was delayed by -1.4203261249999741s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24670000000000003s for a response
W20260709 12:23:36.223018 18646 connection.cc:256] RPC call timeout handler was delayed by -1.0576261249998424s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28700000000000003s for a response
W20260709 12:23:36.197923 22425 consensus_meta.cc:287] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.913s	user 0.015s	sys 0.000s
I20260709 12:23:36.198462 22532 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:36.223598 22559 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:36.224058 22532 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:36.224366 22559 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:36.225248 22354 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:36.225874 22354 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:36.226554 22532 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:36.226786 22559 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:36.227159 22431 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:36.227737 22431 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:36.227412 22559 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:36.230110 22431 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:36.224653 18646 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:36.220304 22538 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:36.168573 18427 catalog_manager.cc:5697] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 6 to 8, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 8 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:36.189481 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:36.249169 18524 raft_consensus.cc:1240] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:36.259001 18680 raft_consensus.cc:2393] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 10: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:36.229565 22559 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:36.285018 18524 raft_consensus.cc:1275] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:36.248278 22532 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.292641 22354 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:36.292497 22532 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:36.282891 22425 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:36.293821 22425 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:36.294772 22532 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:36.295871 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 71216.3us
I20260709 12:23:36.297403 18646 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:36.298066 22559 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:36.298835 22559 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:36.299338 22559 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:35.318224 18674 rpcz_store.cc:276] 0709 12:23:34.247379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.308240 (+1060861us) service_pool.cc:224] Handling call
0709 12:23:35.308658 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.308929 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:35.308960 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:35.309020 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:35.309049 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.315531 (+  6482us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.315633 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:36.298898 18646 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:35.841835 18424 rpcz_store.cc:276] 0709 12:23:26.348414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.353671 (+  5257us) service_pool.cc:224] Handling call
0709 12:23:35.775983 (+9422312us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:29.537656 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:29.581366 (+ 43710us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:29.581403 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:23:29.581420 (+    17us) tablet.cc:662] Decoding operations
0709 12:23:29.581813 (+   393us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:29.581866 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:29.581898 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:23:29.582211 (+   313us) tablet.cc:701] Row locks acquired
0709 12:23:29.582225 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:23:29.582372 (+   147us) write_op.cc:270] Start()
0709 12:23:29.582491 (+   119us) write_op.cc:276] Timestamp: P: 1783599809582321 usec, L: 0
0709 12:23:29.582510 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:23:29.671787 (+ 89277us) log.cc:844] Serialized 930 byte log entry
0709 12:23:30.582984 (+911197us) op_driver.cc:464] REPLICATION: finished
0709 12:23:30.885912 (+302928us) write_op.cc:301] APPLY: starting
0709 12:23:30.885994 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:30.886113 (+   119us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:30.886244 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:30.886734 (+   490us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:30.886909 (+   175us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:23:30.886956 (+    47us) write_op.cc:312] APPLY: finished
0709 12:23:30.887142 (+   186us) log.cc:844] Serialized 29 byte log entry
0709 12:23:30.887341 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:30.887434 (+    93us) write_op.cc:454] Released schema lock
0709 12:23:30.887472 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:30.888690 (+  1218us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:30.888720 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3997,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":288897,"apply.run_cpu_time_us":1787,"apply.run_wall_time_us":2765,"num_ops":2,"prepare.queue_time_us":428315,"prepare.run_cpu_time_us":3443,"prepare.run_wall_time_us":172313,"replication_time_us":947748,"thread_start_us":399138,"threads_started":2}]]}
I20260709 12:23:36.463873 18680 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:36.501212 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2343) took 1618 ms. Trace:
I20260709 12:23:36.501842 18680 rpcz_store.cc:276] 0709 12:23:34.882621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.379656 (+1497035us) service_pool.cc:224] Handling call
0709 12:23:36.463432 (+ 83776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:36.500809 (+ 37377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:36.501133 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:36.315507 18672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 517) took 2026 ms. Trace:
I20260709 12:23:36.505097 18672 rpcz_store.cc:276] 0709 12:23:34.289071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.665687 (+1376616us) service_pool.cc:224] Handling call
0709 12:23:35.666548 (+   861us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:35.667601 (+  1053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:35.667655 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:35.669683 (+  2028us) log.cc:844] Serialized 26 byte log entry
0709 12:23:35.965251 (+295568us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:35.965309 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.965393 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:36.315258 (+349865us) raft_consensus.cc:1685] finished
0709 12:23:36.315286 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:36.315439 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":216,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":124,"thread_start_us":289345,"threads_started":1,"wal-append.queue_time_us":637244}
I20260709 12:23:36.304502 18530 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:35.318971 18675 rpcz_store.cc:276] 0709 12:23:33.860899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.309613 (+1448714us) service_pool.cc:224] Handling call
0709 12:23:35.309962 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.310614 (+   652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.310789 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:36.302721 18523 raft_consensus.cc:1240] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: []
W20260709 12:23:36.517853 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 219059us
I20260709 12:23:36.311057 19246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33372 (request call id 347) took 1258 ms. Trace:
W20260709 12:23:36.398401 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 47007.1us
I20260709 12:23:36.518993 19246 rpcz_store.cc:276] 0709 12:23:35.052687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.053295 (+   608us) service_pool.cc:224] Handling call
0709 12:23:36.310852 (+1257557us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b5400069854. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:36.310987 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1354783104}
W20260709 12:23:36.412352 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 246710us
I20260709 12:23:36.528275 18597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:36.529088 18597 raft_consensus.cc:606] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:23:36.531975 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.517572 22532 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:36.466132 18458 debug-util.cc:398] Leaking SignalData structure 0x7b0800035860 after lost signal to thread 17349
I20260709 12:23:36.277148 22562 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:23:36.536752 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 67557.4us
I20260709 12:23:36.463177 22354 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:36.561065 22354 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:36.561645 22354 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:36.564193 18597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:36.564862 18597 raft_consensus.cc:606] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:23:36.567585 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.567948 22556 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:36.568470 22556 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:36.571697 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:36.572551 18603 raft_consensus.cc:1275] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:23:35.427155 22488 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:36.468107 22418 consensus_queue.cc:1059] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 12:23:36.574764 22382 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.575410 22382 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:36.580734 18523 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 12:23:36.541209 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.299737 22559 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:36.544142 18458 debug-util.cc:398] Leaking SignalData structure 0x7b0800035ae0 after lost signal to thread 18461
I20260709 12:23:36.544859 18680 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:36.548804 18530 raft_consensus.cc:1275] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:23:36.586197 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:36.551134 22532 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:36.547220 22562 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:36.582285 18646 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:36.589254 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2344) took 1706 ms. Trace:
I20260709 12:23:36.596026 18680 rpcz_store.cc:276] 0709 12:23:34.883229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.526630 (+1643401us) service_pool.cc:224] Handling call
0709 12:23:36.540019 (+ 13389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:36.585387 (+ 45368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:36.589167 (+  3780us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:36.539435 22425 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:36.301930 22145 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.276s
I20260709 12:23:36.598438 22272 consensus_queue.cc:1048] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:23:36.603091 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:36.604020 18680 raft_consensus.cc:2393] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 8: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:36.604171 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:36.605973 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2347) took 1564 ms. Trace:
I20260709 12:23:36.598217 22562 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:36.609401 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:36.607363 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:36.620131 22431 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:36.606344 18680 rpcz_store.cc:276] 0709 12:23:35.041251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.605002 (+1563751us) service_pool.cc:224] Handling call
0709 12:23:36.605326 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:36.605646 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:36.605671 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:36.605715 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:36.605747 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:36.605804 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:36.605898 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:36.624114 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 81186.3us
I20260709 12:23:36.598294 22556 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:36.626207 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:36.631434 18600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:36.632117 18600 raft_consensus.cc:606] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:23:36.636706 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.624922 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:36.601905 18524 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:36.640795 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:36.623679 22511 consensus_queue.cc:1048] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:23:36.653255 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:36.654804 18646 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:36.657896 18601 raft_consensus.cc:3055] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:36.658289 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:36.658319 18601 raft_consensus.cc:740] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:36.663558 18599 raft_consensus.cc:1275] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:36.667160 22431 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:36.667385 18646 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:36.667940 22431 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:36.668504 22431 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:36.668993 18646 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:36.669397 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:36.670068 18604 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:23:36.670318 22382 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:36.670547 18646 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:36.668919 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:36.670948 22373 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:23:36.673615 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:36.674731 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:36.675832 18597 raft_consensus.cc:1240] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:36.644002 22556 consensus_queue.cc:1048] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:23:36.680119 22556 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:36.680946 18605 raft_consensus.cc:1275] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:36.642840 22532 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:36.665442 18601 consensus_queue.cc:260] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:36.668824 22447 consensus_meta.cc:287] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.661s	user 0.006s	sys 0.007s
I20260709 12:23:36.632259 22418 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 12:23:36.689745 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.700321 18601 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:36.697608 22487 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:36.697873 22471 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.720678 22431 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:36.732762 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:36.733670 18671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40800 (request call id 1945) took 1508 ms. Trace:
I20260709 12:23:36.734030 18671 rpcz_store.cc:276] 0709 12:23:35.225252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.318345 (+ 93093us) service_pool.cc:224] Handling call
0709 12:23:36.733582 (+1415237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:36.703064 22373 consensus_queue.cc:1059] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:23:36.729841 22431 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:36.736608 22431 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:36.737185 22431 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:36.739506 22431 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:36.714695 22456 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 12:23:36.722337 22487 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:36.732288 22538 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:36.723989 22471 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:36.811180 18601 raft_consensus.cc:1275] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:23:36.813644 19242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33388 (request call id 540) took 1537 ms. Trace:
I20260709 12:23:36.814185 19242 rpcz_store.cc:276] 0709 12:23:35.275811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.275941 (+   130us) service_pool.cc:224] Handling call
0709 12:23:35.276253 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.674789 (+398536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:36.813368 (+1138579us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b54000dd4d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:36.813580 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":913073920}
W20260709 12:23:36.816674 22527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.029s	sys 0.021s
W20260709 12:23:36.820338 22527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.034s	sys 0.021s
I20260709 12:23:36.821414 18526 raft_consensus.cc:1240] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:36.825651 18526 raft_consensus.cc:1240] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:36.828786 18526 raft_consensus.cc:1240] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:36.765484 22431 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:36.862746 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:36.765794 22559 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:36.938710 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:36.984592 18597 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:23:36.939707 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:37.022042 19242 raft_consensus.cc:2393] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 7: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:37.023676 18675 raft_consensus.cc:1240] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:37.025717 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2352) took 1982 ms. Trace:
W20260709 12:23:37.026181 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.026269 18679 rpcz_store.cc:276] 0709 12:23:35.043095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.876469 (+1833374us) service_pool.cc:224] Handling call
0709 12:23:37.025047 (+148578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.025270 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:37.025301 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:37.025359 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:37.025403 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.025477 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:37.025620 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:37.029572 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 359074us
W20260709 12:23:37.030498 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.855979 22431 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:37.052459 18646 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:36.939320 22616 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:37.030412 22299 log.cc:927] Time spent T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:23:37.052281 22527 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:37.108462 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 56110.1us
I20260709 12:23:37.109680 18525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 815) took 1326 ms. Trace:
W20260709 12:23:37.078226 22354 consensus_meta.cc:287] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.516s	user 0.012s	sys 0.000s
I20260709 12:23:37.112787 18677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2350) took 2070 ms. Trace:
I20260709 12:23:37.069533 22631 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:37.116845 18646 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:37.110764 18525 rpcz_store.cc:276] 0709 12:23:35.782966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.783428 (+   462us) service_pool.cc:224] Handling call
0709 12:23:36.317375 (+533947us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x7b5800002798. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:23:36.317587 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:36.317866 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:36.769440 (+451574us) log.cc:844] Serialized 14 byte log entry
0709 12:23:37.109179 (+339739us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:37.109334 (+   155us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:37.109387 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.109485 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:37.109617 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10971,"prepare.queue_time_us":620523,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":6827,"spinlock_wait_cycles":14606720,"thread_start_us":787372,"threads_started":2}
I20260709 12:23:37.115134 18677 rpcz_store.cc:276] 0709 12:23:35.042347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.805676 (+1763329us) service_pool.cc:224] Handling call
0709 12:23:36.853451 (+ 47775us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:36.853660 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:37.018164 (+164504us) log.cc:844] Serialized 14 byte log entry
0709 12:23:37.111850 (+ 93686us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:37.112485 (+   635us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:37.112543 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.112609 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:37.112725 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26564,"thread_start_us":225330,"threads_started":2}
W20260709 12:23:37.124482 19210 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.240.130:37079 timed out after 1.623s (SENT) [suppressed 12 similar messages]
I20260709 12:23:37.123075 18677 raft_consensus.cc:1240] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 6. Current term is 7. Ops: []
W20260709 12:23:37.129375 22611 log.cc:927] Time spent T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.597s	user 0.001s	sys 0.004s
I20260709 12:23:37.129428 18677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 523) took 2042 ms. Trace:
I20260709 12:23:37.130864 18677 rpcz_store.cc:276] 0709 12:23:35.087131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.121369 (+2034238us) service_pool.cc:224] Handling call
0709 12:23:37.122505 (+  1136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.128181 (+  5676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.129226 (+  1045us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:37.132995 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:37.115285 22622 log.cc:927] Time spent T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:23:37.070106 22616 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:37.159354 22431 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:37.159833 22617 log.cc:927] Time spent T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 12:23:37.160068 22431 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:37.164040 22471 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:37.117472 22354 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:37.164892 22562 consensus_meta.cc:287] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.546s	user 0.003s	sys 0.009s
I20260709 12:23:37.166931 22354 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:37.170183 22299 tablet_bootstrap.cc:492] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:37.165827 22562 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:37.171391 18530 raft_consensus.cc:1240] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:37.175437 22361 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:37.176132 22361 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:37.155072 22556 raft_consensus.cc:2749] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:37.110947 22527 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:37.185797 18458 debug-util.cc:398] Leaking SignalData structure 0x7b0800343280 after lost signal to thread 18554
I20260709 12:23:37.157091 22628 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:37.184453 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 1.8988e+06us
I20260709 12:23:37.187707 18676 raft_consensus.cc:1240] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:37.186800 22628 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:37.192127 22562 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:37.193358 22527 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:37.193641 18672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2346) took 2309 ms. Trace:
I20260709 12:23:37.194940 22616 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:37.200971 18677 raft_consensus.cc:1240] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 11. Ops: []
I20260709 12:23:37.177613 22471 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:23:37.203627 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 79154.5us
I20260709 12:23:37.194397 18672 rpcz_store.cc:276] 0709 12:23:34.884621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.534768 (+1650147us) service_pool.cc:224] Handling call
0709 12:23:36.579481 (+ 44713us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:36.768746 (+189265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:36.768776 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:36.804830 (+ 36054us) log.cc:844] Serialized 26 byte log entry
0709 12:23:37.118876 (+314046us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:37.152539 (+ 33663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.155640 (+  3101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:37.193317 (+ 37677us) raft_consensus.cc:1685] finished
0709 12:23:37.193361 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:37.193555 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4851,"raft.queue_time_us":18632,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"thread_start_us":470851,"threads_started":2,"wal-append.queue_time_us":378952}
I20260709 12:23:37.194034 22628 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:37.185586 22559 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:37.222229 18494 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:23:37.230820 18673 consensus_meta.cc:287] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 1.956s	user 0.015s	sys 0.000s
I20260709 12:23:37.231444 18673 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 12.
W20260709 12:23:37.232319 18673 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40800 (request call id 1946) took 2006 ms (client timeout 1770 ms). Trace:
I20260709 12:23:37.232414 18674 raft_consensus.cc:1240] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:37.232869 18673 rpcz_store.cc:269] 0709 12:23:35.225707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.273396 (+ 47689us) service_pool.cc:224] Handling call
0709 12:23:37.232235 (+1958839us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:37.240759 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.222476 22616 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.255489 18672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2353) took 2029 ms. Trace:
I20260709 12:23:37.259227 18672 rpcz_store.cc:276] 0709 12:23:35.226536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.233871 (+2007335us) service_pool.cc:224] Handling call
0709 12:23:37.254952 (+ 21081us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.255146 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:37.255171 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:37.255211 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:37.255239 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.255308 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:37.255433 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:37.260901 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 45026.7us
I20260709 12:23:37.274456 18673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2354) took 2047 ms. Trace:
I20260709 12:23:37.275084 18673 rpcz_store.cc:276] 0709 12:23:35.226886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.237177 (+2010291us) service_pool.cc:224] Handling call
0709 12:23:37.257783 (+ 20606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.263043 (+  5260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:37.274115 (+ 11072us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:37.274169 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:37.274212 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.274279 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:37.274396 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:37.255878 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2348) took 2214 ms. Trace:
I20260709 12:23:37.251933 22447 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:37.216989 22471 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:37.286051 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:37.248186 22361 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:37.281798 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:37.281687 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:37.279448 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:37.289494 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:37.291870 18494 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:37.296814 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 180035us
I20260709 12:23:37.310002 18572 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:37.311338 18600 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 13.
I20260709 12:23:37.307492 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:37.298177 22299 tablet_bootstrap.cc:492] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:23:37.312479 18494 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:37.287648 22447 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:37.321537 18646 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:37.312158 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:37.312637 19242 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 14.
I20260709 12:23:37.313577 18672 raft_consensus.cc:1240] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:37.262707 22616 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:37.306339 22628 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:37.326181 18672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2355) took 2099 ms. Trace:
W20260709 12:23:37.318113 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.329291 22579 raft_consensus.cc:3055] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:37.347970 18521 raft_consensus.cc:1240] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:37.329563 22299 ts_tablet_manager.cc:1403] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 3.157s	user 0.046s	sys 0.019s
I20260709 12:23:37.349148 18672 rpcz_store.cc:276] 0709 12:23:35.227235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.289440 (+2062205us) service_pool.cc:224] Handling call
0709 12:23:37.313402 (+ 23962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.325886 (+ 12484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.326119 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:37.352672 18526 raft_consensus.cc:2393] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 10: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
W20260709 12:23:37.349905 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:37.355633 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.322903 22447 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:37.356544 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.360376 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2357) took 1403 ms. Trace:
I20260709 12:23:37.362437 18678 rpcz_store.cc:276] 0709 12:23:35.957065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.324092 (+1367027us) service_pool.cc:224] Handling call
0709 12:23:37.353986 (+ 29894us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.360028 (+  6042us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:37.360061 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:37.360108 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:37.360144 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.360205 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:37.360319 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:37.360879 18572 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:23:37.364329 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 50268.7us
I20260709 12:23:37.330958 22361 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:37.360049 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.348601 22579 raft_consensus.cc:740] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:37.347751 22628 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:37.374025 22411 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:37.376348 22411 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:37.376739 22471 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:37.376844 22411 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:37.377416 18678 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:37.378032 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 528) took 1235 ms. Trace:
I20260709 12:23:37.378373 18678 rpcz_store.cc:276] 0709 12:23:36.142535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.363350 (+1220815us) service_pool.cc:224] Handling call
0709 12:23:37.377064 (+ 13714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.377781 (+   717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.377975 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:37.378923 22425 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.380072 22226 consensus_queue.cc:1059] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:23:37.381233 22226 raft_consensus.cc:3055] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:37.381274 18675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2345) took 2497 ms. Trace:
I20260709 12:23:37.381716 22226 raft_consensus.cc:740] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:37.381922 18675 rpcz_store.cc:276] 0709 12:23:34.883926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.527451 (+1643525us) service_pool.cc:224] Handling call
0709 12:23:36.543626 (+ 16175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.030183 (+486557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.380950 (+350767us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b54000582d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:37.381196 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1103323008}
I20260709 12:23:37.382743 22226 consensus_queue.cc:260] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:37.385751 22579 consensus_queue.cc:260] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:37.386960 22579 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:37.389605 18672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 527) took 1247 ms. Trace:
I20260709 12:23:37.390328 18672 rpcz_store.cc:276] 0709 12:23:36.142223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.352182 (+1209959us) service_pool.cc:224] Handling call
0709 12:23:37.367066 (+ 14884us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.389297 (+ 22231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:37.389325 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:37.389368 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:37.389398 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.389456 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:37.389553 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:37.359288 22532 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:37.392930 18671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2349) took 2351 ms. Trace:
I20260709 12:23:37.392550 18678 raft_consensus.cc:1275] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:37.353453 22650 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:37.277137 18680 rpcz_store.cc:276] 0709 12:23:35.041686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.621294 (+1579608us) service_pool.cc:224] Handling call
0709 12:23:36.621629 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:36.621916 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:36.938845 (+316929us) log.cc:844] Serialized 14 byte log entry
0709 12:23:37.255361 (+316516us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:37.255556 (+   195us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:37.255633 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.255697 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:37.255824 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29465,"prepare.queue_time_us":494776,"prepare.run_cpu_time_us":448,"prepare.run_wall_time_us":8540,"raft.queue_time_us":30472,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":2766,"thread_start_us":422793,"threads_started":2,"wal-append.queue_time_us":140900}
I20260709 12:23:37.397475 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 529) took 1154 ms. Trace:
I20260709 12:23:37.401707 18678 rpcz_store.cc:276] 0709 12:23:36.243564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.379159 (+1135595us) service_pool.cc:224] Handling call
0709 12:23:37.379489 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.397102 (+ 17613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.397399 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:37.379415 22425 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:37.390684 22628 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:37.414614 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:37.415647 18527 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
I20260709 12:23:37.418077 22649 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:23:37.393268 22532 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:37.419986 18646 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:37.420325 22532 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:37.420959 22559 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:37.421396 22559 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:37.421499 18646 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:37.421831 22559 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:37.422356 22626 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:37.422580 22651 log.cc:927] Time spent T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:23:37.423807 18646 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:37.424475 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.425668 22626 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:37.426071 22626 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:37.426452 22626 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:37.430264 22659 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:37.430603 22559 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:37.431097 22659 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.431811 22659 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:37.433756 22352 consensus_queue.cc:1059] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:37.434293 22659 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:37.435571 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.435940 22440 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:37.436663 22559 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:37.436105 22524 raft_consensus.cc:3055] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:37.437577 22524 raft_consensus.cc:740] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:37.437834 22361 consensus_queue.cc:1059] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:37.438643 22524 consensus_queue.cc:260] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:37.439399 18572 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:23:37.438202 22647 log.cc:927] Time spent T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:23:37.435286 22352 consensus_queue.cc:1048] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:37.443302 18521 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:23:37.461854 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 149480us
W20260709 12:23:37.473248 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 49577.7us
I20260709 12:23:37.474752 18494 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:37.467499 22511 raft_consensus.cc:3055] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:37.436194 22447 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:37.477101 19241 raft_consensus.cc:1240] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:23:37.472986 22524 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:37.470240 22471 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:37.481369 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:37.483078 18458 debug-util.cc:398] Leaking SignalData structure 0x7b080031d640 after lost signal to thread 18630
I20260709 12:23:37.481609 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:37.491285 19246 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:37.482337 18598 raft_consensus.cc:3055] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:23:37.492218 18458 debug-util.cc:398] Leaking SignalData structure 0x7b08002b11e0 after lost signal to thread 18705
I20260709 12:23:37.481323 18646 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:37.492043 18598 raft_consensus.cc:740] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:37.517436 18458 debug-util.cc:398] Leaking SignalData structure 0x7b0800331500 after lost signal to thread 18706
W20260709 12:23:37.519300 18458 debug-util.cc:398] Leaking SignalData structure 0x7b080033f760 after lost signal to thread 19274
W20260709 12:23:37.519722 18458 debug-util.cc:398] Leaking SignalData structure 0x7b08003c7ec0 after lost signal to thread 19275
W20260709 12:23:37.520835 18458 debug-util.cc:398] Leaking SignalData structure 0x7b08003865a0 after lost signal to thread 22434
I20260709 12:23:37.440306 22421 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:23:37.527916 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 522) took 2441 ms. Trace:
W20260709 12:23:37.528403 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.529526 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:37.530576 19240 raft_consensus.cc:2393] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 14: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:37.467702 22373 consensus_queue.cc:1048] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:23:37.531774 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:37.532610 19239 raft_consensus.cc:2393] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 10: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:37.477149 22511 raft_consensus.cc:740] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:37.536664 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 59213.4us
I20260709 12:23:37.537068 22511 consensus_queue.cc:260] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:37.538105 22511 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:37.540366 22655 log.cc:927] Time spent T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:23:37.541617 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:37.544945 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2342) took 2663 ms. Trace:
I20260709 12:23:37.545361 18674 rpcz_store.cc:276] 0709 12:23:34.881910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.313190 (+1431280us) service_pool.cc:224] Handling call
0709 12:23:37.232235 (+919045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.235944 (+  3709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.544749 (+308805us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b5400357fd0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:37.544887 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2112714112}
I20260709 12:23:37.545969 22616 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:37.547315 22425 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:37.547070 22628 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:37.548318 22440 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.548812 22440 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:37.549487 22628 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:37.479823 22527 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:23:37.551124 19244 raft_consensus.cc:1240] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:37.485738 22471 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:37.550889 22440 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:37.533952 18598 consensus_queue.cc:260] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:37.603657 18598 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:37.563982 22447 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:37.606359 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2351) took 2563 ms. Trace:
I20260709 12:23:37.606772 18676 rpcz_store.cc:276] 0709 12:23:35.042792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.822553 (+1779761us) service_pool.cc:224] Handling call
0709 12:23:36.822925 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.188211 (+365286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.606100 (+417889us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54000be0d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:37.606292 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":838376320}
W20260709 12:23:37.569687 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 98856.5us
I20260709 12:23:37.530015 18679 rpcz_store.cc:276] 0709 12:23:35.086800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.056870 (+1970070us) service_pool.cc:224] Handling call
0709 12:23:37.073895 (+ 17025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.077706 (+  3811us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:37.313714 (+236008us) log.cc:844] Serialized 14 byte log entry
0709 12:23:37.527528 (+213814us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:37.527597 (+    69us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:37.527645 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.527712 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:37.527856 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":50989,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":42363,"thread_start_us":358201,"threads_started":2}
I20260709 12:23:37.552378 18672 raft_consensus.cc:1240] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:37.551411 22628 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:37.535676 22559 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:37.568584 22382 raft_consensus.cc:3055] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:37.615913 22658 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:37.616466 22658 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:37.616881 22658 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:37.602757 22471 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:37.626035 18494 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:37.627045 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:37.638327 18679 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:37.628484 22628 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:37.630178 22299 raft_consensus.cc:359] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:23:37.634013 18674 raft_consensus.cc:1240] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:37.634802 22649 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.613406 22382 raft_consensus.cc:740] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:37.636328 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:37.640151 22487 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:37.624428 22411 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:37.613802 22559 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:37.652679 18676 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 14.
I20260709 12:23:37.663856 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:37.661268 22556 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.667413 22556 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:37.670024 18672 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:37.650373 22299 raft_consensus.cc:740] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
W20260709 12:23:37.671726 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 58579us
I20260709 12:23:37.674623 22628 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:37.679695 18530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2650) took 1036 ms. Trace:
I20260709 12:23:37.680330 18530 rpcz_store.cc:276] 0709 12:23:36.643704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.724925 (+ 81221us) service_pool.cc:224] Handling call
0709 12:23:37.171186 (+446261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.174200 (+  3014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.679428 (+505228us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b54000d1450. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:37.679615 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":962901248}
I20260709 12:23:37.665359 22559 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:37.665078 22447 raft_consensus.cc:2804] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:37.648159 22626 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:37.687368 18494 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:37.689726 18494 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:37.690896 22656 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:37.684974 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 532) took 1130 ms. Trace:
W20260709 12:23:37.687536 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 267655us
W20260709 12:23:37.696031 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 256709us
I20260709 12:23:37.697307 18572 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:37.659638 22649 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:37.699133 18646 leader_election.cc:336] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.610s (SENT)
W20260709 12:23:37.684993 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 291695us
I20260709 12:23:37.691567 22656 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:37.701594 18676 raft_consensus.cc:1240] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:37.700613 18646 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:37.703210 18644 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:37.710829 18646 leader_election.cc:336] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.730s (SENT)
I20260709 12:23:37.711498 18646 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:37.706322 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:37.706566 19212 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:37.711706 22650 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:37.696944 22382 consensus_queue.cc:260] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:37.700060 22511 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:37.717203 22650 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:37.717700 22650 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.718048 22650 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:37.700591 22447 raft_consensus.cc:697] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:37.704866 22656 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:37.701968 22660 raft_consensus.cc:2804] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:37.718990 22628 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:37.717195 22382 raft_consensus.cc:3060] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:37.747489 18494 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:23:37.749632 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.750154 18679 raft_consensus.cc:1275] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:37.730259 22556 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:37.713054 22522 consensus_queue.cc:1048] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:23:37.759492 22421 raft_consensus.cc:993] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:23:37.760269 22421 raft_consensus.cc:1081] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:23:37.753661 22487 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:37.761391 22487 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:37.761842 22487 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:37.751823 22660 raft_consensus.cc:697] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:37.764655 22665 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:37.765130 22665 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:37.765836 22665 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:37.765643 22660 consensus_queue.cc:237] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:37.759408 22532 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:37.772449 22666 raft_consensus.cc:2804] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:37.772974 22666 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.773355 22666 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:37.773563 22532 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:37.774983 22487 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:37.779953 22447 consensus_queue.cc:237] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:37.700121 22299 consensus_queue.cc:260] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:23:37.743876 22411 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:37.735026 22511 consensus_queue.cc:1059] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
W20260709 12:23:37.804520 22663 log.cc:927] Time spent T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:23:37.805414 22511 raft_consensus.cc:3055] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:23:37.756289 22661 log.cc:927] Time spent T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:23:37.806998 22649 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:37.804549 22626 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:37.808112 22299 ts_tablet_manager.cc:1434] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.448s	user 0.004s	sys 0.006s
I20260709 12:23:37.802513 18494 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:37.805864 22511 raft_consensus.cc:740] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:37.837157 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:37.842686 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.793503 22628 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:37.845789 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:37.846571 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.807009 22538 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:37.848098 22495 raft_consensus.cc:2804] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:37.849973 22495 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:37.850379 22495 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:37.854125 22511 consensus_queue.cc:260] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:37.855685 22511 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:37.802513 22658 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:37.858023 22658 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:37.858058 18494 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:37.847886 22487 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:37.859939 22672 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:37.860412 22487 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:37.860945 22487 raft_consensus.cc:697] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:37.861887 22487 consensus_queue.cc:237] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:37.862496 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 69539.9us
W20260709 12:23:37.864055 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.864229 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:37.692190 18680 rpcz_store.cc:276] 0709 12:23:36.554666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.407188 (+852522us) service_pool.cc:224] Handling call
0709 12:23:37.460937 (+ 53749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.461200 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:37.474029 (+ 12829us) log.cc:844] Serialized 14 byte log entry
0709 12:23:37.684651 (+210622us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:37.684708 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:37.684749 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.684809 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:37.684919 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14531,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":37,"raft.queue_time_us":604,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":6261,"thread_start_us":209618,"threads_started":1}
I20260709 12:23:37.867923 22361 consensus_queue.cc:1059] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:37.870760 18494 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:37.859150 22666 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:37.877781 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.887476 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:37.888202 18525 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:37.896219 18530 raft_consensus.cc:1240] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:37.881281 22411 raft_consensus.cc:3055] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:37.847831 22421 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:23:37.891757 22659 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:23:37.921640 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 215180us
W20260709 12:23:37.960409 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 257257us
I20260709 12:23:37.876451 22628 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:37.913009 18527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
W20260709 12:23:37.923853 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 217612us
I20260709 12:23:37.880105 22650 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:37.968683 18527 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:37.884282 22471 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:37.960052 18523 pending_rounds.cc:85] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 5
I20260709 12:23:37.975879 18523 pending_rounds.cc:107] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:23:37.976166 18523 raft_consensus.cc:2889] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:37.974776 18527 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:37.918488 22411 raft_consensus.cc:740] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:37.982409 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:37.985292 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 274514us
I20260709 12:23:37.977646 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:37.994865 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:37.997346 18679 raft_consensus.cc:2393] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 11: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:38.000372 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:38.002842 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:37.983343 22659 raft_consensus.cc:697] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:23:38.010191 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.037730 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:38.040731 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 148793us
W20260709 12:23:38.045584 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 58526.4us
I20260709 12:23:38.046953 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:38.053256 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:38.073825 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:38.074301 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:38.076037 18680 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 14.
I20260709 12:23:38.110210 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:38.121248 18494 connection.cc:256] RPC call timeout handler was delayed by -2.6764465030000792s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21030000000000004s for a response
I20260709 12:23:38.132273 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:38.039395 22656 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:38.133267 18679 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
I20260709 12:23:38.070565 22559 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:38.137234 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.086731 22626 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.141215 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:38.141476 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:38.142278 18598 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:38.136281 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:38.047904 22676 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 12:23:38.040030 22411 consensus_queue.cc:260] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:38.143277 18680 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
I20260709 12:23:38.148247 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:38.148747 18644 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:38.148981 18679 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:38.118873 22689 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:38.169364 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:38.170733 18604 raft_consensus.cc:1240] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:38.170632 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:38.171121 22685 log.cc:927] Time spent T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:23:38.171516 22678 consensus_queue.cc:1059] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:23:38.172887 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:38.180997 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:38.182334 18525 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
I20260709 12:23:38.194366 18601 raft_consensus.cc:2468] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:23:38.136348 22682 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.138836 22666 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:38.081611 22665 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:38.217340 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:38.212764 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:38.219113 18525 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:38.172506 22226 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:38.230921 18680 raft_consensus.cc:2393] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 8: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
W20260709 12:23:38.212016 22683 log.cc:927] Time spent T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:23:38.252313 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:38.253789 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:38.138549 22659 consensus_queue.cc:237] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:38.232584 22556 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:38.167016 22649 consensus_queue.cc:1048] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:23:38.150063 22626 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:38.228973 22411 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:38.253170 18680 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:23:38.254587 22693 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:38.284541 22693 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:38.286978 22693 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:38.293290 22471 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:38.297026 22656 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:38.199914 22689 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:38.300812 22628 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:38.301327 18597 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:23:38.260645 22556 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.302295 22556 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:38.263880 22675 consensus_queue.cc:1059] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:23:38.304857 22675 raft_consensus.cc:3055] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:38.305220 22675 raft_consensus.cc:740] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:38.306149 22675 consensus_queue.cc:260] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:38.307430 22675 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:38.264566 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:38.320058 18525 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:38.321564 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:38.325953 18678 raft_consensus.cc:2393] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 10: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:38.323071 18527 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:38.274852 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:38.333083 18680 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:38.338967 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.340317 18599 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:23:38.295413 22559 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:38.341854 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:38.260526 22688 log.cc:927] Time spent T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:23:38.282678 22626 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:38.348053 22495 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:38.273770 22679 log.cc:927] Time spent T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:23:38.357179 18673 raft_consensus.cc:1240] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:38.359920 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:38.361639 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:38.367861 18527 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:38.276650 22616 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.216159 22682 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:38.265242 22680 log.cc:927] Time spent T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:23:38.355541 22628 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:38.388319 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.384243 18674 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
I20260709 12:23:38.396448 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:38.383695 18678 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:23:38.397147 18675 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:38.275650 22527 raft_consensus.cc:3055] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:23:38.400838 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 429921us
W20260709 12:23:38.402899 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 355458us
W20260709 12:23:38.403942 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 269265us
W20260709 12:23:38.408699 18494 connection.cc:256] RPC call timeout handler was delayed by -2.5986807249996673s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
I20260709 12:23:38.266156 22665 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:38.417073 22495 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:38.424149 22682 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:38.403709 22628 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:38.428329 22628 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:38.397938 22616 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:38.432659 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.433435 22376 consensus_queue.cc:1048] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:23:38.435494 22640 log.cc:927] Time spent T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 1.087s	user 0.000s	sys 0.008s
I20260709 12:23:38.436887 18679 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
W20260709 12:23:38.444377 18494 connection.cc:256] RPC call timeout handler was delayed by -1.5701196439999876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260709 12:23:38.444964 18494 connection.cc:256] RPC call timeout handler was delayed by -1.551219643999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
I20260709 12:23:38.445755 18675 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 13.
I20260709 12:23:38.341604 22656 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:38.300880 22689 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:38.455019 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:38.456598 18679 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
W20260709 12:23:38.458827 18494 connection.cc:256] RPC call timeout handler was delayed by -1.5305196439999236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
W20260709 12:23:38.459388 18494 connection.cc:256] RPC call timeout handler was delayed by -1.4045196440001746s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
W20260709 12:23:38.459836 18494 connection.cc:256] RPC call timeout handler was delayed by -1.4018196440001702s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1773s for a response
W20260709 12:23:38.460255 18494 connection.cc:256] RPC call timeout handler was delayed by -1.3928196440001557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
W20260709 12:23:38.460650 18494 connection.cc:256] RPC call timeout handler was delayed by -1.3730196440001237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
W20260709 12:23:38.461045 18494 connection.cc:256] RPC call timeout handler was delayed by -1.3487196440000844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
W20260709 12:23:38.461418 18494 connection.cc:256] RPC call timeout handler was delayed by -1.1822196439998152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
W20260709 12:23:38.462037 18494 connection.cc:256] RPC call timeout handler was delayed by -1.1822196439998152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
W20260709 12:23:38.462437 18494 connection.cc:256] RPC call timeout handler was delayed by -1.0958196440001302s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21130000000000002s for a response
W20260709 12:23:38.462826 18494 connection.cc:256] RPC call timeout handler was delayed by -1.0256196440000167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2191s for a response
W20260709 12:23:38.463192 18494 connection.cc:256] RPC call timeout handler was delayed by -1.0220196440000109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2195s for a response
W20260709 12:23:38.464583 19209 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.013s	sys 0.028s
W20260709 12:23:38.465117 19209 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.014s	sys 0.028s
I20260709 12:23:38.469923 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:38.470474 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:38.472030 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:38.473840 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:38.474391 18598 raft_consensus.cc:2393] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 10: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:38.474964 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:38.406775 22527 raft_consensus.cc:740] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:38.482313 18494 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:38.484302 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:38.484892 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:38.485755 18679 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:38.486347 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:38.431651 22616 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:38.488648 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:38.510963 18604 raft_consensus.cc:1240] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 10. Ops: []
I20260709 12:23:38.517496 18677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1944) took 3292 ms. Trace:
I20260709 12:23:38.518086 18677 rpcz_store.cc:276] 0709 12:23:35.224925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.134031 (+1909106us) service_pool.cc:224] Handling call
0709 12:23:37.197282 (+ 63251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.212828 (+ 15546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:38.218856 (+1006028us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b54001f1654. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:38.517210 (+298354us) spinlock_profiling.cc:243] Waited 62.5 ms on lock 0x7b54001f1650. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:38.517411 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150812160}
I20260709 12:23:38.520076 18599 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:23:38.523434 18679 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 11.
I20260709 12:23:38.524730 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:38.525359 18679 raft_consensus.cc:2393] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 15: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:38.527328 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:38.515443 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 45850.7us
I20260709 12:23:38.530965 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:38.531365 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:38.464872 22682 consensus_queue.cc:1048] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:23:38.538861 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:38.537463 18680 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
I20260709 12:23:38.460444 22656 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:38.545598 18677 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 6.
I20260709 12:23:38.546027 18494 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:38.546523 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:38.547225 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:38.581784 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:38.532423 22382 consensus_queue.cc:1059] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:23:38.581152 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:38.650010 18679 raft_consensus.cc:2393] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 8: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:38.582616 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:38.555361 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:37.394111 18671 rpcz_store.cc:276] 0709 12:23:35.042036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.734846 (+1692810us) service_pool.cc:224] Handling call
0709 12:23:36.735163 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:36.735445 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:37.036920 (+301475us) log.cc:844] Serialized 14 byte log entry
0709 12:23:37.392587 (+355667us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:37.392640 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:37.392683 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.392753 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:37.392876 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":392639,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":18665,"thread_start_us":563770,"threads_started":2}
I20260709 12:23:38.652092 18671 raft_consensus.cc:1240] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 7. Current term is 8. Ops: []
W20260709 12:23:38.596028 22642 log.cc:927] Time spent T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 1.339s	user 0.006s	sys 0.001s
I20260709 12:23:38.597836 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:38.599030 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:38.601426 22687 log.cc:927] Time spent T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 12:23:38.604149 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
W20260709 12:23:38.604735 22695 log.cc:927] Time spent T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.312s	user 0.002s	sys 0.000s
I20260709 12:23:38.609377 18597 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:38.590530 18680 raft_consensus.cc:1240] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:38.657752 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2378) took 1102 ms. Trace:
I20260709 12:23:38.658578 18680 rpcz_store.cc:276] 0709 12:23:37.555728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:38.549495 (+993767us) service_pool.cc:224] Handling call
0709 12:23:38.590282 (+ 40787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:38.657148 (+ 66866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:38.657614 (+   466us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:38.535998 22689 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:38.545267 18570 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:38.630168 18530 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:23:38.630554 18676 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:38.664486 19212 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:38.664942 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:38.665791 19239 raft_consensus.cc:2393] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 7: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:38.631031 18605 raft_consensus.cc:2393] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 11: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:38.668059 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:38.668613 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:38.648154 22699 log.cc:927] Time spent T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:23:38.669178 19246 raft_consensus.cc:1275] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:23:38.675832 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 129879us
I20260709 12:23:38.682170 18676 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:23:38.685325 18677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2380) took 1129 ms. Trace:
I20260709 12:23:38.685897 18677 rpcz_store.cc:276] 0709 12:23:37.556625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:38.630364 (+1073739us) service_pool.cc:224] Handling call
0709 12:23:38.684671 (+ 54307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:38.684906 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:38.684945 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:38.685001 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:38.685045 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:38.685117 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:38.685250 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:38.629799 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:38.689911 18494 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:38.675338 22538 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:38.695925 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:38.688179 22628 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:38.700773 22628 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:38.701201 22701 log.cc:927] Time spent T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:23:38.703492 22628 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:38.694911 22538 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.705272 22538 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:38.706712 18673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2373) took 1152 ms. Trace:
I20260709 12:23:38.707243 18673 rpcz_store.cc:276] 0709 12:23:37.553993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:38.420743 (+866750us) service_pool.cc:224] Handling call
0709 12:23:38.421065 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:38.421483 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:38.421512 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:38.421999 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 12:23:38.632399 (+210400us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:38.632439 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:38.632506 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:38.706399 (+ 73893us) raft_consensus.cc:1685] finished
0709 12:23:38.706428 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:38.706618 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":404,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"thread_start_us":209992,"threads_started":1,"wal-append.queue_time_us":282412}
I20260709 12:23:38.711781 22712 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:23:38.713269 18528 raft_consensus.cc:1240] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:38.721633 22656 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:38.722410 18521 raft_consensus.cc:1240] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:38.723342 22556 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:38.724502 18521 raft_consensus.cc:1240] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:38.724532 18528 raft_consensus.cc:1240] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 7. Current term is 8. Ops: []
W20260709 12:23:38.726517 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 192742us
W20260709 12:23:38.731014 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 52990.3us
I20260709 12:23:38.734244 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:38.734501 22495 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:38.735590 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:38.735209 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:38.745071 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:38.728938 22373 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:38.753382 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:38.757594 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:38.760236 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:38.750313 22522 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.018s	sys 0.043s
W20260709 12:23:38.793843 22522 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.019s	sys 0.045s
W20260709 12:23:38.827231 22667 log.cc:927] Time spent T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:23:38.846048 22579 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.021s	sys 0.024s
I20260709 12:23:38.848074 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:38.842867 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:38.757959 22226 consensus_queue.cc:1059] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 12:23:38.834116 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:38.818655 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:38.850325 22382 raft_consensus.cc:3055] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:38.850828 18528 raft_consensus.cc:2410] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:23:38.834815 22495 raft_consensus.cc:697] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:23:38.851263 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 94322.8us
I20260709 12:23:38.850647 18521 raft_consensus.cc:2393] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 11: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:38.850577 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:38.774580 22556 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:38.853448 18570 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:38.855535 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.856973 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:38.859989 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:38.854621 22579 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.022s	sys 0.025s
I20260709 12:23:38.866361 22704 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:38.850761 22382 raft_consensus.cc:740] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:38.855077 22693 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:38.859452 22373 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:38.878444 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:38.870991 22704 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:38.897042 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:38.879442 22373 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.867168 22713 consensus_queue.cc:1059] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:23:38.897886 22361 consensus_queue.cc:1048] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:38.906767 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:38.907918 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:38.907727 18521 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:38.909005 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:38.910053 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:38.910830 18529 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:38.911434 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:38.900657 22704 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:38.913643 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:38.914309 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:38.914546 18521 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:38.904903 22373 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:38.866708 22495 consensus_queue.cc:237] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:38.922684 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:38.924475 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:38.925314 18529 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:23:38.925581 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:38.926374 18523 raft_consensus.cc:2393] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 13: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:38.926254 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:38.927057 18529 raft_consensus.cc:2393] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 10: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:38.927626 18672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 2377) took 1372 ms. Trace:
I20260709 12:23:38.931273 18672 rpcz_store.cc:276] 0709 12:23:37.555402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.649088 (+ 93686us) service_pool.cc:224] Handling call
0709 12:23:38.927418 (+1278330us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b5400358ed4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:38.927552 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11987200}
I20260709 12:23:38.943241 22650 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:38.963299 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:38.963927 18602 raft_consensus.cc:1240] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:38.963936 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:38.965287 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:23:38.966751 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.966903 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:38.968326 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:38.970280 22704 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:38.965324 18605 raft_consensus.cc:2410] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:23:38.971542 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:38.972715 22723 log.cc:927] Time spent T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:23:38.984220 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:23:38.986819 22700 log.cc:927] Time spent T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.714s	user 0.000s	sys 0.003s
I20260709 12:23:38.951001 22527 consensus_queue.cc:260] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:38.998309 22538 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:39.004210 19210 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:38.910404 22382 consensus_queue.cc:260] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:39.006614 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:39.008091 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:39.059448 18523 raft_consensus.cc:2393] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 8: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:39.015794 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:39.060190 18522 raft_consensus.cc:2393] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 8: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:39.049178 22710 raft_consensus.cc:3055] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:39.052740 18528 raft_consensus.cc:2393] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 7: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:39.053388 18602 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:39.054407 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:23:39.057928 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 54161.2us
I20260709 12:23:39.074510 19210 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:39.076404 19210 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:23:39.061587 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.060621 18530 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:23:39.049065 18644 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:39.072026 18599 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:39.062176 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:39.078444 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:39.079864 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:39.081347 18644 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:39.088171 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:39.090080 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:39.080113 22727 log.cc:927] Time spent T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 12:23:39.118299 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:39.119732 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:39.120054 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:39.120711 18522 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:39.087836 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:39.125628 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:39.126618 22731 log.cc:927] Time spent T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 12:23:39.127034 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:39.123327 18572 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:39.067842 22678 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:39.125747 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:39.129102 18572 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:39.133987 18523 raft_consensus.cc:2393] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 11: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:39.128082 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:39.134907 18530 raft_consensus.cc:2393] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 6: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:39.135205 19246 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:39.136107 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:39.129333 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:39.128012 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:39.130059 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:39.072992 22710 raft_consensus.cc:740] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:39.140027 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2673) took 1269 ms. Trace:
I20260709 12:23:39.080579 22527 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:39.140414 18526 rpcz_store.cc:276] 0709 12:23:37.870321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.873247 (+  2926us) service_pool.cc:224] Handling call
0709 12:23:37.873514 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:37.980579 (+107065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:37.980814 (+   235us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:37.991686 (+ 10872us) log.cc:844] Serialized 26 byte log entry
0709 12:23:38.076123 (+ 84437us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:38.076160 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:38.076224 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:38.986041 (+909817us) spinlock_profiling.cc:243] Waited 43.9 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:23:39.134125 (+148084us) raft_consensus.cc:1685] finished
0709 12:23:39.134146 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:39.139962 (+  5816us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9629,"raft.queue_time_us":17209,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":14534,"spinlock_wait_cycles":100878592,"thread_start_us":131018,"threads_started":2,"wal-append.queue_time_us":269895}
I20260709 12:23:39.080986 22706 raft_consensus.cc:2804] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:39.137503 19240 raft_consensus.cc:2410] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:23:39.137145 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 267659us
I20260709 12:23:39.150911 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:39.152479 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:39.154464 18602 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:39.154740 18675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2375) took 1600 ms. Trace:
I20260709 12:23:39.155303 18675 rpcz_store.cc:276] 0709 12:23:37.554576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:38.448017 (+893441us) service_pool.cc:224] Handling call
0709 12:23:38.468268 (+ 20251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:38.481915 (+ 13647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:38.481959 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:38.526437 (+ 44478us) log.cc:844] Serialized 26 byte log entry
0709 12:23:38.748780 (+222343us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:38.748915 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:38.749092 (+   177us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:39.154467 (+405375us) raft_consensus.cc:1685] finished
0709 12:23:39.154497 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:39.154666 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15703,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":5068,"thread_start_us":132842,"threads_started":1,"wal-append.queue_time_us":324762}
I20260709 12:23:39.119609 22556 raft_consensus.cc:2804] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:39.119781 22712 raft_consensus.cc:2804] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:39.160419 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:39.162798 18526 raft_consensus.cc:1240] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:23:39.168524 18494 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.170238 18494 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.128229 22628 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:23:39.143042 22730 log.cc:927] Time spent T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 12:23:39.132241 22382 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:39.123004 22674 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:39.134716 22352 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:39.080793 22522 consensus_queue.cc:1059] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:23:39.182619 18599 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 15.
I20260709 12:23:39.136778 22675 consensus_queue.cc:1059] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:23:39.130950 22440 consensus_queue.cc:1059] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:23:39.147804 22706 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.146368 22713 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:39.187062 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:39.191875 18527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2686) took 1127 ms. Trace:
I20260709 12:23:39.192272 18530 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:39.163517 22678 raft_consensus.cc:697] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:39.194541 18680 raft_consensus.cc:1240] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:23:39.192294 18527 rpcz_store.cc:276] 0709 12:23:38.064043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:38.419653 (+355610us) service_pool.cc:224] Handling call
0709 12:23:38.436516 (+ 16863us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:38.628131 (+191615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:38.628168 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:38.628218 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:38.628274 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:39.191593 (+563319us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54000825d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:39.191643 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:39.191810 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440005888}
I20260709 12:23:39.186898 22674 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:39.166013 22556 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.199726 18527 raft_consensus.cc:1240] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:23:39.175858 22656 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:39.196462 22352 raft_consensus.cc:697] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:39.208932 22704 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:39.209120 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:39.209726 18523 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:39.209327 22352 consensus_queue.cc:237] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:39.200852 22674 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:39.201016 22556 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:39.207464 22579 raft_consensus.cc:993] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:23:39.184087 22712 raft_consensus.cc:697] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 8 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:39.207396 19246 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 15.
I20260709 12:23:39.172722 22650 consensus_queue.cc:1048] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:23:39.197111 22706 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:39.210306 22538 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:39.231513 18522 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:39.236181 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:23:39.225816 22724 log.cc:927] Time spent T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
I20260709 12:23:39.241410 18494 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.241525 22712 consensus_queue.cc:237] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:39.213258 22713 raft_consensus.cc:697] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:39.239243 22694 raft_consensus.cc:1081] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Signalling peer a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
W20260709 12:23:39.241467 22732 log.cc:927] Time spent T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
W20260709 12:23:39.255716 22659 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.989s	user 0.013s	sys 0.020s
I20260709 12:23:39.252802 22656 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:39.262297 18494 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:39.263490 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 119938us
I20260709 12:23:39.238754 22658 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:39.268280 22659 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.014s	sys 0.020s
W20260709 12:23:39.292840 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 119323us
I20260709 12:23:39.294137 18494 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.304106 18494 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:39.269465 22628 raft_consensus.cc:697] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:39.293537 22729 raft_consensus.cc:2749] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:39.307515 22659 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:23:39.313985 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 172898us
I20260709 12:23:39.319012 18524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 836) took 1009 ms. Trace:
I20260709 12:23:39.321780 18494 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:39.323273 18644 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.319141 22693 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:23:39.330031 19210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.319496 18524 rpcz_store.cc:276] 0709 12:23:38.309959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:38.720854 (+410895us) service_pool.cc:224] Handling call
0709 12:23:38.721469 (+   615us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:38.755503 (+ 34034us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:38.755888 (+   385us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:38.858577 (+102689us) log.cc:844] Serialized 26 byte log entry
0709 12:23:38.922523 (+ 63946us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:38.922562 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:38.922625 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:39.318800 (+396175us) raft_consensus.cc:1685] finished
0709 12:23:39.318820 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:39.318950 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97385,"raft.queue_time_us":28770,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":4217,"spinlock_wait_cycles":431360,"thread_start_us":53486,"threads_started":2,"wal-append.queue_time_us":274846}
I20260709 12:23:39.267625 22678 consensus_queue.cc:237] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:39.347790 22738 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:39.349427 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.348011 22746 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:39.352118 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.301640 22713 consensus_queue.cc:237] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:39.353282 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:39.354092 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:39.354849 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:39.360155 18678 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:39.356110 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:39.350044 18644 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:39.362622 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:39.330902 22659 raft_consensus.cc:2804] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:39.367883 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:39.369467 18600 raft_consensus.cc:3055] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:39.369328 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:39.370052 18600 raft_consensus.cc:740] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:39.367974 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:39.371802 18675 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:39.350683 22741 raft_consensus.cc:3055] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:39.373817 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:39.325354 22373 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:39.351519 22693 raft_consensus.cc:697] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:39.384150 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:39.370952 18600 consensus_queue.cc:260] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:39.387985 18646 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.392992 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:39.408201 18672 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 13.
I20260709 12:23:39.393211 22744 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:39.409411 22744 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:39.409960 22744 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:39.393504 19211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.373417 22616 consensus_queue.cc:1059] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:23:39.393006 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:39.413098 22616 raft_consensus.cc:3055] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:39.413465 18674 raft_consensus.cc:2393] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 8: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:39.413475 22616 raft_consensus.cc:740] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:39.415604 22616 consensus_queue.cc:260] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:39.396302 22736 log.cc:927] Time spent T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:23:39.350497 22739 consensus_queue.cc:1059] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:23:39.384783 22675 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:39.392395 18671 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:23:39.405946 22735 log.cc:927] Time spent T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:23:39.374282 22741 raft_consensus.cc:740] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:39.379432 22659 raft_consensus.cc:697] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:39.372009 22746 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:39.445039 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 131836us
I20260709 12:23:39.417335 22616 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:39.440116 18646 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:39.444378 18678 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:39.353179 22738 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:39.366493 22579 consensus_queue.cc:1059] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:23:39.475060 18570 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:39.448153 22734 log.cc:927] Time spent T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:23:39.368564 22628 consensus_queue.cc:237] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:39.433881 22742 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:39.486047 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 116475us
I20260709 12:23:39.487491 18494 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:39.492558 22704 raft_consensus.cc:3055] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:39.515527 18494 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.488126 22729 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:39.516918 18494 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.491007 22739 raft_consensus.cc:2764] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:23:39.473593 22746 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:39.491931 22693 consensus_queue.cc:237] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:39.522907 22421 consensus_queue.cc:1059] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:39.548357 22373 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:39.514386 22495 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:39.514178 22704 raft_consensus.cc:740] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:39.519058 22656 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:39.487520 22742 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:39.563844 18671 raft_consensus.cc:1240] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: []
W20260709 12:23:39.588375 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.590492 18602 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:39.570135 22650 raft_consensus.cc:2749] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:39.568856 22675 raft_consensus.cc:697] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:39.562901 22729 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:39.598731 22650 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.519253 22659 consensus_queue.cc:237] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:39.605247 22746 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:39.606585 22738 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:39.596205 22495 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:39.607843 22674 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:39.604489 22704 consensus_queue.cc:260] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:39.610616 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 124687us
W20260709 12:23:39.637818 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 197774us
I20260709 12:23:39.630576 22742 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:39.665067 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:39.630297 22707 raft_consensus.cc:3055] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:23:39.689702 18570 connection.cc:256] RPC call timeout handler was delayed by -1.5148240940002324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
I20260709 12:23:39.689896 22707 raft_consensus.cc:740] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:39.690193 18570 connection.cc:256] RPC call timeout handler was delayed by -1.0549240940003983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
W20260709 12:23:39.671541 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.666939 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:39.672654 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:39.673451 18675 raft_consensus.cc:1240] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:23:39.674026 22674 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:39.692857 19241 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:39.673961 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:39.674659 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:39.694761 19247 raft_consensus.cc:2368] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 14. Current term is 15.
I20260709 12:23:39.675184 22729 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:39.675844 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:39.677423 18672 raft_consensus.cc:1240] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:39.681295 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:39.685714 22758 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.686322 22744 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:39.689282 22747 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.689438 18673 raft_consensus.cc:1240] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 12:23:39.667526 18646 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.697714 18671 raft_consensus.cc:2410] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:23:39.693866 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:39.696138 19243 raft_consensus.cc:2468] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:23:39.700285 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:39.707265 18675 raft_consensus.cc:2368] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 14. Current term is 15.
I20260709 12:23:39.705175 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:39.708324 18675 raft_consensus.cc:1240] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:39.710875 18675 raft_consensus.cc:1240] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:39.624486 22556 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:39.715979 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 48532.6us
I20260709 12:23:39.717036 18679 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:39.717160 18646 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.718364 22746 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:39.718878 22746 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:39.718910 18646 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:39.719498 22746 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:39.720084 22674 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:39.624298 22706 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:39.729547 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 210521us
I20260709 12:23:39.731541 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:39.732612 18494 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.728181 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:39.645428 22650 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:39.733146 18606 raft_consensus.cc:1240] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:39.736529 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:39.737929 18603 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 6.
I20260709 12:23:39.734579 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:39.738387 18646 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.739929 18646 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:39.743949 18674 raft_consensus.cc:1240] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:39.707545 22742 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.745484 18494 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.734606 18415 maintenance_manager.cc:419] P 01c309cccd034172a8532c59d6c80638: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033391
I20260709 12:23:39.749791 18494 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.751098 18646 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.755435 18646 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.756264 19244 raft_consensus.cc:2393] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 7: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:39.741120 22704 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:39.741845 22628 raft_consensus.cc:2749] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:39.743852 22674 raft_consensus.cc:2804] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:39.759694 18601 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:23:39.762533 18494 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.731951 22707 consensus_queue.cc:260] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:39.766297 22755 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:39.766647 22656 raft_consensus.cc:2749] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:39.767475 22659 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:39.746308 22729 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:39.763634 18646 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.768527 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.754120 22738 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:39.771803 22738 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:39.772507 22729 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:39.772975 22729 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:39.773625 22674 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:39.773335 18646 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:39.761256 22682 raft_consensus.cc:3055] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:39.774462 22674 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:39.773481 22729 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:39.777318 18646 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.779484 22755 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:39.752110 22495 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:39.780189 22755 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:39.780930 18646 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.775156 22682 raft_consensus.cc:740] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:39.783044 22682 consensus_queue.cc:260] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:39.784169 22682 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:39.785722 22628 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:39.785152 18646 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.752761 22742 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:39.787597 22628 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:39.789835 18494 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.757472 22756 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:39.704461 22675 consensus_queue.cc:237] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:39.797996 19241 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:39.799494 18494 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.729697 22747 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:39.802995 18494 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.803509 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:39.800814 18646 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.714781 22758 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:39.806500 18646 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.807016 22650 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:39.807632 22650 raft_consensus.cc:2749] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:39.808135 22738 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:39.808548 18646 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.809093 18616 tablet_copy_service.cc:342] P c7bd71f1f37c45f28b52c154e59356b9: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-298b8c963d93464e999fee75e74e9781 received from {username='slave'} at 127.0.0.1:39798
I20260709 12:23:39.809597 18616 tablet_copy_service.cc:434] P c7bd71f1f37c45f28b52c154e59356b9: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-298b8c963d93464e999fee75e74e9781 on tablet 298b8c963d93464e999fee75e74e9781 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:39.809831 18646 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.810844 22706 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:39.810926 22756 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:39.811605 18646 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.813225 18646 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.813437 22747 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:39.799322 22768 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:39.814299 18646 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.814515 22628 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:39.814918 22628 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:39.815281 22628 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:39.816072 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:39.816692 18606 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
I20260709 12:23:39.817762 18606 raft_consensus.cc:1240] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:39.818838 18570 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:39.819700 22753 consensus_queue.cc:1059] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:39.820035 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:39.820639 18604 raft_consensus.cc:2468] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 5.
I20260709 12:23:39.820899 22673 raft_consensus.cc:3055] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:39.821324 22673 raft_consensus.cc:740] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:39.822191 22673 consensus_queue.cc:260] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:39.822831 22744 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:39.823424 22673 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:39.823513 22744 consensus_queue.cc:1059] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:39.825673 22738 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:23:39.826257 22749 log.cc:927] Time spent T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 12:23:39.826875 22758 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:39.829237 22556 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:39.806288 22656 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:39.831446 22742 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:39.802246 22495 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:39.833012 22756 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:39.835284 18494 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.836140 18677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:40802
I20260709 12:23:39.828881 22674 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:39.823565 22752 raft_consensus.cc:3055] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:39.853129 18677 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:39.856346 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:39.856877 18677 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:39.857079 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.854694 18526 raft_consensus.cc:1240] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 12. Current term is 13. Ops: []
W20260709 12:23:39.868422 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.855720 22746 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:39.875855 18570 leader_election.cc:400] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Vote denied by peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879) with higher term. Message: Invalid argument: T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 14. Current term is 15.
I20260709 12:23:39.876209 18570 leader_election.cc:403] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:23:39.876959 18570 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:39.877378 22418 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879) with higher term. Message: Invalid argument: T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 14. Current term is 15.
I20260709 12:23:39.878413 22418 raft_consensus.cc:2804] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:39.878825 22418 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.879149 22674 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:39.879338 22418 raft_consensus.cc:3060] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:39.896687 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:39.898429 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:39.879906 22674 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:39.839864 22738 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:39.846582 22656 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:39.846747 22495 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:39.846463 22768 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:39.888371 22728 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:39.889068 22658 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:39.889709 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 54553.3us
I20260709 12:23:39.820652 22753 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:39.892293 18601 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:23:39.877815 18570 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:39.917908 18494 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.841168 22650 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:39.920830 19210 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.930606 19210 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.934386 19210 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:39.910050 18527 raft_consensus.cc:1275] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:23:39.887634 22746 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:39.920302 18494 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:39.924355 19211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.856590 22752 raft_consensus.cc:740] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:39.889642 22729 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:39.941934 18570 leader_election.cc:400] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 14. Current term is 15.
I20260709 12:23:39.943940 18527 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:39.914561 22738 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:39.944815 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:39.946707 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:39.948704 18494 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:39.916601 22656 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:39.979606 18600 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:39.940371 22616 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:39.914494 22495 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:39.958451 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:39.962075 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:39.986251 19243 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:39.953023 22743 consensus_queue.cc:1059] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:23:39.969302 22742 consensus_queue.cc:1048] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:39.969480 22579 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:39.972329 22628 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:39.976583 22745 log.cc:927] Time spent T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.586s	user 0.004s	sys 0.000s
I20260709 12:23:39.977705 22729 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:39.936012 22658 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:39.936507 22758 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:39.940564 22681 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:40.012053 22758 raft_consensus.cc:697] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:40.013059 22758 consensus_queue.cc:237] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:40.013882 18525 raft_consensus.cc:2468] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 5.
I20260709 12:23:40.015153 22421 consensus_queue.cc:1059] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:40.020440 22692 consensus_queue.cc:1059] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:40.001751 22527 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:40.024259 22527 raft_consensus.cc:697] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:40.001413 22670 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.025216 22527 consensus_queue.cc:237] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:40.025826 22670 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:40.027086 22495 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:39.944743 22650 raft_consensus.cc:697] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:23:39.999178 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 54525.6us
I20260709 12:23:39.953459 22712 raft_consensus.cc:2804] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:39.951344 22728 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:39.978590 18524 raft_consensus.cc:1240] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:39.935341 22674 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.004377 18570 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:39.948518 22382 consensus_queue.cc:1059] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 12:23:39.939195 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 124961us
I20260709 12:23:40.023612 18600 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:39.989423 22693 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:39.938136 22768 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:23:40.042035 18529 raft_consensus.cc:1240] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:40.050668 22658 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:40.019428 22738 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:40.055485 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 106903us
I20260709 12:23:40.056574 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:40.059341 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 55048.4us
I20260709 12:23:40.060478 18570 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:23:40.061414 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.042891 22712 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.066864 18494 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:40.075048 18494 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:40.041524 22616 consensus_queue.cc:1059] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:23:40.056025 22746 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:40.082121 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:40.083040 19241 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:40.065821 22774 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:40.066344 22361 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:40.068321 22712 raft_consensus.cc:3060] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:40.067389 22673 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:40.087307 22746 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.087044 18494 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:40.074990 22658 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:40.072999 22495 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:40.067185 22670 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:40.079339 22659 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:23:40.095235 18570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.095031 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:40.078051 22693 raft_consensus.cc:2804] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:40.096203 22774 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:23:40.082537 22689 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:40.104476 18494 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:40.116185 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:40.117149 18680 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:40.113368 18677 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.120886 18494 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:40.125160 18494 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:40.102607 22658 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:40.112564 22728 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:40.127151 18677 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:40.129693 22729 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:40.114301 22693 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:40.124991 22778 raft_consensus.cc:2804] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:40.149070 22774 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:40.152649 22682 raft_consensus.cc:3055] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:40.153126 22682 raft_consensus.cc:740] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:40.154047 22682 consensus_queue.cc:260] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:40.093722 22650 consensus_queue.cc:237] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.133214 22495 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:23:40.157752 22495 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:40.158434 22495 raft_consensus.cc:697] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:40.159657 22495 consensus_queue.cc:237] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.131422 22658 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:40.143242 22693 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:40.148128 18570 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:40.179546 22704 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:23:40.185482 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 108935us
I20260709 12:23:40.181238 18570 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:40.140784 22729 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:40.144224 22778 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:40.187345 22775 log.cc:927] Time spent T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:23:40.206490 18570 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:40.197798 18677 raft_consensus.cc:1240] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:40.189785 22682 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:40.192915 22729 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:40.196596 22675 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:40.185076 22704 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.189340 22757 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:40.202816 19244 raft_consensus.cc:1240] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:40.199537 22756 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:40.184775 22628 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:40.220098 19211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.263651 18599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40948 (request call id 2180) took 1300 ms. Trace:
W20260709 12:23:40.310657 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.259972 22742 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:40.310348 18599 rpcz_store.cc:276] 0709 12:23:38.962843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:38.962995 (+   152us) service_pool.cc:224] Handling call
0709 12:23:40.263477 (+1300482us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54000f0d54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:40.263589 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248241536}
I20260709 12:23:40.265627 18680 raft_consensus.cc:1240] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:40.198305 22778 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:40.267061 22704 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:40.328624 18677 raft_consensus.cc:1240] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:40.266249 22728 raft_consensus.cc:697] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:40.266628 22757 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.310158 22738 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:40.312892 22411 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.268589 22689 raft_consensus.cc:697] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:40.267544 22675 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.341536 22741 consensus_queue.cc:260] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.264917 22382 consensus_queue.cc:1059] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:23:40.353564 22382 raft_consensus.cc:3055] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:40.353752 22791 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:23:40.350980 22781 log.cc:927] Time spent T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 12:23:40.332572 22495 consensus_queue.cc:1059] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:23:40.354001 22382 raft_consensus.cc:740] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:40.266481 22768 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:40.338743 22757 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:40.343039 22707 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:40.349001 22411 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.386924 22411 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:40.343041 22418 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:40.390163 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:40.391091 22418 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:40.393047 18676 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:40.397684 18570 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:40.400338 18676 raft_consensus.cc:1240] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:40.323613 22756 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:40.402817 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
W20260709 12:23:40.409762 22786 log.cc:927] Time spent T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:23:40.379012 22746 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:40.411401 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:40.411883 22795 raft_consensus.cc:3055] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:40.412271 22795 raft_consensus.cc:740] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:40.413188 22795 consensus_queue.cc:260] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:40.395100 22780 log.cc:927] Time spent T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 12:23:40.414326 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:40.414745 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:40.415921 22382 consensus_queue.cc:260] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.416453 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:40.417239 22382 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:40.417802 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:40.418346 18604 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:40.420322 18602 raft_consensus.cc:1240] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:40.426332 22658 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.427030 22753 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:40.427536 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:40.428018 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:40.370534 22710 consensus_queue.cc:260] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.432344 18606 raft_consensus.cc:1240] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8. Ops: []
W20260709 12:23:40.432677 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.433355 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:40.434051 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:40.434113 22656 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.435299 18522 raft_consensus.cc:1240] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:40.348634 22693 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.406993 22728 consensus_queue.cc:237] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.436442 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:40.437031 18599 raft_consensus.cc:3055] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:40.437175 22693 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:40.437369 18599 raft_consensus.cc:740] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:40.438378 18599 consensus_queue.cc:260] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.406981 18644 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:40.440021 22712 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:40.441048 18604 raft_consensus.cc:2468] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:23:40.441896 22774 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:40.441937 18599 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:40.413631 22756 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:40.443403 19244 raft_consensus.cc:2393] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 6: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:40.442636 22712 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:40.445438 18676 raft_consensus.cc:1240] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:40.434413 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:40.457026 18644 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:40.377331 22741 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:40.455992 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:40.456866 18600 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:23:40.442494 22774 raft_consensus.cc:697] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:40.452242 22418 raft_consensus.cc:2804] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:40.482175 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:40.487625 22778 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.490649 22778 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:40.377489 22791 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:40.436501 22675 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:40.474882 22418 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.508539 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:40.514792 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:40.517357 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:40.472293 22756 raft_consensus.cc:2804] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:40.518163 18606 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:40.532107 18599 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
W20260709 12:23:40.525687 18570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.527652 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:40.355458 22689 consensus_queue.cc:237] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.465003 22738 consensus_queue.cc:1059] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:23:40.472661 22361 consensus_queue.cc:1059] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:23:40.513393 22418 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:40.545992 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:40.545153 18528 raft_consensus.cc:1240] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:40.541209 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:40.555923 18599 raft_consensus.cc:2393] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 6: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:40.565119 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:40.567435 18672 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:40.585635 18676 raft_consensus.cc:1240] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:40.585978 18528 raft_consensus.cc:1240] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:40.542570 22756 raft_consensus.cc:697] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:40.599850 18528 raft_consensus.cc:1240] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:40.569648 22656 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:40.617229 18672 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
I20260709 12:23:40.619091 18672 raft_consensus.cc:1240] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 12:23:40.621246 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.613301 22658 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:40.593811 22774 consensus_queue.cc:237] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:40.673812 22729 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.667632 18521 raft_consensus.cc:1240] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:40.683373 18677 raft_consensus.cc:1240] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:40.686664 22704 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:40.687919 18677 raft_consensus.cc:1240] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:40.690555 18606 raft_consensus.cc:2468] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 11.
I20260709 12:23:40.712051 22729 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:40.714350 22704 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:40.725060 22801 log.cc:927] Time spent T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:23:40.715428 22742 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:40.687530 22757 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:40.704248 22738 consensus_queue.cc:1243] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:23:40.736588 18601 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:40.748594 18680 raft_consensus.cc:1240] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 7. Current term is 8. Ops: []
W20260709 12:23:40.744436 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 120561us
W20260709 12:23:40.739650 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 121483us
I20260709 12:23:40.749989 18676 raft_consensus.cc:1275] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:23:40.739666 22746 consensus_queue.cc:1059] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:23:40.728827 22756 consensus_queue.cc:237] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.750072 22791 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:40.763897 19211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.765503 18603 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
I20260709 12:23:40.766770 22810 consensus_queue.cc:1059] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:40.776850 22757 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:40.784825 22797 log.cc:927] Time spent T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.145s	user 0.002s	sys 0.000s
I20260709 12:23:40.786866 22659 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:40.795925 22810 consensus_queue.cc:1243] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer 2f9872512f1646bc835906bd0e98c6a7 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:40.762830 22811 consensus_queue.cc:1059] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:23:40.795882 22659 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:40.814177 18523 raft_consensus.cc:1240] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:40.814564 22816 consensus_queue.cc:1059] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:23:40.823855 22810 raft_consensus.cc:3055] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:40.824296 22674 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:40.824333 22810 raft_consensus.cc:740] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:40.826478 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1978) took 1278 ms. Trace:
I20260709 12:23:40.826890 18674 rpcz_store.cc:276] 0709 12:23:39.547574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.551544 (+  3970us) service_pool.cc:224] Handling call
0709 12:23:39.556047 (+  4503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:39.744375 (+188328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.826234 (+1081859us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54001c0f54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:40.826417 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":432784896}
I20260709 12:23:40.828305 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:40.829830 22811 consensus_queue.cc:1059] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:40.830201 19210 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:40.830951 22811 raft_consensus.cc:3055] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:40.831419 22811 raft_consensus.cc:740] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:40.831019 18606 raft_consensus.cc:1275] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:40.831670 22524 raft_consensus.cc:3055] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:40.836297 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:40.850536 22524 raft_consensus.cc:740] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:40.850847 19239 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 589) took 1732 ms (client timeout 1679 ms). Trace:
I20260709 12:23:40.851605 22524 consensus_queue.cc:260] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:40.851365 19239 rpcz_store.cc:269] 0709 12:23:39.118267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.121044 (+  2777us) service_pool.cc:224] Handling call
0709 12:23:40.850604 (+1729560us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b540022a454. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:40.850756 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":881378048}
I20260709 12:23:40.852690 22524 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:40.850939 18528 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:23:40.841584 22815 raft_consensus.cc:2804] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:40.841691 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:40.855114 22815 raft_consensus.cc:697] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:40.842211 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:40.842561 18606 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:40.856091 22815 consensus_queue.cc:237] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:40.842783 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:40.843369 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:40.844030 19242 raft_consensus.cc:1275] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:23:40.859616 19242 pending_rounds.cc:85] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: Aborting all ops after (but not including) 8
I20260709 12:23:40.859915 19242 pending_rounds.cc:107] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:23:40.861388 19242 raft_consensus.cc:2889] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:40.832235 22811 consensus_queue.cc:260] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.865903 22811 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:40.832226 22787 raft_consensus.cc:3055] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:40.868108 22787 raft_consensus.cc:740] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:40.868918 22787 consensus_queue.cc:260] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.870252 22787 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:40.873026 18529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2701) took 1025 ms. Trace:
I20260709 12:23:40.873461 18529 rpcz_store.cc:276] 0709 12:23:39.847664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.847839 (+   175us) service_pool.cc:224] Handling call
0709 12:23:39.848230 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:40.052766 (+204536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.872759 (+819993us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54002c6854. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:40.872961 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439782656}
I20260709 12:23:40.876294 18524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2700) took 1030 ms. Trace:
I20260709 12:23:40.876730 18524 rpcz_store.cc:276] 0709 12:23:39.847225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.847342 (+   117us) service_pool.cc:224] Handling call
0709 12:23:39.869728 (+ 22386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:40.044265 (+174537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.876059 (+831794us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54002e3454. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:40.876227 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249777536}
I20260709 12:23:40.882467 18528 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
W20260709 12:23:40.885227 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.844092 18672 raft_consensus.cc:1275] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:23:40.845067 22527 consensus_queue.cc:1048] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:40.844286 22810 consensus_queue.cc:260] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.890163 22810 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:40.830241 22418 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.849107 22752 consensus_queue.cc:260] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:40.838359 18646 leader_election.cc:336] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.625s (SENT)
I20260709 12:23:40.896664 18646 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:40.897934 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 59631.7us
I20260709 12:23:40.899155 22674 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:40.901137 22418 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:40.898710 22739 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:40.902282 22739 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:40.904654 22739 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:40.906424 18572 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:40.906631 22758 consensus_queue.cc:1059] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:40.908567 22758 raft_consensus.cc:3055] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:40.908936 22758 raft_consensus.cc:740] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:40.909178 18644 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:40.909737 22758 consensus_queue.cc:260] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.910977 22674 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:40.906394 22733 consensus_queue.cc:1059] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:40.917507 22752 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:40.879498 22659 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.911249 22741 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:23:40.923733 22659 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:40.926090 22788 log.cc:927] Time spent T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.556s	user 0.002s	sys 0.002s
I20260709 12:23:40.935235 18644 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:40.910991 22758 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:40.947999 18522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2703) took 1098 ms. Trace:
I20260709 12:23:40.948529 18522 rpcz_store.cc:276] 0709 12:23:39.849782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.849920 (+   138us) service_pool.cc:224] Handling call
0709 12:23:39.850205 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:40.435650 (+585445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.947670 (+512020us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b54002c7c54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:40.947933 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1345152768}
I20260709 12:23:40.950816 18644 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:40.953527 22740 raft_consensus.cc:3055] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:40.953984 22740 raft_consensus.cc:740] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:40.954836 22740 consensus_queue.cc:260] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.956020 22741 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:40.956810 22741 raft_consensus.cc:697] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:40.957454 22810 consensus_queue.cc:1059] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:40.957680 22741 consensus_queue.cc:237] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.958302 22674 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:40.958915 22674 raft_consensus.cc:697] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:40.961990 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:23:40.962397 22819 log.cc:927] Time spent T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:23:40.964653 22733 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:40.965272 22733 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.967446 18671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2393) took 1279 ms. Trace:
I20260709 12:23:40.967837 22670 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.967900 18671 rpcz_store.cc:276] 0709 12:23:39.687990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.741396 (+ 53406us) service_pool.cc:224] Handling call
0709 12:23:39.756549 (+ 15153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:39.832678 (+ 76129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:39.832707 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:39.832746 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:39.832773 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.967208 (+1134435us) spinlock_profiling.cc:243] Waited 75.9 ms on lock 0x7b540039fb54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:40.967267 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:40.967385 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174598912}
I20260709 12:23:40.968451 22670 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.970743 22670 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:40.959851 22674 consensus_queue.cc:237] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:40.974648 22810 raft_consensus.cc:3055] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:40.974712 22738 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:40.976522 22738 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:40.967468 22733 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:40.980607 18494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.033s	sys 0.045s
W20260709 12:23:40.980949 18494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.033s	sys 0.045s
W20260709 12:23:40.981261 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 855203us
I20260709 12:23:40.982009 18494 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:23:40.982477 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.956034 22740 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:40.970821 18599 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:40.986544 18494 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:40.983668 18525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43124 (request call id 839) took 2528 ms (client timeout 3265 ms). Trace:
W20260709 12:23:40.989652 18525 rpcz_store.cc:269] 0709 12:23:38.455349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:38.526762 (+ 71413us) service_pool.cc:224] Handling call
0709 12:23:40.983218 (+2456456us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400431554. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:40.983511 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3134199552}
I20260709 12:23:40.975246 22810 raft_consensus.cc:740] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:40.994977 18494 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:40.941761 22747 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:40.999123 18673 raft_consensus.cc:1275] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:23:41.002269 18526 raft_consensus.cc:1240] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:41.002767 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:40.993824 22659 raft_consensus.cc:2749] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:41.000268 22689 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.006332 18494 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:41.007936 18494 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:41.017339 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:40.994056 22778 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:40.994242 22628 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.042405 19240 raft_consensus.cc:1275] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:23:41.016116 22421 consensus_queue.cc:1059] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:23:41.024471 22810 consensus_queue.cc:260] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:41.044533 22810 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:41.015151 22658 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:41.010918 22791 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:41.048921 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:41.049585 19243 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:41.050295 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.015304 22823 consensus_queue.cc:1048] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:23:41.052453 18598 raft_consensus.cc:1240] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:23:41.052785 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:41.053573 22739 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:41.054124 22739 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:41.010675 22729 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:41.052448 19239 raft_consensus.cc:1217] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.4->[7.5-7.5]   Dedup: 7.5->[]
I20260709 12:23:41.017508 22747 raft_consensus.cc:697] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:41.057772 18530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2705) took 1202 ms. Trace:
I20260709 12:23:41.058260 22747 consensus_queue.cc:237] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:41.036124 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.057792 18679 raft_consensus.cc:3055] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:41.060091 18679 raft_consensus.cc:740] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:41.014053 22689 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:41.042089 22628 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:41.060842 18679 consensus_queue.cc:260] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:41.061983 18679 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:41.062636 22628 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:41.023910 18671 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:41.043437 22421 raft_consensus.cc:3055] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:41.065050 22421 raft_consensus.cc:740] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:41.065963 22421 consensus_queue.cc:260] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:41.066884 22795 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:41.067272 22421 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:41.068100 18646 leader_election.cc:336] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.682s (SENT)
I20260709 12:23:41.068710 18646 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:41.039417 18672 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:23:41.060712 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 52853.1us
I20260709 12:23:41.070930 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:41.058169 18530 rpcz_store.cc:276] 0709 12:23:39.855479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.855609 (+   130us) service_pool.cc:224] Handling call
0709 12:23:39.912292 (+ 56683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:39.943892 (+ 31600us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:40.058731 (+114839us) log.cc:844] Serialized 14 byte log entry
0709 12:23:40.448468 (+389737us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:40.448524 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:40.448579 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.784186 (+335607us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:23:41.057534 (+273348us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b5400286254. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:41.057583 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:41.057719 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":53054,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":133,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":8928,"spinlock_wait_cycles":79460864,"thread_start_us":489744,"threads_started":2,"wal-append.queue_time_us":532556}
I20260709 12:23:41.071842 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:41.072067 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:41.072609 18529 raft_consensus.cc:2393] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 8: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:41.071331 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:41.036377 19210 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:41.073812 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:41.075874 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:41.076350 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:41.076610 18526 raft_consensus.cc:2393] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 6: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:41.077155 18675 raft_consensus.cc:1240] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:41.077626 18527 raft_consensus.cc:2393] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 10: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:41.068343 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:41.078729 18677 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:41.080122 19210 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:41.083989 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:41.084426 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:41.085237 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:41.086565 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:41.086575 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:41.082193 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:41.088737 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:41.089948 18598 raft_consensus.cc:1240] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:41.083222 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:41.092056 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:41.092258 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:41.093200 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:41.093681 18673 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:41.094024 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:41.093641 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:41.095938 18526 raft_consensus.cc:2393] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 8: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:41.096825 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:41.097335 18598 raft_consensus.cc:1240] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:41.098695 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:41.092716 18672 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
I20260709 12:23:41.102072 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:41.103111 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:41.104636 18676 raft_consensus.cc:1275] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:23:41.085330 22628 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:41.105918 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:41.106443 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:41.106736 18676 raft_consensus.cc:2393] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 10: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:41.083642 22823 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:41.106107 18680 raft_consensus.cc:2393] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 7: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:41.114705 18646 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:41.108459 18677 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:41.106751 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:41.115698 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:41.116098 18646 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:41.116657 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:41.117322 18671 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
I20260709 12:23:41.118026 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:41.109896 18679 raft_consensus.cc:1275] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:23:41.111626 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:41.119113 18679 pending_rounds.cc:85] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting all ops after (but not including) 7
I20260709 12:23:41.119372 18679 pending_rounds.cc:107] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:23:41.119606 18679 raft_consensus.cc:2889] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:41.120028 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.121500 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:41.122146 18603 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
I20260709 12:23:41.122277 19239 raft_consensus.cc:1240] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 8 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:41.122913 18646 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:41.124958 18570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.124970 18646 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:41.126435 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:41.126885 18646 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:41.127883 18680 raft_consensus.cc:1240] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:41.129158 18646 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:41.108199 22681 raft_consensus.cc:2804] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:41.131181 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:41.134305 18494 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:41.134292 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:41.135627 18525 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:41.136735 18646 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:41.125223 22538 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:23:41.244761 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:41.250392 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:41.125313 22628 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:41.235136 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:41.201436 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.204190 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:41.139834 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:41.203269 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:41.208426 18529 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:41.204663 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:41.262879 18678 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:41.263374 19239 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:23:41.264917 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 125796us
I20260709 12:23:41.265915 18494 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:41.128469 22746 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:41.128782 22738 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:41.128111 22674 raft_consensus.cc:2749] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:41.257633 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:41.218109 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:41.272279 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:23:41.150220 22773 log.cc:927] Time spent T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 1.245s	user 0.003s	sys 0.000s
I20260709 12:23:41.134239 22756 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:41.130282 22741 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:41.267774 19243 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
I20260709 12:23:41.263033 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:41.260600 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:41.280019 18679 raft_consensus.cc:2393] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 8: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:41.136508 18530 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:23:41.251362 18527 raft_consensus.cc:1217] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 8.4->[10.5-10.5]   Dedup: 10.5->[]
W20260709 12:23:41.277457 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.277902 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:41.282092 18527 raft_consensus.cc:1240] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:23:41.202267 22681 raft_consensus.cc:697] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:41.255117 22739 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:41.268436 22755 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.287962 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:41.270848 22778 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:41.140307 22659 consensus_queue.cc:1059] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.144s
W20260709 12:23:41.295027 22826 log.cc:927] Time spent T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:23:41.300570 18598 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 15.
I20260709 12:23:41.301435 22681 consensus_queue.cc:237] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:41.143276 22675 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:41.143451 22658 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:41.292822 18673 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:41.257059 18525 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:41.324352 18672 raft_consensus.cc:1240] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 8. Current term is 9. Ops: [7.8-8.9]
I20260709 12:23:41.309538 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:41.260627 22832 consensus_queue.cc:1059] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:23:41.286178 22674 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:41.350520 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 83790.6us
I20260709 12:23:41.284111 22738 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:23:41.292012 22778 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:41.358834 22833 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.359606 22833 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:41.362800 22833 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:41.322697 22689 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:41.382083 18602 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 14.
I20260709 12:23:41.351877 22756 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:41.396077 22226 raft_consensus.cc:3055] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:41.397066 22226 raft_consensus.cc:740] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:41.406291 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:41.409515 18598 raft_consensus.cc:1275] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:23:41.410861 18598 raft_consensus.cc:1240] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:41.413118 22226 consensus_queue.cc:260] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:41.424422 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:41.426203 22831 log.cc:927] Time spent T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:23:41.426503 18644 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:41.442719 22741 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:41.427512 18599 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:23:41.443490 18599 pending_rounds.cc:85] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9: Aborting all ops after (but not including) 8
I20260709 12:23:41.443821 18599 pending_rounds.cc:107] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:23:41.444064 18599 raft_consensus.cc:2889] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:41.444600 18603 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:23:41.388023 22675 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.308068 22755 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:41.407608 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:23:41.432667 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 302175us
I20260709 12:23:41.432824 18523 raft_consensus.cc:1275] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:23:41.449308 18523 pending_rounds.cc:85] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 8
I20260709 12:23:41.449646 18523 pending_rounds.cc:107] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:23:41.449944 18523 raft_consensus.cc:2889] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:41.433979 18598 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:23:41.357999 22674 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:41.429268 18605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39798 (request call id 526) took 1612 ms. Trace:
I20260709 12:23:41.370934 22778 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:41.454933 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.454581 18605 rpcz_store.cc:276] 0709 12:23:39.816546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.029382 (+1212836us) service_pool.cc:224] Handling call
0709 12:23:41.029763 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:41.030149 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:41.030179 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:41.030662 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 12:23:41.112634 (+ 81972us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:41.128315 (+ 15681us) log.cc:844] Serialized 14 byte log entry
0709 12:23:41.428510 (+300195us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b1800393e20. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc7936cc0a 00007efc82aac219 00007efc793f4a40 00007efc793ef4e4 00007efc793ef455 00007efc7c4d7060 00007efc7c4e9716 00007efc7c4fa287 00007efc7c4fa208
0709 12:23:41.428727 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:41.428826 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:41.428887 (+    61us) raft_consensus.cc:1685] finished
0709 12:23:41.429015 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:41.429194 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2088,"prepare.queue_time_us":17641,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":8511,"raft.queue_time_us":314211,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":218,"spinlock_wait_cycles":4655872,"thread_start_us":81539,"threads_started":1,"wal-append.queue_time_us":109670}
I20260709 12:23:41.457330 22755 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:41.445598 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 85032.4us
I20260709 12:23:41.431871 22756 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:41.445209 22795 consensus_queue.cc:1048] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:23:41.460590 22756 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:41.462687 22674 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:41.447885 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:41.465688 22226 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:41.435132 18602 raft_consensus.cc:1240] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:41.482193 18646 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:41.482878 18679 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:41.484030 18646 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:41.485791 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:41.486495 18646 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:41.488277 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.493702 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:41.495455 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:41.496012 18494 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:41.499435 18601 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
W20260709 12:23:41.478531 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 181429us
I20260709 12:23:41.504922 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:41.506100 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:41.448850 22658 raft_consensus.cc:697] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:41.510038 18494 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:41.515053 18494 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:41.501675 22728 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:41.560820 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 112045us
I20260709 12:23:41.476711 22689 consensus_queue.cc:1059] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:23:41.455412 22675 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:41.501569 22795 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 12:23:41.560945 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 105197us
I20260709 12:23:41.511588 22674 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:23:41.563632 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 48662.7us
I20260709 12:23:41.575081 18494 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:41.577293 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:41.577986 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.580120 22658 consensus_queue.cc:237] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:41.560772 22729 consensus_queue.cc:1059] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
W20260709 12:23:41.591400 22810 consensus_meta.cc:287] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.000s
I20260709 12:23:41.593140 22675 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:41.595082 22674 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:41.576052 22836 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.617254 22778 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:41.618923 22689 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:41.621500 22733 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.622664 18599 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:41.624141 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:41.625648 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 50616.5us
I20260709 12:23:41.648727 18604 raft_consensus.cc:1275] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:41.649279 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:41.649597 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:41.634266 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 191422us
I20260709 12:23:41.570906 22659 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:41.636116 19244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33388 (request call id 557) took 1243 ms. Trace:
W20260709 12:23:41.573720 22827 log.cc:927] Time spent T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:23:41.653255 18644 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:41.577869 22738 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:41.651829 18603 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 6.
W20260709 12:23:41.646333 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 83403.6us
W20260709 12:23:41.648021 22825 log.cc:927] Time spent T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.624s	user 0.000s	sys 0.005s
I20260709 12:23:41.631426 18600 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:23:41.641758 22495 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:41.695835 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:41.705446 18602 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:41.574054 22728 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:41.696864 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:41.697533 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:41.653741 19244 rpcz_store.cc:276] 0709 12:23:40.392544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:40.392708 (+   164us) service_pool.cc:224] Handling call
0709 12:23:41.635836 (+1243128us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b540044ff54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:41.636035 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91422592}
I20260709 12:23:41.645709 22682 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.646142 22694 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.711402 18644 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:41.658612 22791 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:41.729620 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:41.658349 22538 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.731590 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:41.694747 22811 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.692194 22839 raft_consensus.cc:3055] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:41.706198 22674 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:41.704366 22689 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:41.653017 22733 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:41.755306 18570 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:41.645468 22836 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:41.703926 22675 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:23:41.774878 18570 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:41.738227 22741 raft_consensus.cc:697] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:23:41.761626 22824 log.cc:927] Time spent T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.492s	user 0.004s	sys 0.000s
I20260709 12:23:41.747408 22839 raft_consensus.cc:740] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:41.732995 22226 consensus_queue.cc:1059] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:23:41.786041 19241 raft_consensus.cc:1240] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:41.797572 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 309334us
I20260709 12:23:41.767683 22689 raft_consensus.cc:697] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:41.752002 22811 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:41.749033 22538 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:41.731578 22659 consensus_queue.cc:1048] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:23:41.758774 22748 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:23:41.750351 22752 consensus_queue.cc:1048] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:23:41.857920 22840 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:41.730283 22682 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:41.770849 22739 consensus_queue.cc:1059] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 12:23:41.806123 22758 raft_consensus.cc:2804] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:23:42.018181 22835 log.cc:927] Time spent T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.440s	user 0.001s	sys 0.008s
I20260709 12:23:41.766961 22823 consensus_queue.cc:1048] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.097s
I20260709 12:23:41.734308 22694 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:41.989063 18646 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:41.766186 22838 consensus_queue.cc:1059] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.139s
I20260709 12:23:42.002182 18526 raft_consensus.cc:1240] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:42.005466 18524 raft_consensus.cc:1240] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:41.998876 22728 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:41.988806 22853 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:23:42.015151 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 240354us
I20260709 12:23:42.042971 18570 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:23:42.001178 22826 log.cc:927] Time spent T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.224s	user 0.000s	sys 0.014s
W20260709 12:23:42.025859 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 331642us
I20260709 12:23:42.046216 18494 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:23:42.028075 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 322425us
I20260709 12:23:41.788200 22741 consensus_queue.cc:237] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:41.997035 22650 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:23:41.749745 22674 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:42.064401 22674 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:42.014083 22795 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.068161 22795 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:41.990839 22692 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:41.998301 22226 raft_consensus.cc:3055] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:23:42.004114 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:42.072494 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.983819 22843 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.018496 22440 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.983494 22862 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.037797 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 554) took 1127 ms. Trace:
W20260709 12:23:42.027993 22773 log.cc:927] Time spent T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.239s	user 0.000s	sys 0.015s
W20260709 12:23:42.028429 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 284114us
I20260709 12:23:42.063050 18494 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:42.135221 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 72287.1us
I20260709 12:23:42.136018 18494 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:42.103399 18570 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:42.102064 18605 raft_consensus.cc:2410] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 12 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:23:42.071440 22226 raft_consensus.cc:740] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:42.043838 22853 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.038151 22844 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:42.129097 18674 rpcz_store.cc:276] 0709 12:23:40.910442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:40.910559 (+   117us) service_pool.cc:224] Handling call
0709 12:23:40.910911 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:40.912752 (+  1841us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:40.912794 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:40.938850 (+ 26056us) log.cc:844] Serialized 26 byte log entry
0709 12:23:41.084991 (+146141us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:41.085031 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:41.425760 (+340729us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b54003f2fd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:41.425806 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:41.733972 (+308166us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b2400241cb8. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc792789c4 00007efc79276acb 00007efc79431dc9 00007efc79431a55 00007efc7943109d 00007efc7c06310e 00007efc7c07a88c 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221
0709 12:23:42.037543 (+303571us) raft_consensus.cc:1685] finished
0709 12:23:42.037578 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:42.037725 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":68,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":4234,"spinlock_wait_cycles":62000384,"thread_start_us":141938,"threads_started":1,"wal-append.queue_time_us":195744}
I20260709 12:23:42.112457 22728 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:42.160784 18601 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:23:42.159881 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 135115us
I20260709 12:23:42.154313 18494 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:42.112042 22778 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:42.143705 22836 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:42.217211 19242 raft_consensus.cc:1275] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:42.217555 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:42.237540 18675 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:42.132167 22361 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:42.160636 22838 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:23:42.170917 22835 log.cc:927] Time spent T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:23:42.123263 22791 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
W20260709 12:23:42.171496 22832 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.009s	sys 0.009s
W20260709 12:23:42.248852 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 94652.7us
I20260709 12:23:42.196691 22746 raft_consensus.cc:2749] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:42.172196 22659 raft_consensus.cc:2804] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:42.153479 22853 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:42.142170 22440 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:42.274178 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:42.134895 22843 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:42.198122 22728 raft_consensus.cc:697] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:42.244488 22758 raft_consensus.cc:697] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:42.270627 22832 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.013s	sys 0.011s
I20260709 12:23:42.273676 18679 raft_consensus.cc:1275] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:42.245299 22361 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.196888 22739 consensus_queue.cc:1048] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:23:42.283254 22867 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:42.260632 22778 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:42.297304 22778 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.297796 22778 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:42.297917 22628 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:42.298853 22628 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:42.300226 22838 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:42.300874 22838 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:42.301787 22746 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.302341 22746 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:42.303092 22871 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.303596 22871 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:42.283165 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:42.285544 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:42.179984 22840 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 12:23:42.143059 22689 consensus_queue.cc:237] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:42.289275 22538 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:42.289465 22682 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:42.270048 22226 consensus_queue.cc:260] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:42.142402 22862 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:42.273128 22860 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:42.290234 22758 consensus_queue.cc:237] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:42.170627 22844 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:42.304661 22361 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:42.288156 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 299129us
I20260709 12:23:42.329120 18646 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:42.330695 18646 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:42.306708 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 133340us
I20260709 12:23:42.174860 22658 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
W20260709 12:23:42.280695 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 139730us
I20260709 12:23:42.310848 18675 raft_consensus.cc:2393] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 10: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:42.312704 18679 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:23:42.332948 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 150476us
I20260709 12:23:42.350593 18646 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:42.362728 18494 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:42.364298 18570 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:42.367957 18677 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:23:42.362329 22787 consensus_queue.cc:1048] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:23:42.323024 22860 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:42.380143 18597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39798 (request call id 520) took 2675 ms. Trace:
I20260709 12:23:42.386580 22860 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:42.370569 18605 raft_consensus.cc:1275] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:23:42.392728 18597 rpcz_store.cc:276] 0709 12:23:39.704575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:40.723407 (+1018832us) service_pool.cc:224] Handling call
0709 12:23:40.727882 (+  4475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:40.728253 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:40.735548 (+  7295us) log.cc:844] Serialized 14 byte log entry
0709 12:23:41.238211 (+502663us) spinlock_profiling.cc:243] Waited 938 us on lock 0x7b18002724a0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793d4e07 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793f1c02 00007efc7c07920b 00007efc7c07ed23 00007efc7c07f23a 00007efc7c4e9a2a
0709 12:23:41.512723 (+274512us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:41.513327 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 12:23:41.513503 (+   176us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:41.839944 (+326441us) log.cc:844] Serialized 14 byte log entry
0709 12:23:41.991476 (+151532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:41.991556 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:42.379902 (+388346us) raft_consensus.cc:1685] finished
0709 12:23:42.379924 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:42.380078 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":298486,"prepare.queue_time_us":88525,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":75,"raft.queue_time_us":297383,"raft.run_cpu_time_us":506,"raft.run_wall_time_us":51025,"spinlock_wait_cycles":2158336,"thread_start_us":421108,"threads_started":2,"wal-append.queue_time_us":763903}
I20260709 12:23:42.341804 22867 raft_consensus.cc:697] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:42.397308 22860 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:42.407385 22864 raft_consensus.cc:2749] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:42.377992 22844 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
W20260709 12:23:42.378527 22847 log.cc:927] Time spent T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 12:23:42.323484 22733 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:42.415359 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 243544us
I20260709 12:23:42.355067 22628 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:42.369817 22868 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.376777 22524 raft_consensus.cc:3055] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:23:42.378777 22842 log.cc:927] Time spent T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.594s	user 0.005s	sys 0.005s
I20260709 12:23:42.384132 22694 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:42.366956 22791 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:42.381219 22440 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:42.370959 22862 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:42.387038 22871 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:42.369637 22659 raft_consensus.cc:697] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:42.386736 22226 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:42.452147 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:42.463603 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 113138us
I20260709 12:23:42.709612 18524 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
W20260709 12:23:42.449402 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 45011.5us
I20260709 12:23:42.452476 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:42.710812 18523 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:23:42.467890 18600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40954 (request call id 1981) took 1354 ms. Trace:
I20260709 12:23:42.711582 18600 rpcz_store.cc:276] 0709 12:23:41.113476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.288854 (+175378us) service_pool.cc:224] Handling call
0709 12:23:42.467679 (+1178825us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54002a0dd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:42.467828 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":627500416}
W20260709 12:23:42.472210 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 107990us
I20260709 12:23:42.714972 18570 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:23:42.467650 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 105284us
I20260709 12:23:42.384622 22855 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 12:23:42.718856 22865 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:42.384276 22728 consensus_queue.cc:237] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:42.719578 22877 consensus_queue.cc:1059] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.271s
I20260709 12:23:42.720007 22865 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:42.699302 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:42.722599 18602 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:42.700007 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:42.447860 22746 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:42.705999 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:42.724874 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.464586 18679 raft_consensus.cc:1275] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:42.464337 22741 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:42.726727 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:42.727201 18605 raft_consensus.cc:2393] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 11: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
W20260709 12:23:42.715013 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 238190us
I20260709 12:23:42.729585 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:42.719084 22879 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:42.370497 22854 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 12:23:42.717504 22881 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.240s
I20260709 12:23:42.465655 22843 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:42.461275 22524 raft_consensus.cc:740] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:42.736625 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:42.446081 22787 consensus_queue.cc:1059] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.257s
I20260709 12:23:42.447480 22840 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.255s
I20260709 12:23:42.463685 22844 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:42.477403 22740 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:42.697196 22866 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:42.753471 18646 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:42.730384 18601 raft_consensus.cc:2393] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 10: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:42.761330 19212 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:42.772861 19212 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:42.773761 18646 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:42.774788 22785 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:42.775323 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:42.776274 18601 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
I20260709 12:23:42.751924 22832 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:42.776531 18494 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:42.776856 22832 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:42.775349 22785 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:42.778862 22746 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:42.779006 22832 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:42.780941 18644 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:42.782080 22785 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:42.782691 22860 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:42.789353 18604 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
I20260709 12:23:42.707979 22694 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:42.798673 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:42.799345 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:42.800047 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:42.800406 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:42.800899 18525 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:42.800987 18522 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:42.802881 18530 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:42.468251 22747 consensus_queue.cc:1059] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.294s
I20260709 12:23:42.667652 22791 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:42.812601 22856 raft_consensus.cc:2804] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:42.813184 22856 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.813576 22856 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:42.463001 22868 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:42.822093 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:42.828723 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:42.830451 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:42.779628 22832 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:42.834421 18494 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:42.829413 18524 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:42.835705 18494 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:42.809504 22538 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:42.768429 22862 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:23:42.812045 22865 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:42.846868 18672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 557) took 1746 ms. Trace:
I20260709 12:23:42.827363 22883 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.857683 18672 rpcz_store.cc:276] 0709 12:23:41.101081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.104056 (+  2975us) service_pool.cc:224] Handling call
0709 12:23:41.324069 (+220013us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:41.324791 (+   722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.846634 (+1521843us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54003a1e50. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:42.846797 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":504804608}
I20260709 12:23:42.801046 22871 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:23:42.816725 22870 raft_consensus.cc:2804] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:42.806349 22746 consensus_queue.cc:1048] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:23:42.865741 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:42.834590 22787 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.865993 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:42.796339 22844 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:42.807732 22694 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:42.832775 22854 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.900341 18672 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:23:42.842707 22879 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:42.871891 18605 raft_consensus.cc:1240] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:23:42.848704 22538 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.903420 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:42.898872 22853 consensus_meta.cc:287] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.617s	user 0.006s	sys 0.004s
I20260709 12:23:42.793418 22866 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:42.849546 22832 raft_consensus.cc:697] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:42.864643 22887 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:42.915884 18672 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:23:42.922896 18679 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
I20260709 12:23:42.898849 22728 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:42.869880 22870 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:42.850757 22659 consensus_queue.cc:237] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:42.948848 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:42.908025 22879 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.917240 22538 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:42.904775 22872 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:23:42.917382 22729 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.041s	sys 0.108s
I20260709 12:23:42.919260 22440 raft_consensus.cc:3055] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:42.947871 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:42.784585 22867 consensus_queue.cc:237] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:42.947516 22876 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:23:42.949394 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 176604us
I20260709 12:23:42.906388 22787 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:42.943787 22888 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.926692 22853 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:42.915278 22854 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:42.925051 22840 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:42.948071 22728 raft_consensus.cc:697] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:42.948768 22870 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:42.983875 18646 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:23:42.975181 22884 log.cc:927] Time spent T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:23:43.003829 22888 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:43.004195 22728 consensus_queue.cc:237] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.006227 22888 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:42.959722 22879 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:42.905069 22883 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:42.974030 22746 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:42.980734 22860 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.002440 18646 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:23:42.964115 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 171846us
W20260709 12:23:43.003332 22891 log.cc:927] Time spent T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:23:43.003244 22897 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:42.977770 22440 raft_consensus.cc:740] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:43.026669 18674 raft_consensus.cc:1240] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:43.046429 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:43.055787 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 113029us
I20260709 12:23:43.064570 18522 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:43.069856 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:43.069478 18494 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.240.130:37079 timed out after 1.976s (SENT) [suppressed 17 similar messages]
I20260709 12:23:43.015328 22880 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:43.054288 22791 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:43.058796 22877 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.081904 22899 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:23:43.000396 22832 consensus_queue.cc:237] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.081741 22440 consensus_queue.cc:260] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:42.975267 22872 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:43.091002 22900 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:43.091650 22900 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.008059 22840 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.053495 22746 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:43.052517 22860 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:42.993156 22876 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:43.099625 18522 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:23:43.073401 22758 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:43.105656 22848 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:23:43.096450 22674 consensus_meta.cc:287] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 1.025s	user 0.013s	sys 0.001s
I20260709 12:23:43.068053 22868 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:43.089437 22791 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.098822 22741 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:43.114487 22440 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:43.096284 22900 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:43.118749 22848 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.119045 22741 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.088081 22880 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.144289 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:43.145188 18602 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:43.124243 22791 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:43.147267 22837 log.cc:927] Time spent T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 1.435s	user 0.002s	sys 0.012s
I20260709 12:23:43.070158 22897 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.149564 22897 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:43.149802 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1985) took 1971 ms. Trace:
I20260709 12:23:43.127449 22844 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:43.150259 18680 rpcz_store.cc:276] 0709 12:23:41.178928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.179077 (+   149us) service_pool.cc:224] Handling call
0709 12:23:41.179521 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:41.202911 (+ 23390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:41.202944 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:41.269742 (+ 66798us) log.cc:844] Serialized 26 byte log entry
0709 12:23:41.448095 (+178353us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:41.448136 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:41.448202 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:43.141756 (+1693554us) spinlock_profiling.cc:243] Waited 4.82 ms on lock 0x7b2400241c28. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc792789c4 00007efc79276acb 00007efc79431dc9 00007efc79431a55 00007efc7943109d 00007efc7c06310e 00007efc7c07a88c 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221
0709 12:23:43.149483 (+  7727us) raft_consensus.cc:1685] finished
0709 12:23:43.149508 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:43.149736 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24511,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":3280,"spinlock_wait_cycles":11092736,"thread_start_us":122068,"threads_started":1,"wal-append.queue_time_us":338848}
I20260709 12:23:43.114025 22840 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:43.154667 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:43.114485 22674 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.115346 22758 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:43.142618 22741 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:43.164368 22893 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.169605 18604 raft_consensus.cc:1240] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:23:43.172525 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 119339us
I20260709 12:23:43.159739 18602 raft_consensus.cc:1240] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:23:43.139734 22848 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:43.089542 22877 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:43.180457 22880 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:43.163856 22898 log.cc:927] Time spent T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:23:43.177518 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:43.161341 22885 log.cc:927] Time spent T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:23:43.151659 22853 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:43.191854 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:43.181988 22904 consensus_queue.cc:1059] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:43.192924 18604 raft_consensus.cc:2393] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 15: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:43.167448 22538 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:43.186542 19210 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:43.184290 22787 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:43.234108 19242 raft_consensus.cc:2393] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 9: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:43.261046 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:43.269850 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 83398.9us
I20260709 12:23:43.270541 18528 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 11.
I20260709 12:23:43.278203 22877 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:43.280525 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.282975 22538 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:43.283088 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:43.283860 22860 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:43.283880 18604 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:43.285163 22876 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:43.285595 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:43.286254 22746 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:43.232595 22912 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:43.286252 18604 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:43.290081 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:43.296900 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 2000) took 1031 ms. Trace:
I20260709 12:23:43.297398 18678 rpcz_store.cc:276] 0709 12:23:42.265517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.267041 (+  1524us) service_pool.cc:224] Handling call
0709 12:23:42.267373 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:42.278790 (+ 11417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:42.278826 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:42.283280 (+  4454us) log.cc:844] Serialized 52 byte log entry
0709 12:23:42.467838 (+184558us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:42.467883 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.467952 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:43.296663 (+828711us) raft_consensus.cc:1685] finished
0709 12:23:43.296684 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:43.296839 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7804,"raft.queue_time_us":49186,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":24124,"thread_start_us":147799,"threads_started":1,"wal-append.queue_time_us":589875}
W20260709 12:23:43.302371 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:43.214726 22901 log.cc:927] Time spent T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:23:43.196135 22880 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:43.218348 22895 log.cc:927] Time spent T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
W20260709 12:23:43.242156 22778 consensus_meta.cc:287] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.944s	user 0.013s	sys 0.000s
I20260709 12:23:43.216925 22853 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.310014 22868 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.220726 22854 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:43.184520 22903 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:43.321424 22868 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:43.322959 22845 log.cc:927] Time spent T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 1.391s	user 0.012s	sys 0.000s
I20260709 12:23:43.241022 22872 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:43.233567 22907 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:43.322818 22710 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:43.343988 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.319603 22791 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:43.336649 22361 consensus_meta.cc:287] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.975s	user 0.014s	sys 0.000s
I20260709 12:23:43.326627 22853 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.353634 22868 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:43.362478 22856 consensus_meta.cc:287] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.548s	user 0.013s	sys 0.000s
I20260709 12:23:43.288470 22912 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.314008 22880 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:41.075649 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:43.343963 22883 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:43.339214 22870 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:43.387205 18672 raft_consensus.cc:1240] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:43.388486 22870 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:43.362989 22856 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:43.196915 22893 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.320745 22778 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.356266 22848 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.358336 22907 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.377249 22758 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:43.401911 22692 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:43.378434 22880 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:43.378893 22226 consensus_meta.cc:287] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.653s	user 0.008s	sys 0.005s
I20260709 12:23:43.379698 22783 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:43.399144 22879 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.402179 19244 raft_consensus.cc:2393] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 11: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:43.368212 22361 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.343353 22903 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.411098 18523 raft_consensus.cc:1240] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:43.407143 18600 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:23:43.377162 19239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 601) took 1942 ms. Trace:
I20260709 12:23:43.402693 22692 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:43.411921 19239 rpcz_store.cc:276] 0709 12:23:41.434451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.434633 (+   182us) service_pool.cc:224] Handling call
0709 12:23:41.435038 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:41.435680 (+   642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:41.435739 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:41.436689 (+   950us) log.cc:844] Serialized 26 byte log entry
0709 12:23:41.747692 (+311003us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:41.747772 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:41.747873 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:43.170936 (+1423063us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:23:43.376818 (+205882us) raft_consensus.cc:1685] finished
0709 12:23:43.376841 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:43.377066 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":224,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":7382,"spinlock_wait_cycles":71215360,"thread_start_us":310294,"threads_started":1,"wal-append.queue_time_us":342807}
I20260709 12:23:43.422434 18525 raft_consensus.cc:2393] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 11: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:43.423261 18599 raft_consensus.cc:1240] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:23:43.408217 22853 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:43.410538 22783 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:43.426079 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 356602us
I20260709 12:23:43.437608 18675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40800 (request call id 2004) took 1170 ms. Trace:
I20260709 12:23:43.444684 18675 rpcz_store.cc:276] 0709 12:23:42.266796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.270516 (+  3720us) service_pool.cc:224] Handling call
0709 12:23:43.437306 (+1166790us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b540038b154. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:43.437506 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7267712}
I20260709 12:23:43.455376 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:43.456259 19239 raft_consensus.cc:2393] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 6: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:43.455724 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:43.460296 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:43.461197 19246 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:23:43.475494 18494 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:43.446038 22783 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:43.506834 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:43.508553 18522 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:43.512986 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:43.513671 18570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.004s	sys 0.027s
W20260709 12:23:43.514099 18570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.004s	sys 0.027s
W20260709 12:23:43.504204 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 501806us
I20260709 12:23:43.519367 18646 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:43.519670 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 804732us
I20260709 12:23:43.523041 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:43.523123 22853 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:43.524580 22880 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:43.507490 22689 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:43.512353 22729 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:43.506807 22912 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:43.531450 18522 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
W20260709 12:23:43.533186 18671 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.017s	sys 0.016s
I20260709 12:23:43.510783 22854 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:43.524930 18646 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:43.541119 22848 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:43.544102 18671 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.017s	sys 0.017s
W20260709 12:23:43.541718 22914 log.cc:927] Time spent T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:23:43.554955 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:43.556191 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:43.543648 22883 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.534696 22689 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:43.534152 22907 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:43.546941 22856 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:43.550004 22880 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:43.527154 22226 consensus_queue.cc:1048] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:23:43.552415 22913 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:43.558187 22867 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.004s	sys 0.019s
I20260709 12:23:43.568001 22883 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.572352 22694 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:43.574913 22911 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:43.575212 22411 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.575677 22738 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:43.517127 22910 consensus_queue.cc:1059] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 12:23:43.576174 22870 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:43.576309 22893 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:43.576640 22774 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.577057 22756 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:43.580617 22907 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.561231 22843 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:43.562105 22659 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:43.631641 22659 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.633882 22659 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:43.545101 22729 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.597764 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:43.636023 22729 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:43.587440 22728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.025s	sys 0.035s
W20260709 12:23:43.636807 22728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.025s	sys 0.035s
I20260709 12:23:43.564287 22689 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:43.638338 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:43.602197 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:43.606483 22758 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.551790 22854 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:43.602200 22832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.006s	sys 0.027s
I20260709 12:23:43.563670 22853 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:23:43.623816 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:43.617822 22361 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:43.629293 22774 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.629565 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:43.630164 22756 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.670929 18644 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:43.683912 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:43.684231 22756 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:43.684892 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:43.685603 18600 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:23:43.686561 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:43.687145 18600 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:43.580667 22879 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:43.687934 22879 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:43.688416 22879 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:43.690445 22879 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:43.569777 22880 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.691208 22880 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:43.641521 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 138216us
I20260709 12:23:43.696817 18570 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:43.651881 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:43.657728 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:43.697909 18602 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 11.
I20260709 12:23:43.698853 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:43.657887 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:43.625926 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:43.668836 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:43.699443 18602 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:43.700266 18604 raft_consensus.cc:2393] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 14: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:43.608194 22926 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.713605 18644 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:43.617224 22411 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.713595 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:43.714090 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:43.730727 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:43.661091 22832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.006s	sys 0.027s
W20260709 12:23:43.732285 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 80401.5us
I20260709 12:23:43.734354 22926 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.735183 18644 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:43.730867 22756 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:43.737340 22926 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:43.731503 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:43.737900 22926 raft_consensus.cc:2749] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:43.622812 22738 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:43.740970 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 44245.8us
I20260709 12:23:43.742798 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:43.745177 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:43.745872 18675 raft_consensus.cc:2393] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 11: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:43.628829 22870 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:43.748920 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:43.750548 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:43.751652 18529 raft_consensus.cc:2393] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 11: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:43.675276 22710 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:43.757046 18606 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:43.756390 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:43.757910 18530 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
I20260709 12:23:43.719086 22226 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:43.588575 22913 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.764117 22921 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:43.759214 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:43.764679 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:43.763463 18570 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:43.755904 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:43.761986 19246 raft_consensus.cc:3055] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:43.766086 19246 raft_consensus.cc:740] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
W20260709 12:23:43.768016 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.769313 18572 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:43.649652 22907 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.658550 22758 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.767285 19246 consensus_queue.cc:260] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:43.775715 19246 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:43.764223 22226 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:43.741914 22860 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:43.752519 22538 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.649015 22910 consensus_queue.cc:1059] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 12:23:43.785830 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:43.764719 22921 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:43.786525 18530 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:43.776146 22670 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:43.774099 22694 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:43.798872 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:43.761809 22926 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:43.614157 22911 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:43.807139 22850 log.cc:927] Time spent T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 2.020s	user 0.014s	sys 0.008s
I20260709 12:23:43.794751 22921 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:43.814433 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:43.768126 22710 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:43.774863 22916 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.799891 22694 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:43.822336 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:43.791654 22538 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:43.828841 18527 raft_consensus.cc:3055] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:43.832041 18527 raft_consensus.cc:740] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:43.832892 18527 consensus_queue.cc:260] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.837826 18527 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:43.828874 18494 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
W20260709 12:23:43.843832 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.843633 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:43.844843 18530 raft_consensus.cc:2393] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 11: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:43.827080 22694 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:43.858542 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:43.866231 22774 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:43.866850 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:43.867502 22927 log.cc:927] Time spent T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:23:43.870144 22907 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:43.842658 22832 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.891398 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:43.888623 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:43.894383 18530 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 14.
I20260709 12:23:43.908217 22935 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:43.908830 22935 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.909281 22935 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:43.913103 22838 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:43.890405 22774 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.915918 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:43.921372 18525 raft_consensus.cc:2393] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 11: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:43.927712 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:43.857210 22916 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.907061 22926 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.914597 22783 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:43.937340 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:43.911635 22854 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:43.938760 18525 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:43.945188 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:43.946028 18525 raft_consensus.cc:2393] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 10: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:43.946871 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:43.932713 18602 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:23:43.937120 22924 log.cc:927] Time spent T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 12:23:43.947476 18525 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
I20260709 12:23:43.948184 22937 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:43.905499 22832 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.951530 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:43.955773 22911 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:43.950990 22913 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:43.957809 22832 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:43.964026 22870 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:43.965008 19239 raft_consensus.cc:1240] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:23:43.928485 22361 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:23:43.941128 22741 consensus_meta.cc:287] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.741s	user 0.010s	sys 0.007s
I20260709 12:23:43.953717 22854 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:43.982874 22538 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:43.984427 22931 log.cc:927] Time spent T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 12:23:43.986383 18600 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:43.925443 22774 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:43.993692 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:43.943841 22758 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:43.996881 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:44.002434 22774 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:44.002849 18671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 561) took 2697 ms. Trace:
I20260709 12:23:44.003208 18671 rpcz_store.cc:276] 0709 12:23:41.305568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.305739 (+   171us) service_pool.cc:224] Handling call
0709 12:23:41.306072 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:41.475571 (+169499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:41.475600 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:41.476571 (+   971us) log.cc:844] Serialized 52 byte log entry
0709 12:23:42.842825 (+1366254us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b18002887c0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793d4e07 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793f1c02 00007efc7c07920b 00007efc7c07ed23 00007efc7c07f0d1 00007efc7c49aa0f
0709 12:23:42.981986 (+139161us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:43.549954 (+567968us) log.cc:844] Serialized 14 byte log entry
0709 12:23:43.559607 (+  9653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.002529 (+442922us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54003a1954. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:44.002586 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:44.002635 (+    49us) raft_consensus.cc:1685] finished
0709 12:23:44.002649 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:44.002794 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1855,"prepare.queue_time_us":214295,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":1702,"raft.queue_time_us":23696,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":18111,"spinlock_wait_cycles":393878912,"thread_start_us":687670,"threads_started":2,"wal-append.queue_time_us":1593976}
I20260709 12:23:44.005275 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:44.006554 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:44.007493 18671 raft_consensus.cc:2393] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 7: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:44.010175 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:44.013248 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 2121) took 1237 ms. Trace:
I20260709 12:23:44.013804 18523 rpcz_store.cc:276] 0709 12:23:42.776186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.776331 (+   145us) service_pool.cc:224] Handling call
0709 12:23:42.776632 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:43.411538 (+634906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.012899 (+601361us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b5400335754. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:44.013152 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1458684160}
I20260709 12:23:44.016244 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:44.016556 22929 log.cc:927] Time spent T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:23:44.001399 22710 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:44.017791 19210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:44.061103 19210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.062512 19210 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:44.088063 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:44.089468 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:44.090602 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:44.005529 22921 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:44.094759 22921 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:44.097358 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:44.094664 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:44.103642 18600 raft_consensus.cc:2393] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 11: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
W20260709 12:23:43.997653 22692 consensus_meta.cc:287] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.575s	user 0.013s	sys 0.003s
I20260709 12:23:44.228883 18527 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:23:44.229290 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:44.229573 18527 pending_rounds.cc:85] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 3
I20260709 12:23:44.233429 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:44.098004 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:43.973289 22361 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:44.239138 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:44.239696 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:44.232882 22712 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:23:43.971491 22832 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.241083 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:44.246667 22870 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:44.248029 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.246869 22866 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:43.995831 22937 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:23:44.256105 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:44.271067 18671 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:23:44.272804 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:44.273669 18671 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:44.275555 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:44.256891 18527 pending_rounds.cc:107] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:23:43.997226 22854 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:44.268608 22783 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:44.276922 18527 raft_consensus.cc:2889] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:44.276636 18673 raft_consensus.cc:2393] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 11: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:44.000870 22741 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:44.278905 22811 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:44.285097 22880 consensus_meta.cc:287] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.593s	user 0.008s	sys 0.003s
I20260709 12:23:44.285439 22926 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:44.270217 22870 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:23:44.286993 22854 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:44.054050 22689 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:44.299962 22937 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:44.237351 22692 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:44.302937 22833 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:23:44.311108 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:44.306157 18527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 2118) took 2813 ms. Trace:
I20260709 12:23:44.309767 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:44.314255 22524 consensus_queue.cc:260] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:44.314885 22741 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:44.317584 18527 rpcz_store.cc:276] 0709 12:23:41.493006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.493180 (+   174us) service_pool.cc:224] Handling call
0709 12:23:41.493645 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:43.828739 (+2335094us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54004c11a0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c456dc0 00007efc7c4e11c0 00007efc7c4e2231 00007efc7c4ded8f 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c
0709 12:23:44.298836 (+470097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.306075 (+  7239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341841152}
I20260709 12:23:44.334571 18599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 1996) took 1635 ms. Trace:
I20260709 12:23:44.339838 18600 raft_consensus.cc:1240] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:44.339972 18599 rpcz_store.cc:276] 0709 12:23:42.699595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.699996 (+   401us) service_pool.cc:224] Handling call
0709 12:23:42.700325 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:43.423961 (+723636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.334258 (+910297us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b540010f754. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:44.334495 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1662018304}
I20260709 12:23:44.337106 22411 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:44.271677 22832 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:44.340929 18530 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
W20260709 12:23:44.342818 18644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.030s	sys 0.045s
W20260709 12:23:44.345824 18644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.030s	sys 0.045s
I20260709 12:23:44.308809 22854 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:44.346442 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 611292us
I20260709 12:23:44.349958 22692 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:44.305616 22880 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:44.352092 22935 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:44.346343 22524 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:44.353672 18644 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:44.352618 22880 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:44.364882 18601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 2001) took 1622 ms. Trace:
I20260709 12:23:44.359642 18644 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:44.362201 18525 raft_consensus.cc:1240] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:44.378614 18601 rpcz_store.cc:276] 0709 12:23:42.742503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.776945 (+ 34442us) service_pool.cc:224] Handling call
0709 12:23:42.777349 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:42.913905 (+136556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:42.913958 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:42.914444 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:23:42.982823 (+ 68379us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:42.982863 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.364233 (+1381370us) spinlock_profiling.cc:243] Waited 70.7 ms on lock 0x7b540010c054. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:44.364278 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:44.364330 (+    52us) raft_consensus.cc:1685] finished
0709 12:23:44.364570 (+   240us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:44.364814 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87198,"raft.queue_time_us":75445,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":13599,"spinlock_wait_cycles":162502528,"thread_start_us":68084,"threads_started":1,"wal-append.queue_time_us":219949,"wal-append.run_cpu_time_us":2063,"wal-append.run_wall_time_us":1002114}
I20260709 12:23:44.382130 18644 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:44.384078 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:44.386988 18601 raft_consensus.cc:1275] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:23:44.387486 18643 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.026s	sys 0.055s
W20260709 12:23:44.387848 18643 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.027s	sys 0.055s
I20260709 12:23:44.386060 22650 raft_consensus.cc:2804] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:44.390736 18601 raft_consensus.cc:1275] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:44.393095 18644 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:44.394176 18680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.017s	sys 0.036s
W20260709 12:23:44.402829 18680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.017s	sys 0.037s
W20260709 12:23:44.394629 18678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.036s	sys 0.072s
W20260709 12:23:44.403661 18678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.037s	sys 0.073s
I20260709 12:23:44.395152 18644 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:44.359249 22774 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:44.389997 22650 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.358016 22226 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:44.365317 22883 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:44.401242 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:44.361937 22832 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:44.354854 22935 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:44.445688 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 50610.4us
I20260709 12:23:44.374186 22854 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:44.396023 22926 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:44.398952 22880 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:44.414609 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 569) took 1658 ms. Trace:
I20260709 12:23:44.431918 22650 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:44.452852 22911 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:44.464649 22911 raft_consensus.cc:697] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:44.466441 22911 consensus_queue.cc:237] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:44.466864 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:44.467803 18673 raft_consensus.cc:2393] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 10: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:44.468573 18600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 2014) took 1010 ms. Trace:
I20260709 12:23:44.468972 18600 rpcz_store.cc:276] 0709 12:23:43.458198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.231039 (+772841us) service_pool.cc:224] Handling call
0709 12:23:44.231398 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:44.340355 (+108957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.468345 (+127990us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54002b8ed4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:44.468517 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248843648}
I20260709 12:23:44.443285 22866 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:44.477950 18526 raft_consensus.cc:3055] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:44.478407 18526 raft_consensus.cc:740] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:44.453393 22832 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:44.458814 22880 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.477382 22839 consensus_queue.cc:260] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:44.485062 22839 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:44.483554 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:44.461529 22361 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:44.486413 18598 raft_consensus.cc:2410] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:23:44.487107 19242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33382 (request call id 603) took 1441 ms. Trace:
I20260709 12:23:44.494670 19242 rpcz_store.cc:276] 0709 12:23:43.045872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.046065 (+   193us) service_pool.cc:224] Handling call
0709 12:23:44.486831 (+1440766us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54005b13d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:44.487025 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409619328}
I20260709 12:23:44.488940 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:44.496927 18600 raft_consensus.cc:2393] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 12: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
W20260709 12:23:44.514688 22694 consensus_meta.cc:287] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.637s	user 0.009s	sys 0.003s
I20260709 12:23:44.515836 18672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 565) took 1817 ms. Trace:
I20260709 12:23:44.516369 18672 rpcz_store.cc:276] 0709 12:23:42.697974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.928966 (+230992us) service_pool.cc:224] Handling call
0709 12:23:42.929204 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:43.387618 (+458414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.515507 (+1127889us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54001c0a54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:44.515731 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1031737600}
I20260709 12:23:44.518280 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:44.519153 18672 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:44.520159 18597 raft_consensus.cc:2393] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 6: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:44.458537 18680 rpcz_store.cc:276] 0709 12:23:42.756369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.155856 (+399487us) service_pool.cc:224] Handling call
0709 12:23:43.156147 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:43.156365 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:43.614992 (+458627us) log.cc:844] Serialized 14 byte log entry
0709 12:23:44.414208 (+799216us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:44.414276 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:44.414329 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.414408 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:44.414529 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10548,"prepare.queue_time_us":140155,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":4934,"raft.queue_time_us":16412,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"thread_start_us":1246133,"threads_started":2}
I20260709 12:23:44.479290 18526 consensus_queue.cc:260] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:44.525981 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:44.515252 22860 consensus_meta.cc:287] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.733s	user 0.010s	sys 0.004s
I20260709 12:23:44.470959 22866 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:44.485977 22880 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:44.536258 18680 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:44.542281 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:44.493785 22832 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:44.622970 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:44.552577 18600 raft_consensus.cc:1240] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:23:44.654582 18572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.010s	sys 0.024s
W20260709 12:23:44.654628 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 421230us
I20260709 12:23:44.648698 18604 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:44.656116 18680 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 14.
W20260709 12:23:44.659819 18570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.894s	user 0.000s	sys 0.028s
W20260709 12:23:44.656139 18494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.001s	sys 0.020s
I20260709 12:23:44.665505 18673 raft_consensus.cc:2393] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 9: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:44.676987 18673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50938 (request call id 572) took 1049 ms. Trace:
I20260709 12:23:44.677338 18673 rpcz_store.cc:276] 0709 12:23:43.627863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.468490 (+840627us) service_pool.cc:224] Handling call
0709 12:23:44.676925 (+208435us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:44.666335 18572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.010s	sys 0.025s
W20260709 12:23:44.679229 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 909988us
I20260709 12:23:44.676826 19241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33372 (request call id 356) took 3546 ms. Trace:
W20260709 12:23:44.670459 19210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:44.671015 18494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.001s	sys 0.020s
W20260709 12:23:44.670775 18570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.000s	sys 0.028s
W20260709 12:23:44.685647 19210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.685333 19241 rpcz_store.cc:276] 0709 12:23:41.107931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.108082 (+   151us) service_pool.cc:224] Handling call
0709 12:23:41.121508 (+ 13426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:41.988618 (+867110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.654488 (+2665870us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b5400069854. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:44.654698 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1527784832}
I20260709 12:23:44.502862 22935 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:44.622725 18526 raft_consensus.cc:3060] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:44.677349 18600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39798 (request call id 541) took 1147 ms. Trace:
I20260709 12:23:44.687448 18600 rpcz_store.cc:276] 0709 12:23:43.530161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.516753 (+986592us) service_pool.cc:224] Handling call
0709 12:23:44.552277 (+ 35524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:44.677076 (+124799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.677294 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:44.691857 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:44.692752 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:44.692938 18528 raft_consensus.cc:2468] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 5.
I20260709 12:23:44.669893 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:44.695513 18646 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:44.672616 18672 raft_consensus.cc:2410] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:23:44.695938 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 932503us
I20260709 12:23:44.700407 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:44.552824 22860 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:44.712936 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40800 (request call id 2011) took 1086 ms. Trace:
I20260709 12:23:44.845245 18680 rpcz_store.cc:276] 0709 12:23:43.626226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.669423 (+1043197us) service_pool.cc:224] Handling call
0709 12:23:44.712829 (+ 43406us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:44.702399 22942 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:44.701092 22943 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:44.515259 22694 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:44.822113 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 56360.7us
I20260709 12:23:44.823221 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:44.587172 22870 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:44.664686 22910 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.010s	sys 0.021s
I20260709 12:23:44.825042 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:44.861258 18673 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:44.862126 18673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 2448) took 1063 ms. Trace:
I20260709 12:23:44.862526 18673 rpcz_store.cc:276] 0709 12:23:43.798457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.678193 (+879736us) service_pool.cc:224] Handling call
0709 12:23:44.862037 (+183844us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:44.569764 22689 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:44.604023 22887 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:44.654325 22729 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.014s	sys 0.024s
I20260709 12:23:44.668741 22872 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:44.652740 22659 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.885s	user 0.020s	sys 0.051s
W20260709 12:23:44.654525 22746 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.023s	sys 0.048s
W20260709 12:23:44.666033 22838 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.006s	sys 0.027s
I20260709 12:23:44.690315 22774 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.769060 22756 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:44.771894 22361 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:44.844710 18605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 2004) took 2071 ms. Trace:
I20260709 12:23:44.852526 18672 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:23:44.852952 19210 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:44.679453 19212 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:44.822247 18570 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:44.834682 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:44.837903 18644 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:44.846514 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:44.656343 22495 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.009s	sys 0.012s
I20260709 12:23:44.569073 22650 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:44.876469 22659 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.119s	user 0.023s	sys 0.058s
I20260709 12:23:44.838335 22373 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:44.864673 22421 raft_consensus.cc:3055] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:23:44.872161 22729 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.097s	user 0.015s	sys 0.030s
W20260709 12:23:44.876663 22746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.094s	user 0.024s	sys 0.057s
I20260709 12:23:44.839783 22854 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:44.768262 22865 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:44.866055 22910 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.011s	sys 0.022s
W20260709 12:23:44.877002 22838 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.006s	sys 0.036s
I20260709 12:23:44.876812 22872 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:44.875053 22887 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:44.767081 22935 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:44.862628 22943 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:45.046380 22935 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:45.047147 22943 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:44.855216 22942 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:44.940831 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:45.037398 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:45.036476 22373 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:44.899286 22926 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:44.940471 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:45.038182 22421 raft_consensus.cc:740] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:45.039420 22495 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.173s	user 0.013s	sys 0.029s
W20260709 12:23:44.948120 18606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40954 (request call id 1972) took 3753 ms (client timeout 1976 ms). Trace:
W20260709 12:23:45.000232 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:44.959093 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:45.039875 18605 rpcz_store.cc:276] 0709 12:23:42.772963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.802644 (+ 29681us) service_pool.cc:224] Handling call
0709 12:23:42.825634 (+ 22990us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:42.916089 (+ 90455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.844359 (+1928270us) spinlock_profiling.cc:243] Waited 45.9 ms on lock 0x7b54001266d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:44.844628 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105671424}
W20260709 12:23:44.943928 19240 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.134s	user 0.025s	sys 0.076s
W20260709 12:23:44.933133 18599 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.016s	sys 0.046s
W20260709 12:23:45.009279 22844 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.021s	sys 0.059s
W20260709 12:23:44.966961 22675 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.009s	sys 0.027s
W20260709 12:23:45.043370 22945 log.cc:927] Time spent T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:23:45.011636 22832 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:44.954367 19246 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.019s	sys 0.056s
I20260709 12:23:45.057971 22942 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:45.040982 22947 log.cc:927] Time spent T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:23:44.966375 22226 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:45.042155 22944 log.cc:927] Time spent T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 12:23:44.961504 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.963922 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:45.059026 18606 rpcz_store.cc:269] 0709 12:23:41.090458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.090583 (+   125us) service_pool.cc:224] Handling call
0709 12:23:44.843702 (+3753119us) spinlock_profiling.cc:243] Waited 2.65 s on lock 0x7b540015ca54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:44.844117 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6090979072}
I20260709 12:23:44.969264 22694 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:45.066586 22421 consensus_queue.cc:260] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:45.073083 22421 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:45.074808 19239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33388 (request call id 566) took 1515 ms. Trace:
I20260709 12:23:45.075901 18672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40800 (request call id 2021) took 1111 ms. Trace:
I20260709 12:23:45.076413 18672 rpcz_store.cc:276] 0709 12:23:43.951378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.725270 (+773892us) service_pool.cc:224] Handling call
0709 12:23:45.058800 (+333530us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.077105 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:45.058137 22373 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:45.077800 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:45.078151 18605 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:44.824219 18528 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:45.078593 18600 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:23:45.080776 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:44.899127 22939 log.cc:927] Time spent T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:23:44.947000 18572 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:45.075845 18599 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.023s	sys 0.052s
W20260709 12:23:45.070108 19240 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.260s	user 0.027s	sys 0.086s
W20260709 12:23:44.900357 22941 log.cc:927] Time spent T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 12:23:45.079596 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:45.077498 18524 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:45.075340 19239 rpcz_store.cc:276] 0709 12:23:43.559324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.559455 (+   131us) service_pool.cc:224] Handling call
0709 12:23:43.559801 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:43.968457 (+408656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.073908 (+1105451us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b54004d8854. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:45.074509 (+   601us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":931264768}
I20260709 12:23:44.880409 22756 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:45.096069 22756 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:45.096185 18600 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:44.882323 22774 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:45.104272 22865 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:45.105788 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 268107us
W20260709 12:23:45.075860 22675 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.016s	sys 0.027s
I20260709 12:23:44.891449 22866 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:45.088140 19246 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.026s	sys 0.061s
I20260709 12:23:45.092044 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40800 (request call id 2005) took 1506 ms. Trace:
I20260709 12:23:45.094177 22361 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:45.087385 22844 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.024s	sys 0.061s
I20260709 12:23:45.090101 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40800 (request call id 2017) took 1196 ms. Trace:
W20260709 12:23:45.075906 18677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40800 (request call id 2001) took 2782 ms (client timeout 1636 ms). Trace:
W20260709 12:23:45.147797 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:45.136762 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:45.110901 18672 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 12.
I20260709 12:23:45.138324 18676 rpcz_store.cc:276] 0709 12:23:43.889854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.036680 (+1146826us) service_pool.cc:224] Handling call
0709 12:23:45.085889 (+ 49209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.123579 18604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40948 (request call id 2234) took 1527 ms. Trace:
I20260709 12:23:45.136143 18605 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:45.111553 18680 rpcz_store.cc:276] 0709 12:23:43.585783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.846175 (+1260392us) service_pool.cc:224] Handling call
0709 12:23:45.091829 (+245654us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.125815 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:45.136206 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2439) took 1551 ms. Trace:
I20260709 12:23:45.082916 22935 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:45.151885 18604 rpcz_store.cc:276] 0709 12:23:43.596145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.716152 (+120007us) service_pool.cc:224] Handling call
0709 12:23:45.122971 (+1406819us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b54001257d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:45.123168 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2029855488}
W20260709 12:23:45.129892 19244 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33372 (request call id 358) took 2071 ms (client timeout 2358 ms). Trace:
I20260709 12:23:45.110121 22650 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:45.135021 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 455508us
W20260709 12:23:45.139871 18677 rpcz_store.cc:269] 0709 12:23:42.265851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.273913 (+  8062us) service_pool.cc:224] Handling call
0709 12:23:45.047568 (+2773655us) spinlock_profiling.cc:243] Waited 92 ms on lock 0x7b54000bd6d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:45.047838 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211653888}
I20260709 12:23:45.107666 18644 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:45.109967 22866 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:45.134884 22674 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:45.174010 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 227475us
I20260709 12:23:45.085475 22226 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:45.181270 22795 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:45.182348 22373 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:45.182652 22778 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:45.183143 22373 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:45.184242 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:45.185827 18676 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:45.178493 18673 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:23:45.202296 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:45.196063 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:45.197120 22935 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:45.209399 18424 catalog_manager.cc:5697] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:45.195025 18601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39798 (request call id 539) took 1665 ms. Trace:
W20260709 12:23:45.166966 19244 rpcz_store.cc:269] 0709 12:23:43.058376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.060491 (+  2115us) service_pool.cc:224] Handling call
0709 12:23:45.129273 (+2068782us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54002747d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:45.129587 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":760559872}
I20260709 12:23:45.149811 22865 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:45.191442 22880 consensus_meta.cc:287] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.604s	user 0.006s	sys 0.011s
I20260709 12:23:45.187403 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:45.184142 22373 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:45.132328 22952 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:45.215777 18602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 2013) took 1757 ms. Trace:
I20260709 12:23:45.211086 18601 rpcz_store.cc:276] 0709 12:23:43.529610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.397878 (+868268us) service_pool.cc:224] Handling call
0709 12:23:44.398537 (+   659us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:44.399066 (+   529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:44.399106 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:44.399663 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 12:23:44.939727 (+540064us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:44.939901 (+   174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.940090 (+   189us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:45.194396 (+254306us) raft_consensus.cc:1685] finished
0709 12:23:45.194425 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.194721 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11337,"raft.queue_time_us":116,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":30005,"thread_start_us":479787,"threads_started":1,"wal-append.queue_time_us":758376}
I20260709 12:23:45.210438 22935 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:45.153640 22694 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:45.233570 18606 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:45.235546 18522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2774) took 1578 ms. Trace:
I20260709 12:23:45.232206 18676 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
W20260709 12:23:45.241477 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 419195us
I20260709 12:23:45.218443 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2443) took 1627 ms. Trace:
I20260709 12:23:45.217557 18673 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:23:45.246824 18606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 2237) took 1625 ms. Trace:
I20260709 12:23:45.250589 18606 rpcz_store.cc:276] 0709 12:23:43.621097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.232478 (+1611381us) service_pool.cc:224] Handling call
0709 12:23:45.233037 (+   559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.245645 (+ 12608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.246730 (+  1085us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.230737 18602 rpcz_store.cc:276] 0709 12:23:43.455066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.888063 (+432997us) service_pool.cc:224] Handling call
0709 12:23:43.910685 (+ 22622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:43.948983 (+ 38298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.211965 (+1262982us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b54001cfa54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:45.212310 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49692928}
I20260709 12:23:45.249397 18680 rpcz_store.cc:276] 0709 12:23:43.585555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.205654 (+1620099us) service_pool.cc:224] Handling call
0709 12:23:45.206356 (+   702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.206877 (+   521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.206922 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.207009 (+    87us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:45.207074 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.207152 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.213073 (+  5921us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.246505 22880 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:45.256985 22880 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:45.210544 22916 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:45.162583 18678 rpcz_store.cc:276] 0709 12:23:43.584549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.584783 (+   234us) service_pool.cc:224] Handling call
0709 12:23:43.608899 (+ 24116us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:43.609260 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:43.609289 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:43.609839 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 12:23:44.404243 (+794404us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:44.404305 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.404644 (+   339us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:45.135550 (+730906us) raft_consensus.cc:1685] finished
0709 12:23:45.135610 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.135928 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1220,"raft.queue_time_us":5655,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":8370,"thread_start_us":793992,"threads_started":1,"wal-append.queue_time_us":1038381}
I20260709 12:23:45.245754 18522 rpcz_store.cc:276] 0709 12:23:43.656927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.657081 (+   154us) service_pool.cc:224] Handling call
0709 12:23:43.682262 (+ 25181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:43.770078 (+ 87816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:43.770124 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:43.770179 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:43.770225 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.234950 (+1464725us) spinlock_profiling.cc:243] Waited 87.6 ms on lock 0x7b54002c7254. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:45.235030 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.235308 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201394560}
I20260709 12:23:45.284544 18598 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:45.289141 18427 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60812 (request call id 119) took 15537 ms (client timeout 15000 ms). Trace:
I20260709 12:23:45.292853 18678 raft_consensus.cc:1240] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 8. Current term is 9. Ops: [7.8-8.9]
W20260709 12:23:45.289639 18427 rpcz_store.cc:269] 0709 12:23:29.670716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.673572 (+  2856us) service_pool.cc:224] Handling call
0709 12:23:45.207594 (+15534022us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:37.160715 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:37.161430 (+   715us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:37.161491 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:23:37.161514 (+    23us) tablet.cc:662] Decoding operations
0709 12:23:37.162470 (+   956us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:37.162571 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:37.162600 (+    29us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:23:37.163382 (+   782us) tablet.cc:701] Row locks acquired
0709 12:23:37.163433 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:23:37.163622 (+   189us) write_op.cc:270] Start()
0709 12:23:37.171869 (+  8247us) write_op.cc:276] Timestamp: P: 1783599817163550 usec, L: 0
0709 12:23:37.179514 (+  7645us) op_driver.cc:348] REPLICATION: starting
0709 12:23:37.304274 (+124760us) log.cc:844] Serialized 2856 byte log entry
0709 12:23:38.186565 (+882291us) op_driver.cc:464] REPLICATION: finished
0709 12:23:38.597447 (+410882us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc793d50ac 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793f1c02 00007efc7ff15ef0
0709 12:23:38.812856 (+215409us) write_op.cc:301] APPLY: starting
0709 12:23:38.833071 (+ 20215us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:38.867334 (+ 34263us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:38.875976 (+  8642us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:38.952142 (+ 76166us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:38.952552 (+   410us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:23:38.952655 (+   103us) write_op.cc:312] APPLY: finished
0709 12:23:38.953134 (+   479us) log.cc:844] Serialized 59 byte log entry
0709 12:23:39.207030 (+253896us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:39.207162 (+   132us) write_op.cc:454] Released schema lock
0709 12:23:39.207236 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:39.240701 (+ 33465us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:39.240751 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1379826,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":542624,"apply.run_cpu_time_us":59422,"apply.run_wall_time_us":464269,"num_ops":7,"prepare.queue_time_us":547491,"prepare.run_cpu_time_us":33653,"prepare.run_wall_time_us":464448,"raft.queue_time_us":311789,"raft.run_cpu_time_us":23881,"raft.run_wall_time_us":532260,"replication_time_us":959746,"spinlock_wait_cycles":107854720,"thread_start_us":1140297,"threads_started":5,"wal-append.queue_time_us":692199,"wal-append.run_cpu_time_us":21689,"wal-append.run_wall_time_us":2411847}]]}
I20260709 12:23:45.293745 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 574) took 1665 ms. Trace:
I20260709 12:23:45.294333 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:45.211679 18424 catalog_manager.cc:5697] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 8 to 10, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 10 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:45.295630 22855 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:45.297142 18677 raft_consensus.cc:1217] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Deduplicated request from leader. Original: 4.3->[5.4-5.4]   Dedup: 5.4->[]
I20260709 12:23:45.297812 18677 raft_consensus.cc:1240] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:23:45.298530 18677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 2007) took 1712 ms. Trace:
I20260709 12:23:45.298908 18677 rpcz_store.cc:276] 0709 12:23:43.586246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.242782 (+1656536us) service_pool.cc:224] Handling call
0709 12:23:45.296870 (+ 54088us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:45.298179 (+  1309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.298433 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.300850 18601 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:23:45.301818 18601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 2015) took 1376 ms. Trace:
I20260709 12:23:45.302248 18601 rpcz_store.cc:276] 0709 12:23:43.925836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.264471 (+1338635us) service_pool.cc:224] Handling call
0709 12:23:45.300310 (+ 35839us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.301453 (+  1143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.301716 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.307844 22670 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:45.308238 18424 catalog_manager.cc:5697] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:45.318203 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 211133us
I20260709 12:23:45.320523 18644 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:45.321818 18570 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:45.310775 18424 catalog_manager.cc:5697] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 11 to 12, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 12 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:45.325160 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 1998) took 3060 ms. Trace:
I20260709 12:23:45.325646 18674 rpcz_store.cc:276] 0709 12:23:42.264767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.266926 (+  2159us) service_pool.cc:224] Handling call
0709 12:23:42.285404 (+ 18478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:43.060628 (+775224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.324608 (+2263980us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b540038a254. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:45.324950 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1669935488}
I20260709 12:23:45.325372 18424 catalog_manager.cc:5697] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 5 to 6, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 6 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:45.326282 18671 raft_consensus.cc:1240] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:23:45.326984 18671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 2015) took 1643 ms. Trace:
I20260709 12:23:45.327618 18424 catalog_manager.cc:5697] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 8 to 10, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 10 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:23:45.328577 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:45.329608 18522 raft_consensus.cc:2468] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:23:45.329784 18424 catalog_manager.cc:5697] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:45.331616 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:45.332052 18675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40800 (request call id 2008) took 1724 ms (client timeout 1512 ms). Trace:
W20260709 12:23:45.332628 18675 rpcz_store.cc:269] 0709 12:23:43.607992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.661336 (+ 53344us) service_pool.cc:224] Handling call
0709 12:23:45.331560 (+1670224us) spinlock_profiling.cc:243] Waited 58.4 ms on lock 0x7b54000578d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:45.331821 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134421888}
W20260709 12:23:45.333711 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 480682us
W20260709 12:23:45.335939 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 88167.3us
I20260709 12:23:45.336772 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:45.337955 18572 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:45.338461 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:45.339329 18528 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 6.
I20260709 12:23:45.345628 22226 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:45.346779 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:45.350782 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:45.352166 22738 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:45.353610 22903 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:45.342801 18679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50938 (request call id 567) took 2629 ms (client timeout 1777 ms). Trace:
I20260709 12:23:45.323879 18525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2781) took 1663 ms. Trace:
I20260709 12:23:45.343014 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:45.294188 18678 rpcz_store.cc:276] 0709 12:23:43.628342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.291917 (+1663575us) service_pool.cc:224] Handling call
0709 12:23:45.292423 (+   506us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:45.293371 (+   948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.293651 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.340812 22912 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.346149 18424 catalog_manager.cc:5697] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 7 to 9, leader changed from 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 9 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:45.347303 19212 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:45.341382 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:45.340513 18597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40954 (request call id 2011) took 1889 ms (client timeout 2272 ms). Trace:
I20260709 12:23:45.327343 18671 rpcz_store.cc:276] 0709 12:23:43.683792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.325389 (+1641597us) service_pool.cc:224] Handling call
0709 12:23:45.325873 (+   484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:45.326711 (+   838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.326932 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.332502 18522 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
W20260709 12:23:45.354624 18679 rpcz_store.cc:269] 0709 12:23:42.713214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.726406 (+ 13192us) service_pool.cc:224] Handling call
0709 12:23:45.342411 (+2616005us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54001f2054. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:45.342581 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449090816}
I20260709 12:23:45.339452 22670 raft_consensus.cc:2804] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:45.355371 18525 rpcz_store.cc:276] 0709 12:23:43.659878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.006156 (+346278us) service_pool.cc:224] Handling call
0709 12:23:44.092086 (+ 85930us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:44.380757 (+288671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.323416 (+942659us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54002c6854. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:45.323671 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620591872}
I20260709 12:23:45.385888 18524 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 11.
I20260709 12:23:45.412191 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:45.412057 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:45.411871 18424 catalog_manager.cc:5697] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 8 to 9, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 9 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:45.413444 19242 raft_consensus.cc:2393] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 9: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
W20260709 12:23:45.360059 18597 rpcz_store.cc:269] 0709 12:23:43.451303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.521411 (+ 70108us) service_pool.cc:224] Handling call
0709 12:23:45.340087 (+1818676us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b5400310954. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:45.340306 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2286251264}
I20260709 12:23:45.416039 18601 raft_consensus.cc:1240] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:45.416967 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:45.418906 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:45.421744 18679 raft_consensus.cc:1275] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:23:45.422523 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2447) took 1624 ms. Trace:
I20260709 12:23:45.422855 18679 rpcz_store.cc:276] 0709 12:23:43.798157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.421038 (+1622881us) service_pool.cc:224] Handling call
0709 12:23:45.421441 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.422174 (+   733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.422386 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:45.423352 22959 log.cc:927] Time spent T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:23:45.423961 22912 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:45.426206 22912 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:45.426890 18677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2444) took 1742 ms. Trace:
W20260709 12:23:45.429113 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 82001.1us
I20260709 12:23:45.430501 22904 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:45.431119 19212 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:45.441231 18522 raft_consensus.cc:1240] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:45.432003 22875 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:45.432485 18527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 2144) took 1619 ms. Trace:
I20260709 12:23:45.443857 18527 rpcz_store.cc:276] 0709 12:23:43.812977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.341810 (+528833us) service_pool.cc:224] Handling call
0709 12:23:44.342181 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:44.381031 (+ 38850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:44.381072 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:44.397799 (+ 16727us) log.cc:844] Serialized 26 byte log entry
0709 12:23:44.936717 (+538918us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:44.936886 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.937100 (+   214us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:45.431866 (+494766us) raft_consensus.cc:1685] finished
0709 12:23:45.432012 (+   146us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.432279 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38499,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":21170,"thread_start_us":478578,"threads_started":1,"wal-append.queue_time_us":840360}
I20260709 12:23:45.432719 22952 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:45.434334 18678 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:23:45.434266 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 304262us
I20260709 12:23:45.380445 22694 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:45.435626 18521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2124) took 2636 ms (client timeout 2102 ms). Trace:
I20260709 12:23:45.395248 22670 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:45.443347 22373 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:45.414345 18424 catalog_manager.cc:5697] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 11 to 12, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 12 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:45.436554 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 116261us
I20260709 12:23:45.439963 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:45.416916 18601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 2023) took 1462 ms. Trace:
I20260709 12:23:45.453383 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 2016) took 1769 ms. Trace:
I20260709 12:23:45.474042 18601 rpcz_store.cc:276] 0709 12:23:43.954907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.303260 (+1348353us) service_pool.cc:224] Handling call
0709 12:23:45.378561 (+ 75301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.416551 (+ 37990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.416818 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.474335 18678 rpcz_store.cc:276] 0709 12:23:43.684108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.378512 (+1694404us) service_pool.cc:224] Handling call
0709 12:23:45.420192 (+ 41680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.453111 (+ 32919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.453322 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.440478 18679 raft_consensus.cc:1275] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:45.354744 22865 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:45.461490 18600 raft_consensus.cc:1240] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10. Ops: []
W20260709 12:23:45.432550 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 110936us
I20260709 12:23:45.462584 18671 raft_consensus.cc:1240] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:45.451313 18604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 2235) took 1841 ms. Trace:
I20260709 12:23:45.457257 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:45.480348 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2454) took 1641 ms. Trace:
I20260709 12:23:45.427412 18677 rpcz_store.cc:276] 0709 12:23:43.684899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.377539 (+1692640us) service_pool.cc:224] Handling call
0709 12:23:45.426133 (+ 48594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.426437 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.426474 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.426551 (+    77us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:45.426615 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.426685 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.426820 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.480744 18679 rpcz_store.cc:276] 0709 12:23:43.834760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.423677 (+1588917us) service_pool.cc:224] Handling call
0709 12:23:45.440147 (+ 16470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.475710 (+ 35563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.476015 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.448949 18602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 2022) took 1498 ms. Trace:
W20260709 12:23:45.456106 18521 rpcz_store.cc:269] 0709 12:23:42.798978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.799106 (+   128us) service_pool.cc:224] Handling call
0709 12:23:45.435253 (+2636147us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b54002c7c54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:45.435444 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2178710400}
I20260709 12:23:45.479840 18604 rpcz_store.cc:276] 0709 12:23:43.609467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.176442 (+1566975us) service_pool.cc:224] Handling call
0709 12:23:45.200356 (+ 23914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.449721 (+249365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.449751 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.449806 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:45.449833 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.451064 (+  1231us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b54002b98d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:45.451108 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.451238 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":572939520}
I20260709 12:23:45.488304 18671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2446) took 1694 ms. Trace:
I20260709 12:23:45.488868 18671 rpcz_store.cc:276] 0709 12:23:43.794080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.378957 (+1584877us) service_pool.cc:224] Handling call
0709 12:23:45.462190 (+ 83233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.487924 (+ 25734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.488215 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:45.447715 22839 consensus_meta.cc:287] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.962s	user 0.008s	sys 0.010s
I20260709 12:23:45.455931 22738 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:45.451763 22807 raft_consensus.cc:2804] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:45.460285 22670 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:45.462920 22373 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:45.461671 18526 consensus_meta.cc:287] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.774s	user 0.004s	sys 0.016s
I20260709 12:23:45.508010 18598 raft_consensus.cc:2468] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:45.482336 18602 rpcz_store.cc:276] 0709 12:23:43.950630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.270388 (+1319758us) service_pool.cc:224] Handling call
0709 12:23:45.448112 (+177724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.448594 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.448624 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.448685 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:45.448716 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.448770 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.448867 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11430,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":112}
I20260709 12:23:45.492681 18603 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:23:45.457819 22694 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:45.449682 22887 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:45.468698 22650 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:45.512617 18597 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:23:45.449496 22952 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:45.518463 18646 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:45.454753 22756 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:45.510262 22807 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:45.542521 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:45.546610 18598 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
I20260709 12:23:45.519279 18424 catalog_manager.cc:5697] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:45.552368 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 571) took 1917 ms. Trace:
I20260709 12:23:45.563443 18678 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:45.536728 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:45.552987 18680 rpcz_store.cc:276] 0709 12:23:43.627567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.275929 (+1648362us) service_pool.cc:224] Handling call
0709 12:23:45.474693 (+198764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.531532 (+ 56839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.531576 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.531636 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:45.544176 (+ 12540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.544286 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.544479 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.575357 18526 raft_consensus.cc:1275] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:23:45.569398 18570 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:45.549182 22807 raft_consensus.cc:3060] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:45.575934 18526 pending_rounds.cc:85] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 9
I20260709 12:23:45.581171 18526 pending_rounds.cc:107] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:23:45.588456 18526 raft_consensus.cc:2889] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:45.584060 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:45.589478 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 124129us
I20260709 12:23:45.594583 18599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39798 (request call id 535) took 2067 ms. Trace:
I20260709 12:23:45.595881 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:45.563230 22738 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:45.598062 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 78215us
I20260709 12:23:45.600595 18598 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
W20260709 12:23:45.601264 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:45.585227 18424 catalog_manager.cc:5697] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 8 to 10, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 10 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:45.604346 18671 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:45.591130 22904 raft_consensus.cc:697] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:45.599596 22694 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:45.612311 18679 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:45.614240 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:45.596346 22880 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:45.599587 22774 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:45.621719 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:45.616707 18424 catalog_manager.cc:5697] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:45.595029 18599 rpcz_store.cc:276] 0709 12:23:43.527461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.345200 (+817739us) service_pool.cc:224] Handling call
0709 12:23:44.345554 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:44.345803 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:45.132654 (+786851us) log.cc:844] Serialized 14 byte log entry
0709 12:23:45.536791 (+404137us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.549905 (+ 13114us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:45.569515 (+ 19610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.582949 (+ 13434us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.594512 (+ 11563us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":897194,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":73141,"raft.queue_time_us":18429,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":30169,"thread_start_us":1075222,"threads_started":2,"wal-append.queue_time_us":462583}
I20260709 12:23:45.609195 22948 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:45.605690 22361 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:45.628518 18605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 2231) took 2045 ms. Trace:
I20260709 12:23:45.630677 22823 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:23:45.635349 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 126045us
I20260709 12:23:45.606281 22840 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:45.645457 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 153710us
I20260709 12:23:45.647239 19246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 605) took 1550 ms. Trace:
I20260709 12:23:45.651511 18572 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:45.661105 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 108127us
W20260709 12:23:45.661226 22834 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:23:45.673017 18494 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:45.674855 22694 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:45.674968 18494 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:45.675443 22694 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:45.676302 22881 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:45.676941 18646 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:45.677129 22871 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:45.679965 18494 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:45.626617 22650 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:45.662171 18424 catalog_manager.cc:5697] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 7 to 9, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 9 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:45.689128 18526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 865) took 3508 ms. Trace:
I20260709 12:23:45.699960 18526 rpcz_store.cc:276] 0709 12:23:42.156969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.158371 (+  1402us) service_pool.cc:224] Handling call
0709 12:23:42.158774 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:44.477843 (+2319069us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400203da0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c456dc0 00007efc7c4e11c0 00007efc7c4e2231 00007efc7c4ded8f 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c
0709 12:23:45.628616 (+1150773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.665138 (+ 36522us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296859392}
I20260709 12:23:45.695645 18598 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:23:45.652661 19246 rpcz_store.cc:276] 0709 12:23:44.096520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.097522 (+  1002us) service_pool.cc:224] Handling call
0709 12:23:44.097851 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:44.098054 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:45.250733 (+1152679us) log.cc:844] Serialized 14 byte log entry
0709 12:23:45.603032 (+352299us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.613232 (+ 10200us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:45.627509 (+ 14277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.627719 (+   210us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.647175 (+ 19456us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12820,"prepare.queue_time_us":802857,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":8495,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":12613,"spinlock_wait_cycles":3328,"thread_start_us":1310150,"threads_started":2,"wal-append.queue_time_us":306293}
W20260709 12:23:45.708245 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 99614.7us
I20260709 12:23:45.697378 18424 catalog_manager.cc:5697] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 12 to 14, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 14 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:45.714313 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 177968us
I20260709 12:23:45.712796 18606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 2020) took 1776 ms. Trace:
I20260709 12:23:45.689860 22694 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:45.696563 22650 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:45.688519 22871 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:45.656117 22880 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:45.731997 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 50241.9us
I20260709 12:23:45.653767 22840 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:45.736955 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 60234.1us
I20260709 12:23:45.711659 22756 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:45.736260 18424 catalog_manager.cc:5697] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 12 to 13, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 13 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:45.728367 22650 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:45.741919 18598 raft_consensus.cc:1240] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:45.730829 22871 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:45.661816 22948 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:45.718530 22774 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:45.653534 22904 consensus_queue.cc:237] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:45.749408 18529 raft_consensus.cc:1275] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:23:45.738256 22881 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:23:45.749822 19275 heartbeater.cc:646] Failed to heartbeat to 127.16.240.190:43515 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.16.240.190:43515 timed out after 15.000s (SENT)
I20260709 12:23:45.750677 22879 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:23:45.752815 22976 log.cc:927] Time spent T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
W20260709 12:23:45.753564 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:45.749583 22880 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:45.755049 18671 raft_consensus.cc:1275] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:23:45.754451 18529 pending_rounds.cc:85] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 5
I20260709 12:23:45.759213 18529 pending_rounds.cc:107] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:23:45.759240 18671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 2022) took 1750 ms. Trace:
I20260709 12:23:45.746364 19212 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:45.759943 18529 raft_consensus.cc:2889] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:45.757578 22738 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:45.760077 18671 rpcz_store.cc:276] 0709 12:23:44.008516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.509409 (+1500893us) service_pool.cc:224] Handling call
0709 12:23:45.576400 (+ 66991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.758814 (+182414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.759161 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:45.777055 22967 log.cc:927] Time spent T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:23:45.788740 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:45.756703 22881 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:45.790974 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:45.785008 22971 log.cc:927] Time spent T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:23:45.801062 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 2135) took 2047 ms. Trace:
I20260709 12:23:45.801527 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2455) took 1935 ms. Trace:
I20260709 12:23:45.802917 18678 rpcz_store.cc:276] 0709 12:23:43.866271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.475322 (+1609051us) service_pool.cc:224] Handling call
0709 12:23:45.492905 (+ 17583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.567185 (+ 74280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.801262 (+234077us) spinlock_profiling.cc:243] Waited 70.3 ms on lock 0x7b54003a0f54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:45.801460 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161713408}
I20260709 12:23:45.758796 18424 catalog_manager.cc:5697] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index -1 to 5, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 7 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
I20260709 12:23:45.808324 22738 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:45.809034 22738 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:45.817111 22911 consensus_queue.cc:1059] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:23:45.818244 22911 raft_consensus.cc:3055] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:45.818634 22911 raft_consensus.cc:740] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:45.819352 22977 raft_consensus.cc:2804] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:45.791376 22524 consensus_queue.cc:1059] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:23:45.819996 22840 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:45.820271 22774 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:45.795192 22881 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:45.827206 18675 raft_consensus.cc:1240] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:45.844079 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 123031us
I20260709 12:23:45.805694 18572 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:45.837158 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:45.841109 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:45.842324 22524 raft_consensus.cc:3055] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:45.843312 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:45.842085 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 578) took 1115 ms. Trace:
I20260709 12:23:45.848796 18604 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:23:45.843199 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 2009) took 2227 ms. Trace:
I20260709 12:23:45.853834 18674 rpcz_store.cc:276] 0709 12:23:44.726405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.840988 (+1114583us) service_pool.cc:224] Handling call
0709 12:23:45.841405 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.841641 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.841687 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.841763 (+    76us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:45.841830 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.841890 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.842027 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.801482 18523 rpcz_store.cc:276] 0709 12:23:43.736808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.017724 (+280916us) service_pool.cc:224] Handling call
0709 12:23:44.018087 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:44.019574 (+  1487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:44.019622 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:44.020378 (+   756us) log.cc:844] Serialized 26 byte log entry
0709 12:23:45.438784 (+1418406us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b18003714a0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793d4e07 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793f1c02 00007efc7c07920b 00007efc7c07ed23 00007efc7c07f0d1 00007efc7c49aa0f
0709 12:23:45.617093 (+178309us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:45.714722 (+ 97629us) log.cc:844] Serialized 14 byte log entry
0709 12:23:45.740164 (+ 25442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.746680 (+  6516us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:45.783458 (+ 36778us) raft_consensus.cc:1685] finished
0709 12:23:45.783602 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.783821 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6825,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":67698,"spinlock_wait_cycles":468594048,"thread_start_us":210287,"threads_started":2,"wal-append.queue_time_us":1704074}
I20260709 12:23:45.855702 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:45.845690 22866 consensus_meta.cc:287] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.617s	user 0.014s	sys 0.000s
I20260709 12:23:45.863325 18675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 2024) took 1168 ms. Trace:
I20260709 12:23:45.867484 18675 rpcz_store.cc:276] 0709 12:23:44.689103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.826439 (+1137336us) service_pool.cc:224] Handling call
0709 12:23:45.826862 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.857070 (+ 30208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.857282 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.863998 18678 raft_consensus.cc:1240] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:23:45.868269 18644 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:45.868753 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 73727.3us
I20260709 12:23:45.871661 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 577) took 1194 ms. Trace:
I20260709 12:23:45.872090 18678 rpcz_store.cc:276] 0709 12:23:44.677334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.804244 (+1126910us) service_pool.cc:224] Handling call
0709 12:23:45.857465 (+ 53221us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:45.871342 (+ 13877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.871599 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.866508 18424 catalog_manager.cc:5697] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 6 to 8, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 8 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:45.873205 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 146137us
I20260709 12:23:45.854993 18676 rpcz_store.cc:276] 0709 12:23:43.615660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.274178 (+1658518us) service_pool.cc:224] Handling call
0709 12:23:45.352534 (+ 78356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:45.570059 (+217525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.570108 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:45.590361 (+ 20253us) log.cc:844] Serialized 26 byte log entry
0709 12:23:45.730868 (+140507us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:45.730911 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.730983 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:45.842962 (+111979us) raft_consensus.cc:1685] finished
0709 12:23:45.842981 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.843121 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":188024,"raft.queue_time_us":217037,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":9861,"thread_start_us":111549,"threads_started":1,"wal-append.queue_time_us":225434}
I20260709 12:23:45.877151 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 2020) took 1957 ms. Trace:
I20260709 12:23:45.877941 18679 rpcz_store.cc:276] 0709 12:23:43.920088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.507859 (+1587771us) service_pool.cc:224] Handling call
0709 12:23:45.580050 (+ 72191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.876759 (+296709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.876794 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.876847 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:45.876884 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.876961 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.877093 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12847}
I20260709 12:23:45.879505 18671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 576) took 1219 ms. Trace:
I20260709 12:23:45.879981 18671 rpcz_store.cc:276] 0709 12:23:44.677001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.768766 (+1091765us) service_pool.cc:224] Handling call
0709 12:23:45.805676 (+ 36910us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.871021 (+ 65345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.871064 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.879229 (+  8165us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:45.879271 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.879335 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.879451 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:45.883739 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:45.885133 18601 raft_consensus.cc:2393] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 12: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:45.886639 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:45.883782 18675 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:23:45.854404 22524 raft_consensus.cc:740] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:45.799729 22879 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:45.857414 22977 raft_consensus.cc:697] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:45.907250 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:45.874187 22875 raft_consensus.cc:2804] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:45.903605 18424 catalog_manager.cc:5697] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:45.905985 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:45.882541 22866 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:45.892823 22774 raft_consensus.cc:2749] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:45.926100 18604 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:45.925333 18424 catalog_manager.cc:5697] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 8 to 10, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 10 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:45.913966 22875 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:45.941175 18424 catalog_manager.cc:5697] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 12 to 14, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 14 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:45.880717 22981 consensus_queue.cc:1059] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
W20260709 12:23:45.961474 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 117075us
I20260709 12:23:45.965051 18601 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:45.965190 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:45.966094 19244 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
I20260709 12:23:45.974026 18572 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:45.947911 22875 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:45.947254 22810 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:45.989550 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 2023) took 1745 ms. Trace:
I20260709 12:23:45.987496 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:45.990022 18680 rpcz_store.cc:276] 0709 12:23:44.244730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.574584 (+1329854us) service_pool.cc:224] Handling call
0709 12:23:45.591472 (+ 16888us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.688233 (+ 96761us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:45.852883 (+164650us) log.cc:844] Serialized 14 byte log entry
0709 12:23:45.989173 (+136290us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.989228 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:45.989269 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.989340 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.989488 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":205821,"threads_started":2}
I20260709 12:23:45.984414 18424 catalog_manager.cc:5697] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 8 to 10, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 10 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:45.996693 18494 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:46.002463 18644 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:46.003706 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 58644.8us
I20260709 12:23:45.973644 22738 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:45.917932 22911 consensus_queue.cc:260] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.008517 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:46.024230 22670 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.025131 18572 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:46.026695 22670 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:45.715209 18606 rpcz_store.cc:276] 0709 12:23:43.936480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.254705 (+1318225us) service_pool.cc:224] Handling call
0709 12:23:45.255171 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.255483 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:45.527285 (+271802us) log.cc:844] Serialized 14 byte log entry
0709 12:23:45.707865 (+180580us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.708017 (+   152us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:45.712355 (+  4338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.712523 (+   168us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.712716 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":188556,"prepare.run_cpu_time_us":140,"prepare.run_wall_time_us":140,"raft.queue_time_us":20272,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6888,"thread_start_us":378141,"threads_started":2}
I20260709 12:23:46.027976 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:46.028637 18606 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
W20260709 12:23:46.031299 22968 log.cc:927] Time spent T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.370s	user 0.002s	sys 0.001s
I20260709 12:23:46.027585 22866 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:46.032487 22818 consensus_queue.cc:1048] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:46.033754 18606 raft_consensus.cc:1240] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:46.034658 22881 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.037027 18644 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:46.043844 22972 log.cc:927] Time spent T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.189s	user 0.000s	sys 0.002s
I20260709 12:23:46.045857 22912 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:46.046432 22912 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.046833 22912 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:46.048804 18601 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:46.055084 22810 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:46.057845 22948 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:46.060065 22940 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:46.064718 22977 consensus_queue.cc:237] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:46.021251 18677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2456) took 2137 ms. Trace:
I20260709 12:23:46.071739 18597 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:46.021751 18424 catalog_manager.cc:5697] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 9 to 11, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 11 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:46.067222 18677 rpcz_store.cc:276] 0709 12:23:43.884332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.481215 (+1596883us) service_pool.cc:224] Handling call
0709 12:23:45.528888 (+ 47673us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.617623 (+ 88735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.617664 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.617742 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:45.617779 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:46.021004 (+403225us) spinlock_profiling.cc:243] Waited 83.5 ms on lock 0x7b540039f654. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:46.021052 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:46.021180 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192085760}
I20260709 12:23:46.078456 22670 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:23:46.081919 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 45010.6us
I20260709 12:23:46.082206 22670 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.082813 22670 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:46.083334 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 132206us
I20260709 12:23:45.982527 22524 consensus_queue.cc:260] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:46.087993 22886 consensus_queue.cc:1059] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:46.082864 18644 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:46.075338 18424 catalog_manager.cc:5697] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 8 to 9, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 9 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:46.058115 22810 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:45.629619 18605 rpcz_store.cc:276] 0709 12:23:43.583261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.171923 (+1588662us) service_pool.cc:224] Handling call
0709 12:23:45.215926 (+ 44003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.232304 (+ 16378us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:23:45.530271 (+297967us) log.cc:844] Serialized 14 byte log entry
0709 12:23:45.627913 (+ 97642us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.627968 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:45.628027 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.628107 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.628452 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13466,"prepare.queue_time_us":211387,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":56,"raft.queue_time_us":169,"thread_start_us":311162,"threads_started":2}
I20260709 12:23:46.118592 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:46.097640 18424 catalog_manager.cc:5697] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:46.131938 18598 raft_consensus.cc:2393] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 10: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:46.119493 18644 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:46.118943 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:46.212798 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:46.155689 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:46.213892 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.156093 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:46.181403 18600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 2246) took 1608 ms. Trace:
W20260709 12:23:46.210273 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:46.201040 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.216159 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:46.188380 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:46.197589 18672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40800 (request call id 2026) took 1244 ms. Trace:
I20260709 12:23:46.190937 18604 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
W20260709 12:23:46.199590 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 157871us
W20260709 12:23:46.197099 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 48612.1us
I20260709 12:23:46.122442 22919 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:46.223235 18672 rpcz_store.cc:276] 0709 12:23:44.953282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.077497 (+124215us) service_pool.cc:224] Handling call
0709 12:23:46.197407 (+1119910us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b54001f2a54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:46.197528 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74161024}
W20260709 12:23:46.115638 18530 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57384 (request call id 2780) took 2455 ms (client timeout 2226 ms). Trace:
I20260709 12:23:46.181406 22952 raft_consensus.cc:3055] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:46.273545 18524 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:46.181710 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:46.168895 22951 log.cc:927] Time spent T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 1.330s	user 0.003s	sys 0.001s
I20260709 12:23:46.175122 22881 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:46.103246 22864 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.147894 22524 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:46.190814 18529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2779) took 2531 ms. Trace:
I20260709 12:23:46.216209 18600 rpcz_store.cc:276] 0709 12:23:44.572665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.335667 (+763002us) service_pool.cc:224] Handling call
0709 12:23:45.345414 (+  9747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.480099 (+134685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:46.171501 (+691402us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b540015bb54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:46.181323 (+  9822us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266510080}
W20260709 12:23:46.226207 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 116905us
I20260709 12:23:46.120967 19240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33388 (request call id 571) took 2352 ms. Trace:
I20260709 12:23:46.191355 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:46.260735 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:46.199843 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:46.301959 18570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.301164 18526 raft_consensus.cc:2393] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 7: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:46.216338 18424 catalog_manager.cc:5697] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 7 to 8, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 8 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:46.173794 22823 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:46.156392 22659 consensus_queue.cc:1059] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.121s
I20260709 12:23:46.109164 22866 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:46.263146 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:46.146616 22911 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:46.266826 18530 rpcz_store.cc:269] 0709 12:23:43.659600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.928976 (+269376us) service_pool.cc:224] Handling call
0709 12:23:46.115189 (+2186213us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b5400374bd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:46.115418 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":884014336}
I20260709 12:23:46.155491 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:46.181646 18494 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:46.192395 22738 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:46.181278 22840 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 12:23:46.281265 22810 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.184880 22872 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:46.282567 22774 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:46.306602 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:46.304287 18529 rpcz_store.cc:276] 0709 12:23:43.659362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.004686 (+345324us) service_pool.cc:224] Handling call
0709 12:23:44.004992 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.801350 (+1796358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:46.189072 (+387722us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b5400336b54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:46.190731 (+  1659us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4004039424}
I20260709 12:23:46.263379 22886 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.118167 22871 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.099179 22650 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:46.151257 22807 consensus_meta.cc:287] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.552s	user 0.013s	sys 0.000s
I20260709 12:23:46.309432 18679 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
I20260709 12:23:46.119308 22728 consensus_queue.cc:1059] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.180s
I20260709 12:23:46.303025 19240 rpcz_store.cc:276] 0709 12:23:43.768592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.775298 (+  6706us) service_pool.cc:224] Handling call
0709 12:23:43.778150 (+  2852us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:43.780417 (+  2267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:43.780469 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:43.781346 (+   877us) log.cc:844] Serialized 26 byte log entry
0709 12:23:46.120235 (+2338889us) spinlock_profiling.cc:243] Waited 73.7 ms on lock 0x7b54006a20a0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c449090 00007efc7c4566b8 00007efc7c4df92b 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c
0709 12:23:46.120354 (+   119us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:46.120422 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:46.120544 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:46.120600 (+    56us) raft_consensus.cc:1685] finished
0709 12:23:46.120619 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:46.120876 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1255,"raft.queue_time_us":2565,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":5986,"spinlock_wait_cycles":169560320,"thread_start_us":1273357,"threads_started":1,"wal-append.queue_time_us":1398318}
I20260709 12:23:46.313155 18522 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:46.185073 22834 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 12:23:46.189052 22940 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:46.201089 22875 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.313198 19242 pending_rounds.cc:85] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4: Aborting all ops after (but not including) 8
I20260709 12:23:46.356096 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:46.360481 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:46.360944 18530 raft_consensus.cc:1240] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:46.361140 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:46.361784 18676 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 15.
I20260709 12:23:46.363346 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:46.364161 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:46.357774 19242 pending_rounds.cc:107] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:23:46.365247 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:46.365664 19242 raft_consensus.cc:2889] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:46.359140 22875 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:46.355713 18522 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
W20260709 12:23:46.368577 19210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.323163 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:46.250227 18523 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:46.273713 22952 raft_consensus.cc:740] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:46.173501 22694 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:46.310705 22823 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:46.326380 18644 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:46.263717 22670 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.335862 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:46.331615 18525 raft_consensus.cc:2468] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 5.
I20260709 12:23:46.346340 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:46.313647 22866 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.340250 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:46.339942 22886 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.349104 18570 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:46.331394 22864 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:46.383942 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.353149 22871 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:46.353555 22807 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:46.396281 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:46.397183 18675 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 14.
I20260709 12:23:46.343034 22912 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:46.402894 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.402716 22952 consensus_queue.cc:260] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:46.342172 22810 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.404305 22952 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:46.405499 22810 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:46.406602 22361 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:46.407034 22361 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:46.407423 22361 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:46.410585 22694 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:46.338243 22738 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.412875 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:46.414206 22738 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:46.372229 18526 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:46.336508 22774 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.376782 18678 raft_consensus.cc:2393] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 9: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:46.376241 18679 raft_consensus.cc:2393] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 8: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:46.382450 22919 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:46.380985 22866 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:46.389987 18524 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
W20260709 12:23:46.390733 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 209206us
I20260709 12:23:46.396008 22865 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:46.420156 19244 raft_consensus.cc:2393] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 7: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:46.433188 18523 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:46.388094 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:46.388345 22659 raft_consensus.cc:3060] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:46.432677 22865 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:46.423354 22823 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:46.444621 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:46.445398 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:46.446554 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 97534.5us
W20260709 12:23:46.448036 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 121785us
I20260709 12:23:46.448654 22886 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:46.449143 22912 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:46.421847 22774 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:46.449707 22670 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:46.453122 22815 consensus_queue.cc:1048] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:46.398092 22807 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:46.469107 18672 raft_consensus.cc:2393] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 9: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:46.470288 18526 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:46.429996 22919 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:46.472113 22865 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:46.480486 18570 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:46.489449 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:46.490621 22886 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:46.491423 18570 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:46.433137 22904 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:23:46.509431 22650 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:46.509831 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:46.496085 22738 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:23:46.511437 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:46.513765 18494 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:46.496637 18675 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:46.497896 18644 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:46.521214 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:46.522207 18678 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:46.514180 22864 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:46.548099 18494 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:46.491488 22886 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:46.566630 22840 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:46.567377 22728 consensus_queue.cc:1059] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:46.568452 22728 raft_consensus.cc:3055] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:46.568821 22728 raft_consensus.cc:740] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:46.569787 22728 consensus_queue.cc:260] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.571046 22728 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:46.534857 22373 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:46.540979 22738 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:46.572500 22738 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:46.572644 18644 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:46.572937 22738 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:46.545212 22871 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:46.574414 22871 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.574513 22911 raft_consensus.cc:2804] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:46.574824 22871 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:46.575081 22911 raft_consensus.cc:697] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:23:46.562044 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 70822.9us
I20260709 12:23:46.577008 18570 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:46.578490 18570 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:46.553511 22361 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.562047 22865 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.566118 18494 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:46.572093 18526 raft_consensus.cc:1275] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:23:46.580354 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 272140us
I20260709 12:23:46.581701 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:46.585777 22864 consensus_queue.cc:1059] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:46.580698 22875 raft_consensus.cc:2749] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:46.589325 22881 raft_consensus.cc:3055] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:46.589849 22881 raft_consensus.cc:740] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:46.590814 22881 consensus_queue.cc:260] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.593295 22879 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:46.596935 22361 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:46.598469 22774 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.600512 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:46.583297 22373 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:23:46.607499 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.567626 22840 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:46.605660 22940 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:46.604777 22865 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:46.609185 22373 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.612412 22840 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:46.615242 22879 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:46.587697 22650 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:23:46.623479 22940 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.612540 22807 consensus_queue.cc:1048] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:23:46.626961 22373 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:46.637508 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 63598.9us
I20260709 12:23:46.626959 22881 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:46.629846 22879 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.617552 22361 consensus_queue.cc:1048] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:23:46.616829 22911 consensus_queue.cc:237] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.655531 22818 raft_consensus.cc:3055] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:46.634678 22875 consensus_queue.cc:1048] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:23:46.655140 23004 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.659147 18494 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:46.635322 22940 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:46.638979 22865 raft_consensus.cc:3055] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:46.685786 22865 raft_consensus.cc:740] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:46.655215 22897 raft_consensus.cc:3055] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:46.661230 18673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 2010) took 3044 ms. Trace:
I20260709 12:23:46.644767 22879 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:46.676975 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 2028) took 1722 ms. Trace:
I20260709 12:23:46.684381 22746 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:46.669791 22373 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:46.695222 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 58347.7us
I20260709 12:23:46.698119 23004 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:46.699002 22894 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:46.699582 22894 raft_consensus.cc:697] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:46.663353 22818 raft_consensus.cc:740] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
W20260709 12:23:46.701064 22999 log.cc:927] Time spent T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.212s	user 0.003s	sys 0.000s
I20260709 12:23:46.701206 23004 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:46.677052 18644 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:46.713135 18529 raft_consensus.cc:1275] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:46.714126 22373 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:46.715009 22877 consensus_queue.cc:1048] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:46.716145 22840 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:46.718362 22840 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:46.691789 18673 rpcz_store.cc:276] 0709 12:23:43.617084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.217825 (+2600741us) service_pool.cc:224] Handling call
0709 12:23:46.307358 (+ 89533us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:46.327387 (+ 20029us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:46.327435 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:46.336145 (+  8710us) log.cc:844] Serialized 26 byte log entry
0709 12:23:46.531367 (+195222us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:46.531428 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:46.531531 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:46.654276 (+122745us) raft_consensus.cc:1685] finished
0709 12:23:46.654296 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:46.661161 (+  6865us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":130,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":7368,"thread_start_us":124889,"threads_started":1,"wal-append.queue_time_us":204815}
I20260709 12:23:46.687129 22865 consensus_queue.cc:260] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.739435 22865 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:46.690864 22897 raft_consensus.cc:740] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:46.724164 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:46.726308 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 49315.3us
I20260709 12:23:46.695209 18674 rpcz_store.cc:276] 0709 12:23:44.954280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.864455 (+910175us) service_pool.cc:224] Handling call
0709 12:23:45.883191 (+ 18736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.883671 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:45.961146 (+ 77475us) log.cc:844] Serialized 14 byte log entry
0709 12:23:46.424321 (+463175us) log.cc:844] Serialized 14 byte log entry
0709 12:23:46.657707 (+233386us) spinlock_profiling.cc:243] Waited 8.37 ms on lock 0x7b18004044a0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793d4e07 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793ef455 00007efc7c4d7060 00007efc7c4e9716 00007efc7c4fa287 00007efc7c4fa208
0709 12:23:46.676622 (+ 18915us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:46.676681 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:46.676724 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:46.676797 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:46.676913 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":225007,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":80,"raft.queue_time_us":81921,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":18844,"spinlock_wait_cycles":19248384,"thread_start_us":431795,"threads_started":3,"wal-append.queue_time_us":486987}
I20260709 12:23:46.723362 22774 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:46.733355 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:46.734043 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:46.750710 18528 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:46.734534 22872 consensus_queue.cc:1059] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:23:46.736241 22818 consensus_queue.cc:260] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:46.701177 22894 consensus_queue.cc:237] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.756072 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:23:46.738472 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 126415us
I20260709 12:23:46.760082 18524 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:46.756621 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:46.762465 18644 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:46.765213 22373 raft_consensus.cc:3055] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:46.750942 23004 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:23:46.754930 22996 log.cc:927] Time spent T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.367s	user 0.004s	sys 0.001s
I20260709 12:23:46.767608 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:46.770310 18523 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:46.739542 22871 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.773167 22871 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:46.781940 18570 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:46.784262 22694 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:46.787076 18572 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:46.787490 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.788865 22650 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:46.789587 22650 raft_consensus.cc:697] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:46.790724 22650 consensus_queue.cc:237] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.791989 18600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:46.792941 18600 raft_consensus.cc:606] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:46.793356 18600 raft_consensus.cc:614] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:46.794800 18644 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:23:46.796659 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.798959 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:46.761370 22659 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:23:46.800506 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 90956.6us
I20260709 12:23:46.744246 22919 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:46.768733 23004 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.765704 22373 raft_consensus.cc:740] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:46.824120 18522 raft_consensus.cc:3060] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:46.833071 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 46888us
I20260709 12:23:46.833863 18570 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:46.834549 22373 consensus_queue.cc:260] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.835907 23005 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:46.837208 23000 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:46.837637 23000 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.837661 22865 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:46.838584 22865 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:46.840791 22872 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:46.840862 22865 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:46.841348 22872 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.841735 22872 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:46.843859 23010 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:46.835924 22373 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:46.843869 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.838019 23000 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:46.840440 22897 consensus_queue.cc:260] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.848057 18570 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:46.848963 18522 raft_consensus.cc:2468] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
W20260709 12:23:46.855314 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 60620.1us
I20260709 12:23:46.843181 22940 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.831113 23004 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:46.832000 22818 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:46.864866 18644 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:46.871774 18524 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:46.866626 18572 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:46.880558 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 44867.3us
I20260709 12:23:46.846642 22866 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.844398 23010 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:46.909364 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.003019 18523 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
W20260709 12:23:46.929675 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 48102.2us
I20260709 12:23:46.992784 18572 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:46.994817 22912 raft_consensus.cc:2804] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:46.919116 23014 consensus_queue.cc:1059] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:23:46.863924 22897 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:46.877882 22875 consensus_queue.cc:1059] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:23:46.883487 22670 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:46.907867 22911 raft_consensus.cc:2804] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:47.005057 18570 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:47.008159 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.008327 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:46.858155 22361 consensus_queue.cc:1048] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.138s
I20260709 12:23:47.010454 18572 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:47.001649 22524 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:47.017902 18678 raft_consensus.cc:2368] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8.
I20260709 12:23:47.016222 18525 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:46.999008 23005 raft_consensus.cc:697] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:47.018559 18528 raft_consensus.cc:2468] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:47.023609 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:47.022753 18528 raft_consensus.cc:1240] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:47.052012 22919 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:47.053056 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.055948 22874 raft_consensus.cc:3055] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:47.056865 22670 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:47.088784 22670 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.089232 22670 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:47.089162 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:47.090191 19244 raft_consensus.cc:2393] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 9: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:47.056892 22524 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:47.057627 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 47299.6us
I20260709 12:23:47.091441 18572 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:47.092363 18572 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:47.092540 22524 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:47.093245 22524 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:47.093477 18572 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:47.058305 22875 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:47.058775 22694 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:23:47.095813 19209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.095650 22694 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:47.098433 22694 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:47.061745 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.062664 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:47.058146 22866 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:47.063568 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:47.067174 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:47.067667 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:47.068696 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:47.068327 23005 consensus_queue.cc:237] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:47.102840 22361 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:47.103300 22361 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.103638 22361 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:47.104173 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:47.104324 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:47.105003 18605 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:47.020865 22911 raft_consensus.cc:697] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:47.105901 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:47.106128 22911 consensus_queue.cc:237] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:47.106631 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:47.068370 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:47.099133 22694 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:47.107462 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:47.024343 18671 raft_consensus.cc:2468] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:23:47.107643 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:47.108882 18673 raft_consensus.cc:3060] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:47.109349 18602 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:47.109872 18677 raft_consensus.cc:1240] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:47.013916 22912 raft_consensus.cc:697] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:47.084424 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:47.115502 18598 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:47.118297 18604 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:47.010424 22807 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:47.093644 22524 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.064226 22815 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:23:47.086513 23012 log.cc:927] Time spent T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638: Append to log took a long time: real 0.091s	user 0.000s	sys 0.002s
I20260709 12:23:47.013621 22886 raft_consensus.cc:2804] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:47.106742 18605 raft_consensus.cc:2393] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 8: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:47.108655 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:47.072072 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:47.077132 22712 consensus_queue.cc:1059] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:47.113636 18599 raft_consensus.cc:2393] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 8: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:47.114976 18601 raft_consensus.cc:2410] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:23:47.115302 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.105955 18679 raft_consensus.cc:1275] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:47.108173 22694 raft_consensus.cc:697] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:47.087908 18644 connection.cc:256] RPC call timeout handler was delayed by -1.2486822040000334s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
I20260709 12:23:47.136207 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.154520 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.023339 22774 consensus_queue.cc:1059] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
W20260709 12:23:47.156863 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.100337 22874 raft_consensus.cc:740] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:47.162876 18523 raft_consensus.cc:2393] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 12: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
W20260709 12:23:47.168087 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.125633 22524 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:47.123631 22746 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:47.139215 22886 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.173327 22855 raft_consensus.cc:3055] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:23:47.178978 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.180397 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.098454 22670 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:47.184345 18528 raft_consensus.cc:2368] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 10. Current term is 11.
W20260709 12:23:47.186288 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 91910.3us
I20260709 12:23:47.122756 22879 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:47.191443 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 186521us
I20260709 12:23:47.133654 22807 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:47.125130 22815 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:47.287676 22991 consensus_queue.cc:1059] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:23:47.294198 22991 raft_consensus.cc:3055] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:47.294612 22991 raft_consensus.cc:740] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
W20260709 12:23:47.274751 22738 consensus_meta.cc:287] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.701s	user 0.013s	sys 0.000s
I20260709 12:23:47.296381 22738 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:47.297544 22834 raft_consensus.cc:3055] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:47.297981 22834 raft_consensus.cc:740] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:47.298849 22834 consensus_queue.cc:260] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:47.275149 23010 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:23:47.263645 22694 consensus_queue.cc:237] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:47.259989 22912 consensus_queue.cc:237] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:47.172081 23019 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:47.194159 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.276872 22874 consensus_queue.cc:260] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:47.276094 18601 raft_consensus.cc:1275] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:47.299701 18602 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:23:47.301481 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:47.219028 18526 raft_consensus.cc:2393] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 12: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:47.324349 18600 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 15.
I20260709 12:23:47.258854 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:23:47.320122 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:47.326140 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 67345.2us
I20260709 12:23:47.182936 22746 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:47.184805 22886 raft_consensus.cc:3060] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:47.193208 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:47.286816 18673 raft_consensus.cc:1275] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:47.321202 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.329087 18644 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:47.259683 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.218410 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:47.192509 18570 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:47.183585 22855 raft_consensus.cc:740] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
W20260709 12:23:47.333103 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.183277 22864 raft_consensus.cc:3055] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:47.331890 19212 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
W20260709 12:23:47.301026 23020 log.cc:927] Time spent T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:23:47.299273 23000 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:47.358752 18644 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:47.313037 22879 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:47.316458 22874 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:47.173126 22875 raft_consensus.cc:697] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:47.316787 22670 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:47.334839 22911 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:47.310992 22738 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:47.373845 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.437690 18522 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
W20260709 12:23:47.438449 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.353170 22864 raft_consensus.cc:740] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:47.352483 22865 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:47.456602 22864 consensus_queue.cc:260] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:47.457213 22865 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:47.458149 22864 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:47.355957 22823 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:47.371091 22834 raft_consensus.cc:3060] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:47.455834 22361 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:47.371557 23026 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:47.462090 22875 consensus_queue.cc:237] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:47.463130 18604 raft_consensus.cc:1240] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:23:47.464751 22774 consensus_queue.cc:1048] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:47.467054 22524 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:47.459599 22865 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:47.467833 22899 raft_consensus.cc:2804] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:47.314822 22872 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:47.300720 23004 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:47.462602 22361 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:47.490319 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.193228 22940 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:47.438311 22650 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:47.295570 22991 consensus_queue.cc:260] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:47.311565 23019 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:47.493314 18606 raft_consensus.cc:2368] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12.
I20260709 12:23:47.439002 22911 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:47.365270 23018 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.126s
W20260709 12:23:47.500770 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 244692us
W20260709 12:23:47.493814 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 301374us
W20260709 12:23:47.520418 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:47.520315 19210 leader_election.cc:336] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Timed out: RequestConsensusVote RPC to 127.16.240.131:36757 timed out after 1.777s (SENT)
I20260709 12:23:47.517040 22855 consensus_queue.cc:260] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:47.534401 18570 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:47.537083 22855 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:47.537796 23026 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:47.517390 22911 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:47.545045 22872 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:47.546247 23026 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:47.551213 23028 consensus_queue.cc:1048] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:47.552086 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.550608 18570 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:47.535849 23004 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:47.536151 22991 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:47.557960 23019 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:47.560283 18570 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:47.571561 22872 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:47.499321 22899 raft_consensus.cc:697] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:47.572559 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:47.594445 22872 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:47.555927 23026 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:47.535810 22815 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:47.638221 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:47.638546 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:47.663468 18604 raft_consensus.cc:2410] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:23:47.631916 18646 leader_election.cc:336] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.517s (SENT)
I20260709 12:23:47.643970 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:47.644363 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:47.651121 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.664417 18646 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:23:47.651213 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.644064 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:47.665942 18600 raft_consensus.cc:2410] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:23:47.647779 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:47.648577 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 282914us
I20260709 12:23:47.668808 18673 raft_consensus.cc:1240] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:23:47.640614 22872 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:47.676542 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.677331 18526 raft_consensus.cc:1240] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:23:47.677901 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.678315 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.678531 18524 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:47.679415 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.679620 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.680074 18526 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:47.680179 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:47.680442 18602 raft_consensus.cc:1240] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 12:23:47.680716 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.680830 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:47.681398 18525 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:47.681529 18526 raft_consensus.cc:2393] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 8: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:47.681586 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:23:47.682205 19211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.682615 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.683240 18530 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:47.683773 18601 raft_consensus.cc:1240] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:47.684159 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:47.684983 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:47.683655 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:47.687570 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:47.640352 22899 consensus_queue.cc:237] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:47.636224 23022 log.cc:927] Time spent T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.373s	user 0.000s	sys 0.001s
I20260709 12:23:47.682773 18526 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:23:47.694171 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.695472 22886 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:47.696727 18606 raft_consensus.cc:2393] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 7: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:47.698940 22746 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:47.699939 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:47.700325 19210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:47.644316 23021 log.cc:927] Time spent T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.372s	user 0.001s	sys 0.000s
I20260709 12:23:47.635923 22524 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:47.702656 18528 raft_consensus.cc:2410] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:23:47.644917 22807 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:47.705920 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.710453 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:23:47.728304 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 96419.6us
I20260709 12:23:47.684121 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:47.684070 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:47.643565 18414 maintenance_manager.cc:643] P 01c309cccd034172a8532c59d6c80638: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 7.851s	user 0.187s	sys 0.068s Metrics: {"bytes_written":29472,"cfile_init":1,"dirs.queue_time_us":404884,"dirs.run_cpu_time_us":476,"dirs.run_wall_time_us":2364,"drs_written":1,"lbm_read_time_us":816,"lbm_reads_lt_1ms":4,"lbm_write_time_us":124073,"lbm_writes_10-100_ms":4,"lbm_writes_lt_1ms":26,"peak_mem_usage":0,"rows_written":63,"thread_start_us":142809,"threads_started":1}
I20260709 12:23:47.716426 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:47.718235 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.640264 23000 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:47.729465 18598 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:23:47.724797 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:47.668730 23010 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:47.661247 23026 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.721127 18570 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:47.735410 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:47.740258 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:47.719255 22774 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:47.727494 22864 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:47.729130 22886 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:47.745370 18680 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:47.747561 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.748257 18528 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:47.748467 18523 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:47.757323 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:47.758024 18671 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:47.758960 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:47.760995 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:47.761883 18673 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
I20260709 12:23:47.759698 18671 raft_consensus.cc:2393] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 8: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
W20260709 12:23:47.769423 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.769898 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:47.772429 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:47.746403 22875 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:47.772960 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:47.773262 18523 raft_consensus.cc:2368] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12.
I20260709 12:23:47.773909 18676 raft_consensus.cc:2393] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 8: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
W20260709 12:23:47.769479 18572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.008s	sys 0.025s
I20260709 12:23:47.774574 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:47.762178 18415 maintenance_manager.cc:419] P 01c309cccd034172a8532c59d6c80638: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9514 bytes on disk
W20260709 12:23:47.775909 18572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.009s	sys 0.025s
W20260709 12:23:47.780316 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 589523us
I20260709 12:23:47.780200 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:47.779542 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:47.782375 18679 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:47.782752 18672 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:47.780079 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:47.740849 23026 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:47.784539 18572 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:47.787364 18570 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:47.749904 22864 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:47.792888 18570 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:23:47.793440 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.751971 22911 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:47.775707 22875 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:47.807255 18679 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 15.
I20260709 12:23:47.808612 18598 raft_consensus.cc:1240] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10. Ops: []
W20260709 12:23:47.810384 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.789868 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.793871 22874 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:47.813690 18600 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:47.815253 22746 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:47.816000 22864 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:47.794304 18572 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:47.819205 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:47.821753 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:47.821960 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:47.821779 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:47.823108 18603 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:47.823554 18414 maintenance_manager.cc:643] P 01c309cccd034172a8532c59d6c80638: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.037s	user 0.003s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":318,"lbm_reads_lt_1ms":4}
I20260709 12:23:47.828392 23040 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:47.799724 22694 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:47.829260 18601 raft_consensus.cc:1240] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:47.829098 18644 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:47.830261 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:47.835666 18523 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:47.836000 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:47.836620 18674 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:47.824527 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:47.837146 18644 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:47.838174 18606 raft_consensus.cc:2368] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 10. Current term is 11.
I20260709 12:23:47.817862 22875 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:47.843966 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:47.845319 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.825624 22855 consensus_queue.cc:1048] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:23:47.837553 22874 raft_consensus.cc:697] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:47.848821 22874 consensus_queue.cc:237] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:47.852421 18603 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:47.853601 18644 leader_election.cc:400] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12.
I20260709 12:23:47.853960 18644 leader_election.cc:403] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:23:47.854632 23004 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:47.855130 23004 raft_consensus.cc:697] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:47.856065 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:47.856276 22865 consensus_queue.cc:1059] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:47.856679 18677 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:47.857386 22650 raft_consensus.cc:3055] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:47.857735 22650 raft_consensus.cc:740] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:47.858520 22650 consensus_queue.cc:260] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:47.862288 18601 raft_consensus.cc:1275] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:23:47.875916 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 88560.6us
I20260709 12:23:47.876784 18672 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:47.881265 18529 raft_consensus.cc:2368] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 10. Current term is 11.
I20260709 12:23:47.887032 18606 raft_consensus.cc:1240] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:47.888306 23004 consensus_queue.cc:237] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:47.890728 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:47.885412 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 56463.1us
I20260709 12:23:47.892954 18570 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:47.842195 22886 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:47.915923 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:47.861901 23005 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:47.912654 19242 raft_consensus.cc:1240] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:47.889474 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:47.924484 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:47.913497 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.859691 22650 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:47.889257 22872 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:47.916531 18672 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:47.917240 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.920616 18604 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 12.
I20260709 12:23:47.906090 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.924721 19244 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 5.
I20260709 12:23:47.886162 22524 raft_consensus.cc:2804] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:47.837571 23040 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:47.937639 18677 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:47.935026 18523 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:23:47.935809 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:47.945297 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:47.945969 18606 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:47.948114 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:47.948868 18601 raft_consensus.cc:2393] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 13: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:47.950639 23019 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:47.950943 23010 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:47.951649 23010 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:47.957958 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:47.961825 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 68960.2us
I20260709 12:23:47.975193 18672 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
I20260709 12:23:47.976406 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:47.977703 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:47.987792 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:47.969288 22524 raft_consensus.cc:697] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:47.931283 23005 raft_consensus.cc:697] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:47.992859 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:47.986013 18570 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:47.938531 22865 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12.
I20260709 12:23:48.005414 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:47.996297 19210 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:48.012627 18600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:48.001132 18570 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:48.013300 18600 raft_consensus.cc:606] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:48.013700 18600 raft_consensus.cc:614] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:48.002828 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:48.016176 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:48.017009 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:48.017827 18522 raft_consensus.cc:2393] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 12: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:47.976452 22864 consensus_queue.cc:1059] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
W20260709 12:23:48.030592 18646 leader_election.cc:336] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.720s (SENT)
I20260709 12:23:48.024735 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:48.025146 18570 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:48.031338 18646 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:48.036070 18570 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:48.040328 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 44108us
I20260709 12:23:48.040725 22855 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:48.042227 18525 raft_consensus.cc:2368] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 10. Current term is 11.
I20260709 12:23:47.990648 22524 consensus_queue.cc:237] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:48.046002 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:48.048599 19210 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:48.051920 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:48.056129 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:48.054673 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:48.060055 18529 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:23:48.060272 18530 raft_consensus.cc:2410] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:23:48.060359 18528 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 13.
I20260709 12:23:48.061158 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:48.051353 19210 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:48.057571 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:48.063050 18523 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:23:48.068836 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:48.068837 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:48.031931 22912 raft_consensus.cc:2804] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:48.070043 18677 raft_consensus.cc:2393] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 11: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:48.037331 22886 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:48.069784 18526 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
W20260709 12:23:48.072046 23044 log.cc:927] Time spent T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:23:48.050555 22911 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:48.089408 22911 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:48.089937 22911 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:48.051838 22774 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:48.048081 22899 consensus_queue.cc:1059] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
W20260709 12:23:48.072206 23045 log.cc:927] Time spent T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:23:48.107826 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:48.093998 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:48.107081 18677 raft_consensus.cc:1240] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:48.046898 22738 raft_consensus.cc:3055] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:48.057003 22712 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:23:48.109854 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 79317.2us
W20260709 12:23:48.129885 18646 leader_election.cc:336] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.748s (SENT)
I20260709 12:23:48.112854 18606 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:48.115568 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:48.119238 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:23:48.108202 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 163537us
I20260709 12:23:48.133112 18671 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:48.133467 18644 leader_election.cc:400] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 10. Current term is 11.
I20260709 12:23:48.133862 18644 leader_election.cc:403] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:23:48.123600 23040 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:48.071719 22974 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:48.134559 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:48.077500 22912 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.138827 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:48.140148 18680 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:48.083666 23026 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:48.108009 23028 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:48.101022 22886 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:48.134536 18644 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:48.148718 18523 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
W20260709 12:23:48.149287 18646 leader_election.cc:336] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.102s (SENT)
I20260709 12:23:48.108309 23037 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:48.093282 23042 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:48.150511 18525 raft_consensus.cc:2393] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 7: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:48.150619 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:48.167335 18524 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:48.150336 18527 raft_consensus.cc:2393] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 7: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:48.158672 18644 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:48.168324 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:48.163182 18523 raft_consensus.cc:1275] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
W20260709 12:23:48.163365 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.168938 18523 pending_rounds.cc:85] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 8
I20260709 12:23:48.169302 18523 pending_rounds.cc:107] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:23:48.169575 18523 raft_consensus.cc:2889] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:48.159955 18646 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:48.119012 22738 raft_consensus.cc:740] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:48.147725 22912 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:48.113040 23005 consensus_queue.cc:237] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:48.178670 18525 raft_consensus.cc:1275] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:48.179220 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:48.180094 18525 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:23:48.183319 23048 log.cc:927] Time spent T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:23:48.164850 22774 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:23:48.185025 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:48.185904 22774 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:48.186435 22774 raft_consensus.cc:697] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:48.165431 23040 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:48.189025 23040 raft_consensus.cc:697] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:48.189138 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:48.189860 18600 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 13.
I20260709 12:23:48.190179 23040 consensus_queue.cc:237] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:48.190907 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:48.164391 22670 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:48.192216 22670 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:48.193053 19240 raft_consensus.cc:1275] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:23:48.193413 19240 pending_rounds.cc:85] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4: Aborting all ops after (but not including) 7
I20260709 12:23:48.193630 19240 pending_rounds.cc:107] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:23:48.171150 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:48.193866 19240 raft_consensus.cc:2889] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:48.156960 22974 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:48.194365 18677 raft_consensus.cc:2410] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:23:48.183215 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:48.200198 19246 raft_consensus.cc:2393] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 9: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:48.156600 23028 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:48.153421 23038 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 10. Current term is 11.
I20260709 12:23:48.221993 18523 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:23:48.252408 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 144205us
I20260709 12:23:48.169991 22886 raft_consensus.cc:697] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:48.172629 22911 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:48.262324 18572 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:48.187328 22774 consensus_queue.cc:237] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:48.247251 23028 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:48.214044 22361 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:48.272478 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 141318us
W20260709 12:23:48.288954 18646 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.411s (SENT) [suppressed 22 similar messages]
I20260709 12:23:48.290410 18572 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:48.275233 18676 raft_consensus.cc:1240] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:23:48.247131 23018 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:48.283332 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:48.287501 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.298348 18599 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
W20260709 12:23:48.299436 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.306638 18674 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 16.
I20260709 12:23:48.311087 18572 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:48.316242 23042 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:48.319029 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.303328 22373 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:48.290269 23010 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:48.228749 23055 consensus_queue.cc:1059] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 12:23:48.321249 23055 raft_consensus.cc:3055] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:48.321715 23055 raft_consensus.cc:740] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:48.321943 23010 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:48.325730 22974 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:48.195907 23037 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:48.331301 23037 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:48.359238 22911 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.344425 22877 raft_consensus.cc:3055] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:48.322793 23055 consensus_queue.cc:260] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:48.406909 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 183221us
W20260709 12:23:48.409395 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:48.411819 23064 log.cc:927] Time spent T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.097s	user 0.004s	sys 0.000s
I20260709 12:23:48.439656 23062 raft_consensus.cc:1064] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:23:48.486538 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:48.488515 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:48.355868 23070 consensus_queue.cc:1059] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:48.294270 22524 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:23:48.485947 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 449912us
I20260709 12:23:48.276080 22738 consensus_queue.cc:260] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:48.493598 18644 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:48.495039 18572 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:48.505770 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:48.505872 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:48.509472 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:48.510460 18527 raft_consensus.cc:1275] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:23:48.505240 22864 raft_consensus.cc:3055] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:48.522734 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:48.523022 18570 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:48.494534 22834 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.494307 22877 raft_consensus.cc:740] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:48.534220 22874 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:48.498594 22373 consensus_queue.cc:1048] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:23:48.494623 22886 consensus_queue.cc:237] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:48.542201 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 48690.4us
I20260709 12:23:48.541201 18570 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:48.544497 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:48.573187 18676 raft_consensus.cc:2393] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 12: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:48.545426 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:48.546814 18679 raft_consensus.cc:1240] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:48.548589 22834 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:48.551119 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:48.575326 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:48.576545 18603 raft_consensus.cc:2368] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 11. Current term is 12.
I20260709 12:23:48.576746 18680 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:48.526639 23055 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:48.547153 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 258208us
I20260709 12:23:48.551254 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:48.551326 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:48.586396 18672 raft_consensus.cc:2393] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 11: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:48.575470 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:48.575690 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:48.506266 23042 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:23:48.526345 22864 raft_consensus.cc:740] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:48.548064 22874 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.587610 18678 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
I20260709 12:23:48.506765 22911 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:48.601926 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 60855.2us
I20260709 12:23:48.613989 18570 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:48.620927 18644 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:48.624321 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:48.547427 23061 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:48.567521 23068 raft_consensus.cc:2804] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:48.656606 23068 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.657162 23068 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:48.660835 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:48.660125 23028 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:48.675884 23061 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:48.676736 23061 raft_consensus.cc:697] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:48.677879 23061 consensus_queue.cc:237] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:48.678833 22911 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:48.681485 22834 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:48.687656 22872 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:48.619558 23004 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:23:48.698387 22864 consensus_queue.cc:260] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:48.700242 22864 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:48.632450 22650 consensus_meta.cc:287] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.699s	user 0.005s	sys 0.009s
I20260709 12:23:48.632333 23066 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.632731 22899 consensus_queue.cc:1048] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:48.633426 23000 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:48.633936 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:48.634552 22746 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:48.620563 22874 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:48.655951 22670 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:48.761565 18646 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:48.766355 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:48.768286 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:48.705715 18680 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 12.
I20260709 12:23:48.712929 18603 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 12.
W20260709 12:23:48.714473 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:48.736582 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.770473 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:48.791535 18599 raft_consensus.cc:2393] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 12: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:48.772946 18600 raft_consensus.cc:1240] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:23:48.773294 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:23:48.775079 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 141192us
I20260709 12:23:48.753333 22746 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:48.777177 22650 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:23:48.704576 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 90649.1us
I20260709 12:23:48.800294 18570 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:48.802307 18646 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:48.806253 18671 raft_consensus.cc:1240] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:48.813717 18570 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:23:48.818477 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.820896 18680 raft_consensus.cc:1275] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:48.823201 18646 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:48.828387 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 44472.1us
I20260709 12:23:48.829185 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:48.781666 23000 raft_consensus.cc:697] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:48.834352 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:48.834722 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:48.835335 18646 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:48.807819 22746 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:48.842697 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:48.805505 23038 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:48.844666 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:23:48.852061 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 74980.8us
I20260709 12:23:48.853906 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:48.821969 22650 raft_consensus.cc:697] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:48.854876 19244 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:48.816569 22373 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:23:48.874240 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.872849 19246 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
I20260709 12:23:48.844230 22866 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:48.779224 23066 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:48.882596 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 326561us
I20260709 12:23:48.883256 18646 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:48.861073 23004 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:48.839481 22865 raft_consensus.cc:2804] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:48.891290 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:48.891534 18644 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:48.900367 18598 raft_consensus.cc:2393] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 12: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
W20260709 12:23:48.902302 18494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:48.902726 18494 connection.cc:256] RPC call timeout handler was delayed by -2.876068855000085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2358s for a response
W20260709 12:23:48.903055 18494 connection.cc:256] RPC call timeout handler was delayed by -2.876068855000085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2358s for a response
I20260709 12:23:48.904062 18676 raft_consensus.cc:1275] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:48.901757 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:48.845252 23072 consensus_queue.cc:1059] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
W20260709 12:23:48.903345 18494 connection.cc:256] RPC call timeout handler was delayed by -2.8206571729997449s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
W20260709 12:23:48.916716 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.916857 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:23:48.917305 18494 connection.cc:256] RPC call timeout handler was delayed by -2.7229768359998161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2913s for a response
I20260709 12:23:48.917640 18603 raft_consensus.cc:2393] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 9: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:48.913038 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:48.918432 18598 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 7.
I20260709 12:23:48.918365 18646 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:48.917671 18494 connection.cc:256] RPC call timeout handler was delayed by -2.7126571730000251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
W20260709 12:23:48.922812 18494 connection.cc:256] RPC call timeout handler was delayed by -2.5355526260000261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
W20260709 12:23:48.923166 18494 connection.cc:256] RPC call timeout handler was delayed by -2.4896526260004066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2081s for a response
I20260709 12:23:48.912176 19246 raft_consensus.cc:1240] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:48.910794 23042 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.924906 23018 raft_consensus.cc:2749] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:48.930320 23042 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:48.933497 23078 log.cc:927] Time spent T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:23:48.934634 23075 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:48.926602 18644 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:48.929121 18603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:48.934705 23042 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:48.936169 18603 raft_consensus.cc:606] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:48.935863 23075 raft_consensus.cc:697] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:48.936566 18603 raft_consensus.cc:614] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:48.937327 23075 consensus_queue.cc:237] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:48.937935 18603 raft_consensus.cc:1240] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:48.943881 18605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 2291) took 1132 ms. Trace:
I20260709 12:23:48.944317 18605 rpcz_store.cc:276] 0709 12:23:47.811521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.844400 (+ 32879us) service_pool.cc:224] Handling call
0709 12:23:47.852078 (+  7678us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:48.049580 (+197502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:48.049617 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:48.342222 (+292605us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b2c0005b3b8. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7add8a11 00007efc7ade8372 00007efc7c51aa01 00007efc7c4df43a 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2
0709 12:23:48.415839 (+ 73617us) log.cc:844] Serialized 26 byte log entry
0709 12:23:48.787613 (+371774us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:48.787667 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:48.787783 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:48.943511 (+155728us) raft_consensus.cc:1685] finished
0709 12:23:48.943533 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:48.943807 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59763,"raft.queue_time_us":71473,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":5988,"spinlock_wait_cycles":49677184,"thread_start_us":405077,"threads_started":2,"wal-append.queue_time_us":399910}
I20260709 12:23:48.947237 18605 raft_consensus.cc:1240] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:23:48.949752 23066 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:48.889915 23004 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:48.950652 23004 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:48.958294 22912 consensus_meta.cc:287] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.002s
I20260709 12:23:48.885221 22991 consensus_queue.cc:1059] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 12:23:48.905094 22834 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:48.966820 22834 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:48.970395 22834 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:48.971659 18606 raft_consensus.cc:1240] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:23:48.884183 22373 raft_consensus.cc:697] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:48.963315 22991 raft_consensus.cc:3055] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:23:48.910096 22875 consensus_meta.cc:287] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 1.024s	user 0.011s	sys 0.003s
W20260709 12:23:48.979031 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 52535.1us
I20260709 12:23:48.958935 22912 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:48.974079 18606 raft_consensus.cc:1240] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:48.896023 22865 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:48.980255 18570 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:48.981639 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:49.001508 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:49.025647 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.040627 18598 raft_consensus.cc:2393] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 7: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:49.056635 18598 raft_consensus.cc:1240] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8. Ops: []
W20260709 12:23:49.063944 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 83808.3us
I20260709 12:23:48.978973 22866 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:23:49.069723 18494 connection.cc:256] RPC call timeout handler was delayed by -1.9241017479998845s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
W20260709 12:23:49.070291 18494 connection.cc:256] RPC call timeout handler was delayed by -1.818801748000169s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17210000000000003s for a response
W20260709 12:23:49.070626 18494 connection.cc:256] RPC call timeout handler was delayed by -1.80080174800014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
W20260709 12:23:49.070971 18494 connection.cc:256] RPC call timeout handler was delayed by -1.5956017479998081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 12:23:49.071326 18494 connection.cc:256] RPC call timeout handler was delayed by -1.5806526260003011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30910000000000004s for a response
W20260709 12:23:49.071764 18494 connection.cc:256] RPC call timeout handler was delayed by -1.5083017480001217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
I20260709 12:23:49.072119 18604 raft_consensus.cc:1240] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:49.072170 18494 connection.cc:256] RPC call timeout handler was delayed by -1.5056017480001174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
W20260709 12:23:49.072839 18494 connection.cc:256] RPC call timeout handler was delayed by -1.392201747999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2195s for a response
I20260709 12:23:48.985206 23085 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.984874 22834 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.980147 22991 raft_consensus.cc:740] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:49.037148 23018 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:49.085050 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:48.935447 23037 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.135s
I20260709 12:23:49.096311 18526 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:23:49.079589 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:49.046855 22865 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:49.092605 18603 raft_consensus.cc:1240] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:23:49.083570 18528 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:49.100505 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:49.105933 18672 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:49.097961 18527 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
I20260709 12:23:49.098284 23085 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:49.068853 23042 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:49.065133 22361 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:23:49.038664 22875 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:49.115875 23028 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:49.069243 23072 consensus_queue.cc:1059] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:23:49.132417 18494 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:48.984038 23000 consensus_queue.cc:237] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:49.138375 18606 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:23:49.099100 22834 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:49.140988 23069 log.cc:927] Time spent T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 12:23:49.088574 22650 consensus_queue.cc:237] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:49.148463 23074 log.cc:927] Time spent T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
W20260709 12:23:49.149770 23089 log.cc:927] Time spent T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:23:49.155946 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:49.167639 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:49.171501 22872 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:49.182632 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:23:49.186755 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 81172.5us
W20260709 12:23:49.174901 23048 log.cc:927] Time spent T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:23:49.193360 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 61024.9us
I20260709 12:23:49.194142 18602 raft_consensus.cc:1240] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:49.206094 18570 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:49.124526 22373 consensus_queue.cc:237] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:49.219429 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 301154us
I20260709 12:23:49.243229 18646 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:49.246506 18678 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:49.203655 23099 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:23:49.240748 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:49.249089 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 46669.9us
I20260709 12:23:49.253125 18494 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:49.205338 22872 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:49.254283 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 48270.5us
W20260709 12:23:49.255146 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 54860us
W20260709 12:23:49.245402 22864 consensus_meta.cc:287] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.001s
I20260709 12:23:49.195894 22991 consensus_queue.cc:260] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:49.207027 23091 consensus_queue.cc:1048] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:23:49.249636 18646 leader_election.cc:400] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12.
I20260709 12:23:49.251303 22670 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:49.250408 23066 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:49.251227 23100 raft_consensus.cc:2804] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:49.270377 18646 leader_election.cc:400] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 10. Current term is 11.
I20260709 12:23:49.262364 22912 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:49.276952 18646 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:49.268074 22670 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.296653 22670 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:49.284512 22875 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:49.300489 23085 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:49.285023 23108 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:49.286093 23096 log.cc:927] Time spent T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:23:49.286329 22872 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:49.286598 23087 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:49.286761 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:49.273876 23103 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.288965 18646 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:49.315166 18646 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:49.289958 23105 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:23:49.291292 22874 consensus_meta.cc:287] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.001s
W20260709 12:23:49.292300 23097 log.cc:927] Time spent T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 12:23:49.292550 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.326066 18570 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:49.293403 22746 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:49.280253 18572 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:49.270871 23100 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:49.274122 23099 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:49.313053 19246 raft_consensus.cc:2393] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 12: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:49.287267 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:49.327941 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:49.339418 18678 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:23:49.339903 18671 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:49.329301 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:23:49.341297 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 61168.1us
I20260709 12:23:49.346895 18646 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:49.349107 19242 raft_consensus.cc:2393] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 10: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:49.283007 22886 consensus_queue.cc:1048] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:23:49.356025 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:49.356833 18677 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:49.357322 18522 raft_consensus.cc:2410] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:23:49.334707 23018 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:49.354053 22866 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:49.375452 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:49.351192 22834 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:49.376693 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:49.376971 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:49.401191 18523 raft_consensus.cc:2393] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 10: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:49.379437 18601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b52424a465944d0ba861991c593bdc17"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:49.401965 18601 raft_consensus.cc:606] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:49.402360 18601 raft_consensus.cc:614] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:49.381160 23070 raft_consensus.cc:3055] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:49.381768 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:49.381471 22865 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:49.382144 22738 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:49.340752 23042 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:49.385344 22877 consensus_queue.cc:260] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:49.387902 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:49.388298 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.372346 23101 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:49.341426 23100 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:49.376374 18525 raft_consensus.cc:3055] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:49.313180 23004 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:49.393656 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 46828.8us
I20260709 12:23:49.394774 18603 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:49.454891 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.474291 18646 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:49.332911 22874 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:49.324447 23108 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:49.334141 23103 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:49.435061 18678 raft_consensus.cc:2410] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:23:49.435088 18572 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:23:49.474612 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:49.406692 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 43990.1us
I20260709 12:23:49.477487 18674 raft_consensus.cc:1240] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:49.425216 23068 consensus_meta.cc:287] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.767s	user 0.010s	sys 0.002s
I20260709 12:23:49.473628 18525 raft_consensus.cc:740] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:23:49.407366 23055 consensus_meta.cc:287] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.816s	user 0.009s	sys 0.005s
I20260709 12:23:49.497407 19210 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:49.481936 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 228868us
I20260709 12:23:49.498432 18646 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:49.455155 18673 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:49.391758 22361 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:49.509289 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.512226 18671 raft_consensus.cc:2468] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
I20260709 12:23:49.513744 18494 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:49.518414 18680 raft_consensus.cc:1240] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:49.519265 18604 raft_consensus.cc:2368] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 12. Current term is 13.
I20260709 12:23:49.521030 18675 raft_consensus.cc:2410] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:23:49.522312 18601 raft_consensus.cc:1275] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:23:49.408301 22872 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 12:23:49.405099 23070 raft_consensus.cc:740] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:49.428478 23081 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:49.426283 22670 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:49.497677 22650 raft_consensus.cc:2749] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:49.528393 22877 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:49.551163 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 53873us
I20260709 12:23:49.533002 18605 raft_consensus.cc:1240] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:23:49.394712 23075 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 12:23:49.537897 18603 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 11.
I20260709 12:23:49.495287 23101 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:49.551055 18494 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:49.528528 22361 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:49.520076 22911 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:49.519869 23105 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:49.578361 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:49.629112 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.533275 23117 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:49.551777 22866 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:49.671659 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 119322us
I20260709 12:23:49.564353 23101 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:49.717209 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 282188us
W20260709 12:23:49.717736 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 166766us
I20260709 12:23:49.557009 18525 consensus_queue.cc:260] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:49.662609 23055 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.500427 23068 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:49.728230 19210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.672408 22886 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:49.742702 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 79927.1us
W20260709 12:23:49.735529 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 255535us
I20260709 12:23:49.701647 22818 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:49.743917 18525 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:49.751173 18494 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:49.754560 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:49.755282 18521 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:49.726006 23042 raft_consensus.cc:697] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:49.748873 18646 leader_election.cc:336] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.861s (SENT)
I20260709 12:23:49.757051 18646 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:49.756771 19210 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:23:49.766384 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.773221 18570 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:49.721052 22866 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:49.757782 22670 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:49.737267 23055 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:49.774577 23028 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:49.796047 23004 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:49.796299 23028 raft_consensus.cc:697] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:49.797147 22874 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:49.797295 23028 consensus_queue.cc:237] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:49.804075 23128 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.804666 23128 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:49.805524 23055 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:49.806519 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.806818 23128 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:49.808326 22865 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:49.792153 23111 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:49.809894 22865 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.810164 23111 raft_consensus.cc:697] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:49.810400 22865 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:49.811143 23111 consensus_queue.cc:237] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:49.812565 22361 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:49.814345 22361 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.814803 22361 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:49.815217 18600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 2038) took 1330 ms. Trace:
I20260709 12:23:49.741479 23070 consensus_queue.cc:260] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:49.815639 18600 rpcz_store.cc:276] 0709 12:23:48.485197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.485309 (+   112us) service_pool.cc:224] Handling call
0709 12:23:48.772656 (+287347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:48.791992 (+ 19336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.815014 (+1023022us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b540010bb50. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:49.815155 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":613200768}
I20260709 12:23:49.816952 23087 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:49.817246 18600 raft_consensus.cc:1240] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:49.817463 23103 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:49.819852 23066 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.820326 23066 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:49.775688 22746 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:49.795182 23042 consensus_queue.cc:237] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:49.817518 23087 raft_consensus.cc:697] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:49.776870 22834 raft_consensus.cc:2749] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:49.792851 23112 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:49.792555 23119 log.cc:927] Time spent T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:23:49.807336 23128 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:49.766846 22981 consensus_queue.cc:1048] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:23:49.844189 18494 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:49.756275 22818 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:49.784323 23072 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:49.855126 18678 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:23:49.856848 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 69935.1us
I20260709 12:23:49.819852 23108 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:49.831502 18521 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 14.
W20260709 12:23:49.876072 18646 leader_election.cc:336] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.072s (SENT)
I20260709 12:23:49.892313 18646 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:49.875589 18678 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:49.890799 22834 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:49.895017 22834 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:49.895592 22834 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:49.896191 22818 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:49.902092 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 128968us
I20260709 12:23:49.902927 18570 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:23:49.904594 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 60532.9us
W20260709 12:23:49.913832 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.915352 18570 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:49.916589 18494 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:49.917344 18525 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:23:49.917716 18525 pending_rounds.cc:85] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 8
I20260709 12:23:49.917944 18525 pending_rounds.cc:107] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:23:49.918181 18525 raft_consensus.cc:2889] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:49.897761 22746 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:49.931291 22874 raft_consensus.cc:2749] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:49.931468 23112 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:49.933863 18572 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:49.867937 23128 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:49.939375 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:49.948324 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:23:49.937367 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:49.961113 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 44605.5us
I20260709 12:23:49.898905 23100 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:49.965503 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:49.972177 19244 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:49.931367 23118 log.cc:927] Time spent T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:23:49.979485 18599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:49.980152 18599 raft_consensus.cc:606] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:49.980500 18599 raft_consensus.cc:614] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:49.936951 22361 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:49.982275 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:49.985585 18525 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:49.972642 22875 raft_consensus.cc:2804] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:49.972913 18678 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 14
W20260709 12:23:49.973636 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.961412 23127 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.972666 18494 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:49.975706 18527 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:49.977314 18521 raft_consensus.cc:3055] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:49.971275 22746 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:49.991671 18521 raft_consensus.cc:740] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:49.982265 22981 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:49.998317 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.000353 18521 consensus_queue.cc:260] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.001057 18494 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:50.001578 18521 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:50.001827 22834 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.003266 18494 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:50.003876 23053 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.004801 23103 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:50.004961 22834 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:50.005259 23103 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:50.005703 22834 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:50.005734 23103 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:50.014360 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:50.014496 23103 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:50.015125 18600 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 15.
I20260709 12:23:50.016268 22834 raft_consensus.cc:2804] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:50.016593 18494 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:50.017056 22834 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:50.018235 22834 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:50.018378 23112 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:50.018889 23112 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:50.019235 23112 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:50.011940 23109 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:50.021597 18602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 2288) took 2211 ms. Trace:
I20260709 12:23:50.022135 23099 consensus_queue.cc:1059] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:50.024029 22875 raft_consensus.cc:697] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:50.025094 22875 consensus_queue.cc:237] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.025731 18605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40954 (request call id 2046) took 1392 ms. Trace:
I20260709 12:23:50.026171 18605 rpcz_store.cc:276] 0709 12:23:48.633032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.948661 (+315629us) service_pool.cc:224] Handling call
0709 12:23:48.949045 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.552097 (+603052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.025445 (+473348us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b54002a0dd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:50.025657 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342312320}
I20260709 12:23:49.983711 22865 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:50.030650 19210 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:50.021983 18602 rpcz_store.cc:276] 0709 12:23:47.810575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.818727 (+  8152us) service_pool.cc:224] Handling call
0709 12:23:47.832648 (+ 13921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.202759 (+1370111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.021341 (+818582us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400126bd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:50.021510 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3130675968}
I20260709 12:23:50.040270 18678 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 14.
W20260709 12:23:50.042032 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 50134.3us
I20260709 12:23:50.049400 18521 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 12:23:50.049803 18521 pending_rounds.cc:85] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 7
I20260709 12:23:50.050050 18521 pending_rounds.cc:107] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:23:50.050284 18521 raft_consensus.cc:2889] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:50.040995 22712 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:50.051419 22712 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:50.051935 22712 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:50.051009 22834 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:23:50.038278 22981 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:50.055284 22361 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:50.054636 22834 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:50.058346 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:50.060487 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:50.063215 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.063187 18678 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:50.004477 23053 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.070050 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:50.040594 23066 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.071601 23053 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:50.001098 23127 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.077975 23127 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:50.092388 23066 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:50.097316 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:50.098624 23128 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:50.039253 23068 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:50.048379 23118 log.cc:927] Time spent T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:23:50.102589 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:50.110029 18527 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
W20260709 12:23:50.114477 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 46668.4us
I20260709 12:23:50.033182 23109 raft_consensus.cc:697] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:50.119210 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:50.121826 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:50.265905 18671 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:50.123908 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:50.266932 19244 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:23:50.125160 22981 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:50.125872 23101 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.058367 23136 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.967732 23087 consensus_queue.cc:237] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:50.012036 23062 consensus_queue.cc:237] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 3, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:50.270889 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:50.269546 18570 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:50.273739 18603 raft_consensus.cc:1240] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:50.275029 23101 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:50.272212 23143 log.cc:927] Time spent T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.072s	user 0.002s	sys 0.002s
W20260709 12:23:50.269588 22738 consensus_meta.cc:287] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.797s	user 0.012s	sys 0.006s
W20260709 12:23:50.277748 23147 log.cc:927] Time spent T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.177s	user 0.010s	sys 0.000s
W20260709 12:23:50.269685 22886 consensus_meta.cc:287] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.519s	user 0.017s	sys 0.001s
I20260709 12:23:50.283341 18527 raft_consensus.cc:1240] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:50.267174 22974 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.260752 23065 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.276701 23112 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.287596 18678 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:23:50.269487 23042 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.285887 23104 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:50.296883 18676 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:50.292250 22886 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:50.280490 23136 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.344189 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:50.345186 18527 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4.
W20260709 12:23:50.345381 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.291239 22712 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:50.307996 22738 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:50.338588 23104 raft_consensus.cc:697] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:50.368073 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.341845 23103 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:50.296823 22974 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:50.372836 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:50.377224 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:50.381974 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.347952 23109 consensus_queue.cc:237] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.309217 23042 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:50.356915 23091 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.296365 23065 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.372929 23100 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:50.380112 23095 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:50.395651 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.363767 23146 consensus_queue.cc:1048] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:23:50.372738 22738 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:50.425464 22974 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:50.429706 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:50.430583 19244 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:50.434504 18570 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:50.437681 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 176014us
I20260709 12:23:50.394678 23091 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:50.441699 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:23:50.442857 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.444325 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:50.444671 18677 raft_consensus.cc:1275] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:23:50.434340 23145 log.cc:927] Time spent T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 12:23:50.436721 23148 log.cc:927] Time spent T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:23:50.447419 18524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2857) took 1367 ms. Trace:
I20260709 12:23:50.449537 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:50.450350 18605 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:50.425551 23042 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:50.448936 18524 rpcz_store.cc:276] 0709 12:23:49.079951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.080134 (+   183us) service_pool.cc:224] Handling call
0709 12:23:49.099968 (+ 19834us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.200689 (+100721us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:49.200722 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:49.206577 (+  5855us) log.cc:844] Serialized 26 byte log entry
0709 12:23:49.336168 (+129591us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:49.336219 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.435843 (+1099624us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b5400082ad4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:50.435896 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:50.435965 (+    69us) raft_consensus.cc:1685] finished
0709 12:23:50.435986 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.447353 (+ 11367us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":62932,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":1838,"spinlock_wait_cycles":230071168,"thread_start_us":129261,"threads_started":1,"wal-append.queue_time_us":143984,"wal-append.run_cpu_time_us":1730,"wal-append.run_wall_time_us":1023683}
I20260709 12:23:50.458164 23136 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:50.458918 23150 log.cc:927] Time spent T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:23:50.461179 23112 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:50.417904 23104 consensus_queue.cc:237] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:50.461882 22712 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:50.465960 18602 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 11.
I20260709 12:23:50.466500 23091 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:50.468242 22738 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:50.469856 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:50.439204 23101 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:50.470890 23101 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:50.471300 23101 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:50.401576 23095 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:50.473999 23095 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:50.474519 23042 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:50.475241 23042 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.478175 23042 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:50.480454 23065 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:50.484045 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:50.485222 19244 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
I20260709 12:23:50.486689 18570 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:50.488271 18671 raft_consensus.cc:1275] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:50.490119 18605 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 16.
I20260709 12:23:50.481789 23065 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.492389 22872 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:50.497429 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:50.499639 22872 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:50.500102 22872 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:50.500662 23123 log.cc:927] Time spent T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.686s	user 0.004s	sys 0.000s
W20260709 12:23:50.505476 18675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40800 (request call id 2047) took 1960 ms (client timeout 2216 ms). Trace:
W20260709 12:23:50.505980 18675 rpcz_store.cc:269] 0709 12:23:48.544735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.545931 (+  1196us) service_pool.cc:224] Handling call
0709 12:23:50.505221 (+1959290us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b54002913d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:50.505403 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2140717696}
I20260709 12:23:50.507332 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:50.510077 18675 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:50.511826 18494 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:50.517236 23103 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:50.517627 23103 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:50.517995 23103 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:50.518798 22738 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.519366 22738 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.512954 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2509) took 1438 ms. Trace:
I20260709 12:23:50.521682 22738 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:50.523031 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.526168 23059 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:50.526746 23059 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:50.529546 23059 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:50.532193 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:50.533360 18671 raft_consensus.cc:2393] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 14: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:50.534735 18671 raft_consensus.cc:1240] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:50.522538 18680 rpcz_store.cc:276] 0709 12:23:49.074332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.074871 (+   539us) service_pool.cc:224] Handling call
0709 12:23:49.095722 (+ 20851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.518861 (+423139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.512725 (+993864us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b54001f1654. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:50.512896 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":971627392}
I20260709 12:23:50.536809 18494 leader_election.cc:400] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 7. Current term is 8.
I20260709 12:23:50.537043 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:50.538125 18680 raft_consensus.cc:2393] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 12: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:50.496573 23065 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.541575 23065 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:50.542953 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:50.545416 23149 log.cc:927] Time spent T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:23:50.549221 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2516) took 1409 ms. Trace:
I20260709 12:23:50.549695 18674 rpcz_store.cc:276] 0709 12:23:49.140336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.186362 (+ 46026us) service_pool.cc:224] Handling call
0709 12:23:49.198903 (+ 12541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.503728 (+304825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.548942 (+1045214us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b540039fb54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:50.549152 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":640197504}
W20260709 12:23:50.552805 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.552922 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:50.554268 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:50.559891 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:50.560817 18674 raft_consensus.cc:2410] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:23:50.564420 18675 raft_consensus.cc:1240] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:50.566040 18494 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:50.566864 23158 raft_consensus.cc:2804] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:50.566689 22872 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:50.567284 18494 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:50.567302 23158 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:50.571587 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:50.657881 23158 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:50.658150 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:50.658197 18524 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 15.
I20260709 12:23:50.658855 18605 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:50.659708 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:50.583941 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:50.516081 23101 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:50.584867 22872 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:50.589634 18604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39798 (request call id 565) took 1511 ms (client timeout 1654 ms). Trace:
I20260709 12:23:50.589958 18522 raft_consensus.cc:1240] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:50.579311 18527 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:50.596587 18603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 2306) took 1611 ms. Trace:
I20260709 12:23:50.670948 18603 rpcz_store.cc:276] 0709 12:23:48.985443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.555420 (+569977us) service_pool.cc:224] Handling call
0709 12:23:49.671886 (+116466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.282666 (+610780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.596290 (+313624us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54002247d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:50.596507 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1383750528}
I20260709 12:23:50.598757 23070 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:50.670508 23104 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:23:50.671726 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:50.678287 18527 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:50.672163 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:50.602627 22991 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:50.602890 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:50.605013 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2521) took 1274 ms. Trace:
W20260709 12:23:50.613467 23113 log.cc:927] Time spent T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 1.088s	user 0.002s	sys 0.002s
I20260709 12:23:50.613751 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:50.614058 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:50.561825 22911 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.684163 18530 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:50.615329 18525 raft_consensus.cc:3055] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:50.697499 18525 raft_consensus.cc:740] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:23:50.616143 23124 log.cc:927] Time spent T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.808s	user 0.002s	sys 0.000s
W20260709 12:23:50.708941 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 141729us
I20260709 12:23:50.615972 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:50.617059 22866 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:50.617556 18529 raft_consensus.cc:1275] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:23:50.618038 23144 log.cc:927] Time spent T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
W20260709 12:23:50.620713 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.622434 22864 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.623128 23105 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.623402 23073 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:50.624639 18644 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:50.625869 22738 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.633301 22834 raft_consensus.cc:3055] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:50.631338 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:50.722575 18599 raft_consensus.cc:1240] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:50.715420 18605 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 14.
I20260709 12:23:50.638455 18572 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:50.642992 19210 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:50.655821 23111 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.007s	sys 0.008s
W20260709 12:23:50.657337 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 220283us
I20260709 12:23:50.661322 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:50.708912 23146 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:50.584667 18528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2867) took 1233 ms. Trace:
I20260709 12:23:50.662951 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:50.726612 18599 raft_consensus.cc:1275] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:23:50.669047 18646 leader_election.cc:336] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.895s (SENT)
I20260709 12:23:50.602335 18602 raft_consensus.cc:1275] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:23:50.671710 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:50.679705 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:50.728332 18522 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:50.670179 18604 rpcz_store.cc:269] 0709 12:23:49.078145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.167281 (+ 89136us) service_pool.cc:224] Handling call
0709 12:23:50.589451 (+1422170us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b5400310e54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:50.589576 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":740211968}
I20260709 12:23:50.685041 18606 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:50.679852 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:50.730242 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 58750.9us
I20260709 12:23:50.615152 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:50.729033 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:50.731920 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:50.732573 18527 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:50.733422 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:50.726228 18524 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
W20260709 12:23:50.706501 23028 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.007s	sys 0.015s
W20260709 12:23:50.707954 18424 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47714 (request call id 203) took 13227 ms (client timeout 15000 ms). Trace:
I20260709 12:23:50.712453 18494 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:50.714993 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:50.716529 18525 consensus_queue.cc:260] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.739905 18525 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:50.716531 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2514) took 1616 ms. Trace:
W20260709 12:23:50.719136 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 94587.2us
I20260709 12:23:50.674468 23018 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:23:50.724778 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 86424.7us
W20260709 12:23:50.724799 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 81906.9us
I20260709 12:23:50.684499 18676 rpcz_store.cc:276] 0709 12:23:49.330967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.331138 (+   171us) service_pool.cc:224] Handling call
0709 12:23:49.331514 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.305614 (+974100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.604787 (+299173us) spinlock_profiling.cc:243] Waited 963 ms on lock 0x7b54001c0f54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:50.604942 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2215184128}
I20260709 12:23:50.726613 18528 rpcz_store.cc:276] 0709 12:23:49.351663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.351842 (+   179us) service_pool.cc:224] Handling call
0709 12:23:50.583983 (+1232141us) spinlock_profiling.cc:243] Waited 884 us on lock 0x7b5800002798. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:23:50.584185 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.584366 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:50.584395 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:50.584439 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:50.584468 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.584520 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.584613 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2032896}
I20260709 12:23:50.741422 18679 rpcz_store.cc:276] 0709 12:23:49.099727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.100268 (+   541us) service_pool.cc:224] Handling call
0709 12:23:49.110341 (+ 10073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.110566 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:50.511313 (+1400747us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b1800417760. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc7c0874bc 00007efc793d548b 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793ef455 00007efc7fed73c7 00007efc7c4e99a7 00007efc7c4f90bf
0709 12:23:50.511476 (+   163us) log.cc:844] Serialized 14 byte log entry
0709 12:23:50.716059 (+204583us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:50.716137 (+    78us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:50.716194 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.716277 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.716441 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14367,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":114,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":121,"spinlock_wait_cycles":4840192,"thread_start_us":274414,"threads_started":2}
I20260709 12:23:50.745735 18526 raft_consensus.cc:2410] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:23:50.673310 23103 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.751835 18597 raft_consensus.cc:1240] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 15. Current term is 16. Ops: []
W20260709 12:23:50.755057 19210 leader_election.cc:336] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Timed out: RequestConsensusVote RPC to 127.16.240.130:37079 timed out after 1.654s (SENT)
I20260709 12:23:50.755434 19210 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:50.757993 18572 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:50.719341 22864 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:50.733250 23111 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.007s	sys 0.008s
I20260709 12:23:50.775897 18526 raft_consensus.cc:1275] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:50.714238 23085 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:23:50.761581 18644 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:50.781219 18644 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:50.725528 23070 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:50.750597 23059 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.766743 22774 consensus_queue.cc:1059] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:50.800123 18526 raft_consensus.cc:1240] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:50.768383 22864 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:50.726366 22834 raft_consensus.cc:740] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:23:50.773154 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 62764.9us
I20260709 12:23:50.804462 23059 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.805258 22834 consensus_queue.cc:260] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.775199 18672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2522) took 1443 ms. Trace:
I20260709 12:23:50.733096 22974 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:50.806542 22834 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:50.806706 23059 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:50.735016 23028 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.008s	sys 0.015s
I20260709 12:23:50.807001 22974 raft_consensus.cc:697] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:50.808024 22974 consensus_queue.cc:237] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:50.711333 22911 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.732924 23104 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:50.815356 23104 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:50.815837 23104 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:50.816186 22911 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:50.817957 18598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 2301) took 2006 ms. Trace:
I20260709 12:23:50.732173 22738 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:50.818879 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2873) took 1094 ms. Trace:
I20260709 12:23:50.818392 18598 rpcz_store.cc:276] 0709 12:23:48.811164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.094313 (+283149us) service_pool.cc:224] Handling call
0709 12:23:49.094639 (+   326us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:49.218473 (+123834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.218505 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:49.245095 (+ 26590us) log.cc:844] Serialized 52 byte log entry
0709 12:23:49.313798 (+ 68703us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:49.313836 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.313907 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:50.612849 (+1298942us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:23:50.817631 (+204782us) raft_consensus.cc:1685] finished
0709 12:23:50.817654 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.817896 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10524,"raft.queue_time_us":31682,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":146,"spinlock_wait_cycles":31399296,"thread_start_us":155493,"threads_started":2,"wal-append.queue_time_us":270148}
I20260709 12:23:50.717515 23112 consensus_queue.cc:1059] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:23:50.783668 19246 raft_consensus.cc:1275] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:50.820470 22738 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:50.765467 23146 raft_consensus.cc:2749] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:50.794039 23085 consensus_queue.cc:1059] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:50.794100 22866 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:50.764760 23066 consensus_queue.cc:1059] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:23:50.761447 23018 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:50.795089 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:50.795353 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:50.823467 19242 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:50.787539 23070 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:50.823732 23018 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:50.824163 23070 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:50.735945 23073 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:50.826205 23073 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:50.765132 23052 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:23:50.796350 18572 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:50.764353 23076 consensus_queue.cc:1059] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 12:23:50.828833 23076 raft_consensus.cc:3055] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:50.829236 23076 raft_consensus.cc:740] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:50.830188 23076 consensus_queue.cc:260] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:50.789956 22855 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.796891 22875 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:50.832178 22855 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:50.832747 23101 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:50.767843 23167 log.cc:927] Time spent T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:23:50.834475 22864 raft_consensus.cc:3055] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:50.834955 22864 raft_consensus.cc:740] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:50.835780 23103 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:50.787170 23094 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:50.790213 23100 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:50.786815 19212 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:50.836970 23100 raft_consensus.cc:697] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:50.836719 23094 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:50.837329 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 50576us
I20260709 12:23:50.837888 23100 consensus_queue.cc:237] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.838853 23094 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:50.790449 23040 consensus_queue.cc:1048] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:23:50.803941 23068 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:50.714110 23099 consensus_queue.cc:1059] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:23:50.840760 23068 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:50.841076 23099 consensus_queue.cc:1243] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer a0dee333a83a45f1ab0c1bb6d094afd1 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:23:50.841238 23068 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:50.841701 23099 raft_consensus.cc:3055] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:50.842051 23099 raft_consensus.cc:740] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:50.842911 23099 consensus_queue.cc:260] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.805647 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:50.820639 23112 raft_consensus.cc:3055] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:50.844127 23112 raft_consensus.cc:740] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:50.844913 23112 consensus_queue.cc:260] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.721027 23105 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.846378 23066 raft_consensus.cc:3055] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:50.846843 23066 raft_consensus.cc:740] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:50.847816 23066 consensus_queue.cc:260] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.849159 23066 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:50.789742 23075 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:50.850606 23075 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:50.851080 23075 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:50.806186 18672 rpcz_store.cc:276] 0709 12:23:49.331988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.332118 (+   130us) service_pool.cc:224] Handling call
0709 12:23:49.352245 (+ 20127us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.361184 (+  8939us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.361216 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:49.387353 (+ 26137us) log.cc:844] Serialized 26 byte log entry
0709 12:23:49.717257 (+329904us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:49.717303 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.717378 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:50.615339 (+897961us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:23:50.761941 (+146602us) raft_consensus.cc:1685] finished
0709 12:23:50.761961 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.775113 (+ 13152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20880,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":62,"spinlock_wait_cycles":81904512,"thread_start_us":240309,"threads_started":1,"wal-append.queue_time_us":370963}
I20260709 12:23:50.791941 23084 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:50.835839 22864 consensus_queue.cc:260] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:50.914350 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 118080us
I20260709 12:23:50.831511 23076 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:50.859968 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:50.856303 23112 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:50.819471 18523 rpcz_store.cc:276] 0709 12:23:49.724218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.732000 (+  7782us) service_pool.cc:224] Handling call
0709 12:23:49.732482 (+   482us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:49.733675 (+  1193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.733714 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:49.748930 (+ 15216us) log.cc:844] Serialized 52 byte log entry
0709 12:23:49.986257 (+237327us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:49.996420 (+ 10163us) log.cc:844] Serialized 14 byte log entry
0709 12:23:49.996642 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.996716 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:50.617455 (+620739us) spinlock_profiling.cc:243] Waited 8.48 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:23:50.818564 (+201109us) raft_consensus.cc:1685] finished
0709 12:23:50.818665 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.818821 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9974,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":4662,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":8353,"spinlock_wait_cycles":19510016,"thread_start_us":205457,"threads_started":1,"wal-append.queue_time_us":519423}
I20260709 12:23:50.860699 18423 catalog_manager.cc:5697] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 11 to 12, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 12 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:50.918987 18526 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:23:50.783653 18525 raft_consensus.cc:1275] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:23:50.903579 18530 raft_consensus.cc:3055] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:50.912302 18522 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:50.914367 19242 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
W20260709 12:23:50.924332 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.925282 19244 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:50.922834 18530 raft_consensus.cc:740] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:23:50.926819 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 121238us
I20260709 12:23:50.927685 18570 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:23:50.743551 18424 rpcz_store.cc:269] 0709 12:23:37.480808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.531343 (+ 50535us) service_pool.cc:224] Handling call
0709 12:23:50.707875 (+13176532us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:46.636533 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:46.656950 (+ 20417us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:46.657147 (+   197us) write_op.cc:435] Acquired schema lock
0709 12:23:46.657196 (+    49us) tablet.cc:662] Decoding operations
0709 12:23:46.666902 (+  9706us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:46.667025 (+   123us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:46.667053 (+    28us) tablet.cc:685] Acquiring locks for 26 operations
0709 12:23:46.678728 (+ 11675us) tablet.cc:701] Row locks acquired
0709 12:23:46.678780 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:23:46.679047 (+   267us) write_op.cc:270] Start()
0709 12:23:46.679213 (+   166us) write_op.cc:276] Timestamp: P: 1783599826678912 usec, L: 0
0709 12:23:46.679257 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 12:23:46.698007 (+ 18750us) log.cc:844] Serialized 10361 byte log entry
0709 12:23:47.289678 (+591671us) op_driver.cc:464] REPLICATION: finished
0709 12:23:47.534602 (+244924us) write_op.cc:301] APPLY: starting
0709 12:23:47.534723 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:47.640985 (+106262us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:47.641129 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:48.101232 (+460103us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:48.101818 (+   586us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=52
0709 12:23:48.101889 (+    71us) write_op.cc:312] APPLY: finished
0709 12:23:48.102718 (+   829us) log.cc:844] Serialized 332 byte log entry
0709 12:23:48.102924 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:48.103135 (+   211us) write_op.cc:454] Released schema lock
0709 12:23:48.103225 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:48.151506 (+ 48281us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:48.155607 (+  4101us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":837619,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":229558,"apply.run_cpu_time_us":32602,"apply.run_wall_time_us":583338,"cfile_cache_hit":50,"cfile_cache_hit_bytes":52325,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6220,"cfile_init":1,"lbm_read_time_us":978,"lbm_reads_lt_1ms":8,"num_ops":26,"prepare.queue_time_us":169136,"prepare.run_cpu_time_us":29105,"prepare.run_wall_time_us":148492,"raft.queue_time_us":150695,"raft.run_cpu_time_us":31011,"raft.run_wall_time_us":152719,"replication_time_us":610213,"thread_start_us":383792,"threads_started":4,"wal-append.queue_time_us":149577,"wal-append.run_cpu_time_us":34005,"wal-append.run_wall_time_us":2252708}]]}
I20260709 12:23:50.929010 23105 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:50.930066 23075 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.919965 22875 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:50.932595 22886 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:50.932993 22875 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:50.933388 22875 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:50.926290 22815 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.933969 18530 consensus_queue.cc:260] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.934868 22815 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:50.935326 18530 raft_consensus.cc:3060] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:50.937764 22911 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.938268 22911 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.938997 23129 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:50.938570 23062 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:50.939944 23062 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:50.940320 23062 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:50.940632 18572 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:50.941776 18572 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:50.942878 18572 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:50.945777 23068 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.946386 23109 consensus_queue.cc:1048] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:50.924108 23094 raft_consensus.cc:2764] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:23:50.948022 23128 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:50.948488 23128 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:50.948860 23128 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:50.949841 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.950769 22855 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:50.943702 18572 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:50.952385 18423 catalog_manager.cc:5697] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 10 to 11, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 11 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:50.922686 18525 pending_rounds.cc:85] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 6
I20260709 12:23:50.954800 18525 pending_rounds.cc:107] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:23:50.955118 18525 raft_consensus.cc:2889] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:50.956910 18423 catalog_manager.cc:5697] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 6 to 7, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 7 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:50.958859 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 246462us
I20260709 12:23:50.962056 18530 raft_consensus.cc:1275] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:23:50.962402 18530 pending_rounds.cc:85] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 7
I20260709 12:23:50.962997 18530 pending_rounds.cc:107] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:23:50.963315 18530 raft_consensus.cc:2889] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:50.960632 18494 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:50.927436 22864 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:50.927263 23099 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:50.964861 18494 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:23:50.971307 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 190172us
I20260709 12:23:50.974120 23052 raft_consensus.cc:3055] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:50.974220 23070 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:50.970439 22373 consensus_queue.cc:1048] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:23:50.970125 22872 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:50.974741 23052 raft_consensus.cc:740] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:50.977452 18494 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:50.979843 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:50.987371 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:50.980506 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.986128 22872 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:50.986440 23170 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:23:50.987723 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.995343 19212 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:50.963296 23087 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:50.977146 18423 catalog_manager.cc:5697] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 7 to 9, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 9 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:50.994822 18644 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:51.007627 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:50.969260 23172 raft_consensus.cc:2764] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:23:50.971012 23068 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:51.013001 18570 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:51.021651 18572 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:50.965373 23059 consensus_queue.cc:1048] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:23:51.011207 22834 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:51.028501 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 51124.1us
I20260709 12:23:51.002076 22872 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:51.032406 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.035559 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:51.034564 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:51.036208 18598 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 12.
I20260709 12:23:51.005888 23087 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.041067 18676 raft_consensus.cc:2393] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 13: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:51.038833 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:51.012923 23073 raft_consensus.cc:2804] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:51.012389 23170 raft_consensus.cc:697] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:51.002102 23066 consensus_queue.cc:1059] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:23:51.052201 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:51.020030 22738 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:51.051442 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:51.056299 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:51.057013 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:23:51.058997 18494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.060863 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:51.060879 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:51.067772 18601 raft_consensus.cc:2368] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 15. Current term is 16.
I20260709 12:23:51.068346 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:51.069907 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:51.074090 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:51.043433 23087 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:51.075730 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:51.013588 23104 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:51.076591 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:23:51.091246 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.092412 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:51.093202 18678 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 12.
I20260709 12:23:51.049456 23130 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:51.023301 22524 consensus_queue.cc:1059] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:23:51.043358 23075 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:51.075363 23126 consensus_queue.cc:1048] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 12:23:51.052774 23061 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:51.061087 22834 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:23:51.112183 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.115850 23082 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:51.116707 23082 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.117156 23130 raft_consensus.cc:697] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:51.117379 23082 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:51.118173 23130 consensus_queue.cc:237] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:51.099116 22738 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:51.129884 22738 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:51.130350 19210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.082244 23073 raft_consensus.cc:697] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:51.134038 22834 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:51.048229 22886 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:51.048974 23052 consensus_queue.cc:260] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:51.135800 23052 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:51.136307 22834 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:51.142370 23158 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:51.144652 23158 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:51.063323 22911 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:51.145793 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:51.146023 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:51.146209 18677 raft_consensus.cc:1240] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:23:51.094074 23172 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.147050 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:51.147181 23172 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:51.147835 23136 consensus_queue.cc:1175] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" responder_term: 9 status { last_received { term: 9 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 9 index: 6 } }
I20260709 12:23:51.148240 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:51.148550 18680 raft_consensus.cc:1240] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:23:51.149395 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:51.149634 23172 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:51.134475 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.150205 18678 raft_consensus.cc:2410] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:23:51.150503 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.150902 18528 raft_consensus.cc:1240] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:51.055140 23068 consensus_queue.cc:1048] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:23:51.152582 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:51.154052 18680 raft_consensus.cc:1240] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:51.150050 18677 raft_consensus.cc:1240] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:51.157392 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:51.158082 18676 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:51.107662 18423 catalog_manager.cc:5697] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:51.162384 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:51.163049 18672 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 12.
I20260709 12:23:51.166841 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:51.169245 23073 consensus_queue.cc:237] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:51.170096 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:51.170819 19244 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:23:51.172531 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:51.173120 23100 raft_consensus.cc:3055] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:51.173553 23100 raft_consensus.cc:740] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:51.174396 23100 consensus_queue.cc:260] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:51.104292 23173 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:51.177738 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:51.177862 23173 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:51.168385 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:51.181145 18598 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:23:51.183218 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:51.185281 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:51.187547 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:51.188357 18603 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:51.104461 23070 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:51.192144 23170 consensus_queue.cc:237] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:51.195348 22373 raft_consensus.cc:3055] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:51.195909 22373 raft_consensus.cc:740] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:51.196714 22373 consensus_queue.cc:260] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:51.197162 23104 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:51.198167 22373 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:51.203836 22524 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:51.204447 22524 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:51.206744 22524 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:51.208752 22815 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:51.217232 23128 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:51.219604 18597 raft_consensus.cc:1240] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 12. Current term is 13. Ops: []
W20260709 12:23:51.222875 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.224777 23128 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:51.229884 22875 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:51.260797 22875 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:51.163304 18423 catalog_manager.cc:5697] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 8 to 9, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 9 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:51.234404 23100 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:51.081496 18494 connection.cc:256] RPC call timeout handler was delayed by -1.5497942209999565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
W20260709 12:23:51.265432 18494 connection.cc:256] RPC call timeout handler was delayed by -1.5137942209998982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260709 12:23:51.265928 18494 connection.cc:256] RPC call timeout handler was delayed by -1.422894221000206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
W20260709 12:23:51.266618 18494 connection.cc:256] RPC call timeout handler was delayed by -1.3823942210001405s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 12:23:51.267038 18494 connection.cc:256] RPC call timeout handler was delayed by -1.2968942210000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18660000000000002s for a response
W20260709 12:23:51.267473 18494 connection.cc:256] RPC call timeout handler was delayed by -1.2455942209999193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
W20260709 12:23:51.267905 18494 connection.cc:256] RPC call timeout handler was delayed by -1.2122942209998655s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
I20260709 12:23:51.268786 18494 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:51.249722 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:51.288141 18644 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:51.251179 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:51.252527 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:51.257334 23087 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:51.222924 23062 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:51.263448 18423 catalog_manager.cc:5697] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 9 to 11, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 11 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:23:51.299718 18494 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:51.245784 19210 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:51.292012 18598 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:51.305586 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 59882.3us
I20260709 12:23:51.308290 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:51.309473 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 287879us
I20260709 12:23:51.329417 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:51.330112 18601 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:51.219578 23173 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:51.334820 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:51.339391 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:51.340428 18528 raft_consensus.cc:2410] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:23:51.341120 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:51.341187 18494 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:51.341799 18526 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:51.345741 18530 raft_consensus.cc:1240] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:51.352471 18524 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:23:51.353873 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 340925us
I20260709 12:23:51.357462 18600 raft_consensus.cc:2393] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 13: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:51.358474 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:51.359889 18494 leader_election.cc:400] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 11. Current term is 12.
I20260709 12:23:51.360244 18494 leader_election.cc:403] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:23:51.360121 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:51.361133 18528 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:51.367621 18528 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:23:51.368896 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:51.369585 18528 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:51.303297 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:51.372661 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:51.303267 19242 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 12.
I20260709 12:23:51.329859 23076 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:23:51.389643 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.308957 23112 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:51.308055 23068 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:51.394549 18598 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 13.
I20260709 12:23:51.379290 23099 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:51.353596 23172 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:51.402199 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.308176 22864 consensus_queue.cc:1059] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
W20260709 12:23:51.419190 18646 leader_election.cc:336] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.542s (SENT)
I20260709 12:23:51.353143 23128 consensus_queue.cc:1048] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:23:51.416043 18570 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:51.335811 23105 consensus_queue.cc:1059] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:23:51.424492 18644 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:51.356446 22875 consensus_queue.cc:1059] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:23:51.338966 23136 consensus_queue.cc:1048] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:23:51.416476 18601 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
W20260709 12:23:51.488246 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:51.521672 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:51.477962 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.471472 18526 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 16.
W20260709 12:23:51.491849 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 72689.1us
I20260709 12:23:51.500921 18528 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
W20260709 12:23:51.397441 22974 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.003s	sys 0.064s
I20260709 12:23:51.381763 23173 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:51.589115 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.570873 18605 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
W20260709 12:23:51.584424 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 159072us
I20260709 12:23:51.398300 23076 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.554039 22738 raft_consensus.cc:3055] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:51.423549 23103 raft_consensus.cc:2749] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 11. Current term is 12.
I20260709 12:23:51.403445 23068 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:51.597783 22974 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.017s	sys 0.068s
W20260709 12:23:51.632611 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.633190 18644 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:51.594718 22864 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:51.554317 22911 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:51.400803 22524 consensus_queue.cc:1059] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.202s
I20260709 12:23:51.626502 23018 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.638285 18572 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:51.631001 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 226815us
I20260709 12:23:51.422662 23104 consensus_queue.cc:1059] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.214s
I20260709 12:23:51.464478 23082 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:51.392427 22872 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:51.606683 22738 raft_consensus.cc:740] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:51.637398 23068 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:51.628775 23076 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:51.637106 23040 raft_consensus.cc:3055] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:23:51.687422 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:51.727258 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.639899 23129 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:51.749728 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:51.684365 23179 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:23:51.610198 23173 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:51.732610 22872 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:51.733507 22738 consensus_queue.cc:260] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:51.736632 23181 log.cc:927] Time spent T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:23:51.740250 23040 raft_consensus.cc:740] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:51.684268 23126 consensus_queue.cc:1059] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:23:51.741811 18603 raft_consensus.cc:1240] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:23:51.649181 23087 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:51.775985 23040 consensus_queue.cc:260] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:51.777499 23040 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:51.745488 23082 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:51.685341 23018 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:51.649456 23180 log.cc:927] Time spent T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:23:51.782056 23018 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:51.782644 23018 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:51.783142 23018 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:51.785960 23018 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:51.750538 18528 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:51.755278 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 117072us
I20260709 12:23:51.798580 18572 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:51.715621 22864 raft_consensus.cc:697] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:51.801007 23128 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:51.800885 22864 consensus_queue.cc:237] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:51.801594 23128 raft_consensus.cc:697] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:51.802465 23128 consensus_queue.cc:237] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:51.803803 18572 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:51.804584 23062 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:51.805512 23062 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:51.806157 23062 raft_consensus.cc:697] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:51.649966 23070 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:51.647423 22911 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:51.764634 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 115898us
I20260709 12:23:51.740236 22373 raft_consensus.cc:3055] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:51.765633 23052 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:51.766129 23065 consensus_queue.cc:1059] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:51.770658 18600 raft_consensus.cc:1275] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:23:51.775236 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:51.846905 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.787601 23103 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:51.810122 18528 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:23:51.644032 23059 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:51.810915 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:51.822729 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 462959us
I20260709 12:23:51.823143 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:51.854600 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:51.855163 18530 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:51.755939 22774 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:51.877002 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:51.879674 18525 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:51.870481 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:51.881731 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:51.833454 22373 raft_consensus.cc:740] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:51.856828 22738 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:51.759699 23129 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:51.891244 18494 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:51.875949 23070 raft_consensus.cc:697] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:51.896590 18530 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:51.898921 18530 raft_consensus.cc:1275] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:51.900286 18572 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:51.897469 18644 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:51.902920 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 79985.6us
I20260709 12:23:51.925993 18525 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
W20260709 12:23:51.948223 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 44580.3us
I20260709 12:23:51.890249 23052 raft_consensus.cc:697] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:51.879804 22774 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:51.950747 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 296481us
W20260709 12:23:51.951953 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 51741us
I20260709 12:23:51.970165 18572 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:51.952359 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:51.903650 23105 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:51.979003 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.893257 23112 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:51.982434 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:51.983093 19242 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEARNER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:23:51.983249 19240 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:51.987226 18522 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.042s	sys 0.067s
I20260709 12:23:51.885761 23073 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:23:51.898393 22872 raft_consensus.cc:3055] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:51.972432 19244 raft_consensus.cc:2393] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 12: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:51.886164 23103 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:51.876371 23062 consensus_queue.cc:237] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:51.965807 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 74648.5us
I20260709 12:23:51.994729 18572 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:51.987959 18522 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.042s	sys 0.067s
W20260709 12:23:51.978750 23186 log.cc:927] Time spent T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 12:23:51.949213 22524 consensus_queue.cc:1059] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:23:51.972012 22834 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:51.985843 22875 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:52.012638 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:52.010390 18494 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:51.973863 23104 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:23:51.963816 22373 consensus_queue.cc:260] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:52.000877 23087 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:51.993299 22872 raft_consensus.cc:740] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:52.022852 18494 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:52.027892 19242 raft_consensus.cc:1275] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:52.028795 18494 leader_election.cc:400] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 15. Current term is 16.
I20260709 12:23:52.029213 18494 leader_election.cc:403] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:23:52.017877 23178 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:52.002297 23170 consensus_queue.cc:1059] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:23:52.019078 23188 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:52.033423 23112 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:52.009913 23109 consensus_queue.cc:1048] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:23:52.041675 23158 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 15. Current term is 16.
I20260709 12:23:51.998689 23070 consensus_queue.cc:237] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:52.034556 22875 raft_consensus.cc:697] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:52.096458 22875 consensus_queue.cc:237] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:52.041700 23129 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:52.091133 23100 consensus_meta.cc:287] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.827s	user 0.011s	sys 0.004s
I20260709 12:23:52.072340 23173 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:52.102010 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.105423 19240 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:52.078251 23112 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:52.075738 23201 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:52.085275 23073 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:52.043147 23052 consensus_queue.cc:237] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:52.208976 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:23:52.187006 23192 log.cc:927] Time spent T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 12:23:52.085937 22911 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:23:52.206246 23073 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:52.218421 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:52.221630 18527 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:23:52.102653 22774 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:52.112156 23158 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:52.240787 18495 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:57384 dropped due to backpressure: service queue is full with 50 items [suppressed 2 similar messages]
I20260709 12:23:52.240499 23201 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:23:52.243564 23201 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:52.199869 23112 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:52.253844 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 395055us
W20260709 12:23:52.251763 23068 consensus_meta.cc:287] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.002s
W20260709 12:23:52.254503 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.274611 23087 raft_consensus.cc:697] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:52.274835 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:52.276901 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.234041 23170 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.098497 22872 consensus_queue.cc:260] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:52.286206 18646 leader_election.cc:336] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.751s (SENT)
I20260709 12:23:52.249627 22774 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.305565 18646 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:52.241257 18495 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:57384 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2236)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2204)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2226)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2213)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2201)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2229)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2218)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2235)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2202)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2206)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2219)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2241)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2234)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2230)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2222)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2220)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2231)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2214)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2216)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2227)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2215)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2238)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2239)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57384 (request call id 2942)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2225)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2228)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2221)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2208)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2209)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2232)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2224)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2940)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 966)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 967)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 968)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2941)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 969)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 970)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 2203)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 2205)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 2207)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 2210)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 2211)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 2212)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 972)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 973)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 974)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 2233)
W20260709 12:23:52.310127 18646 leader_election.cc:336] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.881s (SENT)
I20260709 12:23:52.276239 23201 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:52.313131 18645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.002s	sys 0.014s
W20260709 12:23:52.320066 18645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.002s	sys 0.014s
W20260709 12:23:52.322167 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.290099 23130 raft_consensus.cc:3055] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:52.327172 18677 raft_consensus.cc:1275] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:23:52.306227 23109 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:52.307803 23040 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:52.308626 22864 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:52.333434 18674 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:23:52.349242 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2918) took 1011 ms. Trace:
I20260709 12:23:52.359269 18527 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 12.
I20260709 12:23:52.358361 18523 rpcz_store.cc:276] 0709 12:23:51.337567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.342607 (+  5040us) service_pool.cc:224] Handling call
0709 12:23:51.343043 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:51.359334 (+ 16291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:51.359363 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:51.379314 (+ 19951us) log.cc:844] Serialized 26 byte log entry
0709 12:23:51.758570 (+379256us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:51.758632 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.758729 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:52.349021 (+590292us) raft_consensus.cc:1685] finished
0709 12:23:52.349044 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:52.349179 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15844,"raft.queue_time_us":30371,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":11299,"thread_start_us":247987,"threads_started":1,"wal-append.queue_time_us":520795}
I20260709 12:23:52.360821 19212 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:52.307986 23178 raft_consensus.cc:697] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:52.333801 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:52.247838 23158 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:52.374295 18673 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:52.324702 23103 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:52.375159 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:52.393699 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:52.394423 18673 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:52.309532 22774 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:52.330428 23130 raft_consensus.cc:740] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:52.288334 23068 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:52.415426 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.416926 18673 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:23:52.418448 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:52.423406 18673 raft_consensus.cc:2410] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:23:52.319216 23170 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:52.328136 23201 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:52.425943 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:52.389127 23200 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:52.428674 18679 raft_consensus.cc:2393] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 13: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:52.396911 23100 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:52.402222 22866 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.014s	sys 0.044s
W20260709 12:23:52.432595 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 98052.1us
I20260709 12:23:52.395941 23214 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:52.352273 23109 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:52.371589 23040 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:52.376658 22864 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:52.441855 22866 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.015s	sys 0.044s
I20260709 12:23:52.450146 18601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:52.450821 18601 raft_consensus.cc:606] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:23:52.451339 22738 consensus_meta.cc:287] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.000s
I20260709 12:23:52.449494 18673 raft_consensus.cc:2410] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 12:23:52.454034 18646 leader_election.cc:336] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.740s (SENT)
I20260709 12:23:52.454160 23130 consensus_queue.cc:260] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:52.454753 18646 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:52.455910 23130 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:52.456265 18680 raft_consensus.cc:2410] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 12:23:52.457296 23208 log.cc:927] Time spent T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
W20260709 12:23:52.459156 23211 log.cc:927] Time spent T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:23:52.444936 23178 consensus_queue.cc:237] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:52.462456 18529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2913) took 1126 ms. Trace:
I20260709 12:23:52.462889 18529 rpcz_store.cc:276] 0709 12:23:51.336073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.336190 (+   117us) service_pool.cc:224] Handling call
0709 12:23:51.385791 (+ 49601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:51.386220 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:51.806674 (+420454us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b18003aeac0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc7936cc0a 00007efc82aac219 00007efc793f4a40 00007efc793ef4e4 00007efc793ef455 00007efc7fed73c7 00007efc7c4e99a7 00007efc7c4f90bf 00007efc7c4f9038
0709 12:23:52.042868 (+236194us) log.cc:844] Serialized 14 byte log entry
0709 12:23:52.363524 (+320656us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:52.364190 (+   666us) log.cc:844] Serialized 26 byte log entry
0709 12:23:52.364376 (+   186us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:52.364424 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.364519 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:52.462137 (+ 97618us) raft_consensus.cc:1685] finished
0709 12:23:52.462249 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:52.462389 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22827,"prepare.queue_time_us":581747,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":7493,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":16831,"spinlock_wait_cycles":45086080,"thread_start_us":530260,"threads_started":3,"wal-append.queue_time_us":335688}
I20260709 12:23:52.470000 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:52.420331 23087 consensus_queue.cc:237] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:52.472018 23224 raft_consensus.cc:2749] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:52.474282 23109 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:52.476038 23201 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:52.476168 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.471429 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:52.447628 23076 consensus_meta.cc:287] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.712s	user 0.005s	sys 0.007s
W20260709 12:23:52.479938 18646 leader_election.cc:336] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.905s (SENT)
I20260709 12:23:52.483155 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:52.483371 18646 leader_election.cc:336] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.930s (SENT)
I20260709 12:23:52.483785 18646 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:52.441578 23200 raft_consensus.cc:697] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
W20260709 12:23:52.476819 23207 log.cc:927] Time spent T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:23:52.484862 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.485841 23073 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:52.486011 18601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:52.502542 18601 raft_consensus.cc:606] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:52.502969 18601 raft_consensus.cc:614] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:52.440133 23100 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:52.525533 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.520803 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:52.526546 18672 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:52.520004 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:23:52.502394 23198 log.cc:927] Time spent T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 12:23:52.526558 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.529897 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:52.533847 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:23:52.508780 18646 leader_election.cc:336] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.892s (SENT)
I20260709 12:23:52.535192 18646 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:52.536381 23066 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:52.539520 18646 leader_election.cc:336] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 2.411s (SENT)
W20260709 12:23:52.510743 23210 log.cc:927] Time spent T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:23:52.528486 23217 log.cc:927] Time spent T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:23:52.512041 23092 raft_consensus.cc:3055] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:52.511332 23108 raft_consensus.cc:3055] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:52.550168 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:52.560866 18674 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:52.560994 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:52.562008 18529 raft_consensus.cc:2368] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12.
W20260709 12:23:52.556687 18646 leader_election.cc:336] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.943s (SENT)
I20260709 12:23:52.511018 22864 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:52.522746 23100 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:52.547628 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.507638 23230 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:52.490741 23076 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:52.568636 18528 raft_consensus.cc:2393] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 13: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
W20260709 12:23:52.573486 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.578047 18601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:52.578778 18601 raft_consensus.cc:606] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:52.579175 18601 raft_consensus.cc:614] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:23:52.579399 23197 log.cc:927] Time spent T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.492s	user 0.002s	sys 0.000s
I20260709 12:23:52.545248 23229 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:52.559698 23092 raft_consensus.cc:740] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:52.584404 19246 raft_consensus.cc:1240] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:52.565644 23108 raft_consensus.cc:740] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:52.532505 23112 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:52.580727 23185 log.cc:927] Time spent T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.952s	user 0.005s	sys 0.000s
I20260709 12:23:52.587059 18674 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:23:52.592633 18672 raft_consensus.cc:2410] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:23:52.593341 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:52.591172 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.587270 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:52.595583 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:52.596055 23070 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.003s	sys 0.013s
W20260709 12:23:52.596443 23070 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.003s	sys 0.013s
I20260709 12:23:52.597019 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.595088 18674 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:52.598783 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.582852 23100 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.608791 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.609120 18674 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:52.607481 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:52.516472 23200 consensus_queue.cc:237] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:52.593881 23068 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:52.612151 18523 raft_consensus.cc:2393] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 13: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:52.619920 18528 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:52.612638 18525 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:52.611145 23100 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:52.625382 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.625556 22774 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:52.626178 18530 raft_consensus.cc:2393] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 12: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:52.626765 23100 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:52.627177 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.628746 23092 consensus_queue.cc:260] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:52.630213 23092 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:52.630249 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:52.631057 18529 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:23:52.628197 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:52.590807 23229 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:52.633386 23040 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:52.634018 23229 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:52.634341 22886 raft_consensus.cc:3055] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:52.634754 22886 raft_consensus.cc:740] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:52.635192 18521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2914) took 1298 ms. Trace:
I20260709 12:23:52.631903 22815 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.636412 23170 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:52.636519 22815 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:52.605710 23158 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:52.639158 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:52.642736 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.623447 22872 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:52.635790 22886 consensus_queue.cc:260] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:52.645108 18528 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:52.649637 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.650800 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.660559 18528 raft_consensus.cc:2410] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:23:52.658393 18522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2916) took 1321 ms. Trace:
I20260709 12:23:52.659981 18530 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 4.
I20260709 12:23:52.661084 18522 rpcz_store.cc:276] 0709 12:23:51.336941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.337042 (+   101us) service_pool.cc:224] Handling call
0709 12:23:51.384757 (+ 47715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:51.385041 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:51.996976 (+611935us) log.cc:844] Serialized 14 byte log entry
0709 12:23:52.320573 (+323597us) log.cc:844] Serialized 14 byte log entry
0709 12:23:52.657940 (+337367us) spinlock_profiling.cc:243] Waited 9.34 ms on lock 0x7b18002d4480. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc7c0874bc 00007efc793d548b 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793ef455 00007efc7c4d7060 00007efc7c4e9716 00007efc7c4fa287
0709 12:23:52.658038 (+    98us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:52.658089 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:52.658148 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.658216 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:52.658336 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19065,"prepare.queue_time_us":520472,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":2317,"raft.queue_time_us":58017,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":40976,"spinlock_wait_cycles":52395520,"thread_start_us":959330,"threads_started":3,"wal-append.queue_time_us":442308}
W20260709 12:23:52.655149 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.639890 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.664912 19212 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:52.665447 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.635574 18521 rpcz_store.cc:276] 0709 12:23:51.336359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.336472 (+   113us) service_pool.cc:224] Handling call
0709 12:23:51.336774 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:51.373461 (+ 36687us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:51.576536 (+203075us) log.cc:844] Serialized 14 byte log entry
0709 12:23:51.743170 (+166634us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b48003603d8. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc81408aa1 00007efc813ffb37 00007efc813ff9ca 00007efc814f726f 00007efc814f6f37 00007efc8150b55c 00007efc8150b508 00007efc8150b488 00007efc8150b443 00007efc8150a6ec 00007efc80434a96
0709 12:23:51.952588 (+209418us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:51.968208 (+ 15620us) log.cc:844] Serialized 26 byte log entry
0709 12:23:51.968416 (+   208us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:51.968466 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.968564 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:52.634813 (+666249us) raft_consensus.cc:1685] finished
0709 12:23:52.634917 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:52.635111 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67585,"prepare.queue_time_us":470975,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":44,"raft.queue_time_us":91798,"raft.run_cpu_time_us":3718,"raft.run_wall_time_us":357609,"spinlock_wait_cycles":9565440,"thread_start_us":491162,"threads_started":2,"wal-append.queue_time_us":503160}
I20260709 12:23:52.667520 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.668170 18525 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 4.
I20260709 12:23:52.668340 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:52.668907 18521 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:23:52.669174 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.669801 18525 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:52.664593 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:52.673094 18522 raft_consensus.cc:2410] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:23:52.676631 23076 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:52.677459 22834 raft_consensus.cc:3055] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:52.672420 22886 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:52.678027 22834 raft_consensus.cc:740] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:52.679100 22834 consensus_queue.cc:260] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:52.680647 22834 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:52.688678 22855 raft_consensus.cc:2804] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:52.689177 22855 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:52.689649 22855 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:52.692534 18605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40954 (request call id 2062) took 1636 ms (client timeout 1650 ms). Trace:
W20260709 12:23:52.693011 18605 rpcz_store.cc:269] 0709 12:23:51.056310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.073731 (+ 17421us) service_pool.cc:224] Handling call
0709 12:23:52.692354 (+1618623us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b5400246dd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:52.692469 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896678144}
I20260709 12:23:52.702153 18530 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:52.699518 18521 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 6.
W20260709 12:23:52.717190 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.722311 18530 raft_consensus.cc:1240] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 13. Ops: []
I20260709 12:23:52.724263 18530 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:23:52.726744 18530 pending_rounds.cc:85] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 4
I20260709 12:23:52.728139 18530 pending_rounds.cc:107] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:23:52.740775 18672 raft_consensus.cc:1275] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:52.638032 23108 consensus_queue.cc:260] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:52.806725 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.754364 22886 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:52.700083 22815 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:52.757171 23112 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:52.771447 18529 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:23:52.772104 18530 raft_consensus.cc:2889] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:52.813921 18521 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:52.816185 18529 raft_consensus.cc:1240] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:52.817487 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 152653us
I20260709 12:23:52.822615 18521 raft_consensus.cc:1240] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:23:52.824412 18672 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:23:52.824994 18521 raft_consensus.cc:1240] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:52.829025 18603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 2328) took 1638 ms. Trace:
I20260709 12:23:52.829463 18603 rpcz_store.cc:276] 0709 12:23:51.190418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.231321 (+ 40903us) service_pool.cc:224] Handling call
0709 12:23:51.231661 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:51.772195 (+540534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.828766 (+1056571us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b5400070dd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:52.828962 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1172537728}
W20260709 12:23:52.832305 18679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50938 (request call id 617) took 1531 ms (client timeout 1503 ms). Trace:
I20260709 12:23:52.832823 22855 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:52.835086 22855 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:52.832844 18679 rpcz_store.cc:269] 0709 12:23:51.300813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.303049 (+  2236us) service_pool.cc:224] Handling call
0709 12:23:52.832099 (+1529050us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003a1954. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:52.832236 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2411543296}
I20260709 12:23:52.839418 18603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f9c25fcde974c42918932833eac1523"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:52.840083 23108 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:52.840178 18603 raft_consensus.cc:606] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:52.817157 22886 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:52.850435 23059 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:23:52.843434 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.858072 18528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2940) took 1035 ms. Trace:
I20260709 12:23:52.245731 18494 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:57374 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2236)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2204)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2226)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2213)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2201)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2229)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2218)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2235)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2202)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2206)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2219)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2241)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2234)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2230)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2222)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2220)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2231)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2214)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2216)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2227)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2215)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2238)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2239)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57384 (request call id 2942)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2225)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2228)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2221)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2208)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2209)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2232)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2224)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2940)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 966)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 967)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 968)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2941)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 969)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 970)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 2203)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 2205)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 2207)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 2210)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 2211)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 2212)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 972)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 973)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 974)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57374 (request call id 2233)
I20260709 12:23:52.870232 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:52.870957 18526 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:52.871029 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.874110 18530 raft_consensus.cc:1240] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:52.897379 18526 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 7.
I20260709 12:23:52.901332 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.902503 18526 raft_consensus.cc:2393] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 13: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:52.902456 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.903829 18530 raft_consensus.cc:2393] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 9: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:52.870421 23059 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:52.907192 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:52.910280 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.910626 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.912434 18526 raft_consensus.cc:2393] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 10: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:52.916425 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.918561 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.919345 18530 raft_consensus.cc:2410] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:23:52.920177 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:52.913065 23109 raft_consensus.cc:993] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:23:52.931401 23059 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:52.925253 23070 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.919729 23220 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:23:52.937333 22886 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:52.939046 22886 raft_consensus.cc:993] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:23:52.940059 23128 raft_consensus.cc:1081] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:23:52.940452 22670 raft_consensus.cc:1081] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:23:52.941282 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.941588 23070 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:52.942520 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.944787 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.945684 18521 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:23:52.946846 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:52.948974 23184 log.cc:927] Time spent T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 1.202s	user 0.004s	sys 0.001s
I20260709 12:23:52.949329 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:52.950342 18603 raft_consensus.cc:2368] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 11. Current term is 12.
I20260709 12:23:52.951699 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:52.953933 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.955071 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:52.957190 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:52.958688 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.961499 19212 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:52.961958 23087 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.962682 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:52.962898 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:52.964035 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:52.974953 18603 raft_consensus.cc:2410] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:23:52.975194 18678 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:52.965526 18521 raft_consensus.cc:2410] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:23:52.966313 18601 raft_consensus.cc:1240] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:52.967043 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.943635 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.969678 18598 raft_consensus.cc:1240] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:52.970245 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.977289 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:52.977692 18522 raft_consensus.cc:2393] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 13: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:52.978046 18526 raft_consensus.cc:2410] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 12:23:52.972442 18605 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:23:52.973222 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.973235 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:52.978826 18529 raft_consensus.cc:2376] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12. Re-sending same reply.
I20260709 12:23:52.978955 18600 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:23:52.979065 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.979997 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.979002 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:52.980815 18529 raft_consensus.cc:2393] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 12: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:52.980743 18521 raft_consensus.cc:2376] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11. Re-sending same reply.
I20260709 12:23:52.982612 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:52.984656 18521 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:52.983871 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.987030 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:52.981217 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:52.987360 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:52.987733 18606 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 13.
I20260709 12:23:52.988030 18603 raft_consensus.cc:2410] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:23:52.986038 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:52.987236 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.990307 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:52.984725 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:52.983938 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:52.992018 18677 raft_consensus.cc:2393] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 11: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:52.977974 18674 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:52.991703 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.992709 18646 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:52.993909 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.994148 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:52.995052 18527 raft_consensus.cc:2393] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 13: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:52.997134 18529 raft_consensus.cc:3055] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:52.998334 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:52.998739 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:52.999202 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:53.002460 22855 raft_consensus.cc:2804] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:53.002986 22855 raft_consensus.cc:697] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:53.003301 18529 raft_consensus.cc:740] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:53.005398 22774 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:53.007650 18529 consensus_queue.cc:260] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:53.004096 22855 consensus_queue.cc:237] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:53.013959 23112 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:53.015015 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.991825 23040 consensus_queue.cc:1059] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:23:53.015902 23158 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:53.036609 23158 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:53.035068 23112 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:53.039058 23158 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:53.016793 22834 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:53.040184 22834 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:52.983477 23220 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.018929 23066 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:53.019990 18675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50938 (request call id 618) took 1388 ms. Trace:
I20260709 12:23:53.020294 18494 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
W20260709 12:23:53.048238 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.002929 18604 raft_consensus.cc:1275] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:53.022624 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:53.050469 18678 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:53.023604 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:53.024078 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:53.051816 18530 raft_consensus.cc:2393] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 8: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:53.024893 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:53.023102 18527 raft_consensus.cc:1240] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:53.025573 18599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:23:53.052913 18599 raft_consensus.cc:606] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:53.027766 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:53.030328 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:53.033653 18529 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:53.033960 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:53.054893 18600 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:53.034261 22373 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:53.017648 23170 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.033229 18522 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:23:53.048328 18675 rpcz_store.cc:276] 0709 12:23:51.631662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.632089 (+   427us) service_pool.cc:224] Handling call
0709 12:23:51.649678 (+ 17589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.209809 (+560131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:52.209842 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:52.209883 (+    41us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:52.209917 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.019734 (+809817us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b54000573d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:53.019806 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:53.019934 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97211,"raft.queue_time_us":100373,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":14470,"spinlock_wait_cycles":1071163776}
I20260709 12:23:53.044373 18646 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:53.063838 18646 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:53.065332 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:53.065822 18646 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:53.057924 18602 raft_consensus.cc:2410] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:23:53.054229 18674 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:23:53.067557 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:53.040060 23112 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:53.072100 18529 raft_consensus.cc:1275] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:53.036630 23229 raft_consensus.cc:3055] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:23:53.058326 23251 log.cc:927] Time spent T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:23:53.122167 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:53.162817 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 87558.5us
I20260709 12:23:53.165445 18494 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:53.168682 18494 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:53.170573 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 67098.9us
I20260709 12:23:53.172231 18646 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:52.983615 23087 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:53.191769 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 230333us
I20260709 12:23:53.173744 18646 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:53.057425 23066 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:53.072661 22911 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:53.201285 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:53.065237 23040 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:53.047520 23100 consensus_queue.cc:1059] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.147s
I20260709 12:23:53.109100 22864 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:53.108366 23112 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:53.203419 18602 raft_consensus.cc:2393] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 10: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
W20260709 12:23:53.221197 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.231889 18521 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:23:53.163115 23229 raft_consensus.cc:740] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:53.230023 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:53.061435 23220 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:53.233742 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:53.200683 23076 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.200657 23018 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:53.068629 23170 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:53.201157 23066 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:53.202623 23070 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:53.237848 22774 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:53.242885 23076 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:53.250976 23076 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:53.238377 23200 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.251992 23200 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:53.254604 23200 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:53.255874 22834 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:53.256523 22834 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:53.257210 22834 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:53.265805 23087 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:53.285741 18678 raft_consensus.cc:2468] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 13.
W20260709 12:23:53.292920 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 119249us
I20260709 12:23:53.308125 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:53.309625 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:53.244467 22774 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:53.327999 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 159510us
I20260709 12:23:53.329111 18494 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:53.330336 23227 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:53.332384 18494 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:53.333364 23227 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:53.333801 23227 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:53.334198 23227 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:53.341389 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.342304 18494 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:53.344375 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:53.344513 23179 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:53.344440 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:53.344906 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:53.345057 18530 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:53.345338 18606 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:23:53.345222 23179 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:53.346879 18530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f9c25fcde974c42918932833eac1523"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:23:53.347209 23085 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:53.349182 18521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:23:53.349749 18521 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:53.350100 18521 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:53.345628 18524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2236) took 1147 ms. Trace:
I20260709 12:23:53.352823 18524 rpcz_store.cc:276] 0709 12:23:52.198053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.344688 (+1146635us) service_pool.cc:224] Handling call
0709 12:23:53.345569 (+   881us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:53.347478 18530 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:53.326248 22774 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:53.354975 18530 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:53.359107 18494 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:23:53.362738 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 333734us
I20260709 12:23:53.347540 23179 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:53.366565 18606 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 13.
I20260709 12:23:53.368932 18521 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:53.370055 18524 raft_consensus.cc:1240] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:53.375543 18570 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:53.377229 18570 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:53.379455 18521 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:53.354663 22834 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:53.395248 18570 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:53.385270 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:53.418493 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:53.419450 19244 raft_consensus.cc:3060] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:53.425607 18570 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:53.426874 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:53.427839 19242 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:53.428462 22886 consensus_queue.cc:1048] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:53.427923 23130 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:53.440838 22872 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:53.441874 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:53.442260 22872 raft_consensus.cc:697] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:53.442641 18603 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:23:53.443254 22872 consensus_queue.cc:237] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:53.444679 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:53.445869 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:53.446009 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:53.448019 19244 raft_consensus.cc:2468] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 13.
I20260709 12:23:53.451320 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:53.370193 23112 raft_consensus.cc:697] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:53.482156 18530 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:53.485100 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:53.343160 23227 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:53.489627 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:53.356603 23085 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:53.420053 23092 raft_consensus.cc:2764] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:23:53.497733 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:53.430290 23087 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:23:53.485643 23219 log.cc:927] Time spent T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:23:53.456444 23105 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.502655 18602 raft_consensus.cc:2393] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 13: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:53.506245 18599 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:23:53.508273 18600 raft_consensus.cc:2393] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 12: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:53.510196 18530 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:53.510231 18679 raft_consensus.cc:1240] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:53.430495 22834 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:53.514158 19210 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.240.130:37079 timed out after 1.503s (SENT) [suppressed 32 similar messages]
I20260709 12:23:53.511554 23105 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:53.517731 23105 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:53.518761 19244 raft_consensus.cc:1240] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:52.868961 18528 rpcz_store.cc:276] 0709 12:23:51.822755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.696801 (+874046us) service_pool.cc:224] Handling call
0709 12:23:52.697097 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.697294 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:52.708222 (+ 10928us) log.cc:844] Serialized 14 byte log entry
0709 12:23:52.857614 (+149392us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:52.857698 (+    84us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:52.857761 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.857851 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:52.857997 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11248,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":1157,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":2749,"thread_start_us":147718,"threads_started":1}
I20260709 12:23:53.531822 23170 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:53.558529 23105 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:53.559602 23105 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:53.562762 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57374 (request call id 2241) took 1351 ms. Trace:
I20260709 12:23:53.562984 18527 raft_consensus.cc:1275] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:53.563210 18523 rpcz_store.cc:276] 0709 12:23:52.211318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.533444 (+322126us) service_pool.cc:224] Handling call
0709 12:23:53.562533 (+1029089us) spinlock_profiling.cc:243] Waited 75.4 ms on lock 0x7b54003f0cd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:53.562700 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173485440}
W20260709 12:23:53.564333 23264 log.cc:927] Time spent T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:23:53.570014 23229 consensus_queue.cc:260] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:53.548986 23183 log.cc:927] Time spent T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 1.742s	user 0.001s	sys 0.013s
I20260709 12:23:53.574187 18527 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
W20260709 12:23:53.576584 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.576716 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:53.577286 18527 raft_consensus.cc:1275] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:23:53.578333 18528 raft_consensus.cc:1275] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:53.579944 18572 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:53.582011 23128 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:53.582794 23128 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:53.583303 23128 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:53.552179 23189 log.cc:927] Time spent T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 1.585s	user 0.010s	sys 0.012s
I20260709 12:23:53.584930 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:53.586805 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:53.560647 23066 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:53.571343 23229 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:53.558687 22834 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:53.596203 18528 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:23:53.576279 23173 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.614387 23173 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:53.616197 23066 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:53.616824 23173 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:53.617457 18677 raft_consensus.cc:1240] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:53.542537 23112 consensus_queue.cc:237] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:53.630105 23275 raft_consensus.cc:993] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:23:53.651935 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:53.630728 23105 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:53.633009 23092 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:53.653874 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:53.654488 23092 consensus_queue.cc:1048] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:53.655290 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:53.644456 23128 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:53.653949 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:53.655978 19240 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:53.656342 23092 raft_consensus.cc:1081] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:23:53.640020 23227 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:53.636335 23268 log.cc:927] Time spent T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:23:53.659155 23128 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:53.660207 18673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 2563) took 1326 ms. Trace:
I20260709 12:23:53.660586 18673 rpcz_store.cc:276] 0709 12:23:52.333298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.425675 (+ 92377us) service_pool.cc:224] Handling call
0709 12:23:53.659998 (+1234323us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b54003a1454. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:53.660139 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48344320}
I20260709 12:23:53.662263 22774 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:53.663570 18678 raft_consensus.cc:1240] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:53.665470 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:53.655072 23062 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:23:53.751722 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:53.752584 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 77929us
I20260709 12:23:53.670213 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:53.749054 18676 raft_consensus.cc:2410] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:23:53.749326 18672 raft_consensus.cc:1275] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:23:53.754598 18570 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:53.755079 18672 pending_rounds.cc:85] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting all ops after (but not including) 8
I20260709 12:23:53.755457 18672 pending_rounds.cc:107] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:23:53.755832 18672 raft_consensus.cc:2889] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:53.763932 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:53.766659 18570 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:53.781452 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:53.782434 18680 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 16.
I20260709 12:23:53.808812 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:53.834797 18672 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 12:23:53.835508 18672 pending_rounds.cc:85] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting all ops after (but not including) 5
I20260709 12:23:53.835880 18672 pending_rounds.cc:107] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 12:23:53.836247 18672 raft_consensus.cc:2889] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:53.844300 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:53.764333 23109 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.858805 18676 raft_consensus.cc:1275] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:23:53.859361 18676 pending_rounds.cc:85] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting all ops after (but not including) 7
I20260709 12:23:53.859656 18676 pending_rounds.cc:107] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:23:53.860409 18676 raft_consensus.cc:2889] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:53.785773 22855 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:53.871282 19246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33388 (request call id 599) took 1891 ms. Trace:
I20260709 12:23:53.871918 19246 rpcz_store.cc:276] 0709 12:23:51.980347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.980562 (+   215us) service_pool.cc:224] Handling call
0709 12:23:51.980890 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.588311 (+607421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.870911 (+1282600us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b540082da54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:53.871188 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1387421440}
I20260709 12:23:53.785763 23128 consensus_queue.cc:1048] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:23:53.850637 23052 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:53.886869 22855 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:53.895032 23052 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:53.895931 23052 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:53.897661 22855 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:53.887109 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:53.904507 19246 raft_consensus.cc:2393] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 13: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:53.857573 23087 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:53.905520 23087 raft_consensus.cc:697] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:53.906507 23087 consensus_queue.cc:237] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:53.857416 23109 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:53.892556 23085 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:53.909688 23260 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:53.910000 23109 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:53.910192 23260 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:53.910629 23260 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:53.912122 23266 raft_consensus.cc:2804] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:53.912593 23266 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:53.912974 23266 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:53.914698 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
W20260709 12:23:53.914942 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.925576 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:53.924542 19210 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:53.915966 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:53.933395 18529 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:53.930670 18644 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:23:53.936157 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.938508 18644 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:53.943626 23263 raft_consensus.cc:2804] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:53.944547 23263 raft_consensus.cc:697] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 13 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:53.945730 23263 consensus_queue.cc:237] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:53.940842 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:53.952512 18679 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 11.
I20260709 12:23:53.956908 23018 raft_consensus.cc:2804] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:53.959018 23100 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:53.959581 23100 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:53.960623 23100 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:53.964313 18644 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:53.970021 23224 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:53.977634 23224 consensus_queue.cc:1048] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:53.982545 18644 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:53.984716 23224 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:53.887622 23229 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:53.930615 23227 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.928017 22834 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:53.949048 23173 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:53.997268 22774 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:54.035782 23227 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.040717 23173 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.056303 23173 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:54.057399 23100 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.002971 23229 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:54.062857 23229 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:54.063167 23224 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:54.064956 23227 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:54.083923 23173 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:54.095980 23159 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:53.996670 23170 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:54.115936 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 298645us
I20260709 12:23:54.038538 23112 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.998153 23200 consensus_queue.cc:1059] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.110s
W20260709 12:23:54.133889 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 490741us
I20260709 12:23:54.038939 22834 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.143249 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:54.131311 23100 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:54.133329 23227 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.129309 23112 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.130050 23128 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
W20260709 12:23:54.159446 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 800334us
I20260709 12:23:54.161638 18494 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:54.163224 18494 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:54.164844 18494 leader_election.cc:400] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 11. Current term is 12.
I20260709 12:23:54.115196 23170 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.165282 18494 leader_election.cc:403] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:54.135219 22886 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:23:54.176184 23259 raft_consensus.cc:2804] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:54.186707 23259 raft_consensus.cc:697] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:54.187948 23259 consensus_queue.cc:237] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.200618 22834 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:54.201436 22834 consensus_queue.cc:1059] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:54.207547 23112 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:54.156353 23227 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.147955 23059 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:23:54.202525 22834 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:54.208561 23112 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:54.230587 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:54.232973 23178 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.235709 18603 raft_consensus.cc:1240] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:23:54.217358 23227 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:54.242770 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 99612.7us
I20260709 12:23:54.244045 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:54.219628 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 54962.6us
I20260709 12:23:54.238888 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:54.245729 18494 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:54.227953 22834 raft_consensus.cc:697] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:23:54.251988 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.255491 23273 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:54.256119 23273 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:54.242219 23066 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:54.256666 23273 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:54.256847 23066 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.260205 23289 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 11. Current term is 12.
I20260709 12:23:54.260815 23066 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:54.240615 23018 raft_consensus.cc:697] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:54.261356 23289 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:54.265831 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 109999us
I20260709 12:23:54.267338 23018 consensus_queue.cc:237] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:54.271459 23281 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:54.241387 23178 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:54.241941 23227 raft_consensus.cc:3055] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:54.276177 23109 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.276461 23227 raft_consensus.cc:740] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:54.276997 23109 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.277501 23227 consensus_queue.cc:260] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.278838 23227 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:54.227645 23112 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.254621 18494 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:54.282449 18494 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:54.284426 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 284733us
I20260709 12:23:54.293862 23297 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:54.294859 23274 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.295032 23296 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.295492 23274 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.296190 22834 consensus_queue.cc:237] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.296507 23128 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:54.298174 23274 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:54.298907 23220 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:54.303727 23112 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:54.304630 23052 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.306793 23052 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:54.308890 18644 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:54.309824 19210 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:54.310148 18494 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:54.314447 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:54.316589 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:54.317979 18674 raft_consensus.cc:1240] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:23:54.319568 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:54.320432 18679 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:54.327731 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:54.327966 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:54.333364 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:54.295708 23296 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.350255 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:54.338706 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:54.368983 18675 raft_consensus.cc:3055] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:54.369551 18675 raft_consensus.cc:740] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:54.279695 23109 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:54.215605 23260 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:54.364578 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 54500.4us
I20260709 12:23:54.331166 23158 raft_consensus.cc:2764] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:23:54.364295 18598 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:54.399953 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:54.374603 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:54.390235 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:54.390578 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:54.397243 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:54.401973 19246 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:54.374634 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:54.402840 18605 raft_consensus.cc:1275] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:23:54.401854 18599 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:54.410552 18644 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:54.403854 18671 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:54.420907 18570 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:54.422248 18570 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:54.423569 18570 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:54.425442 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:54.426061 18605 raft_consensus.cc:3055] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:54.426337 18605 raft_consensus.cc:740] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:54.418491 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 374233us
I20260709 12:23:54.364041 23066 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:54.434283 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 54536.4us
I20260709 12:23:54.435540 18524 raft_consensus.cc:1240] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9. Ops: []
W20260709 12:23:54.436205 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 105068us
I20260709 12:23:54.362633 23290 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:54.417966 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:54.444073 18529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:23:54.364670 23293 raft_consensus.cc:2749] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:54.448488 18529 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:54.445890 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:23:54.438568 18646 leader_election.cc:336] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.753s (SENT)
I20260709 12:23:54.437595 22373 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:54.447870 18671 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:54.447494 23290 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.405062 23173 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:54.384131 23294 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:54.361183 23281 consensus_queue.cc:1048] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:23:54.477265 18529 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:54.487190 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:54.488029 18671 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:54.462297 23130 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:54.489223 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:54.477723 18646 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:54.452157 19246 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:54.478389 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:54.491528 18606 raft_consensus.cc:2393] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 9: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:54.432119 18675 consensus_queue.cc:260] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:54.481411 18603 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 13.
I20260709 12:23:54.450366 23087 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:54.490033 18671 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:23:54.452788 23158 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:54.493302 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 54763.7us
I20260709 12:23:54.497113 18644 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:54.498955 18646 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:54.492108 18675 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:54.494131 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:54.481195 23266 consensus_meta.cc:287] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.568s	user 0.013s	sys 0.000s
I20260709 12:23:54.500648 18527 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:54.502863 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:54.504166 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:54.504897 18603 raft_consensus.cc:3055] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:54.505352 18603 raft_consensus.cc:740] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:54.454785 23059 consensus_queue.cc:1059] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:23:54.507596 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:54.509074 18527 raft_consensus.cc:1240] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:54.483785 23100 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:54.506345 18603 consensus_queue.cc:260] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.524986 18603 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:54.526386 18528 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:54.528735 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:54.492187 23170 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:54.488581 23290 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:54.496141 23018 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:54.538527 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:54.548118 18603 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:23:54.549852 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:54.551534 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:54.527635 18529 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.556777 22834 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.557408 22834 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.559689 22834 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:54.560720 22834 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:54.561295 22834 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.526062 23173 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:54.561861 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:54.567672 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 144195us
I20260709 12:23:54.570854 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:54.571643 18570 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:54.571177 18494 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:54.573589 18494 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:54.574213 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:54.573241 18570 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:54.580677 18570 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:54.583004 18671 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
I20260709 12:23:54.524410 23178 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:54.586544 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:54.588629 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:54.538758 23059 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.608297 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:54.513645 23158 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:54.610280 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 135378us
I20260709 12:23:54.611855 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:23:54.615943 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 117079us
I20260709 12:23:54.512094 23266 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:54.617446 18646 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:54.586063 23130 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:54.587503 23280 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:54.567356 23170 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:54.621237 18606 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:54.585932 23294 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:54.670786 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:54.671590 18604 raft_consensus.cc:2393] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 12: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:54.672338 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:54.627156 18528 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:54.628355 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:54.675181 23295 log.cc:927] Time spent T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 12:23:54.676782 19239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33388 (request call id 608) took 1007 ms. Trace:
I20260709 12:23:54.677116 23296 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:54.677294 19239 rpcz_store.cc:276] 0709 12:23:53.669184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.669328 (+   144us) service_pool.cc:224] Handling call
0709 12:23:53.811236 (+141908us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:53.927730 (+116494us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:53.927787 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:53.928407 (+   620us) log.cc:844] Serialized 26 byte log entry
0709 12:23:54.226972 (+298565us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:54.227042 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.227138 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:54.676499 (+449361us) raft_consensus.cc:1685] finished
0709 12:23:54.676529 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:54.676704 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":62878,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":97,"thread_start_us":389182,"threads_started":2,"wal-append.queue_time_us":506800}
I20260709 12:23:54.681277 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2578) took 1023 ms. Trace:
I20260709 12:23:54.681717 18678 rpcz_store.cc:276] 0709 12:23:53.657697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.657821 (+   124us) service_pool.cc:224] Handling call
0709 12:23:53.658100 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:53.664190 (+  6090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.681029 (+1016839us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b54002927d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:54.681213 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11964160}
I20260709 12:23:54.683133 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:54.684381 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:54.685067 18678 raft_consensus.cc:2393] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 8: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:54.685791 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:54.686803 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:54.687855 23305 log.cc:927] Time spent T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 12:23:54.695175 18570 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:54.696213 19244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 643) took 1193 ms. Trace:
I20260709 12:23:54.696630 19244 rpcz_store.cc:276] 0709 12:23:53.503405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.503543 (+   138us) service_pool.cc:224] Handling call
0709 12:23:53.503875 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:53.519317 (+ 15442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.695983 (+1176666us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b540045fe54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:54.696156 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33611008}
I20260709 12:23:54.698086 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:54.634508 23301 log.cc:927] Time spent T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:23:54.608233 23087 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:54.589787 23259 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:54.698064 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:54.726496 18678 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 13.
W20260709 12:23:54.697391 23302 log.cc:927] Time spent T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:23:54.699590 18523 raft_consensus.cc:2393] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 11: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:54.701422 18603 raft_consensus.cc:2393] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 13: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:54.661592 23280 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.615790 23059 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.730118 18570 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:54.756177 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:54.757790 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:54.758536 18528 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:54.699376 18529 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:54.618978 23293 consensus_queue.cc:1048] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.103s
I20260709 12:23:54.665244 22834 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:54.762421 23087 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:54.762909 23087 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.763242 23087 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:54.735069 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:54.669024 23294 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.727922 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:54.768908 18678 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:54.736925 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:54.772593 18604 raft_consensus.cc:2393] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 12: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:54.760361 23246 raft_consensus.cc:3055] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:54.773161 18570 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:54.624863 23178 consensus_queue.cc:1059] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 12:23:54.743501 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:54.781827 18676 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:54.748553 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:54.751188 23100 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:54.784678 19210 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:54.759537 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:54.773833 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:54.791435 18603 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:23:54.724727 23259 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:54.774924 23246 raft_consensus.cc:740] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:54.808244 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:54.730383 23260 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:54.736662 23280 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:54.796656 19210 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:54.814810 19244 raft_consensus.cc:1240] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:54.732196 23296 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:54.815718 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:54.810590 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:54.816730 18528 raft_consensus.cc:2393] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 13: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:54.817157 19210 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:54.834160 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:54.805629 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:54.723845 23170 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.837150 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:54.836557 18604 raft_consensus.cc:3055] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:54.847597 18604 raft_consensus.cc:740] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:54.843307 18678 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:23:54.844727 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:54.846673 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:54.789906 22872 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:54.782140 23294 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:54.850529 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:54.798753 23100 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:54.800725 23200 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 12:23:54.848879 19244 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:54.871670 18529 raft_consensus.cc:2393] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 13: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:54.805609 23259 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:54.849720 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:54.804503 23076 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:54.875037 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:54.788518 23052 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:54.827713 23094 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:54.828042 23159 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:54.896663 18528 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:54.929595 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:54.827931 23296 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.861255 22872 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.846220 23316 raft_consensus.cc:2804] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:23:54.870707 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.892503 18604 consensus_queue.cc:260] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.934341 18604 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:54.875492 22670 consensus_queue.cc:1059] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:23:54.916380 18678 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
I20260709 12:23:54.936484 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:54.915722 18523 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 16.
I20260709 12:23:54.916536 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:54.836557 23109 consensus_queue.cc:1059] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 12:23:54.969951 18529 raft_consensus.cc:2393] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 9: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:54.930912 22872 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:54.933457 23296 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:55.049787 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:55.096954 18604 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:23:55.062731 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:55.044049 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:55.086495 18675 consensus_meta.cc:287] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.586s	user 0.009s	sys 0.001s
W20260709 12:23:55.145890 18673 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 2585) took 1476 ms (client timeout 1668 ms). Trace:
W20260709 12:23:55.146539 18673 rpcz_store.cc:269] 0709 12:23:53.669173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.043522 (+1374349us) service_pool.cc:224] Handling call
0709 12:23:55.145826 (+102304us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:55.148030 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:55.146144 18675 raft_consensus.cc:1275] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
W20260709 12:23:55.094121 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 59821.8us
W20260709 12:23:54.995895 23307 log.cc:927] Time spent T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
W20260709 12:23:54.984624 23312 log.cc:927] Time spent T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
W20260709 12:23:55.072788 23319 log.cc:927] Time spent T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 12:23:55.145512 18672 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 7.
I20260709 12:23:55.144686 18680 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:55.188189 18675 pending_rounds.cc:85] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting all ops after (but not including) 7
I20260709 12:23:55.205565 18675 pending_rounds.cc:107] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting uncommitted NO_OP operation due to leader change: 6.8
W20260709 12:23:54.968916 23308 log.cc:927] Time spent T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.347s	user 0.001s	sys 0.000s
I20260709 12:23:55.124949 18676 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:23:55.226279 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:55.227161 18676 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:23:55.077865 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:55.050984 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 433631us
I20260709 12:23:55.229154 18646 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:55.230971 18646 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:55.079201 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:55.190155 18673 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:55.233039 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:55.092451 18494 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:54.972929 18529 raft_consensus.cc:1240] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:23:55.049165 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:54.992615 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:55.235000 18674 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:23:55.235337 18678 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 16.
W20260709 12:23:55.059042 23325 log.cc:927] Time spent T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.182s	user 0.002s	sys 0.000s
I20260709 12:23:55.027891 18605 consensus_queue.cc:260] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:55.096076 23266 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:55.048004 23066 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:55.237634 18605 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:55.050201 23297 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:55.079859 23289 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:55.050448 23173 raft_consensus.cc:697] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:23:54.995251 23311 log.cc:927] Time spent T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 12:23:55.078866 22774 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.034085 18600 raft_consensus.cc:3055] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:55.253750 18600 raft_consensus.cc:740] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:55.254314 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:55.206043 18675 raft_consensus.cc:2889] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:55.254920 18672 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:55.012981 23158 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:55.235910 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:55.236248 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:55.056186 23299 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:55.260990 23275 raft_consensus.cc:3055] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:55.106024 23260 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.261785 23275 raft_consensus.cc:740] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:55.261859 22774 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:55.263154 23260 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:55.263928 23323 log.cc:927] Time spent T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.349s	user 0.000s	sys 0.001s
I20260709 12:23:55.254556 18600 consensus_queue.cc:260] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:55.265357 23260 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:55.266237 23066 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:55.265914 23173 consensus_queue.cc:237] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:55.266564 23326 log.cc:927] Time spent T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.245s	user 0.000s	sys 0.000s
I20260709 12:23:55.266781 23066 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:55.267799 23297 raft_consensus.cc:697] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:55.269095 23066 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:55.271149 18521 raft_consensus.cc:1240] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:55.270255 18605 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 13.
I20260709 12:23:55.130230 23059 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:55.244700 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:55.071087 23304 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:55.248092 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 155714us
I20260709 12:23:55.281287 18494 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:54.933298 23316 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:55.251922 18680 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
W20260709 12:23:55.238884 23109 consensus_queue.cc:1175] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" responder_term: 12 status { last_received { term: 12 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 12 index: 7 } }
I20260709 12:23:54.935586 23290 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:55.268711 23297 consensus_queue.cc:237] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:55.240919 23322 log.cc:927] Time spent T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.520s	user 0.001s	sys 0.000s
I20260709 12:23:55.242306 18676 raft_consensus.cc:1240] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:55.291560 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 175226us
I20260709 12:23:55.239703 18646 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:55.275672 18600 raft_consensus.cc:3060] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:55.257611 23324 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:55.060837 23274 consensus_queue.cc:1059] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.166s
I20260709 12:23:55.129426 23294 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:54.929158 23052 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:55.257453 23289 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:55.280543 23220 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
W20260709 12:23:55.295073 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 55505.2us
I20260709 12:23:55.332069 18646 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:55.296010 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 757511us
I20260709 12:23:55.244002 23018 raft_consensus.cc:2804] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:55.307099 18600 raft_consensus.cc:1275] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 12:23:55.280527 23170 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:55.288475 23316 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:55.311105 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 112596us
I20260709 12:23:55.317224 19243 raft_consensus.cc:1240] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:55.287886 23260 raft_consensus.cc:2804] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:55.300748 23320 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:55.262825 23275 consensus_queue.cc:260] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:55.364252 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:55.344623 18678 raft_consensus.cc:2410] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:23:54.921169 23246 consensus_queue.cc:260] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:55.361893 23260 raft_consensus.cc:697] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:23:55.342182 23328 log.cc:927] Time spent T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
I20260709 12:23:55.288105 23304 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:55.375938 23304 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:55.378687 19210 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:55.343393 22774 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:55.383188 23087 consensus_meta.cc:287] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.620s	user 0.013s	sys 0.000s
I20260709 12:23:55.395325 23290 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:55.396023 23087 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:55.396701 23290 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:55.398356 23087 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:55.401369 23276 raft_consensus.cc:3055] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:55.401823 23276 raft_consensus.cc:740] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:55.402606 23276 consensus_queue.cc:260] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:55.404068 23260 consensus_queue.cc:237] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:55.408982 23289 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:55.376988 23256 consensus_queue.cc:1048] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:23:55.418136 23052 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:55.420763 23273 consensus_meta.cc:287] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 1.163s	user 0.012s	sys 0.001s
I20260709 12:23:55.420938 23276 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:55.421275 23273 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:55.425529 23246 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:55.415488 23227 consensus_meta.cc:287] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 1.136s	user 0.011s	sys 0.003s
I20260709 12:23:55.423532 23273 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 17 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:55.403299 23259 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:55.434257 23294 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:55.427597 23275 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:55.436443 23259 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:55.450994 23299 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:55.485855 18522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 2971) took 1049 ms. Trace:
I20260709 12:23:55.487380 18494 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:55.488430 18524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 993) took 1026 ms. Trace:
I20260709 12:23:55.488919 18524 rpcz_store.cc:276] 0709 12:23:54.461993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.462554 (+   561us) service_pool.cc:224] Handling call
0709 12:23:54.462914 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:54.472450 (+  9536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:54.472506 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:54.486492 (+ 13986us) log.cc:844] Serialized 26 byte log entry
0709 12:23:54.732308 (+245816us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:54.732435 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.732632 (+   197us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:55.058263 (+325631us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:23:55.487712 (+429449us) raft_consensus.cc:1685] finished
0709 12:23:55.487775 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.488238 (+   463us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3719,"raft.queue_time_us":9574,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":6653,"spinlock_wait_cycles":13430144,"thread_start_us":191825,"threads_started":1,"wal-append.queue_time_us":263074}
W20260709 12:23:55.488780 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 206378us
I20260709 12:23:55.494077 18494 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:55.280184 18527 raft_consensus.cc:1275] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:23:55.487035 18522 rpcz_store.cc:276] 0709 12:23:54.436238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.436401 (+   163us) service_pool.cc:224] Handling call
0709 12:23:54.436736 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:54.453181 (+ 16445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:54.453214 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:54.453720 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 12:23:54.614747 (+161027us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:54.614793 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.614876 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:55.240193 (+625317us) spinlock_profiling.cc:243] Waited 8.34 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:23:55.484628 (+244435us) raft_consensus.cc:1685] finished
0709 12:23:55.484721 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.485445 (+   724us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19325,"raft.queue_time_us":16108,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":8879,"spinlock_wait_cycles":19182848,"thread_start_us":124509,"threads_started":1,"wal-append.queue_time_us":185742}
I20260709 12:23:55.499732 18528 raft_consensus.cc:2393] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 9: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:55.304771 18570 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:55.522106 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 217324us
I20260709 12:23:55.523782 18570 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:55.502686 18603 raft_consensus.cc:1240] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
W20260709 12:23:55.527767 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 148996us
I20260709 12:23:55.528087 18494 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:55.530133 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:23:55.531379 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:55.504040 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.339339 18600 pending_rounds.cc:85] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9: Aborting all ops after (but not including) 9
I20260709 12:23:55.503948 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2600) took 1184 ms. Trace:
W20260709 12:23:55.506819 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.533622 18600 pending_rounds.cc:107] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9: Aborting uncommitted NO_OP operation due to leader change: 12.10
W20260709 12:23:55.507222 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 175112us
I20260709 12:23:55.534173 18600 raft_consensus.cc:2889] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:55.535354 18646 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:55.538825 18646 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:55.508108 18672 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 13.
I20260709 12:23:55.541873 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:55.509534 18680 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:23:55.512583 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2604) took 1133 ms. Trace:
I20260709 12:23:55.533489 18674 rpcz_store.cc:276] 0709 12:23:54.318908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.259469 (+940561us) service_pool.cc:224] Handling call
0709 12:23:55.260410 (+   941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:55.260683 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:55.288533 (+ 27850us) log.cc:844] Serialized 14 byte log entry
0709 12:23:55.502855 (+214322us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:55.502973 (+   118us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:55.503085 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:55.503217 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.503560 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26558,"prepare.queue_time_us":29231,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"thread_start_us":54281,"threads_started":1,"wal-append.queue_time_us":106064}
I20260709 12:23:55.545905 18673 raft_consensus.cc:1240] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:55.546725 18674 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:23:55.543232 18679 rpcz_store.cc:276] 0709 12:23:54.378721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.269898 (+891177us) service_pool.cc:224] Handling call
0709 12:23:55.270153 (+   255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:55.270497 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:55.270524 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:55.275124 (+  4600us) log.cc:844] Serialized 26 byte log entry
0709 12:23:55.343908 (+ 68784us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:55.343950 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:55.344031 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:55.512098 (+168067us) raft_consensus.cc:1685] finished
0709 12:23:55.512137 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.512415 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":68456,"threads_started":1,"wal-append.queue_time_us":144283}
I20260709 12:23:55.548525 18674 raft_consensus.cc:1240] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:55.549042 18671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40800 (request call id 2073) took 1119 ms. Trace:
I20260709 12:23:55.549485 18671 rpcz_store.cc:276] 0709 12:23:54.429579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.507307 (+ 77728us) service_pool.cc:224] Handling call
0709 12:23:55.548650 (+1041343us) spinlock_profiling.cc:243] Waited 70 ms on lock 0x7b54000be5d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:55.548835 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161037184}
I20260709 12:23:55.551064 18679 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:23:55.552989 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:55.542834 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:55.557955 18522 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 8.
I20260709 12:23:55.572515 18674 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:55.574640 18494 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:55.583009 18673 raft_consensus.cc:1275] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:23:55.586218 18675 raft_consensus.cc:1240] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:55.586299 23227 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:55.598269 23227 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.598780 23227 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:55.604162 23293 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:55.604836 23293 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:55.605311 23293 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:55.607235 18673 raft_consensus.cc:1275] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:23:55.609824 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:55.610481 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:55.429841 23100 consensus_meta.cc:287] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.000s
I20260709 12:23:55.614130 23100 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:55.585898 23087 raft_consensus.cc:2804] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:23:55.615862 23062 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 12:23:55.596707 23158 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:55.618682 23158 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:55.619153 23158 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:55.590714 23229 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:55.621021 23229 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:55.621307 23343 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:55.586277 23018 raft_consensus.cc:697] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:23:55.628024 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 87182.6us
I20260709 12:23:55.629899 18570 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:55.586812 23289 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.632082 23289 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:55.632555 23273 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:55.633236 23273 raft_consensus.cc:697] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:55.636086 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.592082 22834 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:55.638921 23216 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.591167 23299 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:55.639766 23216 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:55.640466 23274 consensus_queue.cc:1059] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:55.592195 23324 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:55.615965 23087 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.599026 23285 consensus_queue.cc:1059] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:23:55.586810 23066 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:55.639539 23281 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.641197 22670 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:23:55.652558 23281 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:55.656500 22834 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:55.595821 23294 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:55.658701 23294 raft_consensus.cc:697] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:55.658857 23229 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:55.661304 18600 raft_consensus.cc:1240] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:55.660586 23294 consensus_queue.cc:237] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:55.587885 23304 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:55.596333 18671 raft_consensus.cc:1275] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:23:55.662475 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 76652.9us
I20260709 12:23:55.597514 23108 raft_consensus.cc:2804] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:55.643051 23087 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:55.665980 23289 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:55.668500 23109 raft_consensus.cc:3055] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:55.595194 19244 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:55.641860 23274 raft_consensus.cc:3055] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:55.634845 23273 consensus_queue.cc:237] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:55.674271 23304 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:55.626904 23018 consensus_queue.cc:237] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:55.698422 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 166869us
I20260709 12:23:55.688674 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 2085) took 1102 ms. Trace:
I20260709 12:23:55.691177 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40800 (request call id 2082) took 1187 ms. Trace:
I20260709 12:23:55.655495 23281 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:55.709131 18680 rpcz_store.cc:276] 0709 12:23:54.586260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.286180 (+699920us) service_pool.cc:224] Handling call
0709 12:23:55.286638 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:55.543171 (+256533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:55.675059 (+131888us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b5400056ed4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:55.688578 (+ 13519us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509804160}
I20260709 12:23:55.675179 23108 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.709358 18678 rpcz_store.cc:276] 0709 12:23:54.503917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.236015 (+732098us) service_pool.cc:224] Handling call
0709 12:23:55.690682 (+454667us) spinlock_profiling.cc:243] Waited 85.1 ms on lock 0x7b54002913d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:55.690974 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195805952}
I20260709 12:23:55.697722 23109 raft_consensus.cc:740] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:55.706446 23274 raft_consensus.cc:740] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:55.804560 19210 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.888617 18494 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:55.893842 18524 raft_consensus.cc:1240] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:55.906327 18675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2599) took 1587 ms. Trace:
I20260709 12:23:55.757288 18677 raft_consensus.cc:1275] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:23:55.817852 18679 raft_consensus.cc:1240] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:55.762724 18603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39798 (request call id 595) took 1069 ms. Trace:
W20260709 12:23:55.720737 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 81980.9us
I20260709 12:23:55.675856 22834 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:55.711303 23216 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:55.914867 18675 rpcz_store.cc:276] 0709 12:23:54.318545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.255716 (+937171us) service_pool.cc:224] Handling call
0709 12:23:55.256346 (+   630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:55.586849 (+330503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:55.901255 (+314406us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b54003a1454. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:55.906236 (+  4981us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757066112}
I20260709 12:23:55.748407 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:54.475327 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:55.916646 18603 rpcz_store.cc:276] 0709 12:23:54.692970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.793665 (+100695us) service_pool.cc:224] Handling call
0709 12:23:54.794024 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:55.528262 (+734238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:55.762182 (+233920us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b54000f0d54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:55.762629 (+   447us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1627800960}
W20260709 12:23:55.751013 23296 consensus_meta.cc:287] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.608s	user 0.001s	sys 0.014s
I20260709 12:23:55.831245 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:55.746850 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:55.916249 18677 pending_rounds.cc:85] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting all ops after (but not including) 6
I20260709 12:23:55.750566 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:55.721894 23108 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:55.893095 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:55.890621 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:55.757895 18528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57384 (request call id 2988) took 1060 ms. Trace:
W20260709 12:23:55.757867 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 219389us
I20260709 12:23:55.758163 18522 raft_consensus.cc:1240] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:55.740638 23289 raft_consensus.cc:2804] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:55.832597 23179 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.927678 23324 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.831867 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:55.759413 18572 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:23:55.760972 23280 consensus_meta.cc:287] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.912s	user 0.015s	sys 0.003s
I20260709 12:23:55.931269 18677 pending_rounds.cc:107] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:23:55.805174 23100 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:55.724100 23304 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:55.885715 23066 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:55.939046 18677 raft_consensus.cc:2889] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:55.753170 23227 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:55.933737 18528 rpcz_store.cc:276] 0709 12:23:54.697450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.929240 (+231790us) service_pool.cc:224] Handling call
0709 12:23:55.757613 (+828373us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b5400374bd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:55.757812 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1305892224}
I20260709 12:23:55.948199 18527 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
I20260709 12:23:55.949949 23109 consensus_queue.cc:260] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:55.950675 23260 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:55.945801 23179 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:55.952034 23109 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:55.884940 23229 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:23:55.954226 23179 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:55.954536 23293 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:55.936815 23289 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:55.956624 23289 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:55.854823 23087 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:55.939877 23296 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:55.956704 18646 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:55.747795 23276 consensus_queue.cc:1059] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.222s
I20260709 12:23:55.965193 18494 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:23:55.965539 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 52452.9us
I20260709 12:23:55.959038 23260 raft_consensus.cc:697] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:23:55.981190 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.981876 18529 raft_consensus.cc:1240] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:55.979830 23066 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:55.982997 18530 raft_consensus.cc:1240] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:55.947427 23173 consensus_queue.cc:1059] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 12:23:55.960268 23324 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:55.975108 23229 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:55.995664 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 54537.6us
I20260709 12:23:55.945845 23280 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:56.006186 22872 consensus_meta.cc:287] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.756s	user 0.004s	sys 0.015s
I20260709 12:23:56.006261 23259 raft_consensus.cc:2764] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:23:56.008594 18602 raft_consensus.cc:1240] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
W20260709 12:23:56.009298 23362 log.cc:927] Time spent T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:23:56.015180 23259 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:56.017423 23158 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:56.020072 23158 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:56.017870 23066 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:56.020498 23275 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:56.015244 23260 consensus_queue.cc:237] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:56.024986 23324 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:56.009935 22872 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:56.033335 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 82820.6us
I20260709 12:23:56.034385 23087 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:56.040002 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 280805us
W20260709 12:23:56.042325 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.035450 23227 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:56.048339 23316 consensus_meta.cc:287] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.678s	user 0.012s	sys 0.005s
I20260709 12:23:56.050381 23280 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:56.051457 23293 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 17 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:56.057616 18646 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:56.079411 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 73452.5us
I20260709 12:23:56.075802 23100 raft_consensus.cc:3055] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:56.078225 23316 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:56.081034 23100 raft_consensus.cc:740] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:56.078696 23324 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:56.081113 18646 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:56.067559 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 54263.3us
I20260709 12:23:56.082230 23324 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:56.069587 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 67799.4us
I20260709 12:23:56.086540 23227 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:56.087826 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:56.089144 23100 consensus_queue.cc:260] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:56.086862 23293 consensus_queue.cc:1048] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:23:56.089645 23227 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:56.086283 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:56.091672 23100 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:56.086247 19244 raft_consensus.cc:1240] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:56.092190 19243 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:56.069602 23108 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:56.092954 23275 raft_consensus.cc:697] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:56.096884 23275 consensus_queue.cc:237] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:56.097975 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 83319.3us
W20260709 12:23:56.100033 23359 log.cc:927] Time spent T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.127s	user 0.000s	sys 0.004s
I20260709 12:23:56.101853 18601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 2365) took 1776 ms. Trace:
I20260709 12:23:56.102639 22373 consensus_queue.cc:1048] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:56.104460 23062 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.105309 18677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2607) took 1051 ms. Trace:
I20260709 12:23:56.101675 23179 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:56.105079 23062 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:56.102588 18601 rpcz_store.cc:276] 0709 12:23:54.325460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.329072 (+  3612us) service_pool.cc:224] Handling call
0709 12:23:54.329533 (+   461us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:54.330016 (+   483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:54.330056 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:55.593924 (+1263868us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b1800085480. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793c02a6 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7add8a11 00007efc7ade8372 00007efc7c51aa01 00007efc7c4df43a
0709 12:23:55.594515 (+   591us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b2c0005b3b8. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7add8a11 00007efc7ade8372 00007efc7c51aa01 00007efc7c4df43a 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2
0709 12:23:55.618929 (+ 24414us) log.cc:844] Serialized 52 byte log entry
0709 12:23:55.795173 (+176244us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:55.796927 (+  1754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:55.797060 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:56.099298 (+302238us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:23:56.101222 (+  1924us) raft_consensus.cc:1685] finished
0709 12:23:56.101250 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:56.101635 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30981,"raft.queue_time_us":8256,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":9697,"spinlock_wait_cycles":69193216,"thread_start_us":175015,"threads_started":1,"wal-append.queue_time_us":300769}
I20260709 12:23:56.105705 18677 rpcz_store.cc:276] 0709 12:23:55.054074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.295196 (+241122us) service_pool.cc:224] Handling call
0709 12:23:55.721661 (+426465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:55.957052 (+235391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.105058 (+148006us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54002913d0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:56.105252 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":911073024}
I20260709 12:23:56.083575 18646 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:56.075446 22872 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:56.087206 23316 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:56.107707 23062 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:56.146396 18671 raft_consensus.cc:1240] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:56.155162 19244 raft_consensus.cc:1275] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:56.158085 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:56.159930 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:56.160952 18606 raft_consensus.cc:2393] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 11: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:56.163323 23108 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:56.178236 22834 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:56.167833 23259 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.169734 23324 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:56.172039 23296 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:56.205160 23259 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:56.208340 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 124901us
W20260709 12:23:56.216934 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.239404 23227 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:56.237231 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 56921.3us
I20260709 12:23:56.248605 18646 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:56.250023 23370 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:23:56.252116 18494 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:56.260398 23105 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.261022 23105 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:56.263185 23105 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:56.221165 23229 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:23:56.233682 23066 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:23:56.272056 23105 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:23:56.289080 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 55725.3us
I20260709 12:23:56.293432 18644 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:56.294585 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 45254.4us
I20260709 12:23:56.295527 18644 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:56.296778 23299 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:56.297544 23299 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:56.297925 23299 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:56.298306 23299 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:56.300464 22834 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:56.289893 23108 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:56.289921 23227 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.301965 23108 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:56.302250 23227 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:56.288487 23259 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:56.276726 22872 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:56.305142 22872 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:56.274158 23289 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:56.318110 23289 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:56.320618 23276 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:56.292140 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 50739.9us
W20260709 12:23:56.344300 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 69750us
I20260709 12:23:56.356673 23361 consensus_queue.cc:1048] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:23:56.357213 23227 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:56.358155 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:56.358475 23296 consensus_queue.cc:1048] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:56.360234 22872 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:56.367368 23375 consensus_queue.cc:1059] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:23:56.292574 23370 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:56.368392 23370 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:56.368813 23370 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:56.353068 23359 log.cc:927] Time spent T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:23:56.379566 18646 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:56.380950 18572 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:56.349540 23105 raft_consensus.cc:697] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:56.321499 23276 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:56.405484 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 110049us
I20260709 12:23:56.394683 18672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 2617) took 1087 ms. Trace:
I20260709 12:23:56.396392 18494 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:56.448320 19212 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:56.355638 23066 consensus_queue.cc:1048] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:23:56.447155 18672 rpcz_store.cc:276] 0709 12:23:55.299766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.541259 (+241493us) service_pool.cc:224] Handling call
0709 12:23:56.387042 (+845783us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b540039fb54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:56.387242 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1385089920}
I20260709 12:23:56.454727 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:56.455924 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:56.456197 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:56.456581 23293 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:56.456838 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:56.458092 18680 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:56.460842 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 105541us
W20260709 12:23:56.450562 23362 log.cc:927] Time spent T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:23:56.460980 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 67745.9us
I20260709 12:23:56.469201 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:56.472994 23094 consensus_queue.cc:1048] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:23:56.473472 23378 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:56.453114 23229 raft_consensus.cc:2749] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:56.471668 23216 raft_consensus.cc:2804] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:56.372149 23274 consensus_queue.cc:260] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:56.475445 23375 consensus_queue.cc:1059] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
W20260709 12:23:56.483464 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 108221us
W20260709 12:23:56.513355 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 54670.1us
W20260709 12:23:56.520746 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 121893us
I20260709 12:23:56.456099 18426 catalog_manager.cc:5697] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.492018 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:56.513329 18674 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:56.527056 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
W20260709 12:23:56.530088 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 54915.2us
I20260709 12:23:56.481914 23108 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:56.530346 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 152461us
I20260709 12:23:56.534265 23100 consensus_queue.cc:1048] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:56.534521 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:56.533656 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:56.525048 23216 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.537959 18646 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:56.540591 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 58410.4us
I20260709 12:23:56.543282 19239 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEARNER]: Advancing to term 9
I20260709 12:23:56.549365 23384 raft_consensus.cc:3055] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:56.549975 23384 raft_consensus.cc:740] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:56.566145 23243 consensus_queue.cc:1059] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:56.567341 23243 raft_consensus.cc:3055] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:56.567735 23243 raft_consensus.cc:740] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:56.579157 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:56.582688 19210 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:56.545446 23109 consensus_meta.cc:287] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.593s	user 0.009s	sys 0.004s
I20260709 12:23:56.592912 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:56.598301 18600 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:56.544226 23094 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.546872 23216 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:56.604537 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 64346.1us
I20260709 12:23:56.490993 22774 consensus_queue.cc:1059] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 12:23:56.615898 22373 consensus_queue.cc:1059] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:56.617295 22373 raft_consensus.cc:3055] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:56.617669 22373 raft_consensus.cc:740] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:56.618238 22774 raft_consensus.cc:3055] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:56.618604 22373 consensus_queue.cc:260] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:56.618783 22774 raft_consensus.cc:740] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:56.620508 18525 raft_consensus.cc:1275] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:23:56.620926 18525 pending_rounds.cc:85] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 6
I20260709 12:23:56.621317 18525 pending_rounds.cc:107] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:23:56.621572 18525 raft_consensus.cc:2889] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:56.616181 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:56.614229 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.617830 23243 consensus_queue.cc:260] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:56.624178 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 93997.4us
I20260709 12:23:56.625032 23243 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:56.625072 18646 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:56.626819 18646 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:56.569142 23276 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:56.629290 23229 raft_consensus.cc:2749] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:56.630837 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:56.631649 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:56.551366 23384 consensus_queue.cc:260] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:56.631776 23094 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:56.631657 23324 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:56.633152 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:56.655277 18522 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:23:56.620744 22774 consensus_queue.cc:260] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:56.633919 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:56.614264 23018 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:56.660872 18528 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:56.661612 23384 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:56.634617 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:56.634666 18494 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:56.664510 18527 raft_consensus.cc:2410] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:23:56.665612 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:56.665907 18646 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:56.666025 18494 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:56.666877 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:56.635491 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:56.667244 22834 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:56.667548 23229 raft_consensus.cc:2749] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:56.668294 22834 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:56.668498 23229 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:56.606750 23289 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:56.669505 23289 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:56.672155 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:56.673350 23259 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:56.675004 18494 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:56.668934 18525 raft_consensus.cc:1275] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:23:56.676065 23259 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:56.677879 23094 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:56.681520 23366 log.cc:927] Time spent T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.569s	user 0.003s	sys 0.000s
I20260709 12:23:56.687788 23289 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:56.689711 23375 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:56.690261 18521 raft_consensus.cc:1240] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:56.628720 23108 consensus_queue.cc:1059] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:23:56.692124 23276 raft_consensus.cc:3055] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:56.691383 18426 catalog_manager.cc:5697] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 8 to 9, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 9 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.692549 23276 raft_consensus.cc:740] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:56.693555 23276 consensus_queue.cc:260] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:56.694613 23276 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:56.588479 23105 consensus_queue.cc:237] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:56.606074 23274 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:56.697885 18426 catalog_manager.cc:5697] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 6 to 7, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 7 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.684322 18494 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:56.686844 18524 raft_consensus.cc:1240] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:56.667567 18527 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:56.702239 18680 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
W20260709 12:23:56.705160 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.667309 18646 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:56.719152 18570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.699887 18525 pending_rounds.cc:85] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 5
I20260709 12:23:56.719962 18525 pending_rounds.cc:107] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:23:56.720232 18525 raft_consensus.cc:2889] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:56.753785 22373 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:23:56.687345 23363 log.cc:927] Time spent T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:23:56.758255 18522 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:56.761224 18522 raft_consensus.cc:1240] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:56.717854 23289 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:56.713344 23378 raft_consensus.cc:3055] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:56.792574 23378 raft_consensus.cc:740] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:56.793797 23378 consensus_queue.cc:260] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:56.683321 23370 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:56.772903 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 88727.4us
I20260709 12:23:56.813665 18572 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:56.822108 18572 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:56.825415 18525 raft_consensus.cc:1240] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:56.825225 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:56.826162 19239 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEARNER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:56.831089 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:56.831864 23018 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:56.832216 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:56.832497 23018 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:56.833053 18679 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:56.834407 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:56.834739 23018 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:56.835711 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:56.836980 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:56.837502 18678 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:56.842106 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 174851us
I20260709 12:23:56.789036 23387 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:56.854198 18523 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:56.843513 18679 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:56.866065 18528 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
W20260709 12:23:56.864130 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 237122us
I20260709 12:23:56.866268 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:56.819994 23260 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:56.875176 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 298409us
I20260709 12:23:56.804001 23227 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:56.870641 19244 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:56.841852 23296 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:56.876281 18522 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:23:56.885421 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:56.856659 23108 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:56.799865 23299 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:56.799472 23062 consensus_queue.cc:1048] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:23:56.818189 23289 raft_consensus.cc:697] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:56.914390 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:56.926542 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 85293.3us
I20260709 12:23:56.918286 23243 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:56.931572 18646 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:56.933503 18528 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:56.909655 23280 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:56.943234 19211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.937655 23243 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:56.943540 23352 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.008s	sys 0.020s
W20260709 12:23:56.944209 23352 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.009s	sys 0.020s
I20260709 12:23:56.950286 18522 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
I20260709 12:23:56.953379 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:56.954373 18494 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:56.962978 18672 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
I20260709 12:23:56.974400 18678 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:56.981168 18644 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:23:56.986239 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 164087us
I20260709 12:23:56.925598 23227 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:56.937933 23260 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.015589 18671 raft_consensus.cc:1275] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:57.015679 18676 raft_consensus.cc:1240] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:57.020577 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:56.960089 23280 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:57.001820 18572 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:57.001593 23387 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.030887 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:57.033363 18672 raft_consensus.cc:2393] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 12: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:57.035650 19212 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:57.001389 23400 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:57.005678 23066 raft_consensus.cc:2804] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:23:57.169293 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 273778us
W20260709 12:23:57.171456 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 135901us
I20260709 12:23:57.172400 18522 raft_consensus.cc:1240] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:57.147635 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:57.175659 18671 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:57.035360 22872 raft_consensus.cc:2804] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:57.187932 23397 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:57.006570 23296 consensus_queue.cc:1059] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.168s
I20260709 12:23:57.147275 23066 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.188436 23274 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.188270 23370 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:57.035544 22670 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.166s
I20260709 12:23:57.222051 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:57.230937 22872 raft_consensus.cc:697] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:57.231432 23276 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.232023 18572 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:57.232092 23179 consensus_queue.cc:1059] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:57.232853 23109 consensus_queue.cc:1059] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:57.202263 23397 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.185685 23361 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.235221 18646 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:57.234557 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.144668 23387 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.216356 23066 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:57.243510 22373 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:23:57.250891 23404 log.cc:927] Time spent T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 12:23:57.251151 23393 log.cc:927] Time spent T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:23:57.251998 23402 log.cc:927] Time spent T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 12:23:57.256477 23179 raft_consensus.cc:3055] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:57.280009 23179 raft_consensus.cc:740] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:57.281181 22872 consensus_queue.cc:237] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.257202 23109 raft_consensus.cc:3055] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:57.259786 23397 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:57.261869 18426 catalog_manager.cc:5697] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:57.240267 23392 log.cc:927] Time spent T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.324s	user 0.000s	sys 0.002s
I20260709 12:23:57.263932 23274 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:57.265975 23299 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:57.139930 23289 consensus_queue.cc:237] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.234551 23108 raft_consensus.cc:3055] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:23:57.277026 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.246640 23296 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:23:57.289705 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 78641.2us
I20260709 12:23:57.310432 18646 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:57.311141 23281 consensus_queue.cc:1059] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:57.312397 23281 raft_consensus.cc:3055] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:57.312810 23281 raft_consensus.cc:740] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:57.314651 18426 catalog_manager.cc:5697] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 8 to 11, leader changed from 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 11 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:57.301600 23108 raft_consensus.cc:740] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:57.317230 23274 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:57.288851 23361 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.317462 23108 consensus_queue.cc:260] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.319252 23361 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:57.290591 23260 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:57.288790 18599 raft_consensus.cc:1275] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:57.296319 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:57.268237 23276 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.313699 23281 consensus_queue.cc:260] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.285405 23109 raft_consensus.cc:740] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:57.302316 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.279022 23018 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:57.320232 23227 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:57.291344 23280 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:57.322649 18677 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
W20260709 12:23:57.324584 18423 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47708 (request call id 183) took 16186 ms (client timeout 15000 ms). Trace:
I20260709 12:23:57.333345 23387 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:57.339074 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:57.337303 23296 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.339915 23296 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:57.340801 23243 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:57.341071 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.345734 23324 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:57.325996 23109 consensus_queue.cc:260] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.357205 18530 raft_consensus.cc:1240] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:57.357733 23109 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:57.358285 18528 raft_consensus.cc:1240] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:57.358546 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:57.359256 18530 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:57.359340 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:57.360024 18528 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
W20260709 12:23:57.360862 23216 consensus_meta.cc:287] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.692s	user 0.001s	sys 0.012s
I20260709 12:23:57.326740 23018 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:57.325161 23276 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:57.362324 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:57.361321 23216 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.325527 23281 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:57.362180 23018 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:57.366896 18523 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:57.370368 18572 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:57.373742 18572 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:57.376578 18606 raft_consensus.cc:1240] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:57.375315 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:57.378535 18679 consensus_meta.cc:287] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.513s	user 0.003s	sys 0.009s
I20260709 12:23:57.378923 18679 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:57.377143 23361 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:57.370087 23062 consensus_queue.cc:1059] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:23:57.384708 23361 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.364538 23100 consensus_queue.cc:1048] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:23:57.377687 23276 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:57.385186 23361 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:57.418453 23389 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:57.418545 23066 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.419286 23389 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.426661 23361 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.427419 23179 consensus_queue.cc:260] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.428244 23397 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:57.428890 23179 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:57.430528 23397 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:57.396711 23276 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.432029 23276 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:57.439397 23413 log.cc:927] Time spent T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.222s	user 0.002s	sys 0.000s
I20260709 12:23:57.446902 23293 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:57.447494 23293 raft_consensus.cc:697] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:57.448056 18572 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:57.448379 23293 consensus_queue.cc:237] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.451900 22834 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:23:57.336423 18423 rpcz_store.cc:269] 0709 12:23:41.200280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.222162 (+ 21882us) service_pool.cc:224] Handling call
0709 12:23:57.324247 (+16102085us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:52.210971 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:52.355969 (+144998us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:52.369486 (+ 13517us) write_op.cc:435] Acquired schema lock
0709 12:23:52.374938 (+  5452us) tablet.cc:662] Decoding operations
0709 12:23:52.486659 (+111721us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:52.486736 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:52.486767 (+    31us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:23:52.487390 (+   623us) tablet.cc:701] Row locks acquired
0709 12:23:52.487406 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:23:52.487575 (+   169us) write_op.cc:270] Start()
0709 12:23:52.487705 (+   130us) write_op.cc:276] Timestamp: P: 1783599832487520 usec, L: 0
0709 12:23:52.487727 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:23:52.509713 (+ 21986us) log.cc:844] Serialized 2871 byte log entry
0709 12:23:52.926234 (+416521us) op_driver.cc:464] REPLICATION: finished
0709 12:23:53.295565 (+369331us) write_op.cc:301] APPLY: starting
0709 12:23:53.295654 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:53.427392 (+131738us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:53.427493 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:53.628115 (+200622us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:53.628384 (+   269us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 12:23:53.628431 (+    47us) write_op.cc:312] APPLY: finished
0709 12:23:53.628715 (+   284us) log.cc:844] Serialized 73 byte log entry
0709 12:23:53.628888 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:53.629015 (+   127us) write_op.cc:454] Released schema lock
0709 12:23:53.629079 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:53.629532 (+   453us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:53.629559 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2023442,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":363283,"apply.run_cpu_time_us":14198,"apply.run_wall_time_us":333920,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33429,"num_ops":7,"prepare.queue_time_us":551579,"prepare.run_cpu_time_us":45292,"prepare.run_wall_time_us":485209,"raft.queue_time_us":210020,"raft.run_cpu_time_us":85791,"raft.run_wall_time_us":297040,"replication_time_us":427748,"thread_start_us":897515,"threads_started":4,"wal-append.queue_time_us":148069,"wal-append.run_cpu_time_us":27734,"wal-append.run_wall_time_us":1974599}]]}
I20260709 12:23:57.452520 22834 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:57.454622 23378 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:57.454869 22834 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:57.460013 18527 consensus_meta.cc:287] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7: Time spent flushing consensus metadata: real 0.697s	user 0.007s	sys 0.003s
I20260709 12:23:57.439961 18671 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:57.441347 23296 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.460417 18527 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:23:57.468164 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 2620) took 1016 ms. Trace:
I20260709 12:23:57.468755 18674 rpcz_store.cc:276] 0709 12:23:56.452283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.456588 (+  4305us) service_pool.cc:224] Handling call
0709 12:23:57.467961 (+1011373us) spinlock_profiling.cc:243] Waited 55.7 ms on lock 0x7b54000be0d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:23:57.468079 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128152320}
I20260709 12:23:57.471834 23066 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:57.483484 18572 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:57.479581 23296 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:57.507972 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:57.508750 18527 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:57.468538 23109 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:23:57.514580 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:57.511451 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 568546us
I20260709 12:23:57.518659 23289 consensus_queue.cc:1059] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:57.520126 18602 raft_consensus.cc:1275] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:57.520025 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:57.519979 23289 raft_consensus.cc:3055] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:57.520860 23289 raft_consensus.cc:740] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:57.522256 23289 consensus_queue.cc:260] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:57.524570 23289 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:57.528774 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:57.529358 18525 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:57.534999 18527 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 14.
I20260709 12:23:57.536078 19243 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:23:57.511068 23062 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:57.513172 23109 raft_consensus.cc:697] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:57.541524 23400 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:57.541886 23109 consensus_queue.cc:237] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.542770 22774 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:57.539726 18572 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:57.547317 23062 raft_consensus.cc:697] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:57.548296 23062 consensus_queue.cc:237] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.551648 22670 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:57.552017 23246 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:57.552289 22670 raft_consensus.cc:697] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:57.552440 18525 raft_consensus.cc:2468] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:57.552723 23246 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:57.553400 22670 consensus_queue.cc:237] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.555181 23246 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:57.552037 23216 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:57.551172 23276 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.557468 18572 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:57.540189 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:57.570976 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:57.565510 23406 raft_consensus.cc:2804] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:57.581163 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:57.581892 18524 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:23:57.586680 23423 log.cc:927] Time spent T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 12:23:57.587318 23411 log.cc:927] Time spent T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.335s	user 0.000s	sys 0.002s
I20260709 12:23:57.587688 23018 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.589257 23389 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:57.593026 18606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 2390) took 1029 ms. Trace:
I20260709 12:23:57.598268 23389 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:57.598888 18678 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:57.598839 23389 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.600140 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:23:57.600412 23408 log.cc:927] Time spent T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.356s	user 0.000s	sys 0.002s
I20260709 12:23:57.601219 23389 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:57.604192 23276 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:57.608191 23406 raft_consensus.cc:697] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:57.609287 23406 consensus_queue.cc:237] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.619732 18602 raft_consensus.cc:1240] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:57.619801 23361 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:57.621085 23108 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:57.624030 19209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.626089 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:57.629225 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:57.629688 23216 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:57.629896 18672 raft_consensus.cc:3060] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:57.630285 23216 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:57.631889 23275 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:57.632321 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:57.632477 23275 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:57.632917 18601 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:57.634631 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:57.635483 18600 raft_consensus.cc:2393] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 11: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:57.635731 23216 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:57.640355 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:57.640523 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:57.640892 18601 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:57.641052 18673 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
W20260709 12:23:57.644724 18570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.644968 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:23:57.645591 18570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.646342 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:57.646763 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:57.593495 18606 rpcz_store.cc:276] 0709 12:23:56.563761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.563928 (+   167us) service_pool.cc:224] Handling call
0709 12:23:56.564267 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:57.377048 (+812781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.592719 (+215671us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b5400310454. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:57.592953 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1867523840}
I20260709 12:23:57.647349 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:57.632967 22872 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:57.648993 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:57.649040 18527 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 11.
I20260709 12:23:57.649744 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:57.652966 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:57.653448 18525 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 14
W20260709 12:23:57.654357 18570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.663336 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:57.663823 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:57.664556 22373 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.665215 22373 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.666579 18525 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 14.
I20260709 12:23:57.658048 18672 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 11.
I20260709 12:23:57.634635 23275 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:57.688385 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:57.667459 22872 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:57.696234 18673 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:23:57.696393 18644 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:57.696712 22373 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:57.590088 23018 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:57.697767 23389 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:57.674793 18524 raft_consensus.cc:2468] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 11.
I20260709 12:23:57.705973 19212 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:57.712302 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:57.705888 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:57.720868 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:57.722007 18672 raft_consensus.cc:2393] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 9: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:57.723879 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:57.729910 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:57.741369 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:57.744479 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:57.744527 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:57.731640 18570 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:57.747200 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:57.746619 18644 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:57.748126 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:57.747427 18606 raft_consensus.cc:1240] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:57.749918 18673 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:57.754074 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:57.753971 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:57.754874 18679 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 13.
I20260709 12:23:57.754897 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:57.757522 18675 raft_consensus.cc:2368] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10.
I20260709 12:23:57.757819 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:57.758040 18676 raft_consensus.cc:1275] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:57.758666 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:57.759276 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:57.757725 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:57.760306 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:57.766043 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:57.777348 22373 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:57.732399 23062 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:23:57.758744 23428 log.cc:927] Time spent T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:23:57.748021 23397 raft_consensus.cc:2804] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:57.761348 23389 raft_consensus.cc:2804] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:57.788290 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:57.792068 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:57.792594 19212 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:57.789693 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:57.762226 23276 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:23:57.808488 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 77203.4us
I20260709 12:23:57.809600 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:57.811991 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:57.813084 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:57.817278 18672 raft_consensus.cc:1240] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:23:57.820086 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:57.822381 18674 raft_consensus.cc:2368] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9.
I20260709 12:23:57.762449 23066 consensus_queue.cc:1059] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:23:57.828357 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:57.831213 18601 raft_consensus.cc:2393] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 14: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:57.784897 23296 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.785959 22872 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:57.835506 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:57.810784 23415 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:57.857424 18674 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:57.814414 23173 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.866851 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:57.867280 23173 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:57.829481 23389 raft_consensus.cc:697] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:57.858202 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:57.807507 23397 raft_consensus.cc:697] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:23:57.863932 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:57.860603 23296 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.866637 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:57.873438 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:57.874604 18680 raft_consensus.cc:2393] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 13: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:23:57.883503 18674 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:23:57.852144 23216 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:57.808182 23400 consensus_queue.cc:1059] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:23:57.795944 23062 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:57.869470 22774 raft_consensus.cc:3055] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:57.859486 23415 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:23:57.903280 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:57.904773 18601 raft_consensus.cc:2410] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:23:57.825737 23276 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:57.891186 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:57.892385 18570 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:23:57.932999 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 146112us
I20260709 12:23:57.938473 18572 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:57.893486 22774 raft_consensus.cc:740] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:57.955303 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:57.906071 23415 raft_consensus.cc:3060] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:57.973385 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 81084.8us
I20260709 12:23:57.965801 18600 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:23:57.955349 23274 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:23:57.970505 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.936105 23293 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.980895 23293 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:57.969689 18603 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:23:57.978202 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:57.983458 23387 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.978377 18570 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:57.984891 23293 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:57.984229 23387 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:57.988019 23387 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:57.991657 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:57.994385 18570 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:57.930111 23400 consensus_queue.cc:1243] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:23:57.970081 22872 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:23:57.999111 23440 log.cc:927] Time spent T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:23:58.007784 19243 raft_consensus.cc:2393] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 13: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:57.978754 23173 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:58.029963 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:58.034682 18530 raft_consensus.cc:2393] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 10: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:58.037292 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:57.993314 23274 raft_consensus.cc:697] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:58.038084 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:58.006631 23406 raft_consensus.cc:2764] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:23:58.046087 18530 raft_consensus.cc:2393] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 9: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:58.046188 23274 consensus_queue.cc:237] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.000823 23397 consensus_queue.cc:237] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:58.011400 23275 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.009555 23179 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:58.053768 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:58.059932 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.068135 18600 raft_consensus.cc:1240] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:58.077845 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:58.052266 23062 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:58.085764 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:57.995853 23389 consensus_queue.cc:237] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.084758 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
W20260709 12:23:58.093211 19209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.099253 18529 raft_consensus.cc:1240] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:58.103477 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:58.106000 18600 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
I20260709 12:23:58.107203 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:58.034790 22774 consensus_queue.cc:260] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.107805 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:58.085587 23352 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.116387 18524 raft_consensus.cc:1275] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:58.083011 23173 consensus_queue.cc:1059] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:23:58.091979 22872 raft_consensus.cc:697] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:58.123910 23296 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:58.126019 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:58.126573 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:58.127782 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:58.128243 23435 log.cc:927] Time spent T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:23:58.137770 18601 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 14.
I20260709 12:23:58.064791 23275 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.122960 23173 consensus_queue.cc:1243] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:23:58.100842 23431 log.cc:927] Time spent T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 12:23:58.125909 18606 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:23:58.144866 23445 log.cc:927] Time spent T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.072s	user 0.001s	sys 0.002s
I20260709 12:23:58.145300 18673 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 17.
I20260709 12:23:58.123574 23276 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:58.143651 23433 log.cc:927] Time spent T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 12:23:58.128093 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:58.167106 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.179111 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:58.156306 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:58.142879 23275 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:58.181005 18598 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:23:58.160262 18600 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:58.155200 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:58.153937 23415 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:58.196792 23415 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:58.146142 23352 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:58.199250 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:58.200652 18527 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
I20260709 12:23:58.205521 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:58.147598 23358 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.123920 22872 consensus_queue.cc:237] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.198279 23296 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.217828 18676 raft_consensus.cc:1240] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:23:58.221256 18602 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 17.
I20260709 12:23:58.219535 23358 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.242041 18522 raft_consensus.cc:1275] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:58.244807 23352 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:58.249361 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:58.258697 18528 raft_consensus.cc:2393] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 9: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:58.259780 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:58.264333 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:58.263257 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:58.264993 18600 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:23:58.265018 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:58.266335 19244 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:23:58.268296 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:58.277276 18528 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:58.270432 18494 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:58.271039 23289 consensus_queue.cc:1059] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:58.271557 23100 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.272279 18522 raft_consensus.cc:2393] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 12: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:58.257798 22774 raft_consensus.cc:3060] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:58.273491 18600 raft_consensus.cc:1275] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:58.268437 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:58.275349 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:58.284246 18601 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 17.
I20260709 12:23:58.278158 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:58.248548 23358 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:58.279035 18644 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:58.289062 18527 raft_consensus.cc:2468] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 11.
I20260709 12:23:58.218426 23296 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.301615 19212 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:23:58.302165 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:58.308954 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:58.301249 18644 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:58.307471 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:58.309867 18523 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 17.
I20260709 12:23:58.319450 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:58.322736 18527 raft_consensus.cc:1240] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:58.324113 18527 raft_consensus.cc:1240] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:58.303594 23389 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:58.326000 23389 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:58.326457 23389 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:58.328121 23018 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:58.328712 23018 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.331007 23018 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:58.300135 23100 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.334334 23100 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:58.344774 18528 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 17.
I20260709 12:23:58.346225 18522 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:58.317260 23352 raft_consensus.cc:2804] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:58.321249 23173 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:58.345655 23100 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:58.358310 23443 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:58.363252 23443 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.354882 23289 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.380326 23289 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.382843 23289 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:58.371125 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 358697us
I20260709 12:23:58.384771 18570 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:58.371313 23465 raft_consensus.cc:2804] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:23:58.373624 23436 log.cc:927] Time spent T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.339s	user 0.003s	sys 0.000s
I20260709 12:23:58.374931 23105 raft_consensus.cc:3055] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:58.357149 23173 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.379721 23464 raft_consensus.cc:3055] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:58.389566 23464 raft_consensus.cc:740] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:58.390354 23443 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:58.390581 23464 consensus_queue.cc:260] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:58.391709 23105 raft_consensus.cc:740] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:58.355034 23387 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:58.392719 23387 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.392818 23105 consensus_queue.cc:260] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.394017 23105 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:58.395241 23387 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:58.392062 23464 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:58.388168 18527 raft_consensus.cc:1275] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:23:58.396483 23465 raft_consensus.cc:697] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:58.389108 23173 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:58.397998 23465 consensus_queue.cc:237] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:58.362360 23100 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.401876 23100 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:58.402343 23109 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:58.404587 18570 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:58.386785 18522 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:23:58.407586 18570 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:23:58.410586 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 57704.8us
W20260709 12:23:58.412545 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 89311.8us
I20260709 12:23:58.388509 22774 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:58.411370 23109 raft_consensus.cc:2804] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:58.407714 23387 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.413481 22872 raft_consensus.cc:2804] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:58.421746 19210 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:58.413100 23352 raft_consensus.cc:697] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
W20260709 12:23:58.433672 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 163314us
I20260709 12:23:58.414973 23448 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:23:58.438369 22373 consensus_queue.cc:1059] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:58.428687 22872 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.432153 23243 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.418284 22774 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.450459 22774 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:58.453342 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:58.453531 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:58.429483 23389 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.447345 18675 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:58.447674 22373 raft_consensus.cc:3055] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:58.454855 22373 raft_consensus.cc:740] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:58.438184 23379 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:58.430133 23109 raft_consensus.cc:697] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:58.437640 23299 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:58.459885 22373 consensus_queue.cc:260] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:58.461712 18602 raft_consensus.cc:1240] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:58.446156 22872 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:58.431344 23387 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.458727 18646 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:58.480270 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:58.483999 22373 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:58.462534 22774 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:58.488925 23352 consensus_queue.cc:237] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:58.477721 23299 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.494485 23387 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:58.481912 23100 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:58.495842 23299 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:58.496286 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.497977 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:58.498608 18673 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 17.
W20260709 12:23:58.500667 23459 log.cc:927] Time spent T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.166s	user 0.002s	sys 0.000s
I20260709 12:23:58.501016 23173 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:58.503208 23173 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:58.455194 23243 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:58.503955 23439 log.cc:927] Time spent T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.507s	user 0.003s	sys 0.000s
I20260709 12:23:58.505497 23243 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:58.508136 18572 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:58.508767 23276 consensus_queue.cc:1048] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:58.510004 23108 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:58.510466 23108 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.510838 23296 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:58.511003 23361 consensus_queue.cc:1048] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:58.512720 23361 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:58.495543 22774 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.510849 23108 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:58.516582 22774 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:23:58.517995 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.521100 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:58.521512 18601 raft_consensus.cc:1240] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:23:58.522325 18675 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:23:58.523650 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:58.524251 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:58.531309 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:58.532008 18598 raft_consensus.cc:2393] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 11: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:58.535017 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:58.536010 18606 raft_consensus.cc:2393] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 11: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
W20260709 12:23:58.537848 19209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.538306 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:58.539119 19244 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:58.568979 23389 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:58.580860 18494 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:23:58.582504 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 49952.5us
I20260709 12:23:58.583631 18570 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:58.527990 23173 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.584841 18570 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:58.538689 23100 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:58.580920 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:23:58.590847 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 137647us
I20260709 12:23:58.592118 18599 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 17.
I20260709 12:23:58.596644 18494 leader_election.cc:400] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10.
I20260709 12:23:58.597028 18494 leader_election.cc:403] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:58.597246 23216 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:58.597736 23216 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:58.598124 23216 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:58.598223 23280 consensus_queue.cc:1048] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:58.599607 18570 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:58.602038 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:58.602252 23449 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:58.602730 18678 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:58.605453 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:58.605822 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:58.606442 18676 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:58.607115 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:58.608508 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:58.610045 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:58.610494 18673 raft_consensus.cc:1275] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:58.611955 18672 raft_consensus.cc:1275] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:58.610190 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:58.612805 18675 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
I20260709 12:23:58.605490 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:58.620307 19210 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:58.607048 23173 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:58.641875 18646 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:58.634296 18678 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 14.
I20260709 12:23:58.644024 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:58.623270 19242 raft_consensus.cc:2393] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 9: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:23:58.608453 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:58.622993 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:58.644716 18673 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:58.650738 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:58.651535 18673 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:23:58.653545 23173 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:23:58.654701 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 58288.9us
W20260709 12:23:58.655929 23463 log.cc:927] Time spent T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:23:58.656332 18672 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:23:58.584548 23274 consensus_queue.cc:1059] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:23:58.658265 22373 raft_consensus.cc:3055] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:58.658641 22373 raft_consensus.cc:740] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:58.659466 22373 consensus_queue.cc:260] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.660871 23293 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:58.661628 23293 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.664758 22872 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.667017 22872 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:58.672055 23108 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.673310 23100 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:58.673502 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 58135.6us
I20260709 12:23:58.674832 23293 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:58.680565 18646 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:58.620719 23324 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:58.683348 23358 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:58.684355 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.683702 23324 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.685792 18646 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:58.686285 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:23:58.686923 23438 log.cc:927] Time spent T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.690s	user 0.001s	sys 0.003s
I20260709 12:23:58.688514 23361 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:58.688987 23452 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:23:58.689611 23466 consensus_queue.cc:1048] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:23:58.694681 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:58.705765 18601 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 13.
I20260709 12:23:58.692708 19240 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:58.693724 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:58.697258 18598 raft_consensus.cc:1240] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:23:58.699506 19244 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 13.
I20260709 12:23:58.701421 18494 leader_election.cc:400] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9.
I20260709 12:23:58.707800 18494 leader_election.cc:403] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:23:58.709105 18494 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:58.701900 18673 raft_consensus.cc:3055] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:58.642150 23316 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:58.704092 18646 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:58.709964 18673 raft_consensus.cc:740] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:58.717054 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:58.713627 18673 consensus_queue.cc:260] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:58.718406 18673 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:58.719818 18646 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:58.583319 23109 consensus_queue.cc:237] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:58.700783 23468 consensus_queue.cc:1059] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:23:58.724026 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:58.728380 18646 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:58.701033 23389 raft_consensus.cc:2749] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:58.745878 18646 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:58.757771 18605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40948 (request call id 2404) took 1125 ms. Trace:
I20260709 12:23:58.758404 18646 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:58.716514 23293 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 8. Current term is 9.
I20260709 12:23:58.722143 23400 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:58.727113 23100 raft_consensus.cc:2749] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:58.760854 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:58.764816 18600 raft_consensus.cc:2368] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12.
I20260709 12:23:58.762282 18646 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:58.774044 18646 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:58.790798 18646 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:58.745816 23358 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:58.758209 18605 rpcz_store.cc:276] 0709 12:23:57.632265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.636138 (+  3873us) service_pool.cc:224] Handling call
0709 12:23:57.636484 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:57.636874 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:57.636900 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:57.637409 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 12:23:57.749623 (+112214us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:57.948795 (+199172us) log.cc:844] Serialized 14 byte log entry
0709 12:23:57.967916 (+ 19121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.968001 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:58.686219 (+718218us) spinlock_profiling.cc:243] Waited 51.3 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:23:58.757483 (+ 71264us) raft_consensus.cc:1685] finished
0709 12:23:58.757586 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:58.757707 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18771,"prepare.queue_time_us":118622,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":22871,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":6070,"spinlock_wait_cycles":118024448,"thread_start_us":288314,"threads_started":2,"wal-append.queue_time_us":291600}
I20260709 12:23:58.762786 23173 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:58.753618 23108 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:58.761054 22774 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:58.715202 23216 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:58.761677 23389 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:58.797271 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:58.808229 18673 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:23:58.812709 18673 pending_rounds.cc:85] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting all ops after (but not including) 6
I20260709 12:23:58.757704 18676 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 14.
I20260709 12:23:58.813124 18673 pending_rounds.cc:107] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting uncommitted NO_OP operation due to leader change: 12.7
W20260709 12:23:58.813779 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 104739us
I20260709 12:23:58.814191 18673 raft_consensus.cc:2889] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:58.792125 23387 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:58.816300 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:58.825662 18494 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:58.794924 23443 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:58.798013 23466 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:58.761994 23464 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:23:58.837401 18524 raft_consensus.cc:1275] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:58.810387 23018 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:58.853245 19210 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:58.834825 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:58.841285 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:58.856148 18673 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:23:58.857532 18599 raft_consensus.cc:1240] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 12:23:58.835274 23066 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 12:23:58.861519 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:23:58.862006 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 69124us
I20260709 12:23:58.861152 18674 raft_consensus.cc:1275] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:23:58.858785 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.862141 18525 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:58.860327 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:58.867374 18570 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:58.834641 23387 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.870014 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:58.880132 18570 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:58.882326 18527 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:23:58.884179 18525 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:58.839648 23293 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:58.886618 18644 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:58.903331 18673 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:23:58.903692 18570 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:23:58.903518 18646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.866012 23018 raft_consensus.cc:697] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:23:58.931820 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 104991us
I20260709 12:23:58.884276 23387 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:58.955792 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:58.969080 18597 raft_consensus.cc:3060] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:58.908190 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:58.970481 18676 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:58.880788 23415 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:23:58.965126 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 61538.5us
I20260709 12:23:58.983417 18570 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:58.986632 23442 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:58.980382 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:58.909075 18673 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:23:58.917546 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 45062.4us
I20260709 12:23:58.843999 23475 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
W20260709 12:23:58.968636 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 82133.7us
I20260709 12:23:58.996165 18644 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:23:58.880376 23324 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:58.911387 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:58.885864 23400 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:23:58.989176 23085 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.994975 18599 raft_consensus.cc:2393] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 14: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:58.997702 18680 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:23:58.872834 23478 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:59.004169 23478 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.004623 23478 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:58.912750 23479 raft_consensus.cc:2804] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:59.004911 23216 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:59.005288 23479 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.005787 23479 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:59.005970 23470 log.cc:927] Time spent T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
W20260709 12:23:59.006287 23474 log.cc:927] Time spent T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 12:23:59.007364 23471 log.cc:927] Time spent T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
W20260709 12:23:59.007962 23477 log.cc:927] Time spent T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 12:23:59.008867 23472 log.cc:927] Time spent T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 12:23:59.011466 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:59.013585 23085 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:58.905313 23275 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:59.004827 23105 consensus_meta.cc:287] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.610s	user 0.007s	sys 0.007s
I20260709 12:23:58.967517 23449 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:58.878446 23468 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.117s
I20260709 12:23:59.020387 18599 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:23:59.035413 18676 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
W20260709 12:23:59.021821 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 57268.5us
I20260709 12:23:58.902293 23406 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:58.982463 23415 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.043416 18680 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:23:58.968602 23293 raft_consensus.cc:697] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:59.046401 18675 raft_consensus.cc:1275] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:23:59.047057 18675 pending_rounds.cc:85] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting all ops after (but not including) 7
I20260709 12:23:59.047310 18675 pending_rounds.cc:107] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:23:59.047569 18675 raft_consensus.cc:2889] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:59.048971 23293 consensus_queue.cc:237] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:59.053526 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 64585us
I20260709 12:23:59.055778 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:59.055737 18570 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:59.056763 18599 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 8.
I20260709 12:23:59.020473 23100 raft_consensus.cc:2804] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:59.057544 18494 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:58.955576 23476 consensus_queue.cc:1059] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.125s
I20260709 12:23:59.062806 18494 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:59.065748 18570 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:59.001423 23243 consensus_queue.cc:1048] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:23:59.046046 23415 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:59.018999 23400 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:59.084205 18599 raft_consensus.cc:1275] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:59.080304 18570 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:59.030078 23299 consensus_queue.cc:1048] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:23:59.076613 23449 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:59.101498 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:59.082201 23443 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.085626 23406 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:59.106379 18570 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:59.103125 18644 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:59.067319 23108 consensus_queue.cc:1048] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:23:59.110558 18570 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:59.076212 23216 consensus_queue.cc:1048] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:23:59.076439 23464 consensus_queue.cc:1059] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:23:59.112236 18644 leader_election.cc:400] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12.
I20260709 12:23:59.094484 23100 raft_consensus.cc:697] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:59.099241 23299 consensus_queue.cc:1243] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:23:59.116937 18644 leader_election.cc:403] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:59.104142 23449 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.100921 23274 raft_consensus.cc:2804] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:59.111335 23406 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.122085 23406 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:59.122228 23490 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:23:59.126895 23486 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12.
W20260709 12:23:59.128235 23473 log.cc:927] Time spent T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:23:59.123950 23464 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:59.132524 23464 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:59.134716 23464 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:59.118407 23442 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:59.118280 23293 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:59.120908 23449 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:59.081236 23018 consensus_queue.cc:237] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:59.118510 23448 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:59.121716 23479 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:59.166288 23479 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:59.121114 23274 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:23:59.168291 23274 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:59.112920 23443 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:23:59.157948 23482 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:59.159426 23100 consensus_queue.cc:237] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:59.206882 18528 raft_consensus.cc:1275] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:23:59.167660 23400 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:59.193907 23482 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.212832 23482 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:59.223582 23497 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.225008 23497 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:59.225962 23465 raft_consensus.cc:3055] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:59.226404 23465 raft_consensus.cc:740] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:59.227530 23497 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:59.227244 23465 consensus_queue.cc:260] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:59.231108 23465 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:59.233037 23415 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:59.239241 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:59.172556 23448 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.233124 23173 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:59.152100 23105 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.241549 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:59.249248 18597 raft_consensus.cc:2468] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 13.
W20260709 12:23:59.251832 18643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.252053 18525 raft_consensus.cc:2410] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:23:59.155357 23442 raft_consensus.cc:697] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:59.259845 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 199298us
I20260709 12:23:59.206578 23379 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
W20260709 12:23:59.304463 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 241726us
I20260709 12:23:59.299080 18572 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:59.262485 23448 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:59.311506 18494 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:59.309012 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 189118us
I20260709 12:23:59.302729 18530 raft_consensus.cc:1275] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:59.308706 23476 consensus_queue.cc:1243] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer a0dee333a83a45f1ab0c1bb6d094afd1 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:59.298763 23452 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:23:59.307729 23394 consensus_queue.cc:1048] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 12:23:59.301708 23105 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:59.315268 23492 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:59.310377 23243 consensus_queue.cc:1048] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
W20260709 12:23:59.392881 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 81472.3us
W20260709 12:23:59.408510 23494 log.cc:927] Time spent T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:23:59.408977 23480 consensus_queue.cc:1048] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:23:59.307673 23379 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:23:59.407879 23498 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.411653 18494 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:59.412997 23415 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 18 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:59.433012 23442 consensus_queue.cc:237] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:59.434988 23443 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:59.439093 23085 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:59.404727 23489 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:59.443244 22373 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:59.404203 23503 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:59.391445 18644 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:23:59.353513 23280 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:59.312397 23478 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:59.360467 23274 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:23:59.487581 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 174314us
W20260709 12:23:59.487776 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 76218.4us
W20260709 12:23:59.495223 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 126800us
I20260709 12:23:59.496533 18494 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:59.497804 18494 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:59.498852 23476 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:23:59.494971 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 384463us
I20260709 12:23:59.499010 18494 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:59.484987 23389 consensus_meta.cc:287] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.000s
I20260709 12:23:59.500064 23389 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:59.500130 23476 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:59.503163 18494 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:59.488325 23466 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:59.470707 23492 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:59.487207 23498 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:23:59.512764 18570 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:59.512949 23281 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:59.513599 23498 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:59.515803 23274 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:23:59.517853 23379 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:59.489408 23289 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10.
I20260709 12:23:59.520244 23478 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 18 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:23:59.521132 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:59.524502 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:59.524678 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:59.525378 18597 raft_consensus.cc:2393] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 17: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:23:59.525695 19244 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:59.529778 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:59.531713 18673 raft_consensus.cc:1275] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:23:59.532156 18673 pending_rounds.cc:85] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting all ops after (but not including) 6
I20260709 12:23:59.532382 18673 pending_rounds.cc:107] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:23:59.532606 18673 raft_consensus.cc:2889] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:59.534312 18494 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:59.535678 18494 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:59.538048 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:59.538625 23358 consensus_queue.cc:1048] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:59.538864 19246 raft_consensus.cc:2368] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 12. Current term is 13.
I20260709 12:23:59.539937 23464 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:59.540318 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:59.540517 23464 raft_consensus.cc:697] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:59.541066 19240 raft_consensus.cc:2368] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 17. Current term is 18.
I20260709 12:23:59.540781 23506 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:59.541493 23464 consensus_queue.cc:237] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:59.542330 23506 raft_consensus.cc:2749] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:59.544438 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:59.545233 18675 raft_consensus.cc:2368] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10.
I20260709 12:23:59.538801 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:23:59.529850 23443 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:59.540946 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:23:59.549765 18599 raft_consensus.cc:1217] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 6.7->[8.8-11.10]   Dedup: 8.8->[9.9-11.10]
I20260709 12:23:59.550330 18599 pending_rounds.cc:85] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9: Aborting all ops after (but not including) 8
I20260709 12:23:59.550549 18599 pending_rounds.cc:107] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:23:59.550801 18599 raft_consensus.cc:2889] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:59.552755 18570 leader_election.cc:400] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Vote denied by peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879) with higher term. Message: Invalid argument: T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 12. Current term is 13.
I20260709 12:23:59.553097 18570 leader_election.cc:403] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:23:59.515537 23281 raft_consensus.cc:2804] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:59.559257 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:59.551237 23492 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:59.577081 18602 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:59.580145 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:23:59.579428 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:59.580725 18605 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:59.581084 18673 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
W20260709 12:23:59.575240 23501 log.cc:927] Time spent T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:23:59.581933 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:59.591456 19244 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:59.582561 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:59.592271 18603 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:23:59.509058 23105 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:59.590291 18598 raft_consensus.cc:1275] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 12:23:59.582212 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 46619.5us
I20260709 12:23:59.594666 18494 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:59.599066 18494 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:59.602450 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:23:59.603406 18673 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:23:59.520998 23406 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:59.589625 23506 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:59.575230 23108 consensus_queue.cc:1048] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:23:59.590703 23443 raft_consensus.cc:697] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:23:59.600752 23280 raft_consensus.cc:697] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:23:59.637707 18602 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 18.
I20260709 12:23:59.669812 18673 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 18.
W20260709 12:23:59.663379 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 152860us
I20260709 12:23:59.604764 23476 raft_consensus.cc:2804] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:59.703446 23281 raft_consensus.cc:697] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:23:59.719692 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 120755us
I20260709 12:23:59.740505 18494 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:59.728394 18644 leader_election.cc:400] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879) with higher term. Message: Invalid argument: T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 17. Current term is 18.
I20260709 12:23:59.729277 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:23:59.741647 18644 leader_election.cc:403] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:59.606575 23498 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:23:59.745240 18494 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:23:59.748169 18494 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:23:59.777269 23400 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879) with higher term. Message: Invalid argument: T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 17. Current term is 18.
I20260709 12:23:59.787993 23479 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:59.749545 23482 consensus_meta.cc:287] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.536s	user 0.012s	sys 0.000s
W20260709 12:23:59.760025 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 48176.6us
I20260709 12:23:59.751719 23506 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:59.775808 23281 consensus_queue.cc:237] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:59.784008 23507 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.775511 23510 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.241s
I20260709 12:23:59.808825 23280 consensus_queue.cc:237] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:59.800302 23443 consensus_queue.cc:237] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:23:59.813948 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 261311us
I20260709 12:23:59.732407 23503 raft_consensus.cc:2749] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:59.726944 23274 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879) with higher term. Message: Invalid argument: T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 12. Current term is 13.
W20260709 12:23:59.818212 23449 consensus_meta.cc:287] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.003s
I20260709 12:23:59.754058 23465 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:59.813686 22670 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.833953 23406 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:59.839293 23448 consensus_meta.cc:287] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9: Time spent flushing consensus metadata: real 0.517s	user 0.005s	sys 0.003s
I20260709 12:23:59.822072 23479 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:59.844208 23468 raft_consensus.cc:3055] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:59.816403 23478 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:23:59.819988 23387 consensus_meta.cc:287] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.822s	user 0.012s	sys 0.000s
I20260709 12:23:59.851632 18605 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:23:59.852907 18644 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:23:59.858047 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 109964us
I20260709 12:23:59.877535 18570 leader_election.cc:400] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10.
I20260709 12:23:59.879295 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2670) took 1135 ms. Trace:
I20260709 12:23:59.880084 18572 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:59.907160 18570 leader_election.cc:403] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:23:59.907675 18494 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:23:59.882459 23518 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.885841 22670 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:59.753875 23498 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:59.907220 18678 rpcz_store.cc:276] 0709 12:23:58.744133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.744289 (+   156us) service_pool.cc:224] Handling call
0709 12:23:58.760902 (+ 16613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:58.798206 (+ 37304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:58.798248 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:58.798543 (+   295us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:58.798613 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.879032 (+1080419us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b5400357fd4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:23:59.879081 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:59.879210 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85157760}
I20260709 12:23:59.912047 18494 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:23:59.912652 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 144307us
I20260709 12:23:59.919358 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:59.922096 23518 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:59.945629 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:23:59.922331 23478 raft_consensus.cc:697] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:59.922165 23387 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:59.868696 23449 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:59.969915 23449 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:23:59.925076 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 47687.1us
I20260709 12:23:59.955104 18522 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:23:59.973552 18522 pending_rounds.cc:85] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 6
I20260709 12:23:59.973862 18522 pending_rounds.cc:107] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:23:59.974174 18522 raft_consensus.cc:2889] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:59.955456 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:59.925115 23503 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:23:59.924109 23085 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:59.960041 23506 consensus_queue.cc:1059] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:59.899039 23468 raft_consensus.cc:740] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:23:59.925323 23293 raft_consensus.cc:2804] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:59.961845 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:59.962055 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:59.989948 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:23:59.825881 23507 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:00.015537 18603 raft_consensus.cc:1275] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:59.929656 22774 raft_consensus.cc:2804] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:59.965046 23479 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:59.967725 23387 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 18 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:23:59.975945 19244 raft_consensus.cc:1275] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:59.976835 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:59.822934 23482 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:23:59.987267 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
W20260709 12:23:59.993752 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 49439.4us
I20260709 12:24:00.029151 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:00.029699 19210 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:23:59.962872 22670 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:00.019596 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:00.020363 18521 raft_consensus.cc:2393] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 12: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:23:59.972536 23466 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:59.973031 23406 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10.
I20260709 12:24:00.037745 19210 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:00.032745 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:59.922228 23475 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 12:24:00.050840 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:00.035346 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:00.045317 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:00.046422 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:00.053850 18524 raft_consensus.cc:2368] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12.
I20260709 12:24:00.047838 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:23:59.900184 23448 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:00.015125 23293 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:00.050324 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:00.051502 18526 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:23:59.955523 23275 consensus_queue.cc:1048] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:24:00.076094 18673 raft_consensus.cc:2393] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 10: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:24:00.031172 23465 raft_consensus.cc:3055] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:00.077687 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:00.082356 23476 raft_consensus.cc:697] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:00.047117 23352 raft_consensus.cc:2804] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:00.090160 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:00.101087 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:00.091809 18646 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:00.084376 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:00.102221 18597 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:00.105819 18646 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:00.088248 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:00.052616 23316 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:00.092000 18603 raft_consensus.cc:1240] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:00.017828 23510 consensus_queue.cc:1048] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:24:00.098505 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:00.048992 23479 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.107434 18646 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:00.036854 22774 raft_consensus.cc:697] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:00.122491 23518 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:00.122726 23523 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.113729 23524 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:00.123510 23503 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.124106 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:00.124138 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:00.082331 23525 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:00.174806 23525 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:00.177112 23525 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:00.085577 23293 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:00.130836 18597 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 18.
I20260709 12:24:00.087638 23465 raft_consensus.cc:740] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:00.092697 23442 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.181137 23465 consensus_queue.cc:260] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:24:00.183498 23532 log.cc:927] Time spent T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:24:00.106657 23352 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.162771 23523 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:00.184331 23352 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:00.186244 23498 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:00.190165 23476 consensus_queue.cc:237] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:00.077823 23492 consensus_queue.cc:1048] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:24:00.128985 23400 raft_consensus.cc:2749] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:00.153864 23478 consensus_queue.cc:237] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:00.201140 23482 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:00.206598 18604 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:00.174095 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:00.145584 18526 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 18 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:00.186142 23523 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:00.117898 23066 raft_consensus.cc:2749] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:00.181413 23442 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:00.149255 23316 raft_consensus.cc:697] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 18 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:24:00.208719 23465 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:00.211588 23105 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:00.148952 23479 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:24:00.244076 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 164626us
I20260709 12:24:00.211134 23173 consensus_queue.cc:1048] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:24:00.246204 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:00.111220 23468 consensus_queue.cc:260] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:00.210038 23503 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:00.257915 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 152182us
I20260709 12:24:00.259424 23543 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:00.259954 23543 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:00.260324 23543 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:00.264848 22872 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:00.269654 23502 consensus_queue.cc:1048] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:24:00.272617 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 119574us
I20260709 12:24:00.273682 18644 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:00.206106 23524 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:00.281635 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:00.282502 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:00.283161 18597 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:24:00.286082 18644 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:00.287003 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:00.287822 18602 raft_consensus.cc:2393] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 14: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:24:00.286805 23507 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:00.290796 23066 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:00.291258 23066 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.291631 23066 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:00.296083 19239 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEARNER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:24:00.300176 23535 log.cc:927] Time spent T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:24:00.281486 23274 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.304435 23274 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:00.302481 23066 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:00.305231 23443 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:00.306656 23274 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:00.307156 23066 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:24:00.285849 23530 log.cc:927] Time spent T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:24:00.305860 23443 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:00.246124 22774 consensus_queue.cc:237] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:00.284341 23105 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:24:00.328791 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 221410us
I20260709 12:24:00.288301 23468 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:00.334026 18646 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:24:00.341694 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 93891.1us
I20260709 12:24:00.346167 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:00.346999 18528 raft_consensus.cc:2393] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 18: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:24:00.349421 18646 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:00.343290 23105 raft_consensus.cc:697] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:24:00.353650 23540 log.cc:927] Time spent T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:24:00.354036 23105 consensus_queue.cc:237] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:00.357003 23503 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:00.358050 23442 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:00.364884 23443 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:00.365841 23539 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:24:00.368527 23479 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:00.340428 23448 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:00.355255 23543 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:00.378791 23543 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:00.381800 18646 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:00.352197 23400 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:00.380201 23542 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:00.383630 18604 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 18.
I20260709 12:24:00.386461 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:00.388657 18646 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:00.285568 23316 consensus_queue.cc:237] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:00.393999 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:00.394922 18646 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:00.389947 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:00.397270 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:00.397986 18646 leader_election.cc:400] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12.
I20260709 12:24:00.399911 18646 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:00.393659 23324 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:00.404129 23479 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:00.393412 23482 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.399514 23507 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:00.399761 23492 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:00.430096 18528 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:00.407665 23548 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.404273 23400 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:00.441133 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:00.439872 23482 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:00.455986 23548 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:00.465480 19240 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:24:00.477012 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:00.478158 19246 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:00.465720 23276 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:00.424511 23479 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:00.508003 19246 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
W20260709 12:24:00.512305 23512 log.cc:927] Time spent T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 1.014s	user 0.005s	sys 0.013s
I20260709 12:24:00.514180 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 3073) took 1928 ms. Trace:
I20260709 12:24:00.514575 18523 rpcz_store.cc:276] 0709 12:23:58.585455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.586492 (+  1037us) service_pool.cc:224] Handling call
0709 12:23:58.586968 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:58.619854 (+ 32886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:58.619883 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:59.360341 (+740458us) spinlock_profiling.cc:243] Waited 8.6 ms on lock 0x7b2c00058ff8. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7add8a11 00007efc7ade8372 00007efc7c51aa01 00007efc7c4df43a 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2
0709 12:23:59.408899 (+ 48558us) log.cc:844] Serialized 26 byte log entry
0709 12:23:59.487292 (+ 78393us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:59.487328 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.487412 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:00.511977 (+1024565us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b240011a8d8. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc792789c4 00007efc79276acb 00007efc79431dc9 00007efc79431a55 00007efc7943109d 00007efc7c06310e 00007efc7c07a88c 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221
0709 12:24:00.513965 (+  1988us) raft_consensus.cc:1685] finished
0709 12:24:00.513986 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:00.514122 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64237,"raft.queue_time_us":53847,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":4915,"spinlock_wait_cycles":47679616,"thread_start_us":71179,"threads_started":1,"wal-append.queue_time_us":81863}
I20260709 12:24:00.516223 23293 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:00.517333 23479 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:00.517369 18526 raft_consensus.cc:1240] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:00.519145 18523 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:24:00.500036 23276 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:00.522657 23293 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:00.523123 23276 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:00.525638 23548 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:00.535396 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:00.536549 18601 raft_consensus.cc:3060] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:00.536729 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:00.538727 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:00.511884 23352 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:00.561038 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:00.567476 18601 raft_consensus.cc:2468] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:24:00.573069 19244 raft_consensus.cc:1240] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:00.574041 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:00.575284 18526 raft_consensus.cc:2410] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:24:00.577549 23500 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:00.578209 23500 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:00.582959 23484 consensus_queue.cc:1059] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:00.587908 18521 raft_consensus.cc:1275] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:24:00.588465 18521 pending_rounds.cc:85] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 5
I20260709 12:24:00.588728 18521 pending_rounds.cc:107] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:24:00.588997 18521 raft_consensus.cc:2889] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:00.578591 23352 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:00.592805 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:00.584100 23484 raft_consensus.cc:3055] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:24:00.599650 18646 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.240.129:45155 timed out after 1.983s (SENT) [suppressed 6 similar messages]
I20260709 12:24:00.602528 23484 raft_consensus.cc:740] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:24:00.620196 18601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:00.621873 18601 raft_consensus.cc:606] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:00.622834 18601 raft_consensus.cc:614] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:00.629873 23542 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:00.630437 18522 raft_consensus.cc:1275] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:24:00.630836 18522 pending_rounds.cc:85] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 7
I20260709 12:24:00.631073 18522 pending_rounds.cc:107] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:24:00.631304 18522 raft_consensus.cc:2889] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:00.631539 23482 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:00.613647 23491 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:24:00.633251 23527 log.cc:927] Time spent T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.526s	user 0.003s	sys 0.000s
I20260709 12:24:00.633083 23491 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:00.636557 18599 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:00.647607 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2688) took 1114 ms. Trace:
I20260709 12:24:00.648286 18676 rpcz_store.cc:276] 0709 12:23:59.532888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.547827 (+ 14939us) service_pool.cc:224] Handling call
0709 12:23:59.548174 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:59.596611 (+ 48437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:59.596643 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:59.597103 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 12:23:59.852482 (+255379us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:59.852522 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.852592 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:00.632590 (+779998us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b4400022b4c. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc79318c85 00007efc793196a2 00007efc7c08b1db 00007efc7c086aaf 00007efc7c07a86e 00007efc7c079bb6 00007efc7c0797d8 00007efc7c083221 00007efc7c0831d9 00007efc7c083169
0709 12:24:00.638076 (+  5486us) raft_consensus.cc:1685] finished
0709 12:24:00.638099 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:00.647513 (+  9414us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51728,"raft.queue_time_us":53458,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":7302,"spinlock_wait_cycles":12251008,"thread_start_us":143802,"threads_started":1,"wal-append.queue_time_us":414508}
I20260709 12:24:00.650527 18598 raft_consensus.cc:1240] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:00.656826 18604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:00.657754 18604 raft_consensus.cc:606] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:00.658185 18604 raft_consensus.cc:614] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:00.660087 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 193173us
W20260709 12:24:00.667670 23550 log.cc:927] Time spent T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 12:24:00.667800 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:00.669524 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:00.663256 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:00.687412 18604 raft_consensus.cc:2368] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 10. Current term is 11.
I20260709 12:24:00.692762 19210 leader_election.cc:400] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 10. Current term is 11.
I20260709 12:24:00.693392 19210 leader_election.cc:403] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:24:00.695724 23493 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for earlier term 10. Current term is 11.
W20260709 12:24:00.695456 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 95833.6us
I20260709 12:24:00.725055 23531 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:00.725659 23531 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:00.757340 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:00.754474 18600 raft_consensus.cc:1240] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:00.730499 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:00.770160 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:00.730060 18598 raft_consensus.cc:1240] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:24:00.804282 18679 raft_consensus.cc:1275] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:24:00.804435 19244 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 13.
W20260709 12:24:00.747274 18494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.735235 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:00.728979 18597 raft_consensus.cc:1240] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:24:00.807065 18679 raft_consensus.cc:1240] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:24:00.756045 18674 raft_consensus.cc:1240] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:24:00.808010 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:00.808197 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:00.808900 18671 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 13.
I20260709 12:24:00.810247 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:00.810740 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:00.769399 18676 raft_consensus.cc:1240] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:00.748950 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:00.796867 18646 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:00.834324 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:00.835734 18676 raft_consensus.cc:1240] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:24:00.830549 18494 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:24:00.847194 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 50457.4us
I20260709 12:24:00.848685 18646 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:00.851634 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:00.852402 18671 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 13.
I20260709 12:24:00.852234 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:00.854031 18679 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 9.
I20260709 12:24:00.857437 18679 raft_consensus.cc:1275] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:00.864653 18679 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:00.866779 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:00.727928 23531 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:00.873018 18494 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:24:00.874713 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:00.875633 18522 raft_consensus.cc:2410] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 12:24:00.879631 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 81755.6us
I20260709 12:24:00.869545 23289 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:00.693325 23500 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:00.768357 23100 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.757853 23358 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:00.901257 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:00.771409 23281 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:00.899483 23289 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:00.724603 23484 consensus_queue.cc:260] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:00.874115 23293 consensus_queue.cc:1059] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:24:00.899844 23531 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:24:00.928170 23561 log.cc:927] Time spent T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:24:00.855427 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:00.987696 18676 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 14.
I20260709 12:24:00.943265 18673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50938 (request call id 683) took 1216 ms. Trace:
I20260709 12:24:00.877209 23480 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:00.878774 23443 raft_consensus.cc:2804] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:24:00.952056 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 84493us
I20260709 12:24:00.877462 23486 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:00.960482 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:01.005125 18605 raft_consensus.cc:2393] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 12: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:24:00.867585 23465 consensus_queue.cc:1059] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 12:24:00.968168 18644 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:00.986676 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:00.876514 23468 consensus_queue.cc:1059] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:24:00.988843 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:00.988708 18673 rpcz_store.cc:276] 0709 12:23:59.727084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.728884 (+  1800us) service_pool.cc:224] Handling call
0709 12:24:00.942982 (+1214098us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54003a1e54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:24:00.943186 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":767928192}
I20260709 12:24:01.009660 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:00.937477 23358 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:00.895088 23507 consensus_queue.cc:1059] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 12:24:01.011659 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:00.985505 23531 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.022338 23507 raft_consensus.cc:3055] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:01.000730 23443 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.018802 18644 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:00.961282 23100 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:00.975333 23281 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.043723 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:01.016372 23299 raft_consensus.cc:2804] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:01.043324 23443 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:01.047205 22373 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:01.027899 23361 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:24:01.055203 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:01.050592 23289 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:01.022826 23524 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:01.056851 23100 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:01.053229 23281 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:01.046368 23542 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:01.065460 23542 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.070932 23358 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:01.025946 23480 raft_consensus.cc:697] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 18 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:01.073016 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:01.072803 23480 consensus_queue.cc:237] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.073729 18526 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:24:01.080116 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:01.081394 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:01.081615 23389 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:24:01.081935 18672 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:01.027982 23507 raft_consensus.cc:740] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:01.083527 23507 consensus_queue.cc:260] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.084718 23507 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:01.023083 23531 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:01.086941 23066 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:01.098629 23066 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:01.099291 23296 consensus_queue.cc:1048] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:01.100615 23100 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:01.101171 23100 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.104082 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2686) took 1572 ms. Trace:
I20260709 12:24:01.104523 18680 rpcz_store.cc:276] 0709 12:23:59.531563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.532075 (+   512us) service_pool.cc:224] Handling call
0709 12:23:59.532484 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:59.584593 (+ 52109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:59.584634 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:59.592397 (+  7763us) log.cc:844] Serialized 26 byte log entry
0709 12:24:00.662233 (+1069836us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b1800422200. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793d4e07 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793f1c02 00007efc7c07920b 00007efc7c07ed23 00007efc7c07f0d1 00007efc7c49aa0f
0709 12:24:00.672694 (+ 10461us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b480018c258. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc81408aa1 00007efc813ffb37 00007efc813ff9ca 00007efc814f726f 00007efc814f6f37 00007efc8150b55c 00007efc8150b508 00007efc8150b488 00007efc8150b443 00007efc8150a6ec 00007efc80434a96
0709 12:24:00.928792 (+256098us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:00.928837 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.928921 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:01.103829 (+174908us) raft_consensus.cc:1685] finished
0709 12:24:01.103855 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.104018 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51588,"raft.queue_time_us":58030,"raft.run_cpu_time_us":3421,"raft.run_wall_time_us":1079575,"spinlock_wait_cycles":26395392,"thread_start_us":266343,"threads_started":1,"wal-append.queue_time_us":1506120}
I20260709 12:24:01.106753 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:01.107214 18672 raft_consensus.cc:2468] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:24:01.113358 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:01.126657 18672 raft_consensus.cc:2393] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 14: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:24:01.131985 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:24:01.138283 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.141392 18570 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:01.142516 22373 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:01.111543 23443 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:01.026783 23503 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:01.117879 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:01.157047 18570 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:01.172049 22373 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:01.210268 18674 raft_consensus.cc:1240] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:01.142486 23491 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:01.224951 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:01.209568 23358 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.228197 23389 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.228659 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:01.171476 23539 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:24:01.220268 23542 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:01.190722 23503 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:01.248512 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 199421us
I20260709 12:24:01.270902 23448 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:01.272871 18644 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:01.272819 23448 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:01.241297 23389 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.242205 23358 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.284938 23542 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:24:01.286194 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.287493 23448 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:01.289878 23389 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:01.292891 18680 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:24:01.293746 23358 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:24:01.280609 23468 consensus_queue.cc:1243] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer c7bd71f1f37c45f28b52c154e59356b9 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:24:01.296772 23468 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.297047 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:01.297331 23468 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.299630 23468 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:01.302634 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:01.284701 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:01.302068 19210 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:24:01.359918 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:01.362146 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 47569.9us
I20260709 12:24:01.364451 18494 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:01.367882 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:01.368975 18671 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 14.
I20260709 12:24:01.371703 18494 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:01.373307 18494 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:01.301152 23468 consensus_queue.cc:1048] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:24:01.375871 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:01.311380 23299 raft_consensus.cc:697] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:01.365813 23389 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.365331 23358 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.379840 18671 raft_consensus.cc:2410] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:24:01.365595 23483 raft_consensus.cc:2804] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:24:01.378223 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 204983us
I20260709 12:24:01.397866 23582 raft_consensus.cc:2804] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:01.405870 23582 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.406392 23582 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:01.407287 18570 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:01.408737 18570 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:01.398672 23581 consensus_queue.cc:1048] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:01.400180 23299 consensus_queue.cc:237] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:01.387662 23389 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.390595 23358 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.384362 23576 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:01.410748 19244 raft_consensus.cc:1275] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:01.411005 18570 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:01.415863 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:01.416059 19210 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:01.389293 23478 consensus_queue.cc:1059] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:24:01.461619 18570 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:24:01.463291 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 47311.1us
I20260709 12:24:01.414041 23517 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:01.472443 18570 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:01.414912 22774 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:01.474650 23452 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:01.476560 23503 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:01.478351 23394 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.500367 23394 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:01.503180 23394 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:01.420833 23483 raft_consensus.cc:697] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:24:01.419322 23480 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:01.418248 23448 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:24:01.413141 23443 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:01.484524 23478 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:01.465437 23491 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:01.478271 23579 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:01.462572 23576 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:01.409654 23577 consensus_queue.cc:1059] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 12:24:01.504509 23449 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:01.505470 22774 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.478346 23468 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:01.475171 23281 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:24:01.514873 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 141684us
I20260709 12:24:01.419431 23531 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:01.509706 23571 log.cc:927] Time spent T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:24:01.535976 23293 raft_consensus.cc:3055] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:01.536446 23293 raft_consensus.cc:740] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:01.536804 22774 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:01.520326 23449 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.537272 23293 consensus_queue.cc:260] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.522661 23468 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:01.520094 23576 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:01.519246 23478 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.544984 23449 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:01.552955 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:01.553256 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:01.545444 23588 raft_consensus.cc:3055] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:01.555953 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:01.556249 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:01.556888 18529 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:24:01.547225 23468 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:01.557289 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:01.523893 23582 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:01.554661 18523 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:24:01.520987 23579 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.557982 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:01.561429 18530 raft_consensus.cc:2393] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 10: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:24:01.559934 18525 raft_consensus.cc:1275] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:24:01.562359 23582 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:01.563521 23358 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:01.565027 23531 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:01.560122 18529 raft_consensus.cc:3055] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:01.573621 18529 raft_consensus.cc:740] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:01.574432 18529 consensus_queue.cc:260] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.575356 18529 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:01.565948 23389 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:01.567373 18672 raft_consensus.cc:2410] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:24:01.549846 23293 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:01.570089 23478 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:01.548297 23479 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:24:01.570529 23568 log.cc:927] Time spent T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:24:01.556134 23588 raft_consensus.cc:740] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:01.580142 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:01.551054 23586 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:01.585335 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:01.585562 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:01.586483 18525 raft_consensus.cc:2410] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:24:01.589501 18675 raft_consensus.cc:1275] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:24:01.587016 23478 raft_consensus.cc:493] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:01.593427 23478 raft_consensus.cc:515] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:01.595902 23478 leader_election.cc:290] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:01.601953 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:01.603647 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:01.610316 18523 raft_consensus.cc:1240] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: [7.6-9.7]
W20260709 12:24:01.611003 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.611395 18529 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 18 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 12:24:01.611805 18529 pending_rounds.cc:85] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 8
I20260709 12:24:01.612609 18529 pending_rounds.cc:107] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 12:24:01.613065 18529 raft_consensus.cc:2889] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:01.614444 18529 raft_consensus.cc:3055] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:01.614735 18529 raft_consensus.cc:740] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:01.546838 23483 consensus_queue.cc:237] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:01.615965 18529 consensus_queue.cc:260] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.617537 18494 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:01.619021 18601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:01.619702 18601 raft_consensus.cc:606] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:01.620116 18601 raft_consensus.cc:614] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:01.622299 18572 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:01.625463 23577 consensus_queue.cc:1059] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:01.626523 23577 raft_consensus.cc:3055] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:01.625854 23588 consensus_queue.cc:260] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.626928 23577 raft_consensus.cc:740] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:01.627656 23588 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:24:01.612269 23583 log.cc:927] Time spent T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:24:01.629751 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:01.632198 18523 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:24:01.638484 18529 raft_consensus.cc:3060] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:01.584285 23479 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:01.587762 23586 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.662743 18572 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:01.666919 18529 raft_consensus.cc:1275] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:24:01.619622 23574 raft_consensus.cc:2749] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:01.675288 18529 pending_rounds.cc:85] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 6
W20260709 12:24:01.628743 23478 consensus_queue.cc:1175] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c7bd71f1f37c45f28b52c154e59356b9" responder_term: 14 status { last_received { term: 12 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 13. Current term is 14. Ops: [13.9-13.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:01.682610 18529 pending_rounds.cc:107] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:24:01.685171 18529 raft_consensus.cc:2889] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:01.655017 23486 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.686234 22872 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:01.659009 23451 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:01.689280 22373 consensus_queue.cc:1048] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:01.691989 22872 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:01.696527 23486 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:01.698348 22872 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:01.701861 23486 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:01.702451 18674 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:24:01.704219 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:01.713162 18598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:01.713825 18598 raft_consensus.cc:606] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:01.714284 18598 raft_consensus.cc:614] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:01.658176 23468 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.672936 23280 consensus_queue.cc:1059] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:24:01.695550 23586 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:01.741597 23574 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:01.742542 23574 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.643546 23577 consensus_queue.cc:260] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.711612 22872 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:01.720443 23448 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:01.752616 23531 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:01.779147 18598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:01.779827 18598 raft_consensus.cc:606] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:01.784130 22872 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:01.764886 23448 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.786712 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:01.788545 23448 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:01.775058 23577 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:01.799489 23479 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:01.800213 23531 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:01.800859 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:01.802670 23468 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:01.803066 23531 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:01.804873 23576 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.810207 23574 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:01.810461 18524 raft_consensus.cc:1240] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 13. Current term is 14. Ops: []
W20260709 12:24:01.811180 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.823225 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:01.772627 23449 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.831465 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:01.833191 18523 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:01.838114 23574 raft_consensus.cc:493] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:01.838721 23574 raft_consensus.cc:515] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:01.840874 23574 leader_election.cc:290] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:01.842049 23574 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.842569 23574 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.828480 23389 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:24:01.844929 23574 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:01.845175 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:01.851504 23584 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:01.852325 23584 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:01.856827 23584 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:01.861840 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:01.858676 23293 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:01.868582 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:24:01.870934 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 54806.4us
W20260709 12:24:01.884076 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.890488 18601 raft_consensus.cc:1240] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:01.863945 23389 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.902002 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:01.903515 18523 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:24:01.892623 23449 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:01.931012 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:01.931784 19210 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:01.932808 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:01.933490 19210 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:01.935648 18524 raft_consensus.cc:1240] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:01.885736 23293 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:01.905217 23389 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:01.956995 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:01.957810 18601 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:24:01.959822 18601 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:24:01.959977 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.939445 23491 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:01.941282 23415 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:01.964170 18675 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:24:01.966683 23493 consensus_queue.cc:1059] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:01.953660 23576 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:01.970760 19210 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:24:01.972705 23465 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:24:01.971412 23497 raft_consensus.cc:3055] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:24:01.988014 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.978603 23483 raft_consensus.cc:2804] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:01.981979 23576 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:02.002249 18572 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:01.990375 23497 raft_consensus.cc:740] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:24:02.006878 18644 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:02.013180 22373 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:02.016273 22373 raft_consensus.cc:697] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:01.978344 23316 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:24:01.995303 23483 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:02.020383 18644 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:02.025126 22373 consensus_queue.cc:237] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:01.994571 23521 consensus_queue.cc:1059] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 12:24:02.036453 23607 log.cc:927] Time spent T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:24:02.036901 23389 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:02.045269 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:02.046090 18671 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:02.052150 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:02.053496 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:02.051618 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:02.055699 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:02.056957 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2697) took 1124 ms. Trace:
I20260709 12:24:02.057368 18679 rpcz_store.cc:276] 0709 12:24:00.932522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.986486 (+ 53964us) service_pool.cc:224] Handling call
0709 12:24:01.880024 (+893538us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814b8fc0 00007efc814a3929 00007efc814a33d2 00007efc7aa1abd4
0709 12:24:01.880193 (+   169us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:01.880543 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:01.880588 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:01.881331 (+   743us) log.cc:844] Serialized 52 byte log entry
0709 12:24:01.998460 (+117129us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:02.021618 (+ 23158us) log.cc:844] Serialized 14 byte log entry
0709 12:24:02.021997 (+   379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.022075 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:02.031900 (+  9825us) raft_consensus.cc:1685] finished
0709 12:24:02.056748 (+ 24848us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.056892 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120,"prepare.queue_time_us":24687,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":9185,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":5037,"spinlock_wait_cycles":10079744,"thread_start_us":88098,"threads_started":1,"wal-append.queue_time_us":133866}
I20260709 12:24:02.023658 23443 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:02.024358 23483 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:02.073873 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:02.004626 23576 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:24:02.079200 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.074877 23579 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:02.080072 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 50677.3us
I20260709 12:24:02.100464 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:24:02.082475 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.028375 23507 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:02.094705 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:02.121692 18679 raft_consensus.cc:1275] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:24:02.122321 18679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2723) took 1011 ms. Trace:
I20260709 12:24:02.122785 18679 rpcz_store.cc:276] 0709 12:24:01.110772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.121053 (+1010281us) service_pool.cc:224] Handling call
0709 12:24:02.121368 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:02.122090 (+   722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.122272 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:02.095553 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:02.129575 18672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 2706) took 1026 ms. Trace:
I20260709 12:24:02.130036 18672 rpcz_store.cc:276] 0709 12:24:01.102683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.131632 (+ 28949us) service_pool.cc:224] Handling call
0709 12:24:02.128947 (+997315us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b54003a0f54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:24:02.129180 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":985389312}
I20260709 12:24:02.130637 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.131991 18672 raft_consensus.cc:1240] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 12:24:02.132388 18601 raft_consensus.cc:1240] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:24:02.133581 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.134181 18602 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 12.
I20260709 12:24:02.134254 18598 raft_consensus.cc:1275] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:24:02.133064 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:02.140676 18677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 2696) took 1209 ms. Trace:
I20260709 12:24:02.141157 18677 rpcz_store.cc:276] 0709 12:24:00.932188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.932341 (+   153us) service_pool.cc:224] Handling call
0709 12:24:02.095387 (+1163046us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b58001d0198. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7927adb1 00007efc793bab71 00007efc793baa22 00007efc822d38d9 00007efc8142dee0 00007efc814f70ab 00007efc814f7131 00007efc814a50a0 00007efc814a4984 00007efc7aa1f6d4 00007efc7aa1f662
0709 12:24:02.140615 (+ 45228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2307840}
I20260709 12:24:02.152344 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.153810 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:02.153997 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.156299 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.162880 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:02.163177 18671 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 15.
I20260709 12:24:02.122110 23576 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:02.171425 18599 raft_consensus.cc:1275] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:24:02.167675 18604 raft_consensus.cc:1240] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:02.172501 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.171526 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:02.168507 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.168731 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.169659 18601 raft_consensus.cc:1275] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:24:02.170006 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.172748 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.168038 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.177421 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.178339 18674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2722) took 1067 ms. Trace:
I20260709 12:24:02.178840 18598 raft_consensus.cc:2410] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:24:02.181196 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:02.182385 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.203791 18606 raft_consensus.cc:2393] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 10: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:24:02.206118 22373 consensus_queue.cc:1048] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:02.208665 18602 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:24:02.205366 18601 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:24:02.213014 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:02.213702 19241 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:02.214003 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40802 (request call id 2698) took 1214 ms. Trace:
I20260709 12:24:02.214354 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.214398 18676 rpcz_store.cc:276] 0709 12:24:00.999574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.999815 (+   241us) service_pool.cc:224] Handling call
0709 12:24:01.000185 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:01.046091 (+ 45906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:01.046137 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:01.046182 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:01.046212 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.213791 (+1167579us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b54001f1b54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:24:02.213840 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.213949 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104921472}
I20260709 12:24:02.215920 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:02.216990 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:02.213708 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:02.164143 23289 raft_consensus.cc:3055] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:02.213405 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:02.219761 18604 raft_consensus.cc:1275] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:02.162617 23293 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:02.223318 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:02.226593 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:02.224198 18494 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:02.171314 23490 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.171260 23449 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:02.235296 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:02.174852 23465 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:02.240252 18676 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 7.
I20260709 12:24:02.241894 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:24:02.236605 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 224727us
I20260709 12:24:02.087128 23497 consensus_queue.cc:260] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:02.362903 18680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 2716) took 1254 ms. Trace:
I20260709 12:24:02.363409 18680 rpcz_store.cc:276] 0709 12:24:01.109058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.228331 (+119273us) service_pool.cc:224] Handling call
0709 12:24:02.362707 (+1134376us) spinlock_profiling.cc:243] Waited 58.9 ms on lock 0x7b54000bd6d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:24:02.362840 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135430912}
I20260709 12:24:02.223938 23289 raft_consensus.cc:740] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:02.294530 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:02.244282 19240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:02.307526 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdefe54c01e0436d82e68981b642554b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:02.312453 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:02.327656 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:02.375257 18677 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:24:02.295017 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 226170us
W20260709 12:24:02.327890 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 90468.3us
W20260709 12:24:02.383142 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.238248 23577 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:02.389576 18646 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:02.391203 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:02.225113 23576 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:02.402894 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:02.400463 23479 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.238003 23618 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.422418 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:02.424381 18646 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:02.427261 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:02.430603 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.438313 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:02.440812 18676 raft_consensus.cc:2393] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 in current term 10: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:24:02.454401 18680 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:02.390730 23577 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.464895 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.243894 23293 consensus_queue.cc:1059] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.199s
I20260709 12:24:02.238749 23574 consensus_queue.cc:1048] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.214s
I20260709 12:24:02.294345 23531 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.135s
I20260709 12:24:02.489890 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.294653 23449 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:02.369228 23465 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:02.460729 23524 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:02.244593 23490 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:02.497968 18676 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:24:02.485211 23618 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:02.450222 23497 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:02.499362 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:02.487952 23577 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:02.438047 23579 consensus_queue.cc:1048] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:24:02.387118 23624 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.149s
I20260709 12:24:02.524744 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:24:02.519011 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 142090us
I20260709 12:24:02.434442 23576 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:02.429566 23479 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:02.535060 18676 raft_consensus.cc:1275] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:02.536768 18672 raft_consensus.cc:1275] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:24:02.538476 18672 raft_consensus.cc:1240] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 12:24:02.521194 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 125595us
W20260709 12:24:02.494277 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.542876 18598 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 18.
W20260709 12:24:02.520815 23615 log.cc:927] Time spent T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:24:02.559278 23100 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:02.563418 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.573504 19241 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 14.
I20260709 12:24:02.573531 18680 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 15.
W20260709 12:24:02.574389 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.575213 19245 raft_consensus.cc:1240] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:24:02.575641 23632 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.575001 18680 raft_consensus.cc:1240] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:02.576227 23632 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:02.578099 18680 raft_consensus.cc:1240] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:02.578590 23632 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:24:02.579816 23627 log.cc:927] Time spent T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:24:02.584406 23465 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:02.585618 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:02.587194 23618 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:02.589754 23576 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:02.590888 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:02.591547 23490 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:02.535920 23389 raft_consensus.cc:2749] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:02.595333 23449 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:02.519515 23289 consensus_queue.cc:260] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:02.597213 23289 raft_consensus.cc:3060] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:02.605439 23479 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:02.615866 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.621978 18678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 2128) took 1816 ms. Trace:
W20260709 12:24:02.624713 18673 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50938 (request call id 686) took 1614 ms (client timeout 1910 ms). Trace:
W20260709 12:24:02.625380 18673 rpcz_store.cc:269] 0709 12:24:01.010526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.011378 (+   852us) service_pool.cc:224] Handling call
0709 12:24:02.624440 (+1613062us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b54003a1e54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:24:02.624631 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1546565888}
I20260709 12:24:02.630017 18676 raft_consensus.cc:1275] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 12:24:02.632227 18676 pending_rounds.cc:85] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting all ops after (but not including) 9
I20260709 12:24:02.632525 18676 pending_rounds.cc:107] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 12:24:02.632823 18676 raft_consensus.cc:2889] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:02.635838 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 80948.2us
I20260709 12:24:02.638465 18677 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 14.
W20260709 12:24:02.639204 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 97873us
I20260709 12:24:02.638290 18570 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:02.661367 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.674551 18603 raft_consensus.cc:1275] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:02.636739 23484 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:02.637753 23531 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:24:02.647583 23483 consensus_meta.cc:287] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.002s
I20260709 12:24:02.688861 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.689828 18604 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 18.
I20260709 12:24:02.704003 18644 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:24:02.715267 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 77089.7us
W20260709 12:24:02.716234 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.710049 18644 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:24:02.765594 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 55666.1us
I20260709 12:24:02.768159 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:24:02.771042 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 54666.6us
I20260709 12:24:02.685171 23479 consensus_queue.cc:1048] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 12:24:02.703578 23539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.001s	sys 0.009s
I20260709 12:24:02.792017 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.711628 23579 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:02.688292 23531 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:02.688741 23483 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:02.788848 23539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.002s	sys 0.010s
I20260709 12:24:02.782471 23490 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:02.809872 23636 consensus_queue.cc:1059] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:24:02.799979 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 199656us
I20260709 12:24:02.817384 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:24:02.805655 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 381344us
I20260709 12:24:02.783349 23507 raft_consensus.cc:2804] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:02.708339 23299 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 12:24:02.824898 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:02.825977 18677 raft_consensus.cc:2410] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 19 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:24:02.827114 19239 raft_consensus.cc:1240] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:02.827433 18675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40802 (request call id 2728) took 1037 ms. Trace:
I20260709 12:24:02.824941 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:02.827876 18675 rpcz_store.cc:276] 0709 12:24:01.790025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.932484 (+142459us) service_pool.cc:224] Handling call
0709 12:24:02.827267 (+894783us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b54000582d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:24:02.827381 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70162176}
I20260709 12:24:02.828610 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:02.782841 23100 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 12:24:02.842693 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.810276 23451 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:02.787712 23379 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 12:24:02.856089 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:02.824954 23507 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.814563 23280 consensus_queue.cc:1048] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:24:02.810572 23584 consensus_queue.cc:1048] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 12:24:02.861020 23443 consensus_meta.cc:287] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1: Time spent flushing consensus metadata: real 0.770s	user 0.013s	sys 0.005s
I20260709 12:24:02.872517 23507 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:02.855980 23493 consensus_queue.cc:1048] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:24:02.859157 23451 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:02.893060 23443 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:24:02.915987 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 97887.7us
I20260709 12:24:02.919399 23451 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:02.924347 23483 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:02.925468 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:02.928680 23531 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:02.935398 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:02.937505 23577 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:02.941504 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:02.943686 23577 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:02.947270 23577 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:02.945825 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.947831 23577 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:02.948845 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:02.178728 18674 rpcz_store.cc:276] 0709 12:24:01.110532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.809518 (+698986us) service_pool.cc:224] Handling call
0709 12:24:01.817755 (+  8237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:01.818047 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:01.833118 (+ 15071us) log.cc:844] Serialized 14 byte log entry
0709 12:24:01.975678 (+142560us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b1800439240. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793d4e07 00007efc8222f9a9 00007efc793f169b 00007efc793ef93f 00007efc793f1c02 00007efc7c07920b 00007efc7c07ed23 00007efc7c07f23a 00007efc7c4e9a2a
0709 12:24:02.174687 (+199009us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:02.174743 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:02.174786 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.174847 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.178282 (+  3435us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13894,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":6064,"spinlock_wait_cycles":3593472,"thread_start_us":197729,"threads_started":1}
I20260709 12:24:02.950057 23577 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:02.946621 23579 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:02.950609 23276 raft_consensus.cc:3055] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:02.951025 23276 raft_consensus.cc:740] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:02.953611 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:02.958299 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.959370 18522 raft_consensus.cc:1275] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:24:02.959877 18522 pending_rounds.cc:85] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 9
I20260709 12:24:02.960104 18522 pending_rounds.cc:107] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:24:02.960352 18522 raft_consensus.cc:2889] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:02.963969 18527 raft_consensus.cc:1240] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 12:24:02.971789 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:02.972168 18521 raft_consensus.cc:1240] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 14. Current term is 15. Ops: []
W20260709 12:24:02.973901 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 154718us
I20260709 12:24:02.972800 19243 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
I20260709 12:24:02.974689 23543 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:02.976459 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 75298.8us
I20260709 12:24:02.974701 18646 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:02.981102 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:02.981851 23570 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.982775 23651 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.990314 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:03.003029 18523 raft_consensus.cc:2393] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 10: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
W20260709 12:24:02.992209 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.003681 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:03.029471 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:03.031217 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:03.035044 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:03.039702 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.042389 19241 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:24:02.994239 23543 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:03.069173 19212 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.021662 23570 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.017195 23651 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.048135 23497 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:03.086773 23066 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:03.062755 23531 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:02.993496 23276 consensus_queue.cc:260] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:03.104405 23657 log.cc:927] Time spent T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 12:24:03.109418 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 66411.1us
W20260709 12:24:03.112382 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.109688 23478 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:03.115448 23641 consensus_queue.cc:1059] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:24:03.099193 23531 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.154124 18599 raft_consensus.cc:1240] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:24:03.155249 23379 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:03.155974 23379 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:03.162662 23379 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:03.164899 23586 consensus_queue.cc:1059] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:03.166332 23630 consensus_queue.cc:1059] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:03.168015 23216 raft_consensus.cc:3055] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:03.168569 23216 raft_consensus.cc:740] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:03.169533 23216 consensus_queue.cc:260] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.170445 23543 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:03.171160 18494 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.179705 18494 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.180658 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:03.181392 18521 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:24:03.181488 18494 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:24:03.182438 23621 log.cc:927] Time spent T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.659s	user 0.002s	sys 0.029s
I20260709 12:24:03.182508 23293 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:24:03.172010 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 45600.1us
I20260709 12:24:03.184625 18494 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.196905 18494 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.183367 23293 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:03.114214 23507 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.203249 19210 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.200105 18572 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:03.200294 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:03.159842 23577 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:03.209190 18529 raft_consensus.cc:2393] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 10: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:24:03.195878 23586 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:03.196092 23639 raft_consensus.cc:2804] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:03.173219 23478 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.236681 18674 raft_consensus.cc:2393] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 11: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:24:03.239512 23570 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:03.240000 23451 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:03.240769 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:03.241755 18570 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:03.242009 23507 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:24:03.228111 23543 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:03.247782 23624 raft_consensus.cc:993] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:03.248543 23624 raft_consensus.cc:1081] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:03.237186 23293 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:03.233271 23577 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.250686 23531 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:03.239395 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:03.236649 23639 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:24:03.251839 23658 log.cc:927] Time spent T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:24:03.254751 23639 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:03.247653 23478 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:03.245085 23665 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:03.260578 23665 raft_consensus.cc:697] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:03.261482 23665 consensus_queue.cc:237] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:24:03.245929 23661 log.cc:927] Time spent T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:24:03.263896 19209 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.232802 23651 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:03.264062 23577 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:03.274986 23478 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:03.276373 23478 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:24:03.278256 19243 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33372 (request call id 378) took 2521 ms (client timeout 1880 ms). Trace:
I20260709 12:24:03.278640 23478 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:24:03.278788 19243 rpcz_store.cc:269] 0709 12:24:00.756717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.756867 (+   150us) service_pool.cc:224] Handling call
0709 12:24:03.278051 (+2521184us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b540059e554. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4e32fa 00007efc814a4b17 00007efc7aa1f6d4 00007efc7aa1f662 00007efc7aa1f591 00007efc7aa1f50c 00007efc7aa1e7c2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:24:03.278161 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4936217984}
I20260709 12:24:03.283814 23452 raft_consensus.cc:3055] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:03.284297 23452 raft_consensus.cc:740] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:03.285176 23452 consensus_queue.cc:260] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:24:03.291015 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.296156 19239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 682) took 1326 ms. Trace:
I20260709 12:24:03.296643 19239 rpcz_store.cc:276] 0709 12:24:01.970144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.976637 (+  6493us) service_pool.cc:224] Handling call
0709 12:24:01.976946 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:02.827533 (+850587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:03.295825 (+468292us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b5400530f54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:24:03.296045 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1954787072}
I20260709 12:24:03.291182 23465 raft_consensus.cc:3055] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:03.298187 23451 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:03.298607 23465 raft_consensus.cc:740] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:03.299712 23465 consensus_queue.cc:260] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.301095 23465 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:03.299081 18600 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:24:03.305311 23478 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:03.310703 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 113922us
I20260709 12:24:03.313524 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.315419 18494 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.317150 18494 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:24:03.324194 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 349549us
I20260709 12:24:03.327590 23618 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:03.328276 23618 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:03.328796 23618 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:03.332260 19242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33382 (request call id 684) took 1202 ms. Trace:
I20260709 12:24:03.333256 19242 rpcz_store.cc:276] 0709 12:24:02.129472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.130255 (+   783us) service_pool.cc:224] Handling call
0709 12:24:02.162526 (+ 32271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:03.249337 (+1086811us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:03.249374 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:03.249421 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:03.249455 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:03.331999 (+ 82544us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54006cd254. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:24:03.332049 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:03.332203 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2498922880}
I20260709 12:24:03.318198 23289 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:24:03.318418 23574 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:03.340607 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:03.310429 23478 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.345266 18598 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:03.349887 18494 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.352306 23531 consensus_queue.cc:1048] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:03.353955 23531 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:03.354467 23531 raft_consensus.cc:697] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:03.354601 23586 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:03.355252 23586 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.357515 23478 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:03.358026 18646 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:03.358666 23673 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:03.355355 23531 consensus_queue.cc:237] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.360605 23579 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:03.359367 18646 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.351606 18494 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.364408 19212 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:24:03.366838 18494 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:03.368785 18494 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.369760 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:03.370666 18679 raft_consensus.cc:2393] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 10: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:24:03.370991 23647 raft_consensus.cc:2804] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:03.372707 18494 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:24:03.364240 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 130930us
I20260709 12:24:03.374119 18494 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.373584 19210 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:03.367654 23584 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:03.378882 23584 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.371443 23647 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.357544 23586 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:03.382081 18646 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.367985 23574 raft_consensus.cc:2749] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:03.375068 23577 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:03.384295 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:03.375600 23673 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:03.386729 18679 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 14.
I20260709 12:24:03.388553 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:03.384107 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:03.372860 23299 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:03.377221 23650 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:03.381826 23443 consensus_queue.cc:1059] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:24:03.380681 23478 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:03.387238 23634 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:03.387607 23644 consensus_queue.cc:1048] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:24:03.400754 23486 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:03.384987 23647 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:03.391167 18523 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:24:03.392087 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:03.392488 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:03.443120 18529 raft_consensus.cc:2410] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:24:03.392935 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:03.403095 18604 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 14.
W20260709 12:24:03.422122 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 179112us
I20260709 12:24:03.410523 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:03.413098 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:03.446636 23574 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.447242 23574 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.375689 23674 raft_consensus.cc:2749] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:03.417873 18598 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:24:03.449311 23574 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:03.418066 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:03.420295 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:03.376199 23618 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.424173 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:03.452605 18673 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
W20260709 12:24:03.452910 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.424582 18646 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.454123 18646 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.454562 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:03.395946 23216 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:03.457801 18603 raft_consensus.cc:1240] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:24:03.439566 23486 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:03.459940 23479 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:03.460211 23486 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:03.460480 23479 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:03.461031 23479 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:03.463943 23443 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:03.464659 23443 consensus_queue.cc:1048] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:03.469393 18679 raft_consensus.cc:1240] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:24:03.472558 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:03.473676 18605 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
I20260709 12:24:03.474942 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:03.426880 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:03.387480 23243 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:03.429710 23639 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:03.431911 23066 raft_consensus.cc:3055] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:24:03.432821 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.433215 22774 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:03.391816 23577 raft_consensus.cc:697] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:03.492769 23577 consensus_queue.cc:237] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:03.421653 18522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:24:03.494488 23486 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.495294 18522 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:03.495711 18522 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:03.422475 23299 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.423009 23650 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.437029 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:03.392333 23584 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:03.455580 18646 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.437995 23673 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
W20260709 12:24:03.502583 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 47067.8us
I20260709 12:24:03.503444 18646 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.485921 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:03.505019 18646 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.486548 23243 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:03.486716 23066 raft_consensus.cc:740] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:03.508530 23066 consensus_queue.cc:260] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:03.509403 23243 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:03.509810 23066 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:03.511399 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:24:03.513046 23642 log.cc:927] Time spent T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.613s	user 0.000s	sys 0.003s
I20260709 12:24:03.513374 23452 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:02.622588 18678 rpcz_store.cc:276] 0709 12:24:00.805893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.806026 (+   133us) service_pool.cc:224] Handling call
0709 12:24:00.870342 (+ 64316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:01.280418 (+410076us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:01.280450 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:01.374623 (+ 94173us) log.cc:844] Serialized 26 byte log entry
0709 12:24:01.538921 (+164298us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:01.538955 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.621413 (+1082458us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54002918d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:24:02.621478 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:02.621547 (+    69us) raft_consensus.cc:1685] finished
0709 12:24:02.621568 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.621877 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32387,"raft.queue_time_us":38703,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":19998,"spinlock_wait_cycles":422313216,"thread_start_us":318075,"threads_started":2,"wal-append.queue_time_us":174072,"wal-append.run_cpu_time_us":6182,"wal-append.run_wall_time_us":1006197}
I20260709 12:24:03.517951 23479 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.488421 18494 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:03.522718 18570 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:03.525323 18570 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:03.531679 18646 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:03.522701 22774 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:03.533598 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 45262.4us
I20260709 12:24:03.527474 18522 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.536158 18646 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.537140 23579 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:03.537842 18522 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:03.538359 18646 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:03.530539 23389 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:03.505836 23672 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:03.527966 23584 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:03.484315 23531 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:03.535100 23100 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:24:03.543366 23531 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.534332 23216 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:03.544304 23216 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:03.533535 22670 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:03.544698 23643 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:03.545436 23478 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:03.545935 23478 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.546361 23478 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:03.487349 23674 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.502404 23673 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:24:03.549813 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.550515 23673 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:03.549851 23634 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:03.547380 23674 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.544726 23216 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:03.560703 23639 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:03.561653 23674 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:03.564287 23100 raft_consensus.cc:2749] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:03.545650 23531 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:03.569166 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:03.579811 23299 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:03.583177 23531 consensus_queue.cc:1059] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:03.584447 23531 raft_consensus.cc:3055] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:03.584793 23531 raft_consensus.cc:740] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:03.585680 23531 consensus_queue.cc:260] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.586493 23618 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:03.586905 23531 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:03.569540 18644 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:03.577055 18494 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:03.590380 18494 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.570910 18646 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.598266 18644 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:03.595836 18494 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.603582 18494 leader_election.cc:304] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.605304 23673 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:03.608683 23647 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:03.609767 18525 raft_consensus.cc:1240] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:03.593358 23639 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:03.611871 23584 raft_consensus.cc:2749] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:03.612270 23650 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:03.593194 23100 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:03.612829 23643 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:03.613086 23100 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.613339 23643 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:03.613603 23100 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:03.613837 23643 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:03.577818 23486 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:03.594336 23465 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:03.618053 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:03.619711 18676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 2146) took 1457 ms. Trace:
I20260709 12:24:03.623401 18676 rpcz_store.cc:276] 0709 12:24:02.162558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.547738 (+385180us) service_pool.cc:224] Handling call
0709 12:24:02.548174 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:02.633444 (+ 85270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:03.619492 (+986048us) spinlock_profiling.cc:243] Waited 81.3 ms on lock 0x7b54003a0f54. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dfe01 00007efc7c4de83e 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6
0709 12:24:03.619652 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186892544}
I20260709 12:24:03.625952 18522 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:03.619467 18494 leader_election.cc:304] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:03.622655 23574 raft_consensus.cc:2749] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:03.624083 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:03.644259 23647 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:03.648370 18672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40800 (request call id 2141) took 1507 ms. Trace:
I20260709 12:24:03.648850 18672 rpcz_store.cc:276] 0709 12:24:02.140741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.539179 (+398438us) service_pool.cc:224] Handling call
0709 12:24:02.827402 (+288223us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:03.020596 (+193194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:03.020627 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:03.036352 (+ 15725us) log.cc:844] Serialized 26 byte log entry
0709 12:24:03.281808 (+245456us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:03.281863 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:03.281977 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:03.363879 (+ 81902us) raft_consensus.cc:1685] finished
0709 12:24:03.363899 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:03.618524 (+254625us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54000582d0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4de8ad 00007efc814a3419 00007efc7aa1abd4 00007efc7aa1ab62 00007efc7aa1aa91 00007efc7aa1aa0c 00007efc7aa19cc2 00007efc7a81a48c 00007efc7a8198c6 00007efc7a81926f
0709 12:24:03.648287 (+ 29763us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":400017,"raft.queue_time_us":65220,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":7426,"spinlock_wait_cycles":662179712,"thread_start_us":399615,"threads_started":2,"wal-append.queue_time_us":306363}
I20260709 12:24:03.643067 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:03.654516 18424 catalog_manager.cc:5697] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 10 to 11, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 11 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:03.655866 23276 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:03.658075 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.657153 18424 catalog_manager.cc:5697] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 4 to 7, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 7 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:03.660020 18424 catalog_manager.cc:5697] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:03.664040 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 60202.9us
I20260709 12:24:03.666203 18570 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:03.668200 23479 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:03.668507 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 57697.8us
I20260709 12:24:03.670285 18644 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:03.673336 23299 raft_consensus.cc:2804] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:03.673867 23299 raft_consensus.cc:697] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:03.674901 23667 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:03.674829 23299 consensus_queue.cc:237] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.611548 23639 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.677588 23639 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:03.681015 23490 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:03.681602 18570 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:03.681664 23490 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:03.681674 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:03.683279 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:03.686415 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:24:03.687924 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 68552.8us
I20260709 12:24:03.688705 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:03.692256 18494 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:03.702343 18529 raft_consensus.cc:1240] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:03.703830 18522 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 11.
I20260709 12:24:03.661900 18424 catalog_manager.cc:5697] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 6 to 9, leader changed from 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 9 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:03.705487 18494 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.708761 18494 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.720685 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:24:03.719518 18570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.723876 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:03.721565 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:24:03.726850 18570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.725041 18673 raft_consensus.cc:2410] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:24:03.728238 18597 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 12.
I20260709 12:24:03.728462 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:03.730816 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:03.731631 18680 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:03.732457 18605 raft_consensus.cc:3055] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:03.732975 18605 raft_consensus.cc:740] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:03.668118 23676 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:03.725561 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:24:03.745257 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 55149.9us
I20260709 12:24:03.745669 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:03.746846 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:03.747143 18530 raft_consensus.cc:1240] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:24:03.739506 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:03.748349 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:03.738416 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:03.738731 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:03.748957 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f0f0df600b45d1b1ba9f3a58145915" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:03.733997 18605 consensus_queue.cc:260] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.750226 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:03.750717 18605 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:03.739852 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:03.748993 18494 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.739997 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:03.740446 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:03.757393 18494 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.740949 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:03.742236 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:03.743275 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:03.759019 18494 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.762002 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:03.746573 19212 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:24:03.754266 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:03.754997 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:03.766194 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:03.766449 22872 raft_consensus.cc:493] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:03.767073 22872 raft_consensus.cc:515] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:03.702215 23577 raft_consensus.cc:2749] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:03.773730 18680 raft_consensus.cc:2468] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:24:03.718454 23641 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:03.718175 23574 raft_consensus.cc:2749] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:03.717832 23465 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:03.777518 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:03.734557 23673 raft_consensus.cc:2749] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:03.718725 23479 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:03.792368 18600 raft_consensus.cc:3060] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:03.754467 23493 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:03.765875 23293 raft_consensus.cc:2749] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:03.766402 23667 raft_consensus.cc:493] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:03.775074 23646 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:03.816805 23638 consensus_queue.cc:1059] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:24:03.783548 23644 raft_consensus.cc:2804] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:03.796489 23586 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:03.822091 18523 raft_consensus.cc:2410] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:24:03.779429 23478 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.831430 23478 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:03.849529 18424 catalog_manager.cc:5697] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:03.870416 22872 leader_election.cc:290] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:03.853281 18600 raft_consensus.cc:2468] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 11.
I20260709 12:24:03.762185 23671 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.125s
I20260709 12:24:03.885367 18570 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:03.881388 18605 raft_consensus.cc:2468] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 8.
I20260709 12:24:03.892189 22373 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:03.896517 18672 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:24:03.896313 23216 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.898013 18677 raft_consensus.cc:1240] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:03.898900 23216 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:03.899418 18680 raft_consensus.cc:1240] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:03.901414 23644 raft_consensus.cc:697] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:24:03.902359 23644 consensus_queue.cc:237] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:03.880998 23669 log.cc:927] Time spent T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:24:03.899974 18603 raft_consensus.cc:1240] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:03.903554 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 57847.9us
W20260709 12:24:03.907872 23686 log.cc:927] Time spent T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:24:03.908241 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:03.916863 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:03.925614 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:24:03.887960 23655 log.cc:927] Time spent T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:24:03.812366 23479 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.945647 19210 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:03.854784 23639 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.851308 23100 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:03.850674 23493 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:03.953063 23490 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:03.908107 23643 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:03.860692 23667 raft_consensus.cc:515] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:03.971486 18496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.953869 23484 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:24:04.029829 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 68982.5us
W20260709 12:24:04.038170 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 279190us
I20260709 12:24:04.040349 18494 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:24:04.027539 23658 log.cc:927] Time spent T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:24:04.045384 18494 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:04.051110 18494 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:04.054276 18646 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:04.059003 18601 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:24:04.060357 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172bc8a62f9b4215b7395487dd4afd2b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:04.063360 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:04.064070 18674 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:04.057886 18646 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:04.066128 18646 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:04.068653 18527 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:24:04.069062 18527 pending_rounds.cc:85] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 8
I20260709 12:24:04.070060 18527 pending_rounds.cc:107] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:24:04.070413 18527 raft_consensus.cc:2889] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:04.072302 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:04.050040 23674 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:04.079365 18646 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:04.050285 23478 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:04.081013 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:04.056543 23646 raft_consensus.cc:2804] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:04.100157 23646 raft_consensus.cc:697] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:24:04.100517 23688 log.cc:927] Time spent T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:24:04.101254 23646 consensus_queue.cc:237] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:04.103292 23639 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:04.079212 23358 raft_consensus.cc:2749] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:04.111828 23667 leader_election.cc:290] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:04.069681 23443 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.112891 23443 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:04.115085 23443 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:04.054665 23577 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:24:04.083863 18601 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:04.085837 23493 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:04.063592 23584 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:04.093843 23648 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:04.094771 23479 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:04.063179 23524 consensus_queue.cc:1059] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:24:04.093909 18494 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:24:04.146282 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 52844.2us
I20260709 12:24:04.147192 18494 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:04.125003 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:04.124715 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:04.123816 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:04.139052 18599 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:24:04.140393 19242 raft_consensus.cc:1275] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:04.141244 23100 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 19 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:04.116986 18646 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:04.151573 18494 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:04.115638 23443 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:04.152154 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:04.156205 18572 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:04.160193 23524 raft_consensus.cc:3055] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:04.160883 23524 raft_consensus.cc:740] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:04.162217 23524 consensus_queue.cc:260] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:04.164091 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:04.160364 23280 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:04.150624 23674 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:04.171572 23449 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
W20260709 12:24:04.177259 23692 log.cc:927] Time spent T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.136s	user 0.003s	sys 0.000s
I20260709 12:24:04.182101 18494 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:04.184830 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:04.115091 23543 raft_consensus.cc:3055] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:04.117153 23643 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 19 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:04.203261 18673 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:24:04.210453 18601 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 15.
W20260709 12:24:04.213629 18644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.217962 18674 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 15.
W20260709 12:24:04.220589 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 103665us
I20260709 12:24:04.223814 18644 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:04.158720 23478 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:04.231191 23478 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:04.231850 23478 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:04.234251 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:04.235267 18601 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:04.225261 18646 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:04.229681 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:04.240800 18675 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:04.243897 23358 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:04.196863 23543 raft_consensus.cc:740] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:24:04.195362 23700 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:04.196907 23674 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:04.218360 23465 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:24:04.264771 18646 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:04.267912 23524 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:04.270635 18672 raft_consensus.cc:1240] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:24:04.229970 23507 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:04.191695 23702 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:04.230187 23443 consensus_queue.cc:1048] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 12:24:04.293035 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:04.304126 23674 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:04.310518 18494 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:04.319049 23702 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:04.319959 23702 raft_consensus.cc:697] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:04.321106 23702 consensus_queue.cc:237] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:04.331594 23465 consensus_queue.cc:1059] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:04.333212 23293 raft_consensus.cc:3055] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:04.333746 23293 raft_consensus.cc:740] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:04.334843 23293 consensus_queue.cc:260] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:04.332372 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab652408d034870b0f276a90a6132d7" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:04.352903 19241 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:24:04.356856 23293 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:04.360368 23674 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:04.362613 23543 consensus_queue.cc:260] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:04.364037 23543 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:04.364246 18601 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:24:04.370157 18424 catalog_manager.cc:5697] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:04.372653 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:04.372447 18424 catalog_manager.cc:5697] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:04.373011 18494 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:04.374449 23465 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:04.375216 23465 raft_consensus.cc:697] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:04.374621 18424 catalog_manager.cc:5697] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:04.376395 23465 consensus_queue.cc:237] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:04.376920 18424 catalog_manager.cc:5697] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 9 to 10, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 10 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:04.382455 18530 raft_consensus.cc:1240] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:04.366699 18675 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:24:04.367609 23674 consensus_queue.cc:1059] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:24:04.385411 18426 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47728 (request call id 220) took 23293 ms (client timeout 15000 ms). Trace:
I20260709 12:24:04.388398 23698 raft_consensus.cc:3055] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:04.389614 23698 raft_consensus.cc:740] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:04.390820 23698 consensus_queue.cc:260] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:04.392738 23698 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:04.368430 18570 leader_election.cc:304] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:24:04.416249 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 192564us
W20260709 12:24:04.412317 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 43986.3us
I20260709 12:24:04.447253 18570 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:04.448891 23584 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:24:04.450354 23448 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:24:04.452739 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 188083us
I20260709 12:24:04.454090 18646 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:24:04.385936 18426 rpcz_store.cc:269] 0709 12:23:41.091647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.122956 (+ 31309us) service_pool.cc:224] Handling call
0709 12:24:04.385306 (+23262350us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:57.659602 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:57.660307 (+   705us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:57.660359 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:23:57.660377 (+    18us) tablet.cc:662] Decoding operations
0709 12:23:57.661068 (+   691us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:57.661162 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:57.661188 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:23:57.661809 (+   621us) tablet.cc:701] Row locks acquired
0709 12:23:57.661857 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:23:57.662031 (+   174us) write_op.cc:270] Start()
0709 12:23:57.662192 (+   161us) write_op.cc:276] Timestamp: P: 1783599837661959 usec, L: 0
0709 12:23:57.662231 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:23:57.662929 (+   698us) log.cc:844] Serialized 2089 byte log entry
0709 12:23:58.268097 (+605168us) op_driver.cc:464] REPLICATION: finished
0709 12:23:58.377305 (+109208us) write_op.cc:301] APPLY: starting
0709 12:23:58.377408 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:58.451617 (+ 74209us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:58.476898 (+ 25281us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:58.597961 (+121063us) spinlock_profiling.cc:243] Waited 6.95 ms on lock 0x7b54002175d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c448571 00007efc7c4dc32a 00007efc7c461f14 00007efc7c461ec3 00007efc7c461e38 00007efc7c461df3 00007efc7c4610dc 00007efc7c48ae16 00007efc7c472cbb 00007efc7c45d39d 00007efc7c460d75
0709 12:23:58.907920 (+309959us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:58.908209 (+   289us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 12:23:58.908289 (+    80us) write_op.cc:312] APPLY: finished
0709 12:23:58.908721 (+   432us) log.cc:844] Serialized 57 byte log entry
0709 12:23:58.908959 (+   238us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:58.909102 (+   143us) write_op.cc:454] Released schema lock
0709 12:23:58.909185 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:58.909648 (+   463us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:58.909677 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3169309,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":103467,"apply.run_cpu_time_us":16327,"apply.run_wall_time_us":532357,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25057,"num_ops":5,"prepare.queue_time_us":318032,"prepare.run_cpu_time_us":28988,"prepare.run_wall_time_us":163787,"raft.queue_time_us":123626,"raft.run_cpu_time_us":36201,"raft.run_wall_time_us":341320,"replication_time_us":605696,"spinlock_wait_cycles":15975168,"thread_start_us":471777,"threads_started":4,"wal-append.queue_time_us":233482,"wal-append.run_cpu_time_us":35532,"wal-append.run_wall_time_us":2017512}]]}
I20260709 12:24:04.472681 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:04.473464 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:04.472886 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:04.474323 18646 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:04.474694 18530 raft_consensus.cc:2410] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:24:04.412089 23517 raft_consensus.cc:2749] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:04.473716 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:04.454605 23641 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:04.488999 19210 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:04.492148 18679 raft_consensus.cc:1240] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:04.494239 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddef1433d2344c9a83050fe07ac225b" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:04.403697 23478 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:04.477687 23100 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:04.458309 23276 consensus_queue.cc:1059] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
W20260709 12:24:04.535342 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 61100.7us
I20260709 12:24:04.537798 18646 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:04.545719 18679 raft_consensus.cc:1240] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Rejecting Update request from peer 8c29c312e4544452b1162d7f81a58cb4 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:04.504096 23648 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:04.568961 18679 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:24:04.458159 23637 consensus_queue.cc:1059] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:24:04.513738 23246 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:04.532092 23665 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:04.601586 23637 raft_consensus.cc:3055] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:24:04.637530 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 66463.9us
I20260709 12:24:04.612386 23667 consensus_queue.cc:1059] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:24:04.572412 23649 raft_consensus.cc:2749] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:04.640343 23617 raft_consensus.cc:3055] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:04.640659 23448 raft_consensus.cc:3055] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:04.660228 23637 raft_consensus.cc:740] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:04.633882 23665 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:04.731585 23665 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:04.638875 23646 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:24:04.685282 23617 raft_consensus.cc:740] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:24:04.740453 23704 log.cc:927] Time spent T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:24:04.740878 23617 consensus_queue.cc:260] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:04.745175 23478 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:04.691571 23448 raft_consensus.cc:740] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:24:04.727074 23703 log.cc:927] Time spent T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.143s	user 0.001s	sys 0.001s
W20260709 12:24:04.752350 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 214631us
I20260709 12:24:04.754969 18646 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:04.756098 18671 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:04.761737 23478 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.762465 23478 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:04.765034 23478 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:04.767803 23637 consensus_queue.cc:260] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:04.772516 18671 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:24:04.774083 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:04.717753 23538 consensus_queue.cc:1059] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 12:24:04.777223 23507 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.803025 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:04.803151 23507 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:04.805264 23478 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:04.805668 23507 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:04.801092 23486 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.806227 18529 raft_consensus.cc:1275] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:24:04.806659 18529 pending_rounds.cc:85] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7: Aborting all ops after (but not including) 7
I20260709 12:24:04.807175 18529 pending_rounds.cc:107] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:24:04.782011 18606 raft_consensus.cc:1275] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:24:04.787703 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:04.807425 18529 raft_consensus.cc:2889] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:04.795504 18599 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:04.808912 23448 consensus_queue.cc:260] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:04.810170 23448 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:04.806627 23486 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:04.813620 23486 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:04.816967 23641 consensus_queue.cc:1175] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2f9872512f1646bc835906bd0e98c6a7" responder_term: 12 status { last_received { term: 12 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 12 index: 9 } }
I20260709 12:24:04.819022 18603 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:04.779150 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:04.821297 18679 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:04.829002 18599 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 13.
W20260709 12:24:04.854830 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 244518us
I20260709 12:24:04.802482 23649 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:24:04.856279 18570 leader_election.cc:304] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:04.871030 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:04.871790 18599 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:24:04.872862 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:04.880306 18603 raft_consensus.cc:2393] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 13: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:24:04.881579 18494 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:04.879686 18644 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:04.889190 18679 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 13.
I20260709 12:24:04.825001 23478 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:24:04.874369 23389 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:04.902885 18529 raft_consensus.cc:1275] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:24:04.892165 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 208536us
I20260709 12:24:04.895239 23465 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:04.921240 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:04.889588 23479 consensus_queue.cc:1048] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:24:04.896854 23452 raft_consensus.cc:2749] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:04.904472 23507 raft_consensus.cc:2804] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:04.933718 18599 raft_consensus.cc:1275] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:04.935082 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:04.941783 19242 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:24:04.936417 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:04.945988 19243 raft_consensus.cc:2393] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 11: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:24:04.944120 23507 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:04.971958 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.929945 23484 consensus_queue.cc:1048] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:24:04.941195 23293 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:24:04.942766 23584 consensus_queue.cc:1048] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:24:04.978992 23507 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:04.994015 23719 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:05.054574 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 147241us
I20260709 12:24:05.055685 18494 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:05.069528 18599 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:24:05.071254 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:05.035552 23465 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:05.132210 23722 log.cc:927] Time spent T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:24:05.129841 23465 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:05.135035 23465 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:05.148203 23394 raft_consensus.cc:3055] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:05.075347 23478 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:05.148731 23394 raft_consensus.cc:740] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:24:05.149665 23394 consensus_queue.cc:260] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:05.152381 23710 log.cc:927] Time spent T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
W20260709 12:24:05.168244 23718 log.cc:927] Time spent T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
W20260709 12:24:05.068612 23705 log.cc:927] Time spent T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 12:24:05.041406 23719 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:05.184191 23478 raft_consensus.cc:697] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
W20260709 12:24:05.182379 23711 log.cc:927] Time spent T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:24:05.185784 23719 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:05.167447 23637 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:05.188263 23617 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:05.185226 23478 consensus_queue.cc:237] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:05.202287 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:05.203286 18606 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 14.
I20260709 12:24:05.204911 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:24:05.206198 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 244784us
I20260709 12:24:05.206493 23448 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:05.209316 23448 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:05.244379 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:05.245319 18527 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 14.
I20260709 12:24:05.251735 18572 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:05.254413 22373 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:05.254828 22373 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:05.255154 22373 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:05.220873 23643 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:05.229422 23448 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:05.268054 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:05.271433 22373 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:05.265803 23293 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:05.275967 23293 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:05.278438 23293 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:05.266018 23484 consensus_queue.cc:1048] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:05.224223 23507 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:05.279699 18678 raft_consensus.cc:2368] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 11. Current term is 12.
I20260709 12:24:05.282877 18528 raft_consensus.cc:2393] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 13: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:24:05.300217 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:05.301640 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:05.302531 18675 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:24:05.305529 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:05.308168 18603 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:24:05.318320 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:05.319005 18525 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:05.338655 18525 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 15.
I20260709 12:24:05.313155 23665 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:05.280822 23643 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:24:05.369647 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 169550us
I20260709 12:24:05.373106 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:05.389618 18603 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:24:05.396200 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:05.398917 18570 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:05.399219 18646 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:05.397943 18680 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:24:05.401180 18644 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:05.402192 22373 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:05.402987 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:05.403854 23740 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:05.405401 23479 raft_consensus.cc:2804] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:05.405948 23479 raft_consensus.cc:697] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:05.399060 18672 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:24:05.412911 18572 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:05.414129 23517 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:05.414538 23517 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:05.414908 23517 raft_consensus.cc:3060] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:05.416478 23667 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:05.417043 23667 raft_consensus.cc:697] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:05.417893 23667 consensus_queue.cc:237] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:05.426360 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:05.426383 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:24:05.427660 19211 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.429479 22872 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.429966 22872 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:05.431860 22872 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:05.432945 18605 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:24:05.444887 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:05.362923 23507 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:24:05.397912 23706 log.cc:927] Time spent T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:24:05.451505 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:05.452450 18494 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:24:05.452898 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 53756.5us
I20260709 12:24:05.456014 23443 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:05.456490 23732 log.cc:927] Time spent T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:24:05.462667 23738 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:24:05.480497 23478 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:05.485008 23643 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:05.463828 23740 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:05.486912 23479 consensus_queue.cc:237] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:05.489288 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:05.406629 23465 raft_consensus.cc:2764] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:24:05.363400 23665 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:05.499464 18528 raft_consensus.cc:2368] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 14. Current term is 15.
I20260709 12:24:05.501469 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:05.502163 18570 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:05.588685 18570 leader_election.cc:400] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 11. Current term is 12.
I20260709 12:24:05.589166 18570 leader_election.cc:403] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:24:05.601274 23709 log.cc:927] Time spent T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:24:05.605392 23718 log.cc:927] Time spent T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:24:05.624075 23745 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:05.632973 23665 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:05.654912 18678 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:24:05.753698 18599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15e3196fc974445e967d05514226ac45"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:05.611904 23719 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 for earlier term 11. Current term is 12.
I20260709 12:24:05.757344 23649 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.765645 23649 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:05.759718 18599 raft_consensus.cc:606] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:05.763036 23394 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:05.763203 23644 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.769497 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:05.773073 18676 raft_consensus.cc:2393] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 19: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:24:05.643692 23517 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:05.779556 23358 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:05.782300 23486 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:05.798192 23486 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:05.776960 23644 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:05.804033 23486 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:05.806134 23517 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:05.813838 23649 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:05.814145 23644 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:24:05.866263 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 87498us
I20260709 12:24:05.891029 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:05.892968 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:05.894416 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:05.895972 18599 raft_consensus.cc:2410] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:24:05.902451 18603 raft_consensus.cc:2393] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 10: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:24:05.921018 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:05.922165 18524 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:24:05.932852 23649 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.933856 23649 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:05.903348 18599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:05.905916 23617 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.937698 23617 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:05.797333 23358 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:05.940400 23649 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:05.941959 23358 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:05.944247 23617 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:05.945168 18599 raft_consensus.cc:606] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:05.949664 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:05.950704 18598 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 13.
I20260709 12:24:05.959219 18599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "512f9ba3d0d04063899283c39177bcdf"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:05.965758 23755 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:05.966662 23755 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:05.961154 18599 raft_consensus.cc:606] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:05.969789 23755 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:05.971695 18599 raft_consensus.cc:614] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:05.973412 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:05.974329 18679 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:24:05.964196 18644 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:05.983399 18570 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:05.985136 23617 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:05.985590 23617 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:05.985960 23617 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:05.988890 23618 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:05.989529 23618 raft_consensus.cc:493] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:05.989996 23618 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:05.992285 18678 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:24:05.996167 22670 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.996830 22670 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:05.996030 18676 raft_consensus.cc:2468] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:24:06.000320 22670 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:06.008279 23478 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:06.009333 23478 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:06.012624 23478 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:06.013689 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:06.014792 18524 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 19.
I20260709 12:24:06.019649 18678 raft_consensus.cc:1275] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:24:06.023854 23650 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.024387 18599 raft_consensus.cc:1275] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:24:06.025142 23650 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:06.032447 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:06.033176 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:06.033963 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:06.034942 18530 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:24:06.034292 18523 raft_consensus.cc:2393] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 8: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:24:06.045133 23650 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:06.033631 18522 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:24:06.046388 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:06.047304 18527 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:24:06.050518 23643 raft_consensus.cc:493] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:06.051532 23643 raft_consensus.cc:515] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:06.072291 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 49770.8us
W20260709 12:24:06.073227 23729 log.cc:927] Time spent T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.710s	user 0.005s	sys 0.009s
I20260709 12:24:06.075233 18605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:06.076395 18605 raft_consensus.cc:606] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:06.076983 18605 raft_consensus.cc:614] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:06.077370 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:06.078285 19241 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 19.
I20260709 12:24:06.079005 18570 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:06.082180 23483 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:06.083290 23483 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:06.082231 23280 raft_consensus.cc:2804] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:06.085750 23280 raft_consensus.cc:697] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:06.086051 23483 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:06.091841 18605 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:24:06.081936 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:06.096077 23543 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.096897 23543 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:06.093375 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:06.094574 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:06.100260 18676 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:24:06.087189 23280 consensus_queue.cc:237] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:06.100302 18678 raft_consensus.cc:2393] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 19: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:24:06.100165 22670 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:06.102209 22670 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:06.102313 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:06.102625 22670 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:06.103015 18530 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 8.
I20260709 12:24:06.104892 19212 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:24:06.109515 23246 raft_consensus.cc:2804] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:06.109325 18599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:06.110095 23246 raft_consensus.cc:493] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.125322 22670 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:06.133555 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:06.134434 18606 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:24:06.136793 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c52474787041b099fe01aa8c862c04" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:06.138058 19241 raft_consensus.cc:3060] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:06.142961 18526 raft_consensus.cc:1275] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:24:06.144274 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:06.145310 18529 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 9.
I20260709 12:24:06.146628 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:06.147202 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:06.147372 18528 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 10.
I20260709 12:24:06.148669 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:06.153599 23617 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:06.155011 23543 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:06.155208 18606 raft_consensus.cc:2368] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 10. Current term is 11.
I20260709 12:24:06.155814 18599 raft_consensus.cc:606] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:06.156272 18599 raft_consensus.cc:614] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:06.130656 23246 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:06.162792 22670 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 19 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:06.162961 23618 raft_consensus.cc:515] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:06.166071 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:06.191263 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:06.192386 18680 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:24:06.193435 23618 leader_election.cc:290] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:06.196686 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:06.197373 18602 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 19.
I20260709 12:24:06.199169 18572 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:06.169710 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:06.170238 22774 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:06.200683 22774 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:06.203161 22774 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:06.205266 23745 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:06.205793 23745 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:06.206228 23745 raft_consensus.cc:3060] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:06.207430 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:06.208663 18675 raft_consensus.cc:2393] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 19: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:24:06.209560 23296 raft_consensus.cc:993] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:06.210191 23731 raft_consensus.cc:1081] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:06.213691 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:06.214526 18675 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:06.218035 23731 raft_consensus.cc:993] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:06.218680 23731 raft_consensus.cc:1081] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:06.220945 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:06.221772 18523 raft_consensus.cc:2393] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 13: Already voted for candidate 2f9872512f1646bc835906bd0e98c6a7 in this term.
I20260709 12:24:06.170816 23643 leader_election.cc:290] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:06.225893 18572 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:06.226913 23490 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:06.174386 18646 leader_election.cc:400] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 14. Current term is 15.
I20260709 12:24:06.227430 23490 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.227694 18646 leader_election.cc:403] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:06.227849 23490 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:06.228818 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 54834.8us
I20260709 12:24:06.229002 23643 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) with higher term. Message: Invalid argument: T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 14. Current term is 15.
I20260709 12:24:06.229948 18646 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:06.231299 18646 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:06.231904 23643 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:06.232419 23643 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:06.232904 23643 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:06.235761 23066 raft_consensus.cc:2804] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:06.236374 23066 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.236729 23066 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:06.174866 23216 consensus_queue.cc:1048] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:24:06.178669 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6156a485f436881bf4d1fb67194d2" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:06.237823 23478 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:24:06.238868 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 70967.8us
I20260709 12:24:06.240120 23389 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.240715 23389 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:06.243319 23389 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:06.243388 18494 leader_election.cc:400] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 10. Current term is 11.
I20260709 12:24:06.244109 18494 leader_election.cc:403] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:06.246346 23646 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:24:06.183929 23617 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:06.189008 19241 raft_consensus.cc:2468] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:24:06.256440 19239 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 19.
I20260709 12:24:06.258018 18570 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:06.258343 23246 raft_consensus.cc:515] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:06.259594 19245 raft_consensus.cc:2368] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9.
I20260709 12:24:06.260210 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:06.261125 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:06.261672 19210 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:06.263348 23394 raft_consensus.cc:2804] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:06.263923 23394 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.264343 19245 raft_consensus.cc:1275] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:24:06.264714 23394 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:06.261786 19241 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 19.
W20260709 12:24:06.269687 18424 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60812 (request call id 120) took 15177 ms (client timeout 15000 ms). Trace:
I20260709 12:24:06.271983 23745 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:06.285069 23478 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:06.286121 23478 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:06.288022 23066 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
W20260709 12:24:06.301901 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 65834.7us
W20260709 12:24:06.302709 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 59571.3us
W20260709 12:24:06.310839 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 52907.2us
I20260709 12:24:06.308538 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:06.317083 18523 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:06.323964 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:06.258998 23646 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 10. Current term is 11.
I20260709 12:24:06.327275 23738 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:24:06.330952 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:06.332722 18598 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:06.323619 23296 consensus_queue.cc:1048] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:24:06.338294 18521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:24:06.339013 18521 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:06.339130 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:06.339792 18526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15e3196fc974445e967d05514226ac45"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:24:06.340356 18526 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:06.322487 23755 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:06.340763 18526 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:06.339448 18521 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:06.346333 18675 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
I20260709 12:24:06.354106 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:06.356019 23246 leader_election.cc:290] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:06.356689 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08cf98d6828c446ebc2e69eda1b33719" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:06.357576 18525 raft_consensus.cc:3060] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:24:06.358078 23755 raft_consensus.cc:697] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 19 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:06.359057 23702 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:06.359326 23755 consensus_queue.cc:237] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:06.359790 23702 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:06.362108 23702 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:06.362350 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52124cfb8a140deaab206a18aadc308" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:06.329525 23745 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 19 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:06.370780 22670 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.369115 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:06.370345 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:06.369719 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:06.388139 18644 leader_election.cc:400] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879) with higher term. Message: Invalid argument: T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9.
I20260709 12:24:06.388559 18644 leader_election.cc:403] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:06.389984 18644 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:06.394356 23643 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:06.395128 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:06.405598 18522 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
W20260709 12:24:06.270296 18424 rpcz_store.cc:269] 0709 12:23:51.095493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.142875 (+ 47382us) service_pool.cc:224] Handling call
0709 12:24:06.269396 (+15126521us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:04.970654 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:05.154406 (+183752us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:05.154445 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:24:05.154457 (+    12us) tablet.cc:662] Decoding operations
0709 12:24:05.155390 (+   933us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:05.155443 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:05.155475 (+    32us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:24:05.156211 (+   736us) tablet.cc:701] Row locks acquired
0709 12:24:05.156226 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:24:05.156401 (+   175us) write_op.cc:270] Start()
0709 12:24:05.156517 (+   116us) write_op.cc:276] Timestamp: P: 1783599845156338 usec, L: 0
0709 12:24:05.156534 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:24:05.157223 (+   689us) log.cc:844] Serialized 3628 byte log entry
0709 12:24:05.781227 (+624004us) op_driver.cc:464] REPLICATION: finished
0709 12:24:05.810943 (+ 29716us) write_op.cc:301] APPLY: starting
0709 12:24:05.811059 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:05.817381 (+  6322us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:05.817526 (+   145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:05.824206 (+  6680us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:05.824523 (+   317us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=0,mrs_lookups=0
0709 12:24:05.824594 (+    71us) write_op.cc:312] APPLY: finished
0709 12:24:05.824997 (+   403us) log.cc:844] Serialized 89 byte log entry
0709 12:24:05.825973 (+   976us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:05.826151 (+   178us) write_op.cc:454] Released schema lock
0709 12:24:05.826224 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:05.826711 (+   487us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:05.826750 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1640285,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":28819,"apply.run_cpu_time_us":14816,"apply.run_wall_time_us":15734,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41801,"num_ops":9,"prepare.queue_time_us":450428,"prepare.run_cpu_time_us":37956,"prepare.run_wall_time_us":371076,"raft.queue_time_us":296032,"raft.run_cpu_time_us":19159,"raft.run_wall_time_us":54514,"replication_time_us":612628,"thread_start_us":650579,"threads_started":4,"wal-append.queue_time_us":214577}]]}
I20260709 12:24:06.396998 22670 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:06.364195 23478 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:06.400358 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:06.401880 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:06.396366 18570 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:06.412954 23618 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:06.413635 23584 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:06.413718 23648 raft_consensus.cc:3060] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:24:06.429951 23584 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.430487 23584 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:06.365161 23066 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:06.410866 23646 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.433487 23646 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:06.407675 18599 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 13.
I20260709 12:24:06.426237 18530 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:06.441907 18525 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 14.
I20260709 12:24:06.446312 18527 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
I20260709 12:24:06.454437 18524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:06.456604 22670 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:06.377286 18423 catalog_manager.cc:5697] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 12 to 14, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 14 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.441088 23617 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:06.455665 18524 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:24:06.441322 23646 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:06.476577 18572 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:06.479826 23490 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:06.442288 23649 consensus_queue.cc:1048] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:24:06.485025 18423 catalog_manager.cc:5697] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 8 to 11, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 11 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.486909 18423 catalog_manager.cc:5697] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 7 to 10, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 10 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.495251 18523 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
I20260709 12:24:06.507658 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:06.503980 18521 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:06.516588 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:06.536618 23452 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:06.537146 23452 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.537487 23452 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:06.541419 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:06.542151 18674 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:24:06.496271 23415 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:06.548491 18423 catalog_manager.cc:5697] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 9 to 12, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 12 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:24:06.560261 19212 leader_election.cc:304] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:24:06.560710 18530 raft_consensus.cc:2468] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:24:06.553730 23394 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:06.565304 18598 raft_consensus.cc:2468] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 14.
I20260709 12:24:06.560091 18494 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:06.564723 23648 raft_consensus.cc:2749] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879) with higher term. Message: Invalid argument: T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 8. Current term is 9.
I20260709 12:24:06.509542 23643 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:06.575888 18676 raft_consensus.cc:2393] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 19: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
W20260709 12:24:06.555649 23764 log.cc:927] Time spent T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:24:06.583125 18521 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:06.586019 18646 leader_election.cc:304] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:06.584017 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:06.531231 23617 raft_consensus.cc:697] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:06.564128 23491 raft_consensus.cc:2804] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:06.583206 18526 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:06.590034 18646 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:06.597564 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:06.591313 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:06.597692 18646 leader_election.cc:304] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:06.600422 18524 raft_consensus.cc:1240] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:06.539482 23584 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:06.602291 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:06.609941 23491 raft_consensus.cc:697] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:24:06.612380 23491 consensus_queue.cc:237] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:06.617115 23490 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:06.621011 18529 raft_consensus.cc:2468] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 19.
I20260709 12:24:06.593153 23648 raft_consensus.cc:2749] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:06.592163 23478 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:06.609795 18423 catalog_manager.cc:5697] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:06.674135 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 64971.8us
I20260709 12:24:06.608397 23066 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:06.725255 18423 catalog_manager.cc:5697] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.575587 23415 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:06.730116 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 125965us
I20260709 12:24:06.675621 23478 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:06.610548 23650 raft_consensus.cc:2804] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:06.745268 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:24:06.746548 23766 log.cc:927] Time spent T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 12:24:06.725805 23066 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.715993 18526 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:06.750075 23478 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:06.770581 18423 catalog_manager.cc:5697] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.767488 23066 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:06.797398 23584 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 20 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:06.797515 23415 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:06.801556 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:06.803207 18598 raft_consensus.cc:3055] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:06.803946 18598 raft_consensus.cc:740] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:06.811735 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:06.817811 18523 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:24:06.833513 18598 consensus_queue.cc:260] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:06.775573 23617 consensus_queue.cc:237] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:06.843693 18423 catalog_manager.cc:5697] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 9 to 11, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 11 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:24:06.848443 18423 catalog_manager.cc:5697] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.850025 18423 catalog_manager.cc:5697] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.851516 18423 catalog_manager.cc:5697] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:06.844585 23776 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:06.854094 23776 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:06.853495 18423 catalog_manager.cc:5697] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.856396 18423 catalog_manager.cc:5697] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.858739 18423 catalog_manager.cc:5697] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.842365 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:06.861447 18423 catalog_manager.cc:5697] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.862632 18606 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 11.
I20260709 12:24:06.842419 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:06.865929 18603 raft_consensus.cc:3055] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:06.866257 18603 raft_consensus.cc:740] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:06.867205 19210 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:06.842216 23738 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:06.870754 18603 consensus_queue.cc:260] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:06.877074 23644 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:06.883226 19245 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 19 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:24:06.885296 23452 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:06.878732 23644 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:06.888154 23452 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:06.888285 23644 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:06.900527 18603 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:06.899025 18423 catalog_manager.cc:5697] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:06.907842 23769 log.cc:927] Time spent T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.386s	user 0.016s	sys 0.024s
I20260709 12:24:06.908429 18423 catalog_manager.cc:5697] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.909871 23066 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:06.911307 18672 raft_consensus.cc:2368] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 13. Current term is 14.
I20260709 12:24:06.910583 18423 catalog_manager.cc:5697] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 12 to 14, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 14 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:24:06.913049 18423 catalog_manager.cc:5697] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 10 to 13, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 13 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
W20260709 12:24:06.914067 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 217531us
I20260709 12:24:06.914815 18423 catalog_manager.cc:5697] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:06.917011 23775 log.cc:927] Time spent T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:24:06.916770 18423 catalog_manager.cc:5697] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 5 to 8, leader changed from 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 8 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
W20260709 12:24:06.919600 23772 log.cc:927] Time spent T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:24:06.919178 18423 catalog_manager.cc:5697] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 10 to 13, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 13 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.921285 18423 catalog_manager.cc:5697] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.922811 18423 catalog_manager.cc:5697] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 9 to 13, leader changed from 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 13 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.917083 23650 raft_consensus.cc:697] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:06.927187 23650 consensus_queue.cc:237] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:06.929239 23066 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:06.929749 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:06.931640 23781 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:06.933590 23478 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:06.934304 18599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:06.935177 18599 raft_consensus.cc:2393] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 14: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:24:06.906286 23394 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:06.936101 23478 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:06.934238 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:06.937376 18602 raft_consensus.cc:3060] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:06.924381 18423 catalog_manager.cc:5697] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.945021 18423 catalog_manager.cc:5697] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.948510 18606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:06.955271 23776 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:06.959879 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:06.960702 18600 raft_consensus.cc:2368] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 10. Current term is 11.
I20260709 12:24:06.968858 18598 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:06.947609 18423 catalog_manager.cc:5697] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 9 to 11, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 11 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:24:06.973158 18423 catalog_manager.cc:5697] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 10 to 13, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 13 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:24:06.977670 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:06.978431 18678 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
W20260709 12:24:06.978535 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 161191us
I20260709 12:24:06.981913 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:06.982733 18604 raft_consensus.cc:2368] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 13. Current term is 14.
I20260709 12:24:06.983541 18673 raft_consensus.cc:1275] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:24:06.990214 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:06.991106 19241 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:06.901238 23452 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 12:24:07.000912 18494 leader_election.cc:400] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 13. Current term is 14.
I20260709 12:24:07.017081 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:07.029732 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:07.077931 18522 raft_consensus.cc:2393] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 11: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:24:07.065404 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:07.080176 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:07.080808 18521 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:07.077126 18494 leader_election.cc:403] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:24:07.085333 18530 raft_consensus.cc:1240] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:07.079023 18522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:07.086848 18522 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:07.088732 19241 raft_consensus.cc:2468] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 20.
I20260709 12:24:07.091774 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222ae469827d4570aa1d61844f01eae9" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:07.091310 18598 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 15.
I20260709 12:24:07.092008 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eceb66ae237462f8f0e7e3b03872311" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:24:07.084138 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 167605us
I20260709 12:24:07.098513 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:07.097234 18646 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:07.101660 18673 raft_consensus.cc:2393] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 14: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:24:07.102471 18602 raft_consensus.cc:2410] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:24:07.109508 18572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:07.106559 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 105804us
I20260709 12:24:07.111515 18572 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:07.114538 22670 raft_consensus.cc:2804] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:07.112957 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:07.116812 18494 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:07.121031 22670 raft_consensus.cc:697] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 19 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:07.117908 18646 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:07.100131 23358 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.151494 23358 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:07.125552 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:07.154089 23358 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:07.139359 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.158921 18680 raft_consensus.cc:2468] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 9.
I20260709 12:24:07.120193 23738 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:07.141755 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:07.123157 23788 raft_consensus.cc:2804] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:07.160116 23788 raft_consensus.cc:697] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:07.159816 23738 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:07.161163 23788 consensus_queue.cc:237] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:07.162173 23738 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:07.162320 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:07.163100 18677 raft_consensus.cc:2368] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 13. Current term is 14.
I20260709 12:24:07.142920 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:07.164314 18679 raft_consensus.cc:2410] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:24:07.165638 22670 consensus_queue.cc:237] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:07.168870 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b8c963d93464e999fee75e74e9781" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:07.134428 18527 raft_consensus.cc:1275] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:24:07.148011 23789 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:07.148555 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:07.189608 18675 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:07.157789 23783 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:07.144516 23643 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:07.174417 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:07.146457 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:07.195345 18676 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:07.183461 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:07.157004 23644 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:07.190033 18644 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:07.218256 23358 raft_consensus.cc:2804] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:07.218835 23358 raft_consensus.cc:697] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 20 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:07.219729 23358 consensus_queue.cc:237] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:07.225478 23644 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:07.226887 18675 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 14.
I20260709 12:24:07.199761 23784 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:07.228737 23784 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:07.229372 18603 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 14.
I20260709 12:24:07.202358 23643 raft_consensus.cc:697] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:07.244030 18644 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:07.244979 23643 consensus_queue.cc:237] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:07.246136 18644 leader_election.cc:400] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 10. Current term is 11.
I20260709 12:24:07.198061 23783 raft_consensus.cc:697] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:07.206149 23789 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:07.207844 18600 raft_consensus.cc:2393] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 14: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
W20260709 12:24:07.189713 18571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.212767 19245 raft_consensus.cc:1240] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:07.227442 19243 raft_consensus.cc:1240] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:24:07.231082 23784 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:24:07.201872 23787 log.cc:927] Time spent T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.002s
W20260709 12:24:07.242607 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 44992.9us
I20260709 12:24:07.245435 23648 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:24:07.204492 23792 log.cc:927] Time spent T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.064s	user 0.002s	sys 0.000s
W20260709 12:24:07.243949 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 127154us
I20260709 12:24:07.192798 18521 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 11.
I20260709 12:24:07.253909 18522 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 14.
I20260709 12:24:07.250727 19210 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:07.281056 18676 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 15.
I20260709 12:24:07.284852 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
W20260709 12:24:07.262698 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 145957us
I20260709 12:24:07.264927 18680 raft_consensus.cc:1240] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 20 LEADER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:07.292520 18675 raft_consensus.cc:1275] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:07.296737 23483 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:07.302273 22670 consensus_queue.cc:1048] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:24:07.307788 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:07.309641 23789 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:07.310485 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:07.311542 23783 consensus_queue.cc:237] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:07.312628 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:07.281878 23726 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) with higher term. Message: Invalid argument: T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 13. Current term is 14.
I20260709 12:24:07.314164 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:07.316567 18572 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:07.317209 23777 consensus_queue.cc:1048] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:07.303790 18524 raft_consensus.cc:1275] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:07.322911 18572 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:07.334293 23066 consensus_queue.cc:1059] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:07.331153 18570 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:07.331931 23452 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:07.335556 18494 leader_election.cc:400] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 13. Current term is 14.
I20260709 12:24:07.328013 23296 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:07.340198 23452 raft_consensus.cc:697] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:07.342043 23296 raft_consensus.cc:697] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:07.342674 23452 consensus_queue.cc:237] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:07.343016 23296 consensus_queue.cc:237] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:07.347024 23066 raft_consensus.cc:3055] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:07.347463 23066 raft_consensus.cc:740] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:07.349835 18494 leader_election.cc:400] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Vote denied by peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757) with higher term. Message: Invalid argument: T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f9872512f1646bc835906bd0e98c6a7 for earlier term 13. Current term is 14.
I20260709 12:24:07.348322 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:07.353542 18494 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:07.357326 23784 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:07.337751 23800 consensus_queue.cc:1048] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:24:07.365585 23778 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:07.364283 23066 consensus_queue.cc:260] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:07.400628 23066 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:07.419970 23415 consensus_queue.cc:1048] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:24:07.434422 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 68920.7us
I20260709 12:24:07.456832 22670 consensus_queue.cc:1059] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:24:07.466248 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:07.474915 22670 consensus_queue.cc:1243] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer a0dee333a83a45f1ab0c1bb6d094afd1 log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 12:24:07.525127 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 171666us
I20260709 12:24:07.526628 18494 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:07.488315 23745 consensus_queue.cc:1059] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
W20260709 12:24:07.535940 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 51427.7us
I20260709 12:24:07.548120 18601 raft_consensus.cc:1275] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:24:07.550045 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:07.550532 18523 raft_consensus.cc:1275] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:24:07.552273 18525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:07.553030 18525 raft_consensus.cc:2393] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 14: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:24:07.558856 23066 consensus_queue.cc:1048] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:07.561862 18494 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:07.562898 23783 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:07.563624 18494 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:07.568653 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:07.569883 18529 raft_consensus.cc:2410] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:24:07.538450 23478 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:07.572794 23783 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:07.573603 23478 raft_consensus.cc:697] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:07.574680 23478 consensus_queue.cc:237] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:07.585269 18646 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:07.585577 23788 consensus_queue.cc:1048] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:07.588259 23665 raft_consensus.cc:3055] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:07.588734 23665 raft_consensus.cc:740] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:07.589437 23789 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:24:07.589594 23665 consensus_queue.cc:260] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:07.591372 23665 raft_consensus.cc:3060] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:24:07.586596 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 48943.6us
I20260709 12:24:07.597190 19210 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:07.599603 23781 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:07.628012 18646 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:07.641426 23066 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:07.643734 18677 raft_consensus.cc:1275] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:24:07.653648 18646 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:07.655808 23299 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:07.690229 23452 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:07.723315 19245 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:24:07.741142 18602 raft_consensus.cc:1240] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:07.765799 18521 raft_consensus.cc:1275] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:24:07.770112 23777 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:07.887571 18527 raft_consensus.cc:1240] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:07.896750 23819 consensus_queue.cc:1059] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:07.897971 23819 raft_consensus.cc:3055] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:07.898381 23819 raft_consensus.cc:740] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:07.929275 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:07.899492 23819 consensus_queue.cc:260] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:07.953621 23819 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:07.975046 23813 log.cc:927] Time spent T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.111s	user 0.002s	sys 0.000s
W20260709 12:24:07.986977 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 151851us
W20260709 12:24:07.990355 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 223442us
I20260709 12:24:07.990564 18526 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:24:07.996157 18600 raft_consensus.cc:1275] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:24:08.004565 18603 raft_consensus.cc:1275] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 20 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 12:24:08.005020 18603 pending_rounds.cc:85] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9: Aborting all ops after (but not including) 14
I20260709 12:24:08.005247 18603 pending_rounds.cc:107] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 12:24:08.005542 18603 raft_consensus.cc:2889] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:08.010809 23804 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:08.016700 23816 consensus_queue.cc:1048] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:24:08.022979 18677 raft_consensus.cc:1275] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:24:08.011574 23804 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:08.030107 23726 consensus_queue.cc:1048] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:08.032537 18600 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:24:08.043468 18527 raft_consensus.cc:1275] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:24:08.064456 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:08.074501 23745 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:08.071514 23816 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:08.077013 23649 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:24:08.081091 18600 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:24:08.081835 18600 pending_rounds.cc:85] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9: Aborting all ops after (but not including) 5
I20260709 12:24:08.082338 18600 pending_rounds.cc:107] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 7.6
I20260709 12:24:08.082876 18600 raft_consensus.cc:2917] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Aborting config change with OpId 7.6: Aborted: Op aborted by new leader
I20260709 12:24:08.083374 18600 raft_consensus.cc:2889] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:08.083895 18600 pending_rounds.cc:107] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:24:08.084292 18600 raft_consensus.cc:2889] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:08.103169 23804 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:08.104969 18671 raft_consensus.cc:1275] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:24:08.105365 18676 raft_consensus.cc:1275] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:24:08.105401 18671 pending_rounds.cc:85] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting all ops after (but not including) 6
I20260709 12:24:08.106773 18671 pending_rounds.cc:107] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:24:08.107013 18671 raft_consensus.cc:2889] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:08.109467 18674 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:24:08.123925 23745 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:08.132023 22872 consensus_queue.cc:1048] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:24:08.132136 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:08.132723 18678 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:24:08.133997 18526 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:24:08.134433 19239 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:24:08.134811 19239 pending_rounds.cc:85] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4: Aborting all ops after (but not including) 5
I20260709 12:24:08.135043 19239 pending_rounds.cc:107] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 7.6
I20260709 12:24:08.135301 19239 raft_consensus.cc:2917] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Aborting config change with OpId 7.6: Aborted: Op aborted by new leader
I20260709 12:24:08.135668 19239 raft_consensus.cc:2889] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:08.139984 19239 pending_rounds.cc:107] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:24:08.140421 19239 raft_consensus.cc:2889] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:08.159686 23650 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:08.170837 23778 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:08.171839 23643 consensus_queue.cc:1048] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:24:08.178144 23066 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:08.190152 23296 consensus_queue.cc:1048] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:08.204079 18526 raft_consensus.cc:1275] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 19 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 12:24:08.220358 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 45151.1us
I20260709 12:24:08.225001 18494 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:08.253933 23066 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:08.258329 23816 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:08.289479 18601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "298b8c963d93464e999fee75e74e9781"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:08.258281 23726 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:24:08.290989 23794 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.306871 23809 consensus_queue.cc:1048] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:24:08.328410 23794 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:08.337852 23794 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:24:08.409991 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 123613us
I20260709 12:24:08.414987 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:08.423776 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb0137def74cb3b0f0590e5e746d02" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:08.430652 18494 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:08.506281 18601 raft_consensus.cc:606] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:08.506700 18601 raft_consensus.cc:614] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:08.603407 23804 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:08.638540 18601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:08.650763 18601 raft_consensus.cc:606] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
W20260709 12:24:08.659623 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 46206us
I20260709 12:24:08.684271 23820 raft_consensus.cc:1064] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:24:08.686836 23820 consensus_queue.cc:237] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 5, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:08.718641 18600 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:24:08.733521 23649 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:08.767114 23755 raft_consensus.cc:993] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:08.767638 23755 raft_consensus.cc:1081] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:08.811043 19245 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEARNER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:24:08.815634 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 43793.9us
I20260709 12:24:08.841179 18526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:24:08.841787 18526 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:08.850097 18526 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:08.860124 18528 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:24:08.893400 18526 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:08.905555 18526 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:08.916290 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:08.917055 18671 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:08.905470 23648 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:24:08.924768 23643 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:08.967134 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:08.968986 18602 raft_consensus.cc:3055] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:08.989048 18602 raft_consensus.cc:740] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:08.991259 23066 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.991916 23066 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:08.993939 23066 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:08.997022 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:08.997748 19239 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:24:09.000075 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:09.001356 18424 catalog_manager.cc:5697] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:09.007395 18424 catalog_manager.cc:5697] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 11 to 13, leader changed from 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 13 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:09.012017 18424 catalog_manager.cc:5697] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 11 to 13, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 13 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:09.007647 18602 consensus_queue.cc:260] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:09.003394 23788 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:24:09.020615 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 106198us
I20260709 12:24:09.022821 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:09.023626 18598 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:24:09.032872 18671 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 15.
I20260709 12:24:09.037170 23066 raft_consensus.cc:2955] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Committing config change with OpId 11.7: config changed from index 5 to 7, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:09.028488 23788 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:09.047159 18602 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:09.055884 18494 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:09.057077 23804 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:09.057646 23804 raft_consensus.cc:697] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:09.058696 23804 consensus_queue.cc:237] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:09.061782 18424 catalog_manager.cc:5697] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 9 to 11, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 11 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:09.045866 23788 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:09.068205 18424 catalog_manager.cc:5697] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:09.075459 18424 catalog_manager.cc:5697] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:09.078074 18424 catalog_manager.cc:5697] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:09.080881 19239 raft_consensus.cc:2955] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index 5 to 7, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:09.104627 18598 raft_consensus.cc:2955] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index 5 to 7, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:09.096328 18424 catalog_manager.cc:5697] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:09.116525 18424 catalog_manager.cc:5697] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:09.182443 18521 raft_consensus.cc:2955] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index 5 to 7, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:09.194537 23788 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:09.168776 18424 catalog_manager.cc:5697] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 12 to 13, leader changed from 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 13 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:09.203112 18602 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 15.
I20260709 12:24:09.201725 18424 catalog_manager.cc:5697] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 11 to 14, leader changed from 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 14 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:09.207064 18423 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47714 (request call id 204) took 9391 ms. Trace:
I20260709 12:24:09.253057 19239 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4"
dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:33400
I20260709 12:24:09.253639 19239 raft_consensus.cc:606] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:09.253959 19239 raft_consensus.cc:614] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:09.212345 18423 rpcz_store.cc:276] 0709 12:23:59.832264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.832520 (+   256us) service_pool.cc:224] Handling call
0709 12:24:09.206994 (+9374474us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:07.342145 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:07.342866 (+   721us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:07.342923 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:24:07.342942 (+    19us) tablet.cc:662] Decoding operations
0709 12:24:07.345030 (+  2088us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:07.345148 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:07.345176 (+    28us) tablet.cc:685] Acquiring locks for 28 operations
0709 12:24:07.409611 (+ 64435us) tablet.cc:701] Row locks acquired
0709 12:24:07.409683 (+    72us) write_op.cc:260] PREPARE: finished
0709 12:24:07.409934 (+   251us) write_op.cc:270] Start()
0709 12:24:07.410139 (+   205us) write_op.cc:276] Timestamp: P: 1783599847409837 usec, L: 0
0709 12:24:07.410190 (+    51us) op_driver.cc:348] REPLICATION: starting
0709 12:24:07.443006 (+ 32816us) log.cc:844] Serialized 11078 byte log entry
0709 12:24:07.686930 (+243924us) op_driver.cc:464] REPLICATION: finished
0709 12:24:07.797016 (+110086us) write_op.cc:301] APPLY: starting
0709 12:24:07.807629 (+ 10613us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:08.142037 (+334408us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:08.142178 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:08.451174 (+308996us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:08.451686 (+   512us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=0,mrs_lookups=0
0709 12:24:08.451780 (+    94us) write_op.cc:312] APPLY: finished
0709 12:24:08.452413 (+   633us) log.cc:844] Serialized 244 byte log entry
0709 12:24:08.454457 (+  2044us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:08.454700 (+   243us) write_op.cc:454] Released schema lock
0709 12:24:08.454795 (+    95us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:08.455273 (+   478us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:08.455310 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1241196,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":77047,"apply.run_cpu_time_us":42780,"apply.run_wall_time_us":686915,"cfile_cache_hit":114,"cfile_cache_hit_bytes":121335,"num_ops":28,"prepare.queue_time_us":113969,"prepare.run_cpu_time_us":34293,"prepare.run_wall_time_us":212423,"raft.queue_time_us":95422,"raft.run_cpu_time_us":21239,"raft.run_wall_time_us":63079,"replication_time_us":276573,"thread_start_us":276238,"threads_started":4,"wal-append.queue_time_us":142745}]]}
W20260709 12:24:09.267366 23862 log.cc:927] Time spent T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:24:09.281320 18601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:09.286966 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:09.288034 18598 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:24:09.289256 23788 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:09.297890 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:09.298601 19239 raft_consensus.cc:3060] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:09.299330 18598 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 13.
I20260709 12:24:09.304626 18644 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:09.312938 23788 raft_consensus.cc:2804] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:09.313589 23788 raft_consensus.cc:697] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:09.281946 18601 raft_consensus.cc:606] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:09.319187 19239 raft_consensus.cc:2468] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 13.
I20260709 12:24:09.314460 23788 consensus_queue.cc:237] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:09.364840 18601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:09.365998 18601 raft_consensus.cc:606] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:09.369021 18601 raft_consensus.cc:614] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:09.377496 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:09.379503 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:09.380460 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:09.463366 18674 raft_consensus.cc:1275] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:24:09.471657 23861 consensus_queue.cc:1048] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:09.475519 18601 raft_consensus.cc:1275] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:24:09.484112 23839 consensus_queue.cc:1048] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:09.694715 23777 raft_consensus.cc:993] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:09.695423 22670 raft_consensus.cc:1081] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Signalling peer a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:09.699925 18674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:40802
I20260709 12:24:09.700714 18674 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:09.701102 18674 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:09.721448 18674 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:09.728350 18674 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:09.729130 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:09.729815 18526 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:09.731312 18424 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60812 (request call id 121) took 2761 ms. Trace:
I20260709 12:24:09.732497 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c31f23053e4804b0fb872f29fde999" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:09.733090 18598 raft_consensus.cc:3055] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:09.733449 18598 raft_consensus.cc:740] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:09.734166 18598 consensus_queue.cc:260] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:09.731822 18424 rpcz_store.cc:276] 0709 12:24:06.967221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:06.967456 (+   235us) service_pool.cc:224] Handling call
0709 12:24:09.728498 (+2761042us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:09.331300 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:09.331909 (+   609us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:09.331944 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:24:09.331960 (+    16us) tablet.cc:662] Decoding operations
0709 12:24:09.332971 (+  1011us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:09.333052 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:09.333083 (+    31us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:24:09.370992 (+ 37909us) tablet.cc:701] Row locks acquired
0709 12:24:09.371013 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:24:09.371168 (+   155us) write_op.cc:270] Start()
0709 12:24:09.371294 (+   126us) write_op.cc:276] Timestamp: P: 1783599849371121 usec, L: 0
0709 12:24:09.371316 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:24:09.374244 (+  2928us) log.cc:844] Serialized 4400 byte log entry
0709 12:24:09.546481 (+172237us) op_driver.cc:464] REPLICATION: finished
0709 12:24:09.618774 (+ 72293us) write_op.cc:301] APPLY: starting
0709 12:24:09.618863 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:09.626357 (+  7494us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:09.626448 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:09.643787 (+ 17339us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:09.644025 (+   238us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 12:24:09.644067 (+    42us) write_op.cc:312] APPLY: finished
0709 12:24:09.644365 (+   298us) log.cc:844] Serialized 105 byte log entry
0709 12:24:09.645173 (+   808us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:09.645314 (+   141us) write_op.cc:454] Released schema lock
0709 12:24:09.645362 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:09.717846 (+ 72484us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:09.717897 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":98530,"reported_tablets":22,"spinlock_wait_cycles":9472,"child_traces":[["op",{"apply.queue_time_us":72010,"apply.run_cpu_time_us":14854,"apply.run_wall_time_us":99015,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50173,"num_ops":11,"prepare.queue_time_us":61464,"prepare.run_cpu_time_us":4599,"prepare.run_wall_time_us":48624,"replication_time_us":174953,"spinlock_wait_cycles":76160,"thread_start_us":121028,"threads_started":2}]]}
I20260709 12:24:09.744218 18598 raft_consensus.cc:3060] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:09.765050 18526 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:24:09.768592 18646 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:09.775589 18598 raft_consensus.cc:2468] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:24:09.778870 23820 raft_consensus.cc:2804] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:09.793927 23820 raft_consensus.cc:697] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:09.805613 23820 consensus_queue.cc:237] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:09.836500 18426 catalog_manager.cc:5697] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 8 to 10, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 10 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:09.839267 18426 catalog_manager.cc:5697] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 6 to 9, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 9 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
W20260709 12:24:09.840772 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 74145us
I20260709 12:24:09.873600 18426 catalog_manager.cc:5697] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 8 to 9, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 9 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:24:09.875669 18426 catalog_manager.cc:5697] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 9 to 12, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 12 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:09.896688 18426 catalog_manager.cc:5697] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:24:09.953344 19239 raft_consensus.cc:1275] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:24:09.953790 18598 raft_consensus.cc:1275] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:24:09.955518 23871 consensus_queue.cc:1048] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:09.956636 23820 consensus_queue.cc:1048] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:10.099889 18427 catalog_manager.cc:5697] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 10 to 13, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 13 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:10.124622 18427 catalog_manager.cc:5697] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 9 to 11, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 11 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:10.117389 18426 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47728 (request call id 221) took 5521 ms. Trace:
I20260709 12:24:10.127547 18426 rpcz_store.cc:276] 0709 12:24:04.596514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.636082 (+ 39568us) service_pool.cc:224] Handling call
0709 12:24:10.117290 (+5481208us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:09.982619 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:09.987636 (+  5017us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:09.987672 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:24:09.987691 (+    19us) tablet.cc:662] Decoding operations
0709 12:24:09.988504 (+   813us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:09.988602 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:09.988632 (+    30us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:24:09.989199 (+   567us) tablet.cc:701] Row locks acquired
0709 12:24:09.989218 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:24:09.989364 (+   146us) write_op.cc:270] Start()
0709 12:24:09.989492 (+   128us) write_op.cc:276] Timestamp: P: 1783599849989312 usec, L: 0
0709 12:24:09.989507 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 12:24:09.990150 (+   643us) log.cc:844] Serialized 2109 byte log entry
0709 12:24:09.993782 (+  3632us) op_driver.cc:464] REPLICATION: finished
0709 12:24:09.994348 (+   566us) write_op.cc:301] APPLY: starting
0709 12:24:09.995254 (+   906us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:10.000816 (+  5562us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:10.000920 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:10.005331 (+  4411us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:10.007339 (+  2008us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 12:24:10.007396 (+    57us) write_op.cc:312] APPLY: finished
0709 12:24:10.007669 (+   273us) log.cc:844] Serialized 57 byte log entry
0709 12:24:10.007883 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:10.008001 (+   118us) write_op.cc:454] Released schema lock
0709 12:24:10.008066 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:10.008463 (+   397us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:10.008495 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5461,"reported_tablets":52,"spinlock_wait_cycles":125824,"child_traces":[["op",{"apply.queue_time_us":324,"apply.run_cpu_time_us":8558,"apply.run_wall_time_us":14066,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20930,"num_ops":5,"prepare.queue_time_us":39019,"prepare.run_cpu_time_us":3484,"prepare.run_wall_time_us":7857,"replication_time_us":4081,"thread_start_us":39154,"threads_started":1}]]}
I20260709 12:24:10.151639 18427 catalog_manager.cc:5697] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 10 to 13, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 13 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:10.161319 18427 catalog_manager.cc:5697] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 10 to 11, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 11 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:10.216935 18424 catalog_manager.cc:5697] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:10.219259 18424 catalog_manager.cc:5697] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:10.220772 18424 catalog_manager.cc:5697] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 5 to 7, term changed from 7 to 11, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:10.297343 18423 catalog_manager.cc:5697] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 14 to 15, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 15 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:24:10.301668 18423 catalog_manager.cc:5697] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 11 to 15, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 15 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:10.303958 18423 catalog_manager.cc:5697] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 9 to 11, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 11 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:10.328567 18423 catalog_manager.cc:5697] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:10.330399 18423 catalog_manager.cc:5697] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:24:10.340688 18423 catalog_manager.cc:5697] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:10.342270 18423 catalog_manager.cc:5697] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:10.344350 18427 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47708 (request call id 184) took 9621 ms. Trace:
I20260709 12:24:10.352612 18523 raft_consensus.cc:1275] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:10.363555 18601 raft_consensus.cc:1275] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:10.364034 18423 catalog_manager.cc:5697] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 12 to 14, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 14 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:24:10.365728 23643 consensus_queue.cc:1048] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:10.362725 18427 rpcz_store.cc:276] 0709 12:24:00.723476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.724578 (+  1102us) service_pool.cc:224] Handling call
0709 12:24:10.344286 (+9619708us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:10.184811 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:10.185338 (+   527us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:10.185375 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:24:10.185387 (+    12us) tablet.cc:662] Decoding operations
0709 12:24:10.185943 (+   556us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:10.185994 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:10.186032 (+    38us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:24:10.186410 (+   378us) tablet.cc:701] Row locks acquired
0709 12:24:10.186424 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:24:10.186567 (+   143us) write_op.cc:270] Start()
0709 12:24:10.186686 (+   119us) write_op.cc:276] Timestamp: P: 1783599850186524 usec, L: 0
0709 12:24:10.186722 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:24:10.187363 (+   641us) log.cc:844] Serialized 1718 byte log entry
0709 12:24:10.189452 (+  2089us) op_driver.cc:464] REPLICATION: finished
0709 12:24:10.189904 (+   452us) write_op.cc:301] APPLY: starting
0709 12:24:10.189989 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:10.192681 (+  2692us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:10.192785 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:10.200168 (+  7383us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:10.200375 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:24:10.200432 (+    57us) write_op.cc:312] APPLY: finished
0709 12:24:10.200683 (+   251us) log.cc:844] Serialized 49 byte log entry
0709 12:24:10.205895 (+  5212us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:10.206003 (+   108us) write_op.cc:454] Released schema lock
0709 12:24:10.206046 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:10.213415 (+  7369us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:10.213449 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":249499,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":220,"apply.run_cpu_time_us":7574,"apply.run_wall_time_us":23443,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16744,"num_ops":4,"prepare.queue_time_us":447,"prepare.run_cpu_time_us":2852,"prepare.run_wall_time_us":2852,"replication_time_us":2592}]]}
I20260709 12:24:10.366562 18423 catalog_manager.cc:5697] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:24:10.367935 18423 catalog_manager.cc:5697] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 12 to 13, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 13 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:10.369642 23788 consensus_queue.cc:1048] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:10.369447 18423 catalog_manager.cc:5697] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 7 to 8, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 8 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:24:10.371063 18423 catalog_manager.cc:5697] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 14 to 18, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 18 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:24:10.388622 18423 catalog_manager.cc:5697] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 9 to 11, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 11 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:24:10.390125 18423 catalog_manager.cc:5697] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:24:10.391872 18423 catalog_manager.cc:5697] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:24:10.393401 18423 catalog_manager.cc:5697] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 13 to 14, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 14 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:24:10.402361 18423 catalog_manager.cc:5697] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 11 to 12, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 12 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:10.403978 18423 catalog_manager.cc:5697] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:10.405506 18423 catalog_manager.cc:5697] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:10.533977 18424 catalog_manager.cc:5697] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:10.597361 18423 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47714 (request call id 205) took 1047 ms. Trace:
I20260709 12:24:10.609093 18423 rpcz_store.cc:276] 0709 12:24:09.550240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.550722 (+   482us) service_pool.cc:224] Handling call
0709 12:24:09.621371 (+ 70649us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b54002175d4. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc7c449090 00007efc7c4e7f3a 00007efc8229de9c 00007efc8239c04e 00007efc8085d2a4 00007efc8085d232 00007efc8085d161 00007efc8085d0dc 00007efc8085c392 00007efc7a81a48c 00007efc7a8198c6
0709 12:24:10.597267 (+975896us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:10.436567 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:10.440092 (+  3525us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:10.440178 (+    86us) write_op.cc:435] Acquired schema lock
0709 12:24:10.440206 (+    28us) tablet.cc:662] Decoding operations
0709 12:24:10.442206 (+  2000us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:10.442274 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:10.442320 (+    46us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:24:10.443713 (+  1393us) tablet.cc:701] Row locks acquired
0709 12:24:10.443733 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:24:10.443923 (+   190us) write_op.cc:270] Start()
0709 12:24:10.444034 (+   111us) write_op.cc:276] Timestamp: P: 1783599850443877 usec, L: 0
0709 12:24:10.444053 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:24:10.444694 (+   641us) log.cc:844] Serialized 7575 byte log entry
0709 12:24:10.447330 (+  2636us) op_driver.cc:464] REPLICATION: finished
0709 12:24:10.447686 (+   356us) write_op.cc:301] APPLY: starting
0709 12:24:10.447799 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:10.469337 (+ 21538us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:10.469451 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:10.515528 (+ 46077us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:10.515833 (+   305us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=0,mrs_lookups=0
0709 12:24:10.515879 (+    46us) write_op.cc:312] APPLY: finished
0709 12:24:10.516272 (+   393us) log.cc:844] Serialized 172 byte log entry
0709 12:24:10.522354 (+  6082us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:10.522546 (+   192us) write_op.cc:454] Released schema lock
0709 12:24:10.522601 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:10.544107 (+ 21506us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:10.544150 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18448,"reported_tablets":39,"spinlock_wait_cycles":84284672,"child_traces":[["op",{"apply.queue_time_us":116,"apply.run_cpu_time_us":22935,"apply.run_wall_time_us":96193,"cfile_cache_hit":76,"cfile_cache_hit_bytes":79534,"num_ops":19,"prepare.queue_time_us":8769,"prepare.run_cpu_time_us":5654,"prepare.run_wall_time_us":11270,"replication_time_us":3167}]]}
I20260709 12:24:10.637234 18426 catalog_manager.cc:5697] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 9 to 10, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 10 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:10.661123 18426 catalog_manager.cc:5697] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 14 to 15, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 15 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } }
I20260709 12:24:10.756539 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:10.974248 18601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:10.974928 18601 raft_consensus.cc:606] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:11.004871 18676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:24:11.005757 18676 raft_consensus.cc:606] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:11.044190 18601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55f8787198c1435695beded3041a941e"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:11.044893 18601 raft_consensus.cc:606] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:11.049182 18676 consensus_queue.cc:237] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:11.064617 18674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:24:11.065306 18674 raft_consensus.cc:606] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:11.074571 18601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6874b99e69744371a73c71762816db62"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:11.075201 18601 raft_consensus.cc:606] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:11.083837 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:11.085705 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:11.086496 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:11.115543 19245 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:24:11.116852 18601 raft_consensus.cc:1275] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:24:11.117532 23788 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:11.129066 23788 consensus_queue.cc:1048] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:11.145138 23820 raft_consensus.cc:2955] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index 7 to 8, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:11.152510 19245 raft_consensus.cc:2955] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:11.177143 18601 raft_consensus.cc:2955] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:11.198311 18426 catalog_manager.cc:5697] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 7 to 8, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New cstate: current_term: 11 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:11.209455 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 298b8c963d93464e999fee75e74e9781 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:11.244637 23871 raft_consensus.cc:993] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:11.245314 23871 raft_consensus.cc:1081] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:11.247627 18530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57374
I20260709 12:24:11.248222 18530 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:11.248615 18530 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:11.256937 18530 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:11.284117 18530 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:11.285861 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:11.286545 18601 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:11.288245 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:11.288561 23776 raft_consensus.cc:993] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:11.288924 18671 raft_consensus.cc:3055] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:11.289182 23776 raft_consensus.cc:1081] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:11.289345 18671 raft_consensus.cc:740] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:11.290338 18671 consensus_queue.cc:260] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:11.291507 18526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55f8787198c1435695beded3041a941e"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:24:11.292168 18526 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:11.292582 18526 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:11.291676 18671 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:11.309590 18601 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 12.
I20260709 12:24:11.312949 18671 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 12.
I20260709 12:24:11.318674 18494 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:11.320307 23887 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:11.320890 23887 raft_consensus.cc:697] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:11.321898 23887 consensus_queue.cc:237] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:11.336722 23820 raft_consensus.cc:993] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:11.337332 23820 raft_consensus.cc:1081] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:11.354380 18530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57374
I20260709 12:24:11.357375 18530 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:11.357841 18530 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:11.393585 18526 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:11.398976 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:11.399230 18530 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:11.399832 18601 raft_consensus.cc:3055] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:11.400405 18601 raft_consensus.cc:740] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:11.409253 18526 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:11.411630 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:11.412314 19245 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:11.428596 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:11.429282 18597 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:11.432073 18530 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:11.434692 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:11.435290 18676 raft_consensus.cc:3055] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:11.435639 18676 raft_consensus.cc:740] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:11.436425 18676 consensus_queue.cc:260] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:11.438113 18676 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:11.443578 23776 raft_consensus.cc:993] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:11.444346 23777 raft_consensus.cc:1081] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:11.440018 18601 consensus_queue.cc:260] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:11.448028 18601 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:11.450716 18523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:24:11.451542 18523 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:11.452057 18523 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:11.453272 19245 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 14.
I20260709 12:24:11.457032 18494 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:24:11.458294 23726 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:11.458853 23726 raft_consensus.cc:697] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:11.459786 23726 consensus_queue.cc:237] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:11.462491 18601 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 14.
I20260709 12:24:11.470456 23745 raft_consensus.cc:993] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:11.471226 23776 raft_consensus.cc:1081] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:11.473701 18526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6874b99e69744371a73c71762816db62"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:24:11.474257 18526 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:11.474638 18526 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:11.481189 18597 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 13.
I20260709 12:24:11.492182 18526 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:11.497463 18676 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 13.
I20260709 12:24:11.500353 18526 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:11.501518 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:11.502276 18597 raft_consensus.cc:3055] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:11.502651 18597 raft_consensus.cc:740] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:11.503698 18597 consensus_queue.cc:260] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:11.501044 18494 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:11.507673 18424 catalog_manager.cc:5697] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 11 to 12, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 12 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:11.515888 23880 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:11.526799 23880 raft_consensus.cc:697] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:11.516600 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:11.529848 18671 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:11.509397 18597 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:11.546262 18671 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 13.
I20260709 12:24:11.547416 18494 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:11.542503 18523 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:11.538887 18512 tablet_service.cc:1558] Processing DeleteTablet for tablet 298b8c963d93464e999fee75e74e9781 with delete_type TABLET_DATA_TOMBSTONED (TS 2f9872512f1646bc835906bd0e98c6a7 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:57364
I20260709 12:24:11.552219 23886 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:11.542165 23880 consensus_queue.cc:237] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:11.591507 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:11.592401 18601 raft_consensus.cc:3055] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:11.592818 18601 raft_consensus.cc:740] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:11.593815 18601 consensus_queue.cc:260] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:11.595217 18601 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:11.596869 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:11.599918 18671 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:11.602896 18523 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:11.608922 18601 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:24:11.614413 18597 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 13.
I20260709 12:24:11.633373 18494 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:11.637503 23726 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:11.638144 23726 raft_consensus.cc:697] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:11.639096 23726 consensus_queue.cc:237] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:11.651139 18671 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:24:11.653288 23896 tablet_replica.cc:333] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:11.657444 23896 raft_consensus.cc:2243] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.658596 23896 raft_consensus.cc:2272] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.661711 23896 ts_tablet_manager.cc:1916] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:11.650322 23886 raft_consensus.cc:697] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:11.664773 23886 consensus_queue.cc:237] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:11.709990 23896 ts_tablet_manager.cc:1929] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.7
I20260709 12:24:11.724145 23896 log.cc:1199] T 298b8c963d93464e999fee75e74e9781 P 2f9872512f1646bc835906bd0e98c6a7: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-0-root/wals/298b8c963d93464e999fee75e74e9781
I20260709 12:24:11.734220 18413 catalog_manager.cc:5028] TS 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): tablet 298b8c963d93464e999fee75e74e9781 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:24:11.739598 18423 catalog_manager.cc:5697] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 13 to 14, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 14 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:11.742462 18423 catalog_manager.cc:5697] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 12 to 13, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 13 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:11.744176 18423 catalog_manager.cc:5697] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 12 to 13, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 13 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:11.772820 18597 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:24:11.783831 23726 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:11.787119 18671 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:24:11.789244 23726 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:11.788827 18423 catalog_manager.cc:5697] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 10 to 11, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 11 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:11.964313 18597 raft_consensus.cc:1275] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:24:11.966176 23886 consensus_queue.cc:1048] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:11.982110 19245 raft_consensus.cc:1275] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:24:11.984912 23886 consensus_queue.cc:1048] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:12.069149 18671 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:24:12.074283 18597 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:24:12.088222 23886 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:12.091903 23897 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:12.113260 18671 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:24:12.131618 23886 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:12.134521 18602 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:24:12.148795 23886 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:24:12.153445 18676 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:24:12.195695 23880 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:12.253865 18597 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:24:12.259426 23880 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:12.533505 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:12.798097 18602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:12.798765 18602 raft_consensus.cc:606] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:12.827378 18602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:12.828069 18602 raft_consensus.cc:606] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:12.838129 18602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:12.838766 18602 raft_consensus.cc:606] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:12.840188 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:12.842253 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:12.843143 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:12.848017 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 71622.1us
I20260709 12:24:12.898275 18677 consensus_queue.cc:237] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
W20260709 12:24:12.925259 18644 consensus_peers.cc:597] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 06c92947c3174627a5618c85f17edeb3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:12.928210 18602 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:24:12.929585 18523 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 18 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:24:12.931528 23820 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:12.932965 23788 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:12.950124 23745 raft_consensus.cc:993] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:12.950717 23745 raft_consensus.cc:1081] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:12.955013 18526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:24:12.955622 18526 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:12.956053 18526 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:12.967206 18526 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:12.970458 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:12.971146 18597 raft_consensus.cc:3055] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:12.971467 18597 raft_consensus.cc:740] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:12.974957 23820 raft_consensus.cc:2955] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 LEADER]: Committing config change with OpId 18.10: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:12.972309 18597 consensus_queue.cc:260] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:12.978770 18597 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:12.978358 18602 raft_consensus.cc:2955] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Committing config change with OpId 18.10: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:12.989148 18523 raft_consensus.cc:2955] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 18 FOLLOWER]: Committing config change with OpId 18.10: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:13.007380 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:13.008052 18676 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:13.008989 18526 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:13.014693 18597 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
I20260709 12:24:13.014860 18676 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 10.
I20260709 12:24:13.043794 18494 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:13.045698 23897 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:13.046290 23897 raft_consensus.cc:697] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:13.047300 23897 consensus_queue.cc:237] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:13.047192 18427 catalog_manager.cc:5697] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 18 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:13.130813 23777 raft_consensus.cc:993] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:13.131448 23745 raft_consensus.cc:1081] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:13.133603 18526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:24:13.134104 18526 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:13.134377 18526 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:13.140082 18526 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:13.149030 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:13.149650 18602 raft_consensus.cc:3055] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:13.149956 18602 raft_consensus.cc:740] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:13.150779 18602 consensus_queue.cc:260] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:13.152976 18602 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:13.177301 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:13.178108 18676 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:13.190057 18676 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 16.
I20260709 12:24:13.190625 18526 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 16 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:13.198299 18602 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 16.
I20260709 12:24:13.212098 18494 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:13.213371 23897 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:13.213893 23897 raft_consensus.cc:697] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:13.210122 18523 consensus_queue.cc:237] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:13.214759 23897 consensus_queue.cc:237] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:24:13.221124 18494 consensus_peers.cc:597] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13a2490fb6904f8ca5c4cab03767d419. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:13.225169 18676 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:24:13.227869 23886 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:13.228307 18600 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:24:13.233408 23886 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:13.239286 23745 raft_consensus.cc:993] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:13.239882 23745 raft_consensus.cc:1081] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Signalling peer a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:13.244203 18677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:40802
I20260709 12:24:13.244910 18677 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:13.245325 18677 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:13.272706 18677 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:13.292300 18677 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:13.309037 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:13.309895 18602 raft_consensus.cc:3055] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:13.311097 18602 raft_consensus.cc:740] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:13.312570 18602 consensus_queue.cc:260] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:13.314052 18602 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:13.325156 18602 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 15.
W20260709 12:24:13.328086 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 47000.6us
I20260709 12:24:13.330761 18600 raft_consensus.cc:2955] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:13.333207 18644 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:13.351610 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:13.352399 18523 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:13.358909 18677 raft_consensus.cc:2955] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:13.372174 23788 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:13.372759 23788 raft_consensus.cc:697] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:13.373641 23788 consensus_queue.cc:237] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:13.350138 23928 raft_consensus.cc:2955] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:13.388046 18523 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 15.
I20260709 12:24:13.423856 18523 raft_consensus.cc:1240] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:13.418413 18423 catalog_manager.cc:5697] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 9 to 10, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 10 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:13.427798 18423 catalog_manager.cc:5697] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 15 to 16, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 16 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:13.436813 18424 catalog_manager.cc:5697] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 11 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
W20260709 12:24:13.482573 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 45130.6us
I20260709 12:24:13.483302 18601 consensus_queue.cc:237] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:13.504421 18424 catalog_manager.cc:5697] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 14 to 15, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 15 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:13.539253 18570 consensus_peers.cc:597] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8f93d163b9441dd9c044b6224aff070. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:13.542852 18676 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:24:13.542989 18530 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:24:13.544785 23916 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:13.546327 23885 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:13.615417 18674 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:24:13.617570 23928 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:13.629894 23940 ts_tablet_manager.cc:933] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:13.631075 23885 raft_consensus.cc:2955] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:13.643762 18676 raft_consensus.cc:2955] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:13.650449 18530 raft_consensus.cc:2955] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:13.690362 18601 raft_consensus.cc:1275] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:24:13.692301 23928 consensus_queue.cc:1048] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:13.714155 23944 ts_tablet_manager.cc:933] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:24:13.719704 18677 raft_consensus.cc:1275] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:24:13.721386 23928 consensus_queue.cc:1048] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:24:13.730957 18523 consensus_queue.cc:237] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:13.779336 18424 catalog_manager.cc:5697] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 11 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:13.793008 23944 tablet_copy_client.cc:323] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.129:45155
I20260709 12:24:13.799139 18540 tablet_copy_service.cc:140] P 2f9872512f1646bc835906bd0e98c6a7: Received BeginTabletCopySession request for tablet 13a2490fb6904f8ca5c4cab03767d419 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:43124)
I20260709 12:24:13.800151 18540 tablet_copy_service.cc:161] P 2f9872512f1646bc835906bd0e98c6a7: Beginning new tablet copy session on tablet 13a2490fb6904f8ca5c4cab03767d419 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:43124: session id = 8c29c312e4544452b1162d7f81a58cb4-13a2490fb6904f8ca5c4cab03767d419
I20260709 12:24:13.804051 23940 tablet_copy_client.cc:323] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.131:36757
I20260709 12:24:13.806393 18690 tablet_copy_service.cc:140] P a0dee333a83a45f1ab0c1bb6d094afd1: Received BeginTabletCopySession request for tablet 06c92947c3174627a5618c85f17edeb3 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:50938)
I20260709 12:24:13.807030 18690 tablet_copy_service.cc:161] P a0dee333a83a45f1ab0c1bb6d094afd1: Beginning new tablet copy session on tablet 06c92947c3174627a5618c85f17edeb3 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:50938: session id = 8c29c312e4544452b1162d7f81a58cb4-06c92947c3174627a5618c85f17edeb3
I20260709 12:24:13.817665 18690 tablet_copy_source_session.cc:215] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:13.834517 18600 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:24:13.856035 18600 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:24:13.841557 23880 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:24:13.856886 18597 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:24:13.863534 18676 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:24:13.868994 18494 consensus_peers.cc:597] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8eebfbd8106141a5903392238ce5a613. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:13.869685 23880 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:13.871944 23928 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:13.881204 23788 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:13.881206 23940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c92947c3174627a5618c85f17edeb3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:13.900153 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 59882.7us
I20260709 12:24:13.901794 18523 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:24:13.904023 23788 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:13.910771 18540 tablet_copy_source_session.cc:215] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:13.922837 23944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13a2490fb6904f8ca5c4cab03767d419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:13.982870 23931 raft_consensus.cc:2955] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:13.991082 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:13.999210 18676 raft_consensus.cc:2955] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:14.015252 18600 raft_consensus.cc:2955] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
W20260709 12:24:14.085431 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 44172.8us
I20260709 12:24:14.106043 18423 catalog_manager.cc:5697] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index -1 to 7, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 8 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
W20260709 12:24:14.109652 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 60454.2us
W20260709 12:24:14.233927 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 49712.9us
I20260709 12:24:14.287299 23944 tablet_copy_client.cc:806] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:14.288586 23944 tablet_copy_client.cc:670] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:14.306241 23944 tablet_copy_client.cc:538] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:14.336784 23978 ts_tablet_manager.cc:933] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:14.356922 23940 tablet_copy_client.cc:806] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:14.364158 23940 tablet_copy_client.cc:670] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:14.381132 23944 tablet_bootstrap.cc:492] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:24:14.400117 23978 tablet_copy_client.cc:323] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.130:37079
I20260709 12:24:14.410475 18616 tablet_copy_service.cc:140] P c7bd71f1f37c45f28b52c154e59356b9: Received BeginTabletCopySession request for tablet f8f93d163b9441dd9c044b6224aff070 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:39798)
I20260709 12:24:14.411137 18616 tablet_copy_service.cc:161] P c7bd71f1f37c45f28b52c154e59356b9: Beginning new tablet copy session on tablet f8f93d163b9441dd9c044b6224aff070 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:39798: session id = 8c29c312e4544452b1162d7f81a58cb4-f8f93d163b9441dd9c044b6224aff070
I20260709 12:24:14.428653 18616 tablet_copy_source_session.cc:215] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:14.432281 23978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f93d163b9441dd9c044b6224aff070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:14.432644 18671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:24:14.433261 18671 raft_consensus.cc:606] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:14.472303 23980 ts_tablet_manager.cc:933] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
W20260709 12:24:14.549141 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 87841.6us
I20260709 12:24:14.624045 23980 tablet_copy_client.cc:323] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.129:45155
I20260709 12:24:14.626658 18540 tablet_copy_service.cc:140] P 2f9872512f1646bc835906bd0e98c6a7: Received BeginTabletCopySession request for tablet 8eebfbd8106141a5903392238ce5a613 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:43124)
I20260709 12:24:14.627290 18540 tablet_copy_service.cc:161] P 2f9872512f1646bc835906bd0e98c6a7: Beginning new tablet copy session on tablet 8eebfbd8106141a5903392238ce5a613 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:43124: session id = 8c29c312e4544452b1162d7f81a58cb4-8eebfbd8106141a5903392238ce5a613
W20260709 12:24:14.633203 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 63238.5us
I20260709 12:24:14.637784 18540 tablet_copy_source_session.cc:215] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:14.639838 23978 tablet_copy_client.cc:806] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:14.649892 23978 tablet_copy_client.cc:670] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:14.650988 18530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
mode: GRACEFUL
new_leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:36318
I20260709 12:24:14.651654 18530 raft_consensus.cc:606] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Received request to transfer leadership to TS c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:14.654775 23940 tablet_copy_client.cc:538] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:14.669544 23978 tablet_copy_client.cc:538] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:14.698100 23944 tablet_bootstrap.cc:492] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=2 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:14.699340 23944 tablet_bootstrap.cc:492] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:24:14.700438 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:14.712390 23944 ts_tablet_manager.cc:1403] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.332s	user 0.043s	sys 0.014s
I20260709 12:24:14.716485 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:14.712790 23980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eebfbd8106141a5903392238ce5a613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:14.721975 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:14.725399 23944 raft_consensus.cc:359] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:14.735951 23944 raft_consensus.cc:740] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:24:14.736825 23944 consensus_queue.cc:260] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
W20260709 12:24:14.728906 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 55886.5us
I20260709 12:24:14.736748 23978 tablet_bootstrap.cc:492] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:24:14.761593 23944 ts_tablet_manager.cc:1434] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260709 12:24:14.791198 18540 tablet_copy_service.cc:342] P 2f9872512f1646bc835906bd0e98c6a7: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-13a2490fb6904f8ca5c4cab03767d419 received from {username='slave'} at 127.0.0.1:43124
I20260709 12:24:14.805709 23940 tablet_bootstrap.cc:492] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:24:14.791724 18540 tablet_copy_service.cc:434] P 2f9872512f1646bc835906bd0e98c6a7: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-13a2490fb6904f8ca5c4cab03767d419 on tablet 13a2490fb6904f8ca5c4cab03767d419 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:14.914561 19245 raft_consensus.cc:1217] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 12:24:14.913388 23886 raft_consensus.cc:993] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7: : Instructing follower c7bd71f1f37c45f28b52c154e59356b9 to start an election
W20260709 12:24:14.922022 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 109426us
I20260709 12:24:14.925491 23886 raft_consensus.cc:1081] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Signalling peer c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:24:14.945516 23980 tablet_copy_client.cc:806] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:14.945758 18598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:40954
I20260709 12:24:14.946170 23980 tablet_copy_client.cc:670] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:14.946388 18598 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:14.946784 18598 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:14.953385 23934 raft_consensus.cc:993] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:14.954286 23934 raft_consensus.cc:1081] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:14.959620 23980 tablet_copy_client.cc:538] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:14.969437 18598 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:14.978699 18526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57374
I20260709 12:24:14.983376 18526 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:14.984306 18526 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:14.990563 18598 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:14.991520 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:14.991670 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:15.015420 18530 raft_consensus.cc:3055] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:15.015707 18671 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:15.006626 18526 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:15.025401 18526 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 19 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:15.015874 18530 raft_consensus.cc:740] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:15.028034 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:15.027987 18530 consensus_queue.cc:260] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:15.028820 18598 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:15.030990 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:15.039253 18530 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:15.044054 18676 raft_consensus.cc:3055] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:15.044567 18676 raft_consensus.cc:740] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:15.045362 18676 consensus_queue.cc:260] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:15.046955 18676 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:15.049512 23980 tablet_bootstrap.cc:492] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:24:15.035478 18671 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 16.
I20260709 12:24:15.055344 18570 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:15.056187 23885 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:15.056667 23885 raft_consensus.cc:697] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:15.057494 23885 consensus_queue.cc:237] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:15.071152 18676 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 19.
I20260709 12:24:15.072135 18530 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 16.
I20260709 12:24:15.094084 18598 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 19.
I20260709 12:24:15.105347 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:15.106489 23959 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:15.107079 23959 raft_consensus.cc:697] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 19 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:15.108094 23959 consensus_queue.cc:237] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:15.144915 18423 catalog_manager.cc:5697] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 15 to 16, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 16 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:15.153272 18424 catalog_manager.cc:5697] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 18 to 19, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 19 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:15.258625 23940 tablet_bootstrap.cc:492] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=2 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:15.264830 23940 tablet_bootstrap.cc:492] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:24:15.265739 23940 ts_tablet_manager.cc:1403] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.460s	user 0.042s	sys 0.010s
I20260709 12:24:15.272228 23940 raft_consensus.cc:359] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:15.273236 23940 raft_consensus.cc:740] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:24:15.274271 23940 consensus_queue.cc:260] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:15.278918 23978 tablet_bootstrap.cc:492] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:15.280027 23978 tablet_bootstrap.cc:492] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:24:15.280860 23978 ts_tablet_manager.cc:1403] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.544s	user 0.039s	sys 0.011s
I20260709 12:24:15.281030 23940 ts_tablet_manager.cc:1434] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:24:15.283632 18690 tablet_copy_service.cc:342] P a0dee333a83a45f1ab0c1bb6d094afd1: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-06c92947c3174627a5618c85f17edeb3 received from {username='slave'} at 127.0.0.1:50938
I20260709 12:24:15.284132 18690 tablet_copy_service.cc:434] P a0dee333a83a45f1ab0c1bb6d094afd1: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-06c92947c3174627a5618c85f17edeb3 on tablet 06c92947c3174627a5618c85f17edeb3 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:15.286005 23978 raft_consensus.cc:359] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:15.287062 23978 raft_consensus.cc:740] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:24:15.287616 23978 consensus_queue.cc:260] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:15.290025 23978 ts_tablet_manager.cc:1434] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:24:15.292349 18616 tablet_copy_service.cc:342] P c7bd71f1f37c45f28b52c154e59356b9: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-f8f93d163b9441dd9c044b6224aff070 received from {username='slave'} at 127.0.0.1:39798
I20260709 12:24:15.292822 18616 tablet_copy_service.cc:434] P c7bd71f1f37c45f28b52c154e59356b9: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-f8f93d163b9441dd9c044b6224aff070 on tablet f8f93d163b9441dd9c044b6224aff070 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:15.294590 23980 tablet_bootstrap.cc:492] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=2 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:15.295656 23980 tablet_bootstrap.cc:492] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:24:15.296442 23980 ts_tablet_manager.cc:1403] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.247s	user 0.035s	sys 0.010s
I20260709 12:24:15.299960 23980 raft_consensus.cc:359] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:15.301191 23980 raft_consensus.cc:740] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:24:15.301993 23980 consensus_queue.cc:260] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:15.308233 23980 ts_tablet_manager.cc:1434] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:24:15.313158 18540 tablet_copy_service.cc:342] P 2f9872512f1646bc835906bd0e98c6a7: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-8eebfbd8106141a5903392238ce5a613 received from {username='slave'} at 127.0.0.1:43124
I20260709 12:24:15.313625 18540 tablet_copy_service.cc:434] P 2f9872512f1646bc835906bd0e98c6a7: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-8eebfbd8106141a5903392238ce5a613 on tablet 8eebfbd8106141a5903392238ce5a613 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:15.349177 23928 raft_consensus.cc:1064] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:24:15.352532 23928 consensus_queue.cc:237] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:15.413344 19245 raft_consensus.cc:1217] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 LEARNER]: Deduplicated request from leader. Original: 8.6->[8.7-8.7]   Dedup: 8.7->[]
I20260709 12:24:15.464475 18523 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:24:15.468586 23777 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:15.479413 19245 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEARNER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:15.479517 18676 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:15.486827 23959 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:15.488160 18598 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:15.489499 23959 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:15.498139 23897 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:15.522966 18602 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 19 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:24:15.544358 23897 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:15.557436 19243 raft_consensus.cc:1217] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 12:24:15.574066 23897 raft_consensus.cc:2955] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:15.616238 18671 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:24:15.620497 23777 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:24:15.665040 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 45936.8us
W20260709 12:24:15.664389 24004 log.cc:927] Time spent T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:24:15.696818 18597 raft_consensus.cc:2955] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:15.710208 19243 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4 [term 18 LEARNER]: Advancing to term 19
W20260709 12:24:15.713387 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 65789.4us
W20260709 12:24:15.728811 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 103660us
W20260709 12:24:15.736209 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 118127us
I20260709 12:24:15.745973 19245 raft_consensus.cc:2955] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:15.767155 19243 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4 [term 19 LEARNER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 12:24:15.808794 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 90995.4us
I20260709 12:24:15.821204 18677 raft_consensus.cc:2955] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:15.827453 18671 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:24:15.829593 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:15.920032 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 95839.3us
W20260709 12:24:15.886086 24004 log.cc:927] Time spent T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:24:15.818475 24000 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 12:24:15.923779 18424 catalog_manager.cc:5697] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
W20260709 12:24:15.936254 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 128610us
W20260709 12:24:16.014300 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 180698us
I20260709 12:24:16.264031 24018 raft_consensus.cc:1064] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
W20260709 12:24:16.278539 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 75530us
I20260709 12:24:16.293159 24018 consensus_queue.cc:237] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:16.312623 24038 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:16.431478 18530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:36318
I20260709 12:24:16.432607 18530 raft_consensus.cc:606] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 19 LEADER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:16.388226 18527 consensus_queue.cc:237] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:16.463740 18601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:16.464416 18601 raft_consensus.cc:606] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:16.534298 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:16.537338 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:16.538511 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:16.572813 19239 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEARNER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:16.612488 23963 raft_consensus.cc:993] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:16.613039 23963 raft_consensus.cc:1081] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:16.612895 24011 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:24:16.615206 18676 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:24:16.624212 24042 log.cc:927] Time spent T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:24:16.630913 24020 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:16.679255 19245 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:16.704973 23959 raft_consensus.cc:1064] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
W20260709 12:24:16.720155 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 59747us
I20260709 12:24:16.735220 18597 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:24:16.741313 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 87014.3us
I20260709 12:24:16.746694 18523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:24:16.747401 18523 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:16.747833 18523 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:16.747839 18528 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:16.759019 23928 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:24:16.762668 23959 consensus_queue.cc:237] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:16.786618 24044 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
W20260709 12:24:16.849619 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 46307.2us
W20260709 12:24:16.913811 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 63432.7us
I20260709 12:24:16.924002 24031 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:16.922520 24020 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:16.928813 23928 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
W20260709 12:24:16.974499 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 47523.5us
W20260709 12:24:16.978540 24047 log.cc:927] Time spent T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:24:16.924749 24031 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:16.994393 24049 log.cc:927] Time spent T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:24:16.996950 24050 log.cc:927] Time spent T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:24:16.998961 24020 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:17.001914 24020 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:24:17.002732 24048 log.cc:927] Time spent T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 12:24:17.030776 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 53119.2us
I20260709 12:24:17.022022 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:17.032820 24031 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:17.034906 24014 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:17.035607 24014 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:17.043380 18523 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:17.048049 24014 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:17.056347 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:17.057199 18603 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:24:17.061321 18527 raft_consensus.cc:1240] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 16. Current term is 17. Ops: []
W20260709 12:24:17.060627 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 89875.8us
I20260709 12:24:17.068552 23885 consensus_queue.cc:1059] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:17.069662 23885 raft_consensus.cc:3055] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:17.070024 23885 raft_consensus.cc:740] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:17.070433 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:17.070868 23885 consensus_queue.cc:260] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:17.072034 23885 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:17.092229 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:17.074981 24060 raft_consensus.cc:2955] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:17.099704 18644 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:17.104848 18523 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 17 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:24:17.125274 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 146078us
I20260709 12:24:17.117152 18530 raft_consensus.cc:2955] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:17.145946 24001 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:17.146548 24001 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:17.146965 24001 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:17.184983 19243 raft_consensus.cc:2955] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:17.190763 18680 raft_consensus.cc:2955] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:17.195438 19212 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:17.200904 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:24:17.204581 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 77211.4us
I20260709 12:24:17.205993 24032 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:17.211799 23928 raft_consensus.cc:993] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7: : Instructing follower a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:17.212379 23928 raft_consensus.cc:1081] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 19 LEADER]: Signalling peer a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:17.222208 19241 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 LEARNER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:17.230672 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:17.239960 18423 catalog_manager.cc:5697] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:17.249466 18603 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:17.257524 18676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:17.258168 18676 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:17.261611 24001 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:17.268491 18679 raft_consensus.cc:2393] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7bd71f1f37c45f28b52c154e59356b9 in current term 12: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
I20260709 12:24:17.270725 18680 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:17.271327 18673 raft_consensus.cc:1240] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 11. Current term is 12. Ops: []
W20260709 12:24:17.274765 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 56518.2us
I20260709 12:24:17.278656 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:17.280324 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:17.280939 24001 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:17.267010 18676 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 17.
I20260709 12:24:17.286875 18598 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 17.
I20260709 12:24:17.297950 24008 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:17.295807 18570 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:17.307870 23885 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:17.317628 24069 consensus_queue.cc:1059] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:17.322333 24038 raft_consensus.cc:3055] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:17.322865 24038 raft_consensus.cc:740] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:17.323885 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:17.324116 24038 consensus_queue.cc:260] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:17.325629 24038 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:17.325698 23959 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:17.331097 24066 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:17.332010 18676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:40800
I20260709 12:24:17.331794 24066 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:17.332741 18676 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:17.333258 18676 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:17.338820 24066 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:17.342494 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:17.344271 18494 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:17.347985 24000 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:17.348583 24000 raft_consensus.cc:697] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:17.349568 24000 consensus_queue.cc:237] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:17.361917 23885 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:17.368518 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:17.369495 24037 raft_consensus.cc:1064] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
W20260709 12:24:17.370018 24037 raft_consensus.cc:1068] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7: Unable to promote non-voter 8c29c312e4544452b1162d7f81a58cb4: Service unavailable: leader transfer in progress
I20260709 12:24:17.370985 24061 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:17.371610 18644 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:17.372553 24066 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:17.374984 24066 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:17.375660 24066 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:17.382087 24063 raft_consensus.cc:2955] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:17.396781 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:17.399648 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:17.389256 18676 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:17.402999 18680 raft_consensus.cc:1240] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 20 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:17.429257 18676 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 20 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:17.438766 24066 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:17.441342 24061 consensus_queue.cc:1059] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:17.399991 18600 raft_consensus.cc:2955] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:17.443768 24037 raft_consensus.cc:3055] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:17.444205 24037 raft_consensus.cc:740] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:17.434064 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:17.452823 18597 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:17.460981 18521 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:24:17.445181 24037 consensus_queue.cc:260] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:17.462000 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:17.471517 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:17.470213 19239 raft_consensus.cc:2955] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:17.492082 18644 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:17.513630 24037 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:17.531028 18597 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 20.
I20260709 12:24:17.541050 24001 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:17.566567 18646 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:17.571074 18644 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:17.580113 24062 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:17.580791 24062 raft_consensus.cc:697] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:17.581727 24062 consensus_queue.cc:237] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:17.597681 24058 raft_consensus.cc:2804] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:17.603560 24058 raft_consensus.cc:697] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 20 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:17.604696 24058 consensus_queue.cc:237] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:17.614013 24063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:57364 (request call id 71) took 1243 ms. Trace:
I20260709 12:24:17.614563 24063 rpcz_store.cc:276] 0709 12:24:16.370899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.383392 (+ 12493us) service_pool.cc:224] Handling call
0709 12:24:16.533929 (+150537us) log.cc:844] Serialized 508 byte log entry
0709 12:24:16.581196 (+ 47267us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b18000285a0. stack: 00007efc793c0343 00007efc793c0240 00007efc78d4f1d4 00007efc82a8d304 00007efc82a8d299 00007efc822baab1 00007efc822c7281 00007efc793f23f3 00007efc793f47c1 00007efc793f4779 00007efc793f4709 00007efc793f46d1 00007efc793f39cd 0000000000388634 0000000000388479 00007efc793d583a
0709 12:24:17.613892 (+1032696us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":603,"raft.queue_time_us":7493,"raft.run_cpu_time_us":1411,"raft.run_wall_time_us":13958,"spinlock_wait_cycles":8518528}
I20260709 12:24:17.618314 18413 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 13a2490fb6904f8ca5c4cab03767d419 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:17.620134 18424 catalog_manager.cc:5697] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 9 to 10, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New cstate: current_term: 11 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:17.643059 24063 raft_consensus.cc:2955] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:17.655223 18605 raft_consensus.cc:2955] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:17.658072 18523 raft_consensus.cc:2468] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 20.
I20260709 12:24:17.661410 18427 catalog_manager.cc:5697] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 16 to 17, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 17 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:17.670224 18665 tablet_service.cc:1558] Processing DeleteTablet for tablet 13a2490fb6904f8ca5c4cab03767d419 with delete_type TABLET_DATA_TOMBSTONED (TS a0dee333a83a45f1ab0c1bb6d094afd1 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:49600
W20260709 12:24:17.683648 18569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.685137 18603 consensus_queue.cc:237] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:17.712707 24084 tablet_replica.cc:333] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:24:17.714087 24084 raft_consensus.cc:2243] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.714967 24084 raft_consensus.cc:2272] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.726128 18676 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:17.732993 24021 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:17.733325 18424 catalog_manager.cc:5697] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 11 to 12, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 12 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:17.736536 19239 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:17.739110 24084 ts_tablet_manager.cc:1916] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:17.761961 24021 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:17.769515 23885 raft_consensus.cc:2955] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:17.730944 18427 catalog_manager.cc:5697] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 7 to 8, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:17.779425 18603 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:24:17.785343 19239 raft_consensus.cc:2955] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:17.786285 18678 raft_consensus.cc:2955] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:17.795780 24037 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:17.798919 19242 raft_consensus.cc:2955] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:17.805406 18679 raft_consensus.cc:2955] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:17.843317 18423 catalog_manager.cc:5697] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 19 to 20, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 20 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:17.853468 18523 consensus_queue.cc:237] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:17.878532 19243 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:17.886279 23959 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:17.890475 24084 ts_tablet_manager.cc:1929] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 12:24:17.904662 24037 raft_consensus.cc:2955] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:17.910949 24084 log.cc:1199] T 13a2490fb6904f8ca5c4cab03767d419 P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-2-root/wals/13a2490fb6904f8ca5c4cab03767d419
I20260709 12:24:17.916595 18411 catalog_manager.cc:5028] TS a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): tablet 13a2490fb6904f8ca5c4cab03767d419 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:24:17.930467 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:17.940232 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f8f93d163b9441dd9c044b6224aff070 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:17.908809 19243 raft_consensus.cc:2955] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:18.003713 18413 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8eebfbd8106141a5903392238ce5a613 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:18.017042 18602 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 20 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:24:18.029960 18423 catalog_manager.cc:5697] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 9 to 10, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New cstate: current_term: 11 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:18.051954 18680 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:24:18.050508 18676 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:18.058236 18523 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:24:18.069283 24001 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:18.070178 23982 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:18.075161 19243 raft_consensus.cc:3060] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4 [term 19 LEARNER]: Advancing to term 20
I20260709 12:24:18.088958 18426 catalog_manager.cc:5697] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: config changed from index 8 to 9, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New cstate: current_term: 8 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:18.094133 18512 tablet_service.cc:1558] Processing DeleteTablet for tablet f8f93d163b9441dd9c044b6224aff070 with delete_type TABLET_DATA_TOMBSTONED (TS 2f9872512f1646bc835906bd0e98c6a7 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:57364
I20260709 12:24:18.106843 24038 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:18.111044 24038 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:18.116571 19243 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4 [term 20 LEARNER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:24:18.118573 18587 tablet_service.cc:1558] Processing DeleteTablet for tablet 8eebfbd8106141a5903392238ce5a613 with delete_type TABLET_DATA_TOMBSTONED (TS c7bd71f1f37c45f28b52c154e59356b9 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:38962
I20260709 12:24:18.122090 24090 tablet_replica.cc:333] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:18.126341 24090 raft_consensus.cc:2243] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.135890 18680 raft_consensus.cc:2955] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:18.168480 24090 raft_consensus.cc:2272] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.179252 24091 tablet_replica.cc:333] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:18.180619 24091 raft_consensus.cc:2243] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.204770 24090 ts_tablet_manager.cc:1916] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:18.173727 24058 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:24:18.211938 24091 raft_consensus.cc:2272] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.216483 24091 ts_tablet_manager.cc:1916] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:18.277887 18530 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 20 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:24:18.280978 24028 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:24:18.283530 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 122340us
I20260709 12:24:18.323099 18605 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:24:18.334887 24058 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:18.373450 24090 ts_tablet_manager.cc:1929] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 12:24:18.374023 24090 log.cc:1199] T f8f93d163b9441dd9c044b6224aff070 P 2f9872512f1646bc835906bd0e98c6a7: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-0-root/wals/f8f93d163b9441dd9c044b6224aff070
I20260709 12:24:18.385243 18413 catalog_manager.cc:5028] TS 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): tablet f8f93d163b9441dd9c044b6224aff070 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:24:18.438161 18679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:24:18.438879 18679 raft_consensus.cc:606] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Received request to transfer leadership to TS c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:18.450662 18679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:24:18.451341 18679 raft_consensus.cc:606] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:18.453102 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:18.455129 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:18.456000 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:18.470793 24001 raft_consensus.cc:1064] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:24:18.473994 24001 consensus_queue.cc:237] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 11, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:18.489432 24091 ts_tablet_manager.cc:1929] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.8
I20260709 12:24:18.490187 24091 log.cc:1199] T 8eebfbd8106141a5903392238ce5a613 P c7bd71f1f37c45f28b52c154e59356b9: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-1-root/wals/8eebfbd8106141a5903392238ce5a613
I20260709 12:24:18.491963 18411 catalog_manager.cc:5028] TS c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): tablet 8eebfbd8106141a5903392238ce5a613 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:24:18.589787 18597 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 20 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:24:18.593705 24001 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:18.596959 19243 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4 [term 20 LEARNER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:24:18.603307 18526 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 20 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:24:18.627792 24070 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:18.662128 24058 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:18.670447 24028 raft_consensus.cc:2955] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index 10 to 13, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:18.682469 18605 raft_consensus.cc:2955] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 10 to 13, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:18.734731 18423 catalog_manager.cc:5697] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 10 to 13, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:18.776266 19243 raft_consensus.cc:2955] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 10 to 13, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:18.837026 24058 raft_consensus.cc:993] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:18.837584 24058 raft_consensus.cc:1081] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:18.832418 18526 raft_consensus.cc:2955] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 10 to 13, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:18.839349 18523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57374
I20260709 12:24:18.842867 18523 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:18.843284 18523 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:18.850251 18523 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:18.853323 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:18.853940 18603 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:18.857522 18523 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:18.860610 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:18.861240 18674 raft_consensus.cc:3055] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:18.861521 18674 raft_consensus.cc:740] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:18.862332 18674 consensus_queue.cc:260] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:18.863480 18674 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:18.890017 18603 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:24:18.891674 18494 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:18.911441 24000 raft_consensus.cc:2804] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:18.919812 24000 raft_consensus.cc:697] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:18.921329 24000 consensus_queue.cc:237] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:18.956655 18674 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 11.
I20260709 12:24:18.967018 24092 raft_consensus.cc:993] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1: : Instructing follower c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:24:18.991161 24092 raft_consensus.cc:1081] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Signalling peer c7bd71f1f37c45f28b52c154e59356b9 to start an election
W20260709 12:24:18.992707 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 76656us
I20260709 12:24:18.998554 18597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:40948
I20260709 12:24:18.999194 18597 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:18.999660 18597 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:19.017645 18597 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:19.036244 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:19.036863 18526 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:19.049090 18526 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:24:19.050474 18572 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:19.061348 24060 raft_consensus.cc:2804] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:19.061923 24060 raft_consensus.cc:697] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:19.062871 24060 consensus_queue.cc:237] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:19.083958 18597 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:19.084442 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbe068cca5f4e01bf21b7df39ac7d89" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:19.085034 18674 raft_consensus.cc:3055] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:19.085309 18674 raft_consensus.cc:740] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:19.089113 18674 consensus_queue.cc:260] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:19.090313 18674 raft_consensus.cc:3060] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:19.099082 18674 raft_consensus.cc:2468] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:24:19.101820 18426 catalog_manager.cc:5697] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 11 to 12, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 12 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:19.102864 18424 catalog_manager.cc:5697] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 10 to 11, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 11 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:19.111002 18679 consensus_queue.cc:237] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:19.132711 19243 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:24:19.134838 24092 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:19.149869 24058 raft_consensus.cc:2955] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index 13 to 14, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:19.158192 18526 raft_consensus.cc:1275] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 20 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:24:19.166031 19243 raft_consensus.cc:2955] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:19.182929 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 06c92947c3174627a5618c85f17edeb3 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:19.184502 24058 consensus_queue.cc:1048] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:19.196491 18424 catalog_manager.cc:5697] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index 13 to 14, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New cstate: current_term: 20 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:19.201014 18526 raft_consensus.cc:2955] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:19.210282 18587 tablet_service.cc:1558] Processing DeleteTablet for tablet 06c92947c3174627a5618c85f17edeb3 with delete_type TABLET_DATA_TOMBSTONED (TS c7bd71f1f37c45f28b52c154e59356b9 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:38962
I20260709 12:24:19.237116 24110 tablet_replica.cc:333] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:19.244261 24110 raft_consensus.cc:2243] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:19.255646 24110 raft_consensus.cc:2272] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:19.294339 24110 ts_tablet_manager.cc:1916] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:19.375479 18597 raft_consensus.cc:1275] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:24:19.378605 24104 consensus_queue.cc:1048] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:19.406536 24110 ts_tablet_manager.cc:1929] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.13
I20260709 12:24:19.407127 24110 log.cc:1199] T 06c92947c3174627a5618c85f17edeb3 P c7bd71f1f37c45f28b52c154e59356b9: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-1-root/wals/06c92947c3174627a5618c85f17edeb3
I20260709 12:24:19.409592 18411 catalog_manager.cc:5028] TS c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): tablet 06c92947c3174627a5618c85f17edeb3 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:24:19.501382 18674 raft_consensus.cc:1275] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:24:19.529906 24037 consensus_queue.cc:1048] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:19.595621 18530 raft_consensus.cc:1275] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:24:19.597193 24021 consensus_queue.cc:1048] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:19.612565 18674 raft_consensus.cc:1275] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:24:19.615593 24060 consensus_queue.cc:1048] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:24:19.710717 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 46531.7us
I20260709 12:24:19.735853 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:19.924798 18526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
mode: GRACEFUL
new_leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:36318
I20260709 12:24:19.925503 18526 raft_consensus.cc:606] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Received request to transfer leadership to TS c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:19.952903 18603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:19.953606 18603 raft_consensus.cc:606] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:19.958681 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:20.011551 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:20.012537 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:20.100342 24000 raft_consensus.cc:993] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7: : Instructing follower c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:24:20.100944 24000 raft_consensus.cc:1081] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Signalling peer c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:24:20.102799 18605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:40954
I20260709 12:24:20.103428 18605 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:20.103827 18605 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:20.131587 18605 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:20.141746 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:20.142446 19242 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:20.141820 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:20.144728 18526 raft_consensus.cc:3055] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:20.145048 18526 raft_consensus.cc:740] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:20.145993 18526 consensus_queue.cc:260] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:20.147074 18526 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:20.156697 18605 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:20.157603 18526 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:24:20.158067 19242 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:24:20.168794 18570 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:20.169737 24021 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:20.170241 24021 raft_consensus.cc:697] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:20.171213 24021 consensus_queue.cc:237] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:20.237159 18426 catalog_manager.cc:5697] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 11 to 12, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 12 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:20.455928 24060 raft_consensus.cc:993] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:20.456485 24060 raft_consensus.cc:1081] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Signalling peer a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:20.460202 18674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:40802
I20260709 12:24:20.460840 18674 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:20.461199 18674 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:20.489537 18674 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:20.496052 18674 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:20.497351 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:20.504240 19242 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:20.497351 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:20.505981 18603 raft_consensus.cc:3055] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:20.506340 18603 raft_consensus.cc:740] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:20.507206 18603 consensus_queue.cc:260] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:20.508507 18603 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:20.536456 19242 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:24:20.568485 18644 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:20.569474 24058 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:20.570031 24058 raft_consensus.cc:697] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:20.570966 24058 consensus_queue.cc:237] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:20.566777 18603 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:24:20.597517 18426 catalog_manager.cc:5697] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 11 to 12, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 12 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:20.647349 18603 consensus_queue.cc:237] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
W20260709 12:24:20.679836 18570 consensus_peers.cc:597] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c1f654a3c5be411f92ffc5ed5b6b70a1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:20.681614 18674 raft_consensus.cc:1275] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:24:20.683609 24018 consensus_queue.cc:1048] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:20.696107 18530 raft_consensus.cc:1275] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:24:20.698478 24021 consensus_queue.cc:1048] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:20.753969 19242 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:20.755914 18526 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:20.756839 24060 raft_consensus.cc:2955] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:20.760943 18674 raft_consensus.cc:2955] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:20.757733 24018 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:20.763232 24018 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:20.793329 18426 catalog_manager.cc:5697] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 13 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:20.814168 18530 consensus_queue.cc:237] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
W20260709 12:24:20.804987 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 44576.7us
I20260709 12:24:20.843204 18523 raft_consensus.cc:2955] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
W20260709 12:24:20.922437 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 51802.8us
W20260709 12:24:20.930814 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 45865.4us
I20260709 12:24:20.959353 18674 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:20.961174 24136 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:24:20.968158 18494 consensus_peers.cc:597] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c6a528af94f43f980dcff59f8ba646e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:20.976907 18603 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:20.988153 24134 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:24:20.997926 19242 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:21.028790 24028 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:21.080610 24134 raft_consensus.cc:2955] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:21.114938 18674 raft_consensus.cc:2955] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
W20260709 12:24:21.123402 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 139994us
I20260709 12:24:21.136366 18603 raft_consensus.cc:2955] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:21.160398 18597 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:21.162354 24130 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:24:21.165922 18605 consensus_queue.cc:237] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:21.169157 18427 catalog_manager.cc:5697] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 15 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:21.197647 18526 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:24:21.199539 24128 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:21.225267 18674 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:24:21.236990 18570 consensus_peers.cc:597] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a5481f6762264d10bd4a98a8b0e678e4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:21.247351 24021 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:21.264084 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:21.267803 24150 ts_tablet_manager.cc:933] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:21.305181 24128 raft_consensus.cc:2955] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:21.309010 18526 raft_consensus.cc:2955] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:21.360671 24150 tablet_copy_client.cc:323] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.130:37079
I20260709 12:24:21.370878 18616 tablet_copy_service.cc:140] P c7bd71f1f37c45f28b52c154e59356b9: Received BeginTabletCopySession request for tablet c1f654a3c5be411f92ffc5ed5b6b70a1 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:39798)
I20260709 12:24:21.371531 18616 tablet_copy_service.cc:161] P c7bd71f1f37c45f28b52c154e59356b9: Beginning new tablet copy session on tablet c1f654a3c5be411f92ffc5ed5b6b70a1 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:39798: session id = 8c29c312e4544452b1162d7f81a58cb4-c1f654a3c5be411f92ffc5ed5b6b70a1
I20260709 12:24:21.387244 18616 tablet_copy_source_session.cc:215] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:21.397274 24150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f654a3c5be411f92ffc5ed5b6b70a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.419457 18597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59141dbba91a4f249871144353b43d37"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:21.420150 18597 raft_consensus.cc:606] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:21.423617 18427 catalog_manager.cc:5697] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 15 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:21.427811 18679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2586476710143e281df940fcb3d3238"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:24:21.431192 18679 raft_consensus.cc:606] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:21.431087 18674 raft_consensus.cc:2955] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:21.440781 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:21.442740 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:21.443542 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:21.472095 24153 ts_tablet_manager.cc:933] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:24:21.483280 24150 tablet_copy_client.cc:806] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:21.484067 24150 tablet_copy_client.cc:670] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:21.500993 24150 tablet_copy_client.cc:538] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:21.508271 18530 consensus_queue.cc:237] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:21.577557 24153 tablet_copy_client.cc:323] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.129:45155
I20260709 12:24:21.589308 18540 tablet_copy_service.cc:140] P 2f9872512f1646bc835906bd0e98c6a7: Received BeginTabletCopySession request for tablet 3c6a528af94f43f980dcff59f8ba646e from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:43124)
I20260709 12:24:21.589947 18540 tablet_copy_service.cc:161] P 2f9872512f1646bc835906bd0e98c6a7: Beginning new tablet copy session on tablet 3c6a528af94f43f980dcff59f8ba646e from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:43124: session id = 8c29c312e4544452b1162d7f81a58cb4-3c6a528af94f43f980dcff59f8ba646e
I20260709 12:24:21.593381 24028 raft_consensus.cc:993] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:21.594007 24058 raft_consensus.cc:1081] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:21.602949 18526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2586476710143e281df940fcb3d3238"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57374
I20260709 12:24:21.603633 18526 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:21.604066 18526 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:21.607965 18603 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:24:21.609663 18679 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:24:21.600646 18540 tablet_copy_source_session.cc:215] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:24:21.615393 18494 consensus_peers.cc:597] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5e48d46c1f784719adae94c79efd88c8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:21.616465 24150 tablet_bootstrap.cc:492] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:24:21.620692 24000 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:21.622726 23928 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:21.613131 18526 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:21.624768 24153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6a528af94f43f980dcff59f8ba646e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.636796 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:21.638541 18603 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:21.641218 18526 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:21.642217 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:21.642833 18674 raft_consensus.cc:3055] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:21.643146 18674 raft_consensus.cc:740] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:21.643911 18674 consensus_queue.cc:260] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:21.645049 18674 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:21.656566 18603 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 13.
I20260709 12:24:21.658602 18494 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:21.662289 23928 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:21.662806 23928 raft_consensus.cc:697] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:21.670653 18674 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 13.
I20260709 12:24:21.664445 23928 consensus_queue.cc:237] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:21.703658 24134 raft_consensus.cc:2955] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:21.709396 18679 raft_consensus.cc:2955] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:21.715873 24153 tablet_copy_client.cc:806] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:21.716756 24153 tablet_copy_client.cc:670] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:21.718102 18597 raft_consensus.cc:2955] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:21.743170 18427 catalog_manager.cc:5697] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 13 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:21.759708 18426 catalog_manager.cc:5697] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 12 to 13, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 13 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:21.840976 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 86819.8us
W20260709 12:24:21.843475 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 72155.2us
I20260709 12:24:21.892030 24153 tablet_copy_client.cc:538] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:21.892905 24160 ts_tablet_manager.cc:933] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:21.996917 24160 tablet_copy_client.cc:323] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.130:37079
I20260709 12:24:21.999027 18616 tablet_copy_service.cc:140] P c7bd71f1f37c45f28b52c154e59356b9: Received BeginTabletCopySession request for tablet a5481f6762264d10bd4a98a8b0e678e4 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:39798)
I20260709 12:24:21.999619 18616 tablet_copy_service.cc:161] P c7bd71f1f37c45f28b52c154e59356b9: Beginning new tablet copy session on tablet a5481f6762264d10bd4a98a8b0e678e4 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:39798: session id = 8c29c312e4544452b1162d7f81a58cb4-a5481f6762264d10bd4a98a8b0e678e4
W20260709 12:24:22.001598 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 207489us
I20260709 12:24:22.027539 24141 raft_consensus.cc:993] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:22.034469 18616 tablet_copy_source_session.cc:215] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:22.057973 24141 raft_consensus.cc:1081] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Signalling peer a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:22.060422 18676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59141dbba91a4f249871144353b43d37"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:40802
I20260709 12:24:22.061018 18676 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:22.061347 18676 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:22.064282 24160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5481f6762264d10bd4a98a8b0e678e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.010196 24153 tablet_bootstrap.cc:492] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:24:22.091126 18676 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:22.097612 18676 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:22.132078 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:22.143412 18521 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:22.175037 18521 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 14.
I20260709 12:24:22.203199 18597 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:24:22.215930 24134 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:22.230410 18674 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:24:22.254144 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 96267.3us
I20260709 12:24:22.256701 18646 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:22.262233 24058 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:22.262776 24058 raft_consensus.cc:697] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:22.275272 24058 consensus_queue.cc:237] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:22.278707 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:22.279381 18603 raft_consensus.cc:3055] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:22.279682 18603 raft_consensus.cc:740] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:22.280443 18603 consensus_queue.cc:260] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:22.281831 18603 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:22.255143 24159 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:24:22.297870 24175 ts_tablet_manager.cc:933] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:24:22.360392 18603 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 14.
I20260709 12:24:22.389106 24175 tablet_copy_client.cc:323] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.129:45155
I20260709 12:24:22.390967 18540 tablet_copy_service.cc:140] P 2f9872512f1646bc835906bd0e98c6a7: Received BeginTabletCopySession request for tablet 5e48d46c1f784719adae94c79efd88c8 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:43124)
I20260709 12:24:22.391537 18540 tablet_copy_service.cc:161] P 2f9872512f1646bc835906bd0e98c6a7: Beginning new tablet copy session on tablet 5e48d46c1f784719adae94c79efd88c8 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:43124: session id = 8c29c312e4544452b1162d7f81a58cb4-5e48d46c1f784719adae94c79efd88c8
I20260709 12:24:22.376639 24160 tablet_copy_client.cc:806] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:22.393227 24160 tablet_copy_client.cc:670] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:22.400713 24160 tablet_copy_client.cc:538] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:22.402258 18540 tablet_copy_source_session.cc:215] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:22.407044 24175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e48d46c1f784719adae94c79efd88c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.421602 24160 tablet_bootstrap.cc:492] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:24:22.469195 18424 catalog_manager.cc:5697] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 13 to 14, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 14 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:22.480374 24175 tablet_copy_client.cc:806] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:22.482141 24175 tablet_copy_client.cc:670] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:22.496701 24175 tablet_copy_client.cc:538] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:22.521066 24175 tablet_bootstrap.cc:492] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:24:22.574990 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:22.594220 24150 tablet_bootstrap.cc:492] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:22.595530 24150 tablet_bootstrap.cc:492] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:24:22.601852 24150 ts_tablet_manager.cc:1403] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.986s	user 0.052s	sys 0.030s
I20260709 12:24:22.602349 24153 tablet_bootstrap.cc:492] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:22.623461 24153 tablet_bootstrap.cc:492] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:24:22.627276 24153 ts_tablet_manager.cc:1403] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.617s	user 0.042s	sys 0.010s
I20260709 12:24:22.631067 24150 raft_consensus.cc:359] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:22.639629 24150 raft_consensus.cc:740] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:24:22.642608 24153 raft_consensus.cc:359] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:22.671275 24153 raft_consensus.cc:740] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:24:22.671725 24150 consensus_queue.cc:260] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:22.672248 24153 consensus_queue.cc:260] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:22.675074 24150 ts_tablet_manager.cc:1434] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
I20260709 12:24:22.681648 24153 ts_tablet_manager.cc:1434] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 12:24:22.682454 18616 tablet_copy_service.cc:342] P c7bd71f1f37c45f28b52c154e59356b9: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-c1f654a3c5be411f92ffc5ed5b6b70a1 received from {username='slave'} at 127.0.0.1:39798
I20260709 12:24:22.692848 18616 tablet_copy_service.cc:434] P c7bd71f1f37c45f28b52c154e59356b9: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-c1f654a3c5be411f92ffc5ed5b6b70a1 on tablet c1f654a3c5be411f92ffc5ed5b6b70a1 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:22.694434 18540 tablet_copy_service.cc:342] P 2f9872512f1646bc835906bd0e98c6a7: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-3c6a528af94f43f980dcff59f8ba646e received from {username='slave'} at 127.0.0.1:43124
I20260709 12:24:22.695021 18540 tablet_copy_service.cc:434] P 2f9872512f1646bc835906bd0e98c6a7: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-3c6a528af94f43f980dcff59f8ba646e on tablet 3c6a528af94f43f980dcff59f8ba646e with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:22.737758 19241 raft_consensus.cc:1217] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 12:24:22.748991 24160 tablet_bootstrap.cc:492] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:22.751916 24160 tablet_bootstrap.cc:492] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:24:22.752712 24160 ts_tablet_manager.cc:1403] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.331s	user 0.055s	sys 0.026s
I20260709 12:24:22.753702 18605 raft_consensus.cc:1275] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:24:22.755546 24173 consensus_queue.cc:1048] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:22.767807 18521 raft_consensus.cc:1275] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:24:22.771003 24174 consensus_queue.cc:1048] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:22.807830 24160 raft_consensus.cc:359] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:22.808897 24160 raft_consensus.cc:740] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:24:22.809581 24160 consensus_queue.cc:260] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:22.811518 24160 ts_tablet_manager.cc:1434] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.058s	user 0.004s	sys 0.002s
I20260709 12:24:22.849684 18530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15e3196fc974445e967d05514226ac45"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
mode: GRACEFUL
new_leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:36318
I20260709 12:24:22.850319 18530 raft_consensus.cc:606] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Received request to transfer leadership to TS c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:22.854988 18674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59141dbba91a4f249871144353b43d37"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:24:22.855665 18674 raft_consensus.cc:606] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:22.857151 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:22.859391 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:22.859586 24162 raft_consensus.cc:993] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:22.860172 24162 raft_consensus.cc:1081] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:22.860345 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:22.876253 18530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59141dbba91a4f249871144353b43d37"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57374
I20260709 12:24:22.876847 18530 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:22.877202 18530 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:22.902172 18530 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:22.903967 18526 raft_consensus.cc:1240] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:22.905972 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:22.906708 18597 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:22.911916 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:22.912606 18674 raft_consensus.cc:3055] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:22.912916 18674 raft_consensus.cc:740] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:22.938185 18530 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:22.939706 18616 tablet_copy_service.cc:342] P c7bd71f1f37c45f28b52c154e59356b9: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-a5481f6762264d10bd4a98a8b0e678e4 received from {username='slave'} at 127.0.0.1:39798
I20260709 12:24:22.941481 18616 tablet_copy_service.cc:434] P c7bd71f1f37c45f28b52c154e59356b9: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-a5481f6762264d10bd4a98a8b0e678e4 on tablet a5481f6762264d10bd4a98a8b0e678e4 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:22.944262 18674 consensus_queue.cc:260] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:22.945788 18674 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:24:22.945847 24174 consensus_queue.cc:1175] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2f9872512f1646bc835906bd0e98c6a7" responder_term: 15 status { last_received { term: 14 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:22.984288 18597 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 15.
I20260709 12:24:22.987352 18605 raft_consensus.cc:1240] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:22.988636 18674 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 15.
I20260709 12:24:22.989945 18494 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:22.991081 24000 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:22.991562 24000 raft_consensus.cc:697] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:22.992504 24000 consensus_queue.cc:237] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:23.003351 19241 raft_consensus.cc:1217] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.10->[15.11-15.11]   Dedup: 15.11->[]
I20260709 12:24:23.007102 24175 tablet_bootstrap.cc:492] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:23.008270 24175 tablet_bootstrap.cc:492] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:24:23.009197 24175 ts_tablet_manager.cc:1403] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.488s	user 0.043s	sys 0.029s
I20260709 12:24:23.016254 24175 raft_consensus.cc:359] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:23.017236 24175 raft_consensus.cc:740] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:24:23.018028 24175 consensus_queue.cc:260] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:23.021327 24175 ts_tablet_manager.cc:1434] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 12:24:23.024031 18540 tablet_copy_service.cc:342] P 2f9872512f1646bc835906bd0e98c6a7: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-5e48d46c1f784719adae94c79efd88c8 received from {username='slave'} at 127.0.0.1:43124
I20260709 12:24:23.024545 18540 tablet_copy_service.cc:434] P 2f9872512f1646bc835906bd0e98c6a7: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-5e48d46c1f784719adae94c79efd88c8 on tablet 5e48d46c1f784719adae94c79efd88c8 with peer 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:24:23.041272 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 59725us
I20260709 12:24:23.043637 24159 raft_consensus.cc:993] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7: : Instructing follower c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:24:23.044389 24159 raft_consensus.cc:1081] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Signalling peer c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:24:23.051476 18605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15e3196fc974445e967d05514226ac45"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:40954
I20260709 12:24:23.052219 18605 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:23.052646 18605 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:23.066388 18426 catalog_manager.cc:5697] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 14 to 15, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 15 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:23.103729 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 53004.8us
I20260709 12:24:23.137800 18605 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:23.143379 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:23.144058 18530 raft_consensus.cc:3055] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:23.144346 18530 raft_consensus.cc:740] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:23.145118 18530 consensus_queue.cc:260] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:23.146216 18530 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:23.182832 19242 raft_consensus.cc:1217] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
W20260709 12:24:23.187769 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 55785.1us
I20260709 12:24:23.197252 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:23.197916 18679 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:23.206038 18679 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 15.
I20260709 12:24:23.211380 18570 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:23.212739 24166 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:23.213421 24166 raft_consensus.cc:697] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:23.214555 24166 consensus_queue.cc:237] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:23.232399 18530 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 15.
I20260709 12:24:23.233163 18605 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:23.246681 18426 catalog_manager.cc:5697] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 14 to 15, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 15 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:23.294338 24193 raft_consensus.cc:1064] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:24:23.298415 24193 consensus_queue.cc:237] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:23.316689 19241 raft_consensus.cc:1217] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.10->[13.11-13.11]   Dedup: 13.11->[]
I20260709 12:24:23.354982 19241 raft_consensus.cc:1275] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 LEARNER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:24:23.356462 24165 consensus_queue.cc:1048] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:23.364389 18521 raft_consensus.cc:1275] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:24:23.367568 18674 raft_consensus.cc:1275] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:24:23.369361 24166 consensus_queue.cc:1048] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:23.372793 24128 consensus_queue.cc:1048] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:23.455457 24165 raft_consensus.cc:2955] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:23.460201 18676 raft_consensus.cc:2955] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:23.468115 18521 raft_consensus.cc:2955] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:23.482555 18674 raft_consensus.cc:1275] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:24:23.487365 24000 consensus_queue.cc:1048] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:23.488118 24167 raft_consensus.cc:1064] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:24:23.503932 19241 raft_consensus.cc:2955] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:23.491072 24167 consensus_queue.cc:237] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:23.521103 18426 catalog_manager.cc:5697] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:23.536083 18597 raft_consensus.cc:1275] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:24:23.541086 24000 consensus_queue.cc:1048] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:23.624269 18605 consensus_queue.cc:237] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:23.688567 24179 log.cc:927] Time spent T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 12:24:23.720464 24189 log.cc:927] Time spent T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 12:24:23.729758 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 140436us
W20260709 12:24:23.723023 24190 log.cc:927] Time spent T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 12:24:23.733100 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 134205us
I20260709 12:24:23.760241 18526 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:24:23.770874 18679 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:24:23.774501 24205 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:23.778277 18530 raft_consensus.cc:1275] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:23.783797 24218 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:23.800787 24205 consensus_queue.cc:1048] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:23.859292 19242 raft_consensus.cc:1275] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:23.868512 19243 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 15 LEARNER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:23.880125 24165 consensus_queue.cc:1048] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:23.881778 24166 raft_consensus.cc:1064] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:24:23.884500 24210 raft_consensus.cc:2955] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:23.887797 24166 consensus_queue.cc:237] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:23.892359 18530 raft_consensus.cc:2955] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:23.899516 24209 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:23.916571 18605 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:23.921363 24211 raft_consensus.cc:1064] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:24:23.924849 18674 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:23.932869 24214 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:23.933277 24211 consensus_queue.cc:237] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:23.963083 19242 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 LEARNER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:23.966785 24206 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:23.967969 19242 raft_consensus.cc:2955] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:23.996155 18674 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:24.048709 24128 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 12:24:24.020617 24213 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 12:24:24.136191 18523 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:24.159195 18424 catalog_manager.cc:5697] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 11 to 12, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New cstate: current_term: 13 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
W20260709 12:24:24.181111 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 176002us
I20260709 12:24:24.182976 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:24.135949 24197 log.cc:927] Time spent T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.092s	user 0.003s	sys 0.004s
W20260709 12:24:24.207566 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 215339us
W20260709 12:24:24.247282 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 72441.7us
W20260709 12:24:24.280035 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 77034.8us
I20260709 12:24:24.258646 24205 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
W20260709 12:24:24.285626 24223 log.cc:927] Time spent T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
W20260709 12:24:24.305743 24229 log.cc:927] Time spent T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:24:24.317130 24225 log.cc:927] Time spent T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 12:24:24.351946 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 74776.3us
W20260709 12:24:24.367715 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 162794us
I20260709 12:24:24.402443 19239 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 LEARNER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:24.411365 24228 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:24.423799 19239 raft_consensus.cc:2955] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:24.454568 24159 raft_consensus.cc:2955] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:24.597450 18671 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:24.606515 18603 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:24.616460 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c1f654a3c5be411f92ffc5ed5b6b70a1 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:24.409858 24242 raft_consensus.cc:2955] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:24.624639 18521 raft_consensus.cc:2955] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:24.716791 19242 raft_consensus.cc:2955] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
W20260709 12:24:24.743690 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 93821.5us
I20260709 12:24:24.757300 24211 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:24:24.786360 24228 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:24:24.808591 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 50276.1us
I20260709 12:24:24.812446 18673 raft_consensus.cc:2955] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:24.824891 18665 tablet_service.cc:1558] Processing DeleteTablet for tablet c1f654a3c5be411f92ffc5ed5b6b70a1 with delete_type TABLET_DATA_TOMBSTONED (TS a0dee333a83a45f1ab0c1bb6d094afd1 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:49600
I20260709 12:24:24.828653 18603 raft_consensus.cc:2955] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:24.841534 18528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:36318
I20260709 12:24:24.842551 18528 raft_consensus.cc:606] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:24.849030 18597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:24.849733 18597 raft_consensus.cc:606] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:24.854764 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:24.855038 18426 catalog_manager.cc:5697] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 11 to 12, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:24.858037 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:24.864921 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:24.862946 18426 catalog_manager.cc:5697] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:24.915799 24254 tablet_replica.cc:333] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
W20260709 12:24:24.928000 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 50815.9us
I20260709 12:24:24.929781 24211 raft_consensus.cc:993] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7: : Instructing follower a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:24.930281 24211 raft_consensus.cc:1081] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Signalling peer a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:24.940908 24159 raft_consensus.cc:2955] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:24.961323 24239 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:24.962061 24239 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:24.966483 18673 raft_consensus.cc:2955] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:24.971969 18671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:40800
I20260709 12:24:24.991009 24254 raft_consensus.cc:2243] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.992409 24254 raft_consensus.cc:2272] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.006343 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:25.008419 18674 raft_consensus.cc:2955] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:25.020232 18671 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:25.020749 18671 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:25.025894 24239 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:25.027568 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:25.028187 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:25.029446 24254 ts_tablet_manager.cc:1916] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:25.030285 18644 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:24:25.031016 18644 raft_consensus.cc:2686] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:24:24.962733 18597 consensus_queue.cc:237] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:25.038442 18603 raft_consensus.cc:2955] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:25.049563 18671 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:25.059240 18671 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:25.061467 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:25.064541 18605 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:25.062956 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:25.068094 19242 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:25.091670 19239 raft_consensus.cc:2955] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:25.092952 18605 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 16.
I20260709 12:24:25.094540 19243 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:25.095067 19242 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 16.
I20260709 12:24:25.100561 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
W20260709 12:24:25.100893 18413 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress [suppressed 5 similar messages]
I20260709 12:24:25.101207 18528 raft_consensus.cc:3055] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:25.101594 18528 raft_consensus.cc:740] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:25.102331 18528 consensus_queue.cc:260] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:25.103724 18528 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:25.114562 18673 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:25.122385 18528 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 16.
I20260709 12:24:25.123976 18644 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:25.130255 24239 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:25.131110 24239 raft_consensus.cc:697] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:24:25.133273 18413 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3c6a528af94f43f980dcff59f8ba646e with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER failed with leader 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2f9872512f1646bc835906bd0e98c6a7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:25.132254 24239 consensus_queue.cc:237] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:25.124974 24206 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:25.124290 18427 catalog_manager.cc:5697] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index 11 to 12, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:25.171947 24254 ts_tablet_manager.cc:1929] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 12:24:25.172578 24254 log.cc:1199] T c1f654a3c5be411f92ffc5ed5b6b70a1 P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-2-root/wals/c1f654a3c5be411f92ffc5ed5b6b70a1
I20260709 12:24:25.174365 18411 catalog_manager.cc:5028] TS a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): tablet c1f654a3c5be411f92ffc5ed5b6b70a1 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:24:25.176609 18521 consensus_queue.cc:237] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:25.177695 24242 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:25.204180 24165 raft_consensus.cc:993] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:25.204706 24165 raft_consensus.cc:1081] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:25.206642 18521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:24:25.207204 18521 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:25.207566 18521 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:25.218065 19239 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:24:25.225775 18671 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:24:25.232824 18521 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:25.237078 18521 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:25.239187 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:25.239204 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:25.240175 18603 raft_consensus.cc:3055] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:25.240492 19239 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:25.240917 18603 raft_consensus.cc:740] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:25.230588 18427 catalog_manager.cc:5697] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 15 to 16, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 16 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.240963 24244 raft_consensus.cc:2955] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:25.245276 18603 consensus_queue.cc:260] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:25.251279 18603 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:25.233239 24211 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 12:24:25.248926 19239 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 14.
I20260709 12:24:25.253389 24220 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:25.256265 19242 raft_consensus.cc:2955] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:25.256448 18671 raft_consensus.cc:2955] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:25.262017 18494 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:24:25.280033 24211 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:25.292812 18603 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 14.
I20260709 12:24:25.313879 24211 raft_consensus.cc:697] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:25.314955 24211 consensus_queue.cc:237] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:25.338598 19242 raft_consensus.cc:2955] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Committing config change with OpId 13.13: config changed from index 12 to 13, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:25.391933 18423 catalog_manager.cc:5697] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 11 to 12, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New cstate: current_term: 15 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:25.398110 24159 raft_consensus.cc:2955] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Committing config change with OpId 13.13: config changed from index 12 to 13, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:25.406951 18671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49600
I20260709 12:24:25.407621 18671 raft_consensus.cc:606] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 LEADER]: Received request to transfer leadership
I20260709 12:24:25.411571 18671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49600
I20260709 12:24:25.412166 18671 raft_consensus.cc:606] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 LEADER]: Received request to transfer leadership
I20260709 12:24:25.412762 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a5481f6762264d10bd4a98a8b0e678e4 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:25.417142 18512 tablet_service.cc:1558] Processing DeleteTablet for tablet a5481f6762264d10bd4a98a8b0e678e4 with delete_type TABLET_DATA_TOMBSTONED (TS 2f9872512f1646bc835906bd0e98c6a7 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:57364
I20260709 12:24:25.418655 18673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49600
I20260709 12:24:25.419296 18673 raft_consensus.cc:606] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 LEADER]: Received request to transfer leadership
W20260709 12:24:25.442513 18475 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:24:25.443068 18475 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 3c6a528af94f43f980dcff59f8ba646e already in progress
W20260709 12:24:25.443452 18475 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 3c6a528af94f43f980dcff59f8ba646e already in progress
I20260709 12:24:25.454484 18424 catalog_manager.cc:5697] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 12 to 13, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New cstate: current_term: 13 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:25.464603 18413 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5e48d46c1f784719adae94c79efd88c8 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:25.469655 24262 tablet_replica.cc:333] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:25.470762 24262 raft_consensus.cc:2243] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.471732 24262 raft_consensus.cc:2272] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:25.473690 18411 catalog_manager.cc:4755] TS a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): ChangeConfig:REMOVE_PEER RPC failed for tablet 3c6a528af94f43f980dcff59f8ba646e: Remote error: Service unavailable: leader transfer in progress
I20260709 12:24:25.477527 18671 raft_consensus.cc:2955] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Committing config change with OpId 13.13: config changed from index 12 to 13, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:25.496687 18587 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e48d46c1f784719adae94c79efd88c8 with delete_type TABLET_DATA_TOMBSTONED (TS c7bd71f1f37c45f28b52c154e59356b9 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:38962
I20260709 12:24:25.496366 18423 catalog_manager.cc:5697] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 13 to 14, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 14 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.516714 24262 ts_tablet_manager.cc:1916] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:25.540961 24263 tablet_replica.cc:333] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:25.567070 18528 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:25.568339 24262 ts_tablet_manager.cc:1929] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 12:24:25.568838 24262 log.cc:1199] T a5481f6762264d10bd4a98a8b0e678e4 P 2f9872512f1646bc835906bd0e98c6a7: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-0-root/wals/a5481f6762264d10bd4a98a8b0e678e4
I20260709 12:24:25.568775 24258 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:25.571244 18413 catalog_manager.cc:5028] TS 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): tablet a5481f6762264d10bd4a98a8b0e678e4 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:24:25.579572 19239 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:25.581298 24258 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:25.581696 24263 raft_consensus.cc:2243] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.584997 24263 raft_consensus.cc:2272] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.595245 24239 raft_consensus.cc:993] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:25.595814 24239 raft_consensus.cc:1081] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:25.603813 18528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57374
I20260709 12:24:25.604523 18528 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:25.604911 18528 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:25.612357 24263 ts_tablet_manager.cc:1916] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:25.615952 18528 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:25.618853 18528 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 17 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:25.619293 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:25.619971 18597 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:25.629016 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:25.629678 18673 raft_consensus.cc:3055] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:25.629957 18673 raft_consensus.cc:740] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:25.631119 24263 ts_tablet_manager.cc:1929] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.12
I20260709 12:24:25.630738 18673 consensus_queue.cc:260] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:25.632578 18673 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:25.632670 19242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:25.635346 18528 raft_consensus.cc:1240] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 17 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:25.646378 24263 log.cc:1199] T 5e48d46c1f784719adae94c79efd88c8 P c7bd71f1f37c45f28b52c154e59356b9: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-1-root/wals/5e48d46c1f784719adae94c79efd88c8
I20260709 12:24:25.651515 18411 catalog_manager.cc:5028] TS c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): tablet 5e48d46c1f784719adae94c79efd88c8 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:24:25.649154 18673 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 17.
I20260709 12:24:25.662719 18597 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 17.
I20260709 12:24:25.692408 18603 raft_consensus.cc:1240] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:25.696264 18494 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:25.697219 24159 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:25.697734 24159 raft_consensus.cc:697] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 17 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:25.698737 24159 consensus_queue.cc:237] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:25.714871 18423 catalog_manager.cc:5697] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 16 to 17, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 17 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.736416 19239 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:24:25.737828 24159 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:25.741928 18597 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:24:25.744379 24167 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:26.163514 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:26.347328 18597 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 12:24:26.528571 18413 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3c6a528af94f43f980dcff59f8ba646e with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER failed with leader 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:24:26.600746 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 54377.3us
I20260709 12:24:26.608007 24159 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.029s
W20260709 12:24:26.638521 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 270429us
I20260709 12:24:26.648795 18528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2586476710143e281df940fcb3d3238"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
mode: GRACEFUL
new_leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:36318
I20260709 12:24:26.649986 18528 raft_consensus.cc:606] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Received request to transfer leadership to TS c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:26.682857 19239 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:26.762903 18526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:36318
I20260709 12:24:26.763769 18526 raft_consensus.cc:606] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:26.792208 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:26.802537 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:26.804427 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:26.806624 19239 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:24:26.834724 24159 raft_consensus.cc:993] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7: : Instructing follower c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:24:26.835419 24159 raft_consensus.cc:1081] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Signalling peer c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:24:26.844777 18601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2586476710143e281df940fcb3d3238"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:40954
I20260709 12:24:26.845629 18601 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:26.846117 18601 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:26.866906 18678 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:24:26.886090 24159 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:26.949959 18601 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:26.954874 24287 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:26.960692 24287 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:26.989208 18601 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:26.991132 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:26.992897 18526 raft_consensus.cc:3055] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:26.993281 18526 raft_consensus.cc:740] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:26.994380 18526 consensus_queue.cc:260] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:26.995498 18526 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:26.996248 24287 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:26.998431 24159 raft_consensus.cc:993] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7: : Instructing follower a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:26.999650 24159 raft_consensus.cc:1081] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Signalling peer a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:27.019058 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:27.023120 24293 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:27.034176 18526 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 14.
I20260709 12:24:27.035425 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:27.035876 18572 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:27.036195 18678 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:27.040153 24165 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:27.040835 24165 raft_consensus.cc:697] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:27.041975 24165 consensus_queue.cc:237] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:27.061335 18678 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 14.
I20260709 12:24:27.063227 18674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:40800
I20260709 12:24:27.075353 18674 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:27.075870 18674 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:27.085954 18674 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:27.086364 18427 catalog_manager.cc:5697] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 13 to 14, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 14 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:27.131342 18674 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:27.131893 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:27.137080 18601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:27.137998 18601 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:27.188844 18601 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 14.
I20260709 12:24:27.190363 18644 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:27.192027 24287 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:27.195271 24287 raft_consensus.cc:697] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:27.196312 24287 consensus_queue.cc:237] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:27.207345 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:27.208048 18526 raft_consensus.cc:3055] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:27.208359 18526 raft_consensus.cc:740] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:27.210332 18605 raft_consensus.cc:1240] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:27.210863 18526 consensus_queue.cc:260] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:27.214648 18526 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:27.216233 18646 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:27.218727 24282 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:27.243886 18678 raft_consensus.cc:1240] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:27.282691 18526 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 14.
I20260709 12:24:27.289371 18424 catalog_manager.cc:5697] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 13 to 14, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 14 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:27.321219 18526 consensus_queue.cc:237] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
W20260709 12:24:27.369076 19271 debug-util.cc:398] Leaking SignalData structure 0x7b08002f93e0 after lost signal to thread 17349
W20260709 12:24:27.370602 19271 debug-util.cc:398] Leaking SignalData structure 0x7b08002feaa0 after lost signal to thread 18461
W20260709 12:24:27.374765 19271 debug-util.cc:398] Leaking SignalData structure 0x7b08000c2ae0 after lost signal to thread 18554
W20260709 12:24:27.376472 19271 debug-util.cc:398] Leaking SignalData structure 0x7b0800228400 after lost signal to thread 18630
W20260709 12:24:27.378158 19271 debug-util.cc:398] Leaking SignalData structure 0x7b08000c18c0 after lost signal to thread 18705
W20260709 12:24:27.379900 19271 debug-util.cc:398] Leaking SignalData structure 0x7b0800302c40 after lost signal to thread 19274
I20260709 12:24:27.556901 18530 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:24:27.577132 18530 consensus_queue.cc:237] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:27.603896 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 82702us
I20260709 12:24:27.607892 18673 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:24:27.607935 24165 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:27.614982 18676 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:24:27.619974 24165 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:27.639667 18530 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:24:27.640190 18598 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:24:27.644127 19241 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:24:27.644886 18597 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:24:27.673096 24292 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:24:27.693526 24292 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:27.693943 18597 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:24:27.700086 24287 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:27.704759 24290 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:24:27.793105 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 49119.1us
I20260709 12:24:27.794179 24287 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:27.923684 24290 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
W20260709 12:24:27.932894 18494 consensus_peers.cc:597] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 171eb098d126492b96266e36d8a6ba81. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:28.045178 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:28.122619 24228 raft_consensus.cc:2955] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 17 LEADER]: Committing config change with OpId 17.15: config changed from index 12 to 15, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:28.157018 18413 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3c6a528af94f43f980dcff59f8ba646e with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 8)
I20260709 12:24:28.185501 24228 raft_consensus.cc:2955] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
W20260709 12:24:28.200876 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 57718.1us
W20260709 12:24:28.241950 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 44864.4us
I20260709 12:24:28.259071 18597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15e3196fc974445e967d05514226ac45"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:28.259729 18597 raft_consensus.cc:606] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:28.269105 18678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:24:28.269800 18678 raft_consensus.cc:606] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:28.277067 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:28.279000 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:28.283316 18678 consensus_queue.cc:237] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:28.284543 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:28.315074 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 74447.3us
W20260709 12:24:28.317209 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 74319.4us
I20260709 12:24:28.384500 18600 raft_consensus.cc:2955] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
W20260709 12:24:28.386897 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 60103.9us
I20260709 12:24:28.379081 18678 raft_consensus.cc:2955] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:28.381294 18598 raft_consensus.cc:2955] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 12 to 15, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:28.422457 18598 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:28.429556 24331 ts_tablet_manager.cc:933] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:24:28.443353 18424 catalog_manager.cc:5697] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 12 to 15, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New cstate: current_term: 17 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:28.445436 18530 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:28.469842 24327 raft_consensus.cc:993] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:28.469583 24287 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:28.478219 24327 raft_consensus.cc:1081] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:28.481366 24331 tablet_copy_client.cc:323] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.129:45155
I20260709 12:24:28.482401 24324 raft_consensus.cc:993] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:28.482916 24324 raft_consensus.cc:1081] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Signalling peer a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:28.482091 19239 raft_consensus.cc:2955] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 12 to 15, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:28.486071 18540 tablet_copy_service.cc:140] P 2f9872512f1646bc835906bd0e98c6a7: Received BeginTabletCopySession request for tablet 171eb098d126492b96266e36d8a6ba81 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:43124)
I20260709 12:24:28.486717 18540 tablet_copy_service.cc:161] P 2f9872512f1646bc835906bd0e98c6a7: Beginning new tablet copy session on tablet 171eb098d126492b96266e36d8a6ba81 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:43124: session id = 8c29c312e4544452b1162d7f81a58cb4-171eb098d126492b96266e36d8a6ba81
I20260709 12:24:28.490123 18674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15e3196fc974445e967d05514226ac45"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:40802
I20260709 12:24:28.490731 18674 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:28.491106 18674 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:28.501813 18674 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:28.512506 18540 tablet_copy_source_session.cc:215] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:28.596040 24311 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:24:28.609375 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 84293.7us
W20260709 12:24:28.667362 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 133954us
W20260709 12:24:28.690160 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 47876.2us
I20260709 12:24:28.734330 24311 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:28.735065 24311 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:28.740466 24311 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:24:28.748440 18644 consensus_peers.cc:597] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3be3087e258443e7b525ec57e79f3e2f. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:28.779672 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 110353us
I20260709 12:24:28.789369 18674 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:28.794930 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:28.796739 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:24:28.805634 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 58490.2us
I20260709 12:24:28.828663 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:28.829586 18600 raft_consensus.cc:3055] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:28.829977 18600 raft_consensus.cc:740] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:28.831039 18600 consensus_queue.cc:260] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:28.832783 18600 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:24:28.843412 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 125304us
W20260709 12:24:28.861824 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 54757.4us
W20260709 12:24:28.875196 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 50861.9us
I20260709 12:24:28.889832 18600 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 16.
I20260709 12:24:28.892858 24331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 171eb098d126492b96266e36d8a6ba81. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:28.900030 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 68258.4us
I20260709 12:24:28.907627 18644 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:28.912801 18526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57374
I20260709 12:24:28.913390 18526 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:28.913762 18526 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:28.913645 24336 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:28.939445 18644 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:28.949077 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:28.954201 24311 raft_consensus.cc:2804] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:28.954818 24311 raft_consensus.cc:697] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:28.984308 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:28.985056 18521 raft_consensus.cc:3060] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:29.024544 18521 raft_consensus.cc:2468] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 16.
I20260709 12:24:29.040745 24312 raft_consensus.cc:2955] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:29.046494 18526 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:29.047663 18530 raft_consensus.cc:1240] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:29.027833 24311 consensus_queue.cc:237] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:29.065752 18427 catalog_manager.cc:5697] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 12 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:29.068740 18665 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c6a528af94f43f980dcff59f8ba646e with delete_type TABLET_DATA_TOMBSTONED (TS a0dee333a83a45f1ab0c1bb6d094afd1 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:49600
I20260709 12:24:29.086916 24327 consensus_queue.cc:1059] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:29.088145 24327 raft_consensus.cc:3055] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:29.088538 24327 raft_consensus.cc:740] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:29.090292 18526 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:29.090934 18598 raft_consensus.cc:2955] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:29.102355 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:29.102998 18597 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:29.089728 24327 consensus_queue.cc:260] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:29.111367 24327 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:29.118404 24360 ts_tablet_manager.cc:933] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:29.121628 18597 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 14.
I20260709 12:24:29.141024 18671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:29.153045 24331 tablet_copy_client.cc:806] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:29.153810 24331 tablet_copy_client.cc:670] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:29.160662 18494 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:29.161369 24362 tablet_replica.cc:333] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:24:29.162804 24362 raft_consensus.cc:2243] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:29.164021 24362 raft_consensus.cc:2272] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:29.165673 18645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.171079 24326 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:29.176594 24360 tablet_copy_client.cc:323] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.131:36757
I20260709 12:24:29.178943 18690 tablet_copy_service.cc:140] P a0dee333a83a45f1ab0c1bb6d094afd1: Received BeginTabletCopySession request for tablet 3be3087e258443e7b525ec57e79f3e2f from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:50938)
I20260709 12:24:29.179564 18690 tablet_copy_service.cc:161] P a0dee333a83a45f1ab0c1bb6d094afd1: Beginning new tablet copy session on tablet 3be3087e258443e7b525ec57e79f3e2f from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:50938: session id = 8c29c312e4544452b1162d7f81a58cb4-3be3087e258443e7b525ec57e79f3e2f
I20260709 12:24:29.191967 24326 raft_consensus.cc:697] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:29.193954 24326 consensus_queue.cc:237] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:29.196424 18530 raft_consensus.cc:2955] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:29.191421 18426 catalog_manager.cc:5697] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 15 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:29.194391 24331 tablet_copy_client.cc:538] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:29.231886 24362 ts_tablet_manager.cc:1916] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:29.241489 18690 tablet_copy_source_session.cc:215] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:29.249147 24360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be3087e258443e7b525ec57e79f3e2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:29.249305 18597 consensus_queue.cc:237] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:29.256714 18671 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 14.
I20260709 12:24:29.254557 18426 catalog_manager.cc:5697] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 15 to 16, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 16 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:29.285318 18526 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:24:29.285961 18570 consensus_peers.cc:597] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 10f0fd04dea343f1a51febdac9b97f7b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:29.287062 24341 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:29.291064 18674 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:24:29.298800 24341 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:29.339275 24244 raft_consensus.cc:2955] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:29.341210 18530 raft_consensus.cc:2955] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:29.348629 24331 tablet_bootstrap.cc:492] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:24:29.369939 18674 raft_consensus.cc:2955] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:29.376041 18426 catalog_manager.cc:5697] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 13 to 14, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 14 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:29.406188 18423 catalog_manager.cc:5697] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 13 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:29.424453 18674 consensus_queue.cc:237] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:29.435349 24360 tablet_copy_client.cc:806] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:29.437230 24360 tablet_copy_client.cc:670] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:29.454106 24360 tablet_copy_client.cc:538] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:29.465898 18530 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:24:29.467089 18644 consensus_peers.cc:597] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d337bc5c46924f42af3a8e39c86bfa17. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:29.467738 18597 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:24:29.468011 24327 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:24:29.472796 24311 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:29.478653 24362 ts_tablet_manager.cc:1929] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.14
I20260709 12:24:29.480006 24362 log.cc:1199] T 3c6a528af94f43f980dcff59f8ba646e P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-2-root/wals/3c6a528af94f43f980dcff59f8ba646e
I20260709 12:24:29.500856 18598 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:24:29.505818 24311 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:24:29.536947 24360 tablet_bootstrap.cc:492] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:24:29.544565 18411 catalog_manager.cc:5028] TS a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): tablet 3c6a528af94f43f980dcff59f8ba646e (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:24:29.554379 24311 raft_consensus.cc:2955] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:29.556524 18530 raft_consensus.cc:2955] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:29.612962 18423 catalog_manager.cc:5697] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 14 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:29.624078 18597 raft_consensus.cc:2955] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:29.673805 18530 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:24:29.676791 24327 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:29.696586 18674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49600
I20260709 12:24:29.697213 18674 raft_consensus.cc:606] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Received request to transfer leadership
I20260709 12:24:29.697768 18676 raft_consensus.cc:1275] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:24:29.706209 18674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49600
I20260709 12:24:29.706899 18674 raft_consensus.cc:606] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Received request to transfer leadership
I20260709 12:24:29.701867 24326 consensus_queue.cc:1048] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:24:29.753253 18602 raft_consensus.cc:1275] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:24:29.756290 24326 consensus_queue.cc:1048] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:29.779383 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:29.803774 24382 ts_tablet_manager.cc:933] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:29.812248 18676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49600
I20260709 12:24:29.814451 18676 raft_consensus.cc:606] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Received request to transfer leadership
W20260709 12:24:29.845541 18475 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:24:29.846050 18475 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for d337bc5c46924f42af3a8e39c86bfa17 already in progress
W20260709 12:24:29.846385 18475 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for d337bc5c46924f42af3a8e39c86bfa17 already in progress
I20260709 12:24:29.880223 24382 tablet_copy_client.cc:323] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.130:37079
W20260709 12:24:29.907835 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 75123us
I20260709 12:24:29.911268 18616 tablet_copy_service.cc:140] P c7bd71f1f37c45f28b52c154e59356b9: Received BeginTabletCopySession request for tablet 10f0fd04dea343f1a51febdac9b97f7b from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:39798)
I20260709 12:24:29.923794 18616 tablet_copy_service.cc:161] P c7bd71f1f37c45f28b52c154e59356b9: Beginning new tablet copy session on tablet 10f0fd04dea343f1a51febdac9b97f7b from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:39798: session id = 8c29c312e4544452b1162d7f81a58cb4-10f0fd04dea343f1a51febdac9b97f7b
I20260709 12:24:29.927167 24331 tablet_bootstrap.cc:492] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:29.954813 24331 tablet_bootstrap.cc:492] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:24:29.955667 24331 ts_tablet_manager.cc:1403] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.607s	user 0.043s	sys 0.037s
W20260709 12:24:29.905413 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 72832.1us
I20260709 12:24:29.988054 24331 raft_consensus.cc:359] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:29.988993 24331 raft_consensus.cc:740] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:24:29.989687 24331 consensus_queue.cc:260] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:29.996305 18616 tablet_copy_source_session.cc:215] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:30.001339 24382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10f0fd04dea343f1a51febdac9b97f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:30.001447 18674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:24:30.002252 18674 raft_consensus.cc:606] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:30.023329 24360 tablet_bootstrap.cc:492] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:30.024411 24360 tablet_bootstrap.cc:492] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:24:30.025064 24360 ts_tablet_manager.cc:1403] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.488s	user 0.044s	sys 0.008s
I20260709 12:24:30.032994 18526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
mode: GRACEFUL
new_leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:36318
I20260709 12:24:30.034559 18526 raft_consensus.cc:606] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Received request to transfer leadership to TS c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:30.038308 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:30.046517 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:30.047983 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:30.055621 24327 raft_consensus.cc:993] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:30.056223 24327 raft_consensus.cc:1081] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:30.067875 18530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57374
I20260709 12:24:30.068486 18530 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:30.068845 18530 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:24:30.071918 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 77459.8us
I20260709 12:24:30.078302 18530 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:30.083182 24331 ts_tablet_manager.cc:1434] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.127s	user 0.007s	sys 0.000s
I20260709 12:24:30.090996 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:30.091648 18597 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:30.091989 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:30.092581 18674 raft_consensus.cc:3055] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:30.092907 18674 raft_consensus.cc:740] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:30.093672 18674 consensus_queue.cc:260] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:30.095083 18674 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:30.097699 24360 raft_consensus.cc:359] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:30.117787 18540 tablet_copy_service.cc:342] P 2f9872512f1646bc835906bd0e98c6a7: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-171eb098d126492b96266e36d8a6ba81 received from {username='slave'} at 127.0.0.1:43124
I20260709 12:24:30.118074 24360 raft_consensus.cc:740] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:24:30.118429 18540 tablet_copy_service.cc:434] P 2f9872512f1646bc835906bd0e98c6a7: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-171eb098d126492b96266e36d8a6ba81 on tablet 171eb098d126492b96266e36d8a6ba81 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:30.121053 18530 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 16 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:30.124243 18597 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 16.
I20260709 12:24:30.125635 18674 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 16.
I20260709 12:24:30.129225 24382 tablet_copy_client.cc:806] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:30.129980 24382 tablet_copy_client.cc:670] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:30.126921 24360 consensus_queue.cc:260] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:30.152362 24382 tablet_copy_client.cc:538] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:30.156872 24331 ts_tablet_manager.cc:933] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:30.158546 18494 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:30.159374 24326 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:30.159960 24326 raft_consensus.cc:697] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 16 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:30.160548 24385 raft_consensus.cc:993] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1: : Instructing follower c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:24:30.161080 24386 raft_consensus.cc:1081] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Signalling peer c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:24:30.160974 24326 consensus_queue.cc:237] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:30.167382 19243 raft_consensus.cc:1217] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.9->[12.10-12.10]   Dedup: 12.10->[]
I20260709 12:24:30.176700 18598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:40948
I20260709 12:24:30.177354 18598 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:30.177722 18598 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:30.180905 24331 tablet_copy_client.cc:323] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.131:36757
I20260709 12:24:30.184062 18690 tablet_copy_service.cc:140] P a0dee333a83a45f1ab0c1bb6d094afd1: Received BeginTabletCopySession request for tablet d337bc5c46924f42af3a8e39c86bfa17 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:50938)
I20260709 12:24:30.184701 18690 tablet_copy_service.cc:161] P a0dee333a83a45f1ab0c1bb6d094afd1: Beginning new tablet copy session on tablet d337bc5c46924f42af3a8e39c86bfa17 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:50938: session id = 8c29c312e4544452b1162d7f81a58cb4-d337bc5c46924f42af3a8e39c86bfa17
I20260709 12:24:30.192946 24382 tablet_bootstrap.cc:492] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:24:30.195590 18690 tablet_copy_source_session.cc:215] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:30.202023 18598 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:30.212621 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:30.213238 18530 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:30.217231 24331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d337bc5c46924f42af3a8e39c86bfa17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:30.160939 24360 ts_tablet_manager.cc:1434] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.136s	user 0.008s	sys 0.001s
I20260709 12:24:30.229820 18690 tablet_copy_service.cc:342] P a0dee333a83a45f1ab0c1bb6d094afd1: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-3be3087e258443e7b525ec57e79f3e2f received from {username='slave'} at 127.0.0.1:50938
I20260709 12:24:30.230515 18690 tablet_copy_service.cc:434] P a0dee333a83a45f1ab0c1bb6d094afd1: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-3be3087e258443e7b525ec57e79f3e2f on tablet 3be3087e258443e7b525ec57e79f3e2f with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:30.231776 18598 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:30.234402 18674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:30.235021 18674 raft_consensus.cc:3055] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:30.235365 18674 raft_consensus.cc:740] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:30.236256 18674 consensus_queue.cc:260] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:30.237598 18674 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:30.245927 18530 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 15.
I20260709 12:24:30.246671 18526 raft_consensus.cc:1240] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:30.247584 18572 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:30.248557 24244 raft_consensus.cc:2804] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:30.249078 24244 raft_consensus.cc:697] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:30.249958 24244 consensus_queue.cc:237] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:30.253834 18674 raft_consensus.cc:2468] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 15.
I20260709 12:24:30.270471 18426 catalog_manager.cc:5697] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 14 to 15, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 15 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:30.297595 24388 raft_consensus.cc:993] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7: : Instructing follower c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:24:30.298182 24388 raft_consensus.cc:1081] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Signalling peer c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:24:30.329445 18598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:40954
I20260709 12:24:30.330124 18598 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:30.330535 18598 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:30.335357 18423 catalog_manager.cc:5697] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 15 to 16, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 16 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:30.339998 18598 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:30.343860 18526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:30.344494 18526 raft_consensus.cc:3055] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:30.344795 18526 raft_consensus.cc:740] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:30.345580 18526 consensus_queue.cc:260] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:30.346920 18526 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:30.357615 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:30.358496 19239 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:30.375017 18526 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 15.
I20260709 12:24:30.376274 18572 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:30.377194 24244 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:30.377712 24244 raft_consensus.cc:697] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:30.378644 24244 consensus_queue.cc:237] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:30.380769 19239 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 15.
I20260709 12:24:30.382951 18598 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:30.399327 24331 tablet_copy_client.cc:806] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:30.401022 24331 tablet_copy_client.cc:670] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:30.411053 24331 tablet_copy_client.cc:538] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:30.430375 18423 catalog_manager.cc:5697] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 14 to 15, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 15 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:30.448558 24382 tablet_bootstrap.cc:492] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:30.449617 24382 tablet_bootstrap.cc:492] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:24:30.450552 24382 ts_tablet_manager.cc:1403] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.258s	user 0.022s	sys 0.017s
I20260709 12:24:30.452975 24331 tablet_bootstrap.cc:492] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:24:30.461549 24382 raft_consensus.cc:359] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:30.462435 24382 raft_consensus.cc:740] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:24:30.463152 24382 consensus_queue.cc:260] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:30.487587 24382 ts_tablet_manager.cc:1434] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.002s
I20260709 12:24:30.490234 18616 tablet_copy_service.cc:342] P c7bd71f1f37c45f28b52c154e59356b9: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-10f0fd04dea343f1a51febdac9b97f7b received from {username='slave'} at 127.0.0.1:39798
I20260709 12:24:30.490768 18616 tablet_copy_service.cc:434] P c7bd71f1f37c45f28b52c154e59356b9: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-10f0fd04dea343f1a51febdac9b97f7b on tablet 10f0fd04dea343f1a51febdac9b97f7b with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:30.542596 24388 raft_consensus.cc:1064] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:24:30.551879 24388 consensus_queue.cc:237] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:30.596585 18671 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:30.610311 19239 raft_consensus.cc:1217] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.7->[13.8-13.8]   Dedup: 13.8->[]
I20260709 12:24:30.613282 18671 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:30.615518 19245 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 LEARNER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:30.622545 24228 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:30.623912 24228 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:30.625744 18597 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:30.631063 18598 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:30.633078 24331 tablet_bootstrap.cc:492] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:30.634222 24331 tablet_bootstrap.cc:492] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:24:30.634974 24331 ts_tablet_manager.cc:1403] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.182s	user 0.041s	sys 0.003s
I20260709 12:24:30.638020 24331 raft_consensus.cc:359] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:30.638885 24331 raft_consensus.cc:740] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:24:30.639565 24331 consensus_queue.cc:260] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:30.648418 24388 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:30.651158 24326 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:30.657346 24331 ts_tablet_manager.cc:1434] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:24:30.667181 18530 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:30.667181 24388 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:24:30.671617 24343 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:30.683100 18690 tablet_copy_service.cc:342] P a0dee333a83a45f1ab0c1bb6d094afd1: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-d337bc5c46924f42af3a8e39c86bfa17 received from {username='slave'} at 127.0.0.1:50938
I20260709 12:24:30.683609 18690 tablet_copy_service.cc:434] P a0dee333a83a45f1ab0c1bb6d094afd1: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-d337bc5c46924f42af3a8e39c86bfa17 on tablet d337bc5c46924f42af3a8e39c86bfa17 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:30.695364 19239 raft_consensus.cc:3060] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 LEARNER]: Advancing to term 15
I20260709 12:24:30.703974 18674 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:30.716248 24343 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:30.725777 19243 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [term 15 LEARNER]: Advancing to term 16
I20260709 12:24:30.760365 19243 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [term 16 LEARNER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:30.773185 19239 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 LEARNER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:30.779937 24228 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:30.781512 24343 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:24:30.884687 19245 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:24:30.886884 24244 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:24:30.909026 24400 log.cc:927] Time spent T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:24:30.954797 18530 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:24:30.980309 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 72659.5us
I20260709 12:24:30.985122 24422 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
W20260709 12:24:31.016752 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 223566us
W20260709 12:24:31.083318 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 144151us
I20260709 12:24:31.133486 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:31.176874 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 181377us
I20260709 12:24:31.361604 24432 raft_consensus.cc:2955] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:31.369858 24228 raft_consensus.cc:1064] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:24:31.374435 24228 consensus_queue.cc:237] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:31.383832 18673 raft_consensus.cc:2955] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:31.384735 19243 raft_consensus.cc:2955] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
W20260709 12:24:31.444227 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 55919.7us
I20260709 12:24:31.457211 24423 raft_consensus.cc:1064] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:24:31.519649 24423 consensus_queue.cc:237] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 11, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:31.548061 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:31.567893 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 113838us
I20260709 12:24:31.567075 18427 catalog_manager.cc:5697] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:31.581230 24343 raft_consensus.cc:1064] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:24:31.586021 24343 consensus_queue.cc:237] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 6, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:31.599695 18598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
W20260709 12:24:31.587096 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 173499us
I20260709 12:24:31.605470 18523 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:24:31.614463 18673 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:31.617662 19245 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 LEARNER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:24:31.619123 19243 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [term 16 LEARNER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:31.623039 18597 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:31.632228 18598 raft_consensus.cc:606] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:31.659711 18679 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:24:31.661526 24433 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:31.662678 24292 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:31.636459 24405 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:24:31.670934 18604 raft_consensus.cc:2955] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:31.680747 24434 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:31.699951 24434 raft_consensus.cc:2955] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 11 to 13, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
W20260709 12:24:31.706852 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 71977.7us
I20260709 12:24:31.715854 24425 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:31.718583 18603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:31.718948 18526 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:24:31.719272 18603 raft_consensus.cc:606] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:31.722998 18526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6874b99e69744371a73c71762816db62"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:36318
I20260709 12:24:31.725420 18526 raft_consensus.cc:606] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:31.727029 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:31.728428 24444 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:31.729339 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:31.728816 18603 raft_consensus.cc:2955] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 11 to 13, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:31.730261 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:31.732831 19241 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [term 13 LEARNER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:24:31.733917 24425 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:31.742064 18679 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:24:31.743943 24440 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:31.749445 24405 raft_consensus.cc:2955] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 11 to 13, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:31.754010 24425 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:31.756582 18679 raft_consensus.cc:2955] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 11 to 13, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:31.769385 18674 raft_consensus.cc:2955] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 11 to 13, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:31.784109 24244 raft_consensus.cc:993] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:31.787989 24244 raft_consensus.cc:1081] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:31.793677 18527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:24:31.794466 18527 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:31.794955 18527 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:31.875861 18527 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:31.895816 18527 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 16 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:24:31.917368 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 60967.7us
I20260709 12:24:31.952131 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:31.952778 18603 raft_consensus.cc:3055] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:31.953073 18603 raft_consensus.cc:740] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:31.953820 18603 consensus_queue.cc:260] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:31.955716 18603 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:31.957785 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:31.961511 19241 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:32.007740 18603 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 16.
I20260709 12:24:32.023206 19241 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 16.
I20260709 12:24:32.025796 18521 raft_consensus.cc:2955] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 11 to 13, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:32.043821 24431 raft_consensus.cc:993] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7: : Instructing follower a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:32.044473 24431 raft_consensus.cc:1081] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Signalling peer a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:32.051519 18494 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:32.052923 24415 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:32.053536 24415 raft_consensus.cc:697] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:32.057437 19239 raft_consensus.cc:2955] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 11 to 13, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:32.054476 24415 consensus_queue.cc:237] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:32.089478 24343 raft_consensus.cc:993] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:32.090852 24343 raft_consensus.cc:1081] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:32.095270 18523 raft_consensus.cc:2955] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:32.096630 24440 raft_consensus.cc:2955] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
W20260709 12:24:32.098177 24359 log.cc:927] Time spent T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.161s	user 0.000s	sys 0.003s
I20260709 12:24:32.105844 18680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6874b99e69744371a73c71762816db62"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:40800
I20260709 12:24:32.106530 18680 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:32.106889 18680 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:32.117209 19243 raft_consensus.cc:2955] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 11 to 13, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:32.121394 18521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:24:32.132485 18680 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:32.135803 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:32.136409 18527 raft_consensus.cc:3055] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:32.136721 18527 raft_consensus.cc:740] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:32.137466 18527 consensus_queue.cc:260] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:32.138553 18527 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:32.141582 18679 raft_consensus.cc:2955] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:32.147459 18521 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:32.147962 18521 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:32.152623 18680 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:32.153805 18600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:32.154418 18600 raft_consensus.cc:3060] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:32.156286 18527 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 14.
I20260709 12:24:32.157325 18521 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:32.165644 18646 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:32.172271 24414 raft_consensus.cc:2804] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:32.176172 18600 raft_consensus.cc:2468] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 14.
I20260709 12:24:32.199030 19239 raft_consensus.cc:2955] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:32.202039 18424 catalog_manager.cc:5697] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 11 to 13, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:32.203995 18424 catalog_manager.cc:5697] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 11 to 13, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:32.214639 18527 consensus_queue.cc:237] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:32.249945 18521 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:32.251122 18600 consensus_queue.cc:237] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:32.270562 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:32.267453 19243 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:24:32.271211 18679 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:32.273900 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:32.274466 18603 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:24:32.274564 19239 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:32.279058 24388 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:32.281567 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:32.282126 18679 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 14.
I20260709 12:24:32.282220 18598 raft_consensus.cc:3055] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:32.282641 18598 raft_consensus.cc:740] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:32.285877 24414 raft_consensus.cc:697] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:32.292837 24414 consensus_queue.cc:237] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:32.307176 19239 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 14.
I20260709 12:24:32.262354 18423 catalog_manager.cc:5697] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:32.310053 18521 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:24:32.311669 24244 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:32.324119 24388 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:32.328892 19239 raft_consensus.cc:1275] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:24:32.303655 18598 consensus_queue.cc:260] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:32.333038 24244 raft_consensus.cc:2955] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Committing config change with OpId 15.14: config changed from index 13 to 14, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:32.341964 18530 raft_consensus.cc:2955] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Committing config change with OpId 15.14: config changed from index 13 to 14, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:32.334184 18598 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:32.335069 24343 consensus_queue.cc:1048] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:32.371654 19243 raft_consensus.cc:2955] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Committing config change with OpId 15.14: config changed from index 13 to 14, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:32.384080 24432 raft_consensus.cc:2955] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:32.397825 18494 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:32.403789 18598 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 14.
I20260709 12:24:32.421867 18427 catalog_manager.cc:5697] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 15 to 16, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 16 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:32.428716 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d337bc5c46924f42af3a8e39c86bfa17 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:32.436844 24445 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:32.445935 18413 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 171eb098d126492b96266e36d8a6ba81 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:32.448223 18600 raft_consensus.cc:2955] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:32.463992 24445 raft_consensus.cc:697] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:32.465137 24445 consensus_queue.cc:237] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:32.492043 18411 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 10f0fd04dea343f1a51febdac9b97f7b with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER failed with leader c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c7bd71f1f37c45f28b52c154e59356b9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:32.501742 19239 raft_consensus.cc:2955] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:32.530598 18426 catalog_manager.cc:5697] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 13 to 14, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 14 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:32.542448 18527 consensus_queue.cc:237] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:32.577076 18674 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:24:32.577091 19243 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:24:32.578660 24326 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 12:24:32.590358 24326 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:32.629944 18598 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:24:32.636729 18424 catalog_manager.cc:5697] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 13 to 14, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New cstate: current_term: 15 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:32.650074 19243 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:24:32.662253 18427 catalog_manager.cc:5697] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 13 to 14, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 14 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:32.666186 18427 catalog_manager.cc:5697] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: config changed from index 11 to 12, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New cstate: current_term: 12 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:32.668466 18665 tablet_service.cc:1558] Processing DeleteTablet for tablet d337bc5c46924f42af3a8e39c86bfa17 with delete_type TABLET_DATA_TOMBSTONED (TS a0dee333a83a45f1ab0c1bb6d094afd1 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:49600
I20260709 12:24:32.672399 24388 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:24:32.699082 24326 raft_consensus.cc:2955] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 16 LEADER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
W20260709 12:24:32.713027 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 46160.5us
I20260709 12:24:32.718014 24464 tablet_replica.cc:333] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:24:32.719300 24464 raft_consensus.cc:2243] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:32.740949 24464 raft_consensus.cc:2272] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:32.747790 24388 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 12:24:32.775995 19241 raft_consensus.cc:2955] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:32.783375 24464 ts_tablet_manager.cc:1916] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:32.852855 18665 tablet_service.cc:1558] Processing DeleteTablet for tablet 171eb098d126492b96266e36d8a6ba81 with delete_type TABLET_DATA_TOMBSTONED (TS a0dee333a83a45f1ab0c1bb6d094afd1 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:49600
I20260709 12:24:32.861032 18530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:57364
I20260709 12:24:32.861824 18530 raft_consensus.cc:606] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Received request to transfer leadership
I20260709 12:24:32.865984 18424 catalog_manager.cc:5697] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 13 to 14, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New cstate: current_term: 16 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:32.879895 18530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:57364
I20260709 12:24:32.880602 18530 raft_consensus.cc:606] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Received request to transfer leadership
W20260709 12:24:32.878170 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 86007.9us
I20260709 12:24:32.883136 18679 raft_consensus.cc:2955] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
W20260709 12:24:32.886075 18413 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 10f0fd04dea343f1a51febdac9b97f7b already in progress [suppressed 3 similar messages]
I20260709 12:24:32.899142 18530 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:24:32.909005 24464 ts_tablet_manager.cc:1929] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.13
I20260709 12:24:32.916010 24464 log.cc:1199] T d337bc5c46924f42af3a8e39c86bfa17 P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-2-root/wals/d337bc5c46924f42af3a8e39c86bfa17
I20260709 12:24:32.920681 18598 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:24:32.922890 24462 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:32.924510 18411 catalog_manager.cc:5028] TS a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): tablet d337bc5c46924f42af3a8e39c86bfa17 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:24:32.930876 24464 tablet_replica.cc:333] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:24:32.948201 18679 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:24:32.950913 18603 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:24:32.956943 18413 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 70894.2us
I20260709 12:24:32.966246 24388 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:32.967272 24464 raft_consensus.cc:2243] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:32.968508 24388 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:32.969746 19243 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:24:32.968776 18587 tablet_service.cc:1558] Processing DeleteTablet for tablet 3be3087e258443e7b525ec57e79f3e2f with delete_type TABLET_DATA_TOMBSTONED (TS c7bd71f1f37c45f28b52c154e59356b9 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:38962
I20260709 12:24:32.976258 18413 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3be3087e258443e7b525ec57e79f3e2f with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:32.984658 24464 raft_consensus.cc:2272] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:32.976792 24468 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:24:33.004411 24326 raft_consensus.cc:993] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7: : Instructing follower a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:32.958989 24462 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:24:33.021908 18523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:57364
I20260709 12:24:33.022724 18523 raft_consensus.cc:606] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Received request to transfer leadership
I20260709 12:24:33.023259 24326 raft_consensus.cc:1081] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Signalling peer a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:33.038087 18679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:40800
I20260709 12:24:33.047587 24474 tablet_replica.cc:333] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:33.054576 24474 raft_consensus.cc:2243] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:33.055533 24474 raft_consensus.cc:2272] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:33.059382 24474 ts_tablet_manager.cc:1916] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:33.095847 24464 ts_tablet_manager.cc:1916] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:24:33.097069 18475 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:24:33.097471 18475 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 10f0fd04dea343f1a51febdac9b97f7b already in progress
W20260709 12:24:33.097750 18475 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 10f0fd04dea343f1a51febdac9b97f7b already in progress
W20260709 12:24:33.120137 18413 catalog_manager.cc:4755] TS 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): ChangeConfig:REMOVE_PEER RPC failed for tablet 10f0fd04dea343f1a51febdac9b97f7b: Remote error: Service unavailable: leader transfer in progress
W20260709 12:24:33.228685 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 138040us
I20260709 12:24:33.232084 18679 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:33.232743 18679 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:33.242965 18679 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:33.266764 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 227358us
I20260709 12:24:33.301322 24474 ts_tablet_manager.cc:1929] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.13
I20260709 12:24:33.301867 24474 log.cc:1199] T 3be3087e258443e7b525ec57e79f3e2f P c7bd71f1f37c45f28b52c154e59356b9: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-1-root/wals/3be3087e258443e7b525ec57e79f3e2f
I20260709 12:24:33.355279 18411 catalog_manager.cc:5028] TS c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): tablet 3be3087e258443e7b525ec57e79f3e2f (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:24:33.367278 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:33.368036 18523 raft_consensus.cc:3055] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:33.368330 18523 raft_consensus.cc:740] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:33.370227 18523 consensus_queue.cc:260] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:33.372309 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:33.372958 18602 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:33.373987 18679 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:33.372920 18523 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:33.377521 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fd04dea343f1a51febdac9b97f7b" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:33.380086 19245 raft_consensus.cc:3060] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:33.407588 24464 ts_tablet_manager.cc:1929] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.11
I20260709 12:24:33.408190 24464 log.cc:1199] T 171eb098d126492b96266e36d8a6ba81 P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-2-root/wals/171eb098d126492b96266e36d8a6ba81
I20260709 12:24:33.410203 18411 catalog_manager.cc:5028] TS a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): tablet 171eb098d126492b96266e36d8a6ba81 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:24:33.416267 18602 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 15.
I20260709 12:24:33.418321 19245 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 15.
I20260709 12:24:33.420361 18644 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:33.421435 24327 raft_consensus.cc:2804] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:33.421979 24327 raft_consensus.cc:697] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:33.426735 24327 consensus_queue.cc:237] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:33.438522 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:33.446478 18523 raft_consensus.cc:2468] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 15.
I20260709 12:24:33.452683 18424 catalog_manager.cc:5697] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 14 to 15, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 15 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:33.546000 18527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
mode: GRACEFUL
new_leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:36318
I20260709 12:24:33.546828 18527 raft_consensus.cc:606] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Received request to transfer leadership to TS c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:33.549883 18527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:36318
I20260709 12:24:33.550717 18527 raft_consensus.cc:606] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:33.559577 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:33.561144 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:33.561815 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:33.607034 24463 raft_consensus.cc:993] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7: : Instructing follower c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:24:33.607573 24326 raft_consensus.cc:1081] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Signalling peer c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:24:33.612777 18598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:40954
I20260709 12:24:33.618698 18598 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:33.619081 18598 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:33.636283 18598 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:33.639406 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:33.640203 18527 raft_consensus.cc:3055] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:33.640512 18527 raft_consensus.cc:740] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:33.641489 18527 consensus_queue.cc:260] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:33.643229 18527 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:33.652124 18527 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:24:33.654145 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:33.658257 19239 raft_consensus.cc:3060] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:33.653100 18598 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:33.669211 18572 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:33.670620 19239 raft_consensus.cc:2468] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:24:33.671083 24440 raft_consensus.cc:2804] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:33.671622 24440 raft_consensus.cc:697] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:33.675843 24440 consensus_queue.cc:237] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:33.683315 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 93713.8us
I20260709 12:24:33.707165 18424 catalog_manager.cc:5697] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 12 to 13, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 13 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:33.912410 24326 raft_consensus.cc:993] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7: : Instructing follower a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:33.910224 18527 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:33.917475 24326 raft_consensus.cc:1081] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Signalling peer a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:33.920923 18679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:40800
I20260709 12:24:33.921530 18679 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:33.921877 18679 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:33.922049 24457 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:33.942540 18679 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:33.950173 18602 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:33.953475 24441 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:33.966305 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:33.966933 18527 raft_consensus.cc:3055] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:33.967257 18527 raft_consensus.cc:740] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:33.968099 18527 consensus_queue.cc:260] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:33.969247 18527 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:33.978472 18527 raft_consensus.cc:2468] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:24:33.979625 18679 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:33.983019 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:33.983685 19239 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:33.980724 18646 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:33.986882 24460 raft_consensus.cc:2804] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:33.987519 24460 raft_consensus.cc:697] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:33.988873 24460 consensus_queue.cc:237] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:33.994072 19239 raft_consensus.cc:2468] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 9.
I20260709 12:24:34.046454 18679 consensus_queue.cc:237] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:34.071774 19239 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:34.079733 19245 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:34.087208 19245 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:24:34.089762 24244 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:34.109927 24457 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:34.156025 18598 raft_consensus.cc:1275] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:34.169891 18527 raft_consensus.cc:1275] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:24:34.174969 24440 consensus_queue.cc:1048] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:34.199072 24497 consensus_queue.cc:1048] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:34.209754 18427 catalog_manager.cc:5697] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 8 to 9, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 9 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:34.218263 24492 raft_consensus.cc:2955] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 9 to 12, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:34.252991 18598 raft_consensus.cc:2955] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 9 to 12, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:34.284389 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 10f0fd04dea343f1a51febdac9b97f7b with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 7)
I20260709 12:24:34.314072 19243 raft_consensus.cc:2955] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 9 to 12, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:34.304893 18424 catalog_manager.cc:5697] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 9 to 12, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New cstate: current_term: 15 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:34.348685 18512 tablet_service.cc:1558] Processing DeleteTablet for tablet 10f0fd04dea343f1a51febdac9b97f7b with delete_type TABLET_DATA_TOMBSTONED (TS 2f9872512f1646bc835906bd0e98c6a7 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:57364
I20260709 12:24:34.352851 24505 tablet_replica.cc:333] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:34.354192 24505 raft_consensus.cc:2243] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.358497 24505 raft_consensus.cc:2272] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.368636 24505 ts_tablet_manager.cc:1916] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:34.414080 24505 ts_tablet_manager.cc:1929] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 12:24:34.414577 24505 log.cc:1199] T 10f0fd04dea343f1a51febdac9b97f7b P 2f9872512f1646bc835906bd0e98c6a7: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-0-root/wals/10f0fd04dea343f1a51febdac9b97f7b
I20260709 12:24:34.416607 18413 catalog_manager.cc:5028] TS 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): tablet 10f0fd04dea343f1a51febdac9b97f7b (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:24:34.480840 18527 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:24:34.482239 24457 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:34.486423 18602 consensus_queue.cc:237] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
W20260709 12:24:34.508138 18570 consensus_peers.cc:597] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb60480c703d4fb3b06a0d4f669bc90c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:34.508755 18680 raft_consensus.cc:1275] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:24:34.510890 24244 consensus_queue.cc:1048] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:34.513339 18523 raft_consensus.cc:1275] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:24:34.515048 24440 consensus_queue.cc:1048] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:34.577519 24244 raft_consensus.cc:2955] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:34.579973 18679 raft_consensus.cc:2955] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:34.621368 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:34.618436 18424 catalog_manager.cc:5697] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 11 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:34.665158 19243 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:24:34.674019 18678 consensus_queue.cc:237] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:34.682186 24457 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:24:34.728924 24508 log.cc:927] Time spent T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:24:34.736073 18598 raft_consensus.cc:1275] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:24:34.739903 24460 consensus_queue.cc:1048] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:34.751837 18523 raft_consensus.cc:2955] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
W20260709 12:24:34.756779 18644 consensus_peers.cc:597] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c2c31f23053e4804b0fb872f29fde999. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:34.768237 18602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:34.769129 18602 raft_consensus.cc:606] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:34.807515 24440 raft_consensus.cc:993] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:34.808089 24440 raft_consensus.cc:1081] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:34.822728 18678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:24:34.824383 18678 raft_consensus.cc:606] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:34.830614 18680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:24:34.834101 18680 raft_consensus.cc:606] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Received request to transfer leadership to TS c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:34.835700 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:34.837637 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:34.838465 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:34.845160 18527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:24:34.845958 18527 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:34.846436 18527 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:34.872423 18521 raft_consensus.cc:1275] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:24:34.925648 24515 ts_tablet_manager.cc:933] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:34.933107 24515 tablet_copy_client.cc:323] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.130:37079
I20260709 12:24:34.935348 18616 tablet_copy_service.cc:140] P c7bd71f1f37c45f28b52c154e59356b9: Received BeginTabletCopySession request for tablet bb60480c703d4fb3b06a0d4f669bc90c from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:39798)
I20260709 12:24:34.935987 18616 tablet_copy_service.cc:161] P c7bd71f1f37c45f28b52c154e59356b9: Beginning new tablet copy session on tablet bb60480c703d4fb3b06a0d4f669bc90c from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:39798: session id = 8c29c312e4544452b1162d7f81a58cb4-bb60480c703d4fb3b06a0d4f669bc90c
I20260709 12:24:34.947832 18616 tablet_copy_source_session.cc:215] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:34.953279 24515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb60480c703d4fb3b06a0d4f669bc90c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:34.987603 24513 log.cc:927] Time spent T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:24:35.002215 24515 tablet_copy_client.cc:806] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:35.002882 24515 tablet_copy_client.cc:670] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:35.004483 24327 consensus_queue.cc:1048] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:35.017692 24327 raft_consensus.cc:2955] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:35.018870 18600 raft_consensus.cc:2955] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:35.037415 18423 catalog_manager.cc:5697] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index -1 to 7, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 10 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:35.067267 24515 tablet_copy_client.cc:538] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:35.077673 24515 tablet_bootstrap.cc:492] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:24:35.009053 18527 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:35.097362 18527 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:35.132934 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:35.133561 18598 raft_consensus.cc:3055] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:35.133867 18598 raft_consensus.cc:740] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:35.136389 18598 consensus_queue.cc:260] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:35.152848 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:35.153529 19245 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:35.164285 18527 consensus_queue.cc:237] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:35.170799 19245 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 13.
I20260709 12:24:35.182202 18598 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:35.226179 24457 raft_consensus.cc:993] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:35.232010 24457 raft_consensus.cc:1081] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:35.254050 18598 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 13.
W20260709 12:24:35.265553 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 84222.3us
I20260709 12:24:35.293243 24515 tablet_bootstrap.cc:492] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:35.294122 24460 raft_consensus.cc:993] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1: : Instructing follower c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:24:35.294942 24496 raft_consensus.cc:1081] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Signalling peer c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:24:35.297133 18600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:40948
I20260709 12:24:35.297868 18600 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:35.298334 18600 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:35.296124 24515 tablet_bootstrap.cc:492] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:24:35.310799 24515 ts_tablet_manager.cc:1403] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.233s	user 0.045s	sys 0.017s
W20260709 12:24:35.313396 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 87378us
I20260709 12:24:35.314469 24523 ts_tablet_manager.cc:933] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:35.314625 18494 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:24:35.315434 24498 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:35.318679 18600 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:35.326398 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:35.327529 18679 raft_consensus.cc:3055] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:35.328006 18679 raft_consensus.cc:740] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:35.330624 18679 consensus_queue.cc:260] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:35.332423 18679 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:35.337002 18600 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Requested vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:35.337212 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:35.338723 19245 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:35.354872 19245 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:24:35.356748 18570 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:35.360905 24244 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:35.361593 24244 raft_consensus.cc:697] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
W20260709 12:24:35.364208 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 47622us
I20260709 12:24:35.365926 24244 consensus_queue.cc:237] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:35.370873 18679 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:24:35.384259 18679 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:24:35.385181 24523 tablet_copy_client.cc:323] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.131:36757
I20260709 12:24:35.398072 24498 raft_consensus.cc:697] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:35.461951 18690 tablet_copy_service.cc:140] P a0dee333a83a45f1ab0c1bb6d094afd1: Received BeginTabletCopySession request for tablet c2c31f23053e4804b0fb872f29fde999 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:50938)
I20260709 12:24:35.463258 18690 tablet_copy_service.cc:161] P a0dee333a83a45f1ab0c1bb6d094afd1: Beginning new tablet copy session on tablet c2c31f23053e4804b0fb872f29fde999 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:50938: session id = 8c29c312e4544452b1162d7f81a58cb4-c2c31f23053e4804b0fb872f29fde999
I20260709 12:24:35.494899 18423 catalog_manager.cc:5697] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 12 to 13, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 13 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:35.420271 24515 raft_consensus.cc:359] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:35.503341 24515 raft_consensus.cc:740] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:24:35.504151 24515 consensus_queue.cc:260] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:35.508136 24498 consensus_queue.cc:237] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:35.542048 18523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57374
I20260709 12:24:35.542712 18523 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:35.543054 18523 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:35.555492 18603 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:24:35.559022 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 43909.5us
I20260709 12:24:35.562129 18523 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:35.564417 18690 tablet_copy_source_session.cc:215] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:35.562793 18527 raft_consensus.cc:2955] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:35.573791 18523 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:35.582762 24515 ts_tablet_manager.cc:1434] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.272s	user 0.006s	sys 0.003s
I20260709 12:24:35.624082 24463 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:24:35.632061 18494 consensus_peers.cc:597] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 406a6f5175ee42239ec8464ef19d6f14. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:35.640368 24536 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:35.645089 24523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c31f23053e4804b0fb872f29fde999. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:35.656487 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 90792.4us
W20260709 12:24:35.688513 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 52503.5us
I20260709 12:24:35.690652 18616 tablet_copy_service.cc:342] P c7bd71f1f37c45f28b52c154e59356b9: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-bb60480c703d4fb3b06a0d4f669bc90c received from {username='slave'} at 127.0.0.1:39798
I20260709 12:24:35.691078 18616 tablet_copy_service.cc:434] P c7bd71f1f37c45f28b52c154e59356b9: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-bb60480c703d4fb3b06a0d4f669bc90c on tablet bb60480c703d4fb3b06a0d4f669bc90c with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:35.696748 19239 raft_consensus.cc:1217] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.7->[11.8-11.8]   Dedup: 11.8->[]
W20260709 12:24:35.706586 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 67462.1us
W20260709 12:24:35.735498 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 96083.3us
I20260709 12:24:35.745208 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:35.745815 18598 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:35.755317 18679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:35.756976 18679 raft_consensus.cc:3055] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:35.757375 18679 raft_consensus.cc:740] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:35.758332 18679 consensus_queue.cc:260] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:35.759564 18679 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:35.775353 18530 raft_consensus.cc:1240] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Rejecting Update request from peer a0dee333a83a45f1ab0c1bb6d094afd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:35.779695 18598 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 15.
I20260709 12:24:35.779014 18423 catalog_manager.cc:5697] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 12 to 13, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 13 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:35.787945 18679 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 15.
I20260709 12:24:35.793916 24515 ts_tablet_manager.cc:933] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:24:35.799674 18494 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:35.800575 24498 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:35.801100 24498 raft_consensus.cc:697] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:35.801981 24498 consensus_queue.cc:237] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:35.836199 24543 raft_consensus.cc:2955] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:35.838227 24515 tablet_copy_client.cc:323] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.129:45155
I20260709 12:24:35.840557 18540 tablet_copy_service.cc:140] P 2f9872512f1646bc835906bd0e98c6a7: Received BeginTabletCopySession request for tablet 406a6f5175ee42239ec8464ef19d6f14 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:43124)
I20260709 12:24:35.841184 18540 tablet_copy_service.cc:161] P 2f9872512f1646bc835906bd0e98c6a7: Beginning new tablet copy session on tablet 406a6f5175ee42239ec8464ef19d6f14 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:43124: session id = 8c29c312e4544452b1162d7f81a58cb4-406a6f5175ee42239ec8464ef19d6f14
I20260709 12:24:35.845116 24523 tablet_copy_client.cc:806] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:35.848623 24523 tablet_copy_client.cc:670] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:35.844359 18598 raft_consensus.cc:2955] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:35.852265 18678 raft_consensus.cc:2955] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:35.851290 19245 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:35.860118 24244 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:35.870354 24523 tablet_copy_client.cc:538] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:35.886109 18424 catalog_manager.cc:5697] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 16 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:35.882561 18427 catalog_manager.cc:5697] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 14 to 15, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 15 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:35.901913 18540 tablet_copy_source_session.cc:215] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:35.905316 24523 tablet_bootstrap.cc:492] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:24:35.906356 24515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 406a6f5175ee42239ec8464ef19d6f14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.906543 18603 consensus_queue.cc:237] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:35.913473 18598 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:35.933095 24543 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:35.965629 18527 raft_consensus.cc:1275] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:24:35.967329 24539 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:35.968729 18678 raft_consensus.cc:1275] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:24:35.970057 18570 consensus_peers.cc:597] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e9507595fc484ec1b5cf1d1b2482debf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:35.977043 24539 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:36.036405 24481 raft_consensus.cc:2955] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:36.038756 24515 tablet_copy_client.cc:806] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:36.039465 24515 tablet_copy_client.cc:670] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:36.041286 18527 raft_consensus.cc:2955] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:36.053136 19239 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:36.077524 24515 tablet_copy_client.cc:538] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:36.077291 24530 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:24:36.102267 18427 catalog_manager.cc:5697] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 11 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:36.128710 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:36.140465 18678 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:36.174608 24515 tablet_bootstrap.cc:492] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:24:36.249908 24541 raft_consensus.cc:1064] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:24:36.252583 24541 consensus_queue.cc:237] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:36.260917 18680 raft_consensus.cc:1275] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:36.262367 24530 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:36.293254 24481 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:36.310756 18523 raft_consensus.cc:1275] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:36.314078 24555 consensus_queue.cc:1048] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:36.333643 18603 raft_consensus.cc:1275] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:36.345121 18680 raft_consensus.cc:2955] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:36.362962 19243 raft_consensus.cc:1275] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEARNER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:36.364639 18674 raft_consensus.cc:1275] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:36.376075 24481 consensus_queue.cc:1048] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:36.384469 24537 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:36.401602 24515 tablet_bootstrap.cc:492] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=2 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:36.402624 24515 tablet_bootstrap.cc:492] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:24:36.403304 24515 ts_tablet_manager.cc:1403] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.229s	user 0.041s	sys 0.019s
I20260709 12:24:36.408663 24523 tablet_bootstrap.cc:492] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:36.408557 24515 raft_consensus.cc:359] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:36.409572 24515 raft_consensus.cc:740] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:24:36.409761 24523 tablet_bootstrap.cc:492] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:24:36.410635 24523 ts_tablet_manager.cc:1403] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.512s	user 0.036s	sys 0.006s
I20260709 12:24:36.410367 24515 consensus_queue.cc:260] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:36.417151 24515 ts_tablet_manager.cc:1434] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.002s
I20260709 12:24:36.419593 24481 consensus_queue.cc:1048] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:36.419988 18540 tablet_copy_service.cc:342] P 2f9872512f1646bc835906bd0e98c6a7: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-406a6f5175ee42239ec8464ef19d6f14 received from {username='slave'} at 127.0.0.1:43124
I20260709 12:24:36.420512 24523 raft_consensus.cc:359] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:36.421942 24523 raft_consensus.cc:740] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:24:36.422657 24523 consensus_queue.cc:260] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:36.420450 18540 tablet_copy_service.cc:434] P 2f9872512f1646bc835906bd0e98c6a7: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-406a6f5175ee42239ec8464ef19d6f14 on tablet 406a6f5175ee42239ec8464ef19d6f14 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:36.425593 24523 ts_tablet_manager.cc:1434] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:24:36.429307 18690 tablet_copy_service.cc:342] P a0dee333a83a45f1ab0c1bb6d094afd1: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-c2c31f23053e4804b0fb872f29fde999 received from {username='slave'} at 127.0.0.1:50938
I20260709 12:24:36.429765 18690 tablet_copy_service.cc:434] P a0dee333a83a45f1ab0c1bb6d094afd1: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-c2c31f23053e4804b0fb872f29fde999 on tablet c2c31f23053e4804b0fb872f29fde999 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:36.431845 24515 ts_tablet_manager.cc:933] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:36.457854 24244 raft_consensus.cc:2955] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:36.473865 24515 tablet_copy_client.cc:323] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.130:37079
I20260709 12:24:36.480729 18616 tablet_copy_service.cc:140] P c7bd71f1f37c45f28b52c154e59356b9: Received BeginTabletCopySession request for tablet e9507595fc484ec1b5cf1d1b2482debf from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:39798)
I20260709 12:24:36.481318 18616 tablet_copy_service.cc:161] P c7bd71f1f37c45f28b52c154e59356b9: Beginning new tablet copy session on tablet e9507595fc484ec1b5cf1d1b2482debf from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:39798: session id = 8c29c312e4544452b1162d7f81a58cb4-e9507595fc484ec1b5cf1d1b2482debf
I20260709 12:24:36.477202 19239 raft_consensus.cc:2955] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:36.498243 18616 tablet_copy_source_session.cc:215] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:36.499478 18523 raft_consensus.cc:2955] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:36.502637 24515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9507595fc484ec1b5cf1d1b2482debf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.511555 18526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
mode: GRACEFUL
new_leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:36318
I20260709 12:24:36.512305 18526 raft_consensus.cc:606] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Received request to transfer leadership to TS a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:36.529251 24515 tablet_copy_client.cc:806] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:36.530369 24515 tablet_copy_client.cc:670] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:36.538442 24515 tablet_copy_client.cc:538] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:36.557593 18679 raft_consensus.cc:2955] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:36.562024 24515 tablet_bootstrap.cc:492] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:24:36.565048 18603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b52424a465944d0ba861991c593bdc17"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:36.565721 18603 raft_consensus.cc:606] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:36.567095 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:36.568984 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:36.569761 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:36.573347 19243 raft_consensus.cc:1217] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.6->[10.7-10.7]   Dedup: 10.7->[]
I20260709 12:24:36.615321 18427 catalog_manager.cc:5697] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:36.652556 24527 raft_consensus.cc:993] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7: : Instructing follower a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:36.653144 24527 raft_consensus.cc:1081] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Signalling peer a0dee333a83a45f1ab0c1bb6d094afd1 to start an election
I20260709 12:24:36.654603 24515 tablet_bootstrap.cc:492] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:36.655656 24515 tablet_bootstrap.cc:492] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:24:36.656431 24515 ts_tablet_manager.cc:1403] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.095s	user 0.019s	sys 0.019s
I20260709 12:24:36.659421 24515 raft_consensus.cc:359] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:36.660135 18679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
 from {username='slave'} at 127.0.0.1:40800
I20260709 12:24:36.660564 24515 raft_consensus.cc:740] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:24:36.660858 18679 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:36.661717 18679 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:36.665511 24515 consensus_queue.cc:260] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:36.668818 24515 ts_tablet_manager.cc:1434] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:24:36.672928 18616 tablet_copy_service.cc:342] P c7bd71f1f37c45f28b52c154e59356b9: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-e9507595fc484ec1b5cf1d1b2482debf received from {username='slave'} at 127.0.0.1:39798
I20260709 12:24:36.672888 18679 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:36.673563 18616 tablet_copy_service.cc:434] P c7bd71f1f37c45f28b52c154e59356b9: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-e9507595fc484ec1b5cf1d1b2482debf on tablet e9507595fc484ec1b5cf1d1b2482debf with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:36.675072 18679 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:36.676507 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:36.677201 19239 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:36.684298 19239 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 14.
I20260709 12:24:36.687003 18644 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:36.687861 24492 raft_consensus.cc:2804] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:36.688373 24492 raft_consensus.cc:697] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:36.689193 24492 consensus_queue.cc:237] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:36.746944 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 61081.1us
I20260709 12:24:36.858578 18598 consensus_queue.cc:237] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:36.867120 19243 raft_consensus.cc:1217] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 12:24:36.884519 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:36.885758 18523 raft_consensus.cc:3055] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:36.888195 18523 raft_consensus.cc:740] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:36.893474 18523 consensus_queue.cc:260] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:36.896096 18523 raft_consensus.cc:3060] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:36.944867 19239 raft_consensus.cc:1275] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:36.948513 24539 consensus_queue.cc:1048] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:36.996383 18674 raft_consensus.cc:1275] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:36.996968 24440 raft_consensus.cc:2955] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:37.009156 19239 raft_consensus.cc:2955] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:37.021457 24481 consensus_queue.cc:1048] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:24:37.049403 24539 raft_consensus.cc:993] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:37.050077 24539 raft_consensus.cc:1081] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:37.027367 18427 catalog_manager.cc:5697] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 13 to 14, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 14 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:37.084259 19241 raft_consensus.cc:1217] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 12:24:37.087003 18523 raft_consensus.cc:2468] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 14.
I20260709 12:24:37.112656 18526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b52424a465944d0ba861991c593bdc17"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:24:37.113732 18526 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:37.114238 18526 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:37.102982 18679 raft_consensus.cc:2955] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:37.157783 18423 catalog_manager.cc:5697] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 9 to 10, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New cstate: current_term: 11 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:37.161083 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bb60480c703d4fb3b06a0d4f669bc90c with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:37.173745 18523 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:24:37.190259 24580 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 12:24:37.194667 24586 raft_consensus.cc:1064] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
W20260709 12:24:37.195873 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 52368.7us
I20260709 12:24:37.203647 19239 raft_consensus.cc:1275] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:24:37.226483 24580 consensus_queue.cc:1048] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:37.235932 24586 consensus_queue.cc:237] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:37.242492 18526 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:37.243439 18512 tablet_service.cc:1558] Processing DeleteTablet for tablet bb60480c703d4fb3b06a0d4f669bc90c with delete_type TABLET_DATA_TOMBSTONED (TS 2f9872512f1646bc835906bd0e98c6a7 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:57364
I20260709 12:24:37.244922 18526 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 16 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:37.246263 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:37.246908 18604 raft_consensus.cc:3055] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:37.247493 18604 raft_consensus.cc:740] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:37.248931 18604 consensus_queue.cc:260] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:37.250125 18604 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:37.271775 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:37.272543 18678 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:37.364105 18604 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 16.
I20260709 12:24:37.373855 24590 tablet_replica.cc:333] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:37.382364 18678 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 16.
I20260709 12:24:37.408788 19239 raft_consensus.cc:1275] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEARNER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:24:37.410241 18494 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:37.411882 24527 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:37.412487 24527 raft_consensus.cc:697] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:37.413611 24527 consensus_queue.cc:237] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:37.425127 24492 consensus_queue.cc:1048] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:37.426111 18603 raft_consensus.cc:1275] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:24:37.438594 24460 consensus_queue.cc:1048] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:37.443082 18527 raft_consensus.cc:1275] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:24:37.462509 24590 raft_consensus.cc:2243] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:37.463653 24590 raft_consensus.cc:2272] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:37.451031 24580 consensus_queue.cc:1048] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:24:37.485901 24481 raft_consensus.cc:1064] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:24:37.489146 24481 consensus_queue.cc:237] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:37.493077 24590 ts_tablet_manager.cc:1916] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:37.509963 18427 catalog_manager.cc:5697] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 15 to 16, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 16 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:37.526003 24581 raft_consensus.cc:1064] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:24:37.583024 18602 raft_consensus.cc:2955] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
W20260709 12:24:37.661463 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 60217.8us
I20260709 12:24:37.622154 24581 consensus_queue.cc:237] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:37.528702 24492 raft_consensus.cc:2955] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
W20260709 12:24:37.671741 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 59629.4us
W20260709 12:24:37.700680 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 69324.2us
W20260709 12:24:37.762660 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 55292.3us
I20260709 12:24:37.807471 18527 raft_consensus.cc:1275] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:37.809599 24481 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:24:37.829397 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 213179us
I20260709 12:24:37.836843 18523 raft_consensus.cc:2955] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:37.866341 19239 raft_consensus.cc:1275] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEARNER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:37.896775 18679 raft_consensus.cc:1275] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:37.918254 18678 raft_consensus.cc:1275] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:24:37.936410 24607 consensus_queue.cc:1048] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:24:37.947584 18602 raft_consensus.cc:1275] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:24:37.990649 24609 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:38.008739 24608 consensus_queue.cc:1048] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:38.017843 19239 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 LEARNER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:38.021117 18602 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:38.027980 18680 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:38.031629 24481 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:38.046685 24613 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:38.056151 24527 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:38.054909 18423 catalog_manager.cc:5697] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 7 to 8, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:38.061628 24590 ts_tablet_manager.cc:1929] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 12:24:38.062232 24590 log.cc:1199] T bb60480c703d4fb3b06a0d4f669bc90c P 2f9872512f1646bc835906bd0e98c6a7: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-0-root/wals/bb60480c703d4fb3b06a0d4f669bc90c
W20260709 12:24:38.070999 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 367911us
I20260709 12:24:38.097056 24527 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:38.123608 24244 raft_consensus.cc:2955] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:38.131668 19243 raft_consensus.cc:2955] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:38.154719 18680 raft_consensus.cc:2955] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:38.244271 18672 consensus_queue.cc:237] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:38.247305 18413 catalog_manager.cc:5028] TS 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): tablet bb60480c703d4fb3b06a0d4f669bc90c (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
W20260709 12:24:38.248255 18413 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 64535.1us
I20260709 12:24:38.249285 19245 raft_consensus.cc:2955] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:38.233017 18527 raft_consensus.cc:2955] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
W20260709 12:24:38.293378 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 67364.7us
I20260709 12:24:38.329258 18423 catalog_manager.cc:5697] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:38.431668 24527 raft_consensus.cc:2955] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
W20260709 12:24:38.440624 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 110496us
W20260709 12:24:38.457486 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 81279.6us
I20260709 12:24:38.472323 19245 raft_consensus.cc:2955] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:38.477978 18672 raft_consensus.cc:2955] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:38.511852 18604 raft_consensus.cc:1275] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:38.529907 18598 consensus_queue.cc:237] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:38.545050 19245 raft_consensus.cc:1275] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:38.549405 24481 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:38.551672 18527 raft_consensus.cc:1275] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:38.558832 24602 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:38.574951 24609 raft_consensus.cc:2955] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:38.587532 18523 raft_consensus.cc:2955] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:38.620805 24603 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:38.621464 24603 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:38.624419 24603 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:38.631108 18598 raft_consensus.cc:2955] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:38.635185 19245 raft_consensus.cc:2955] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
W20260709 12:24:38.675725 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 111407us
W20260709 12:24:38.679847 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 79157.2us
W20260709 12:24:38.686681 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 201880us
I20260709 12:24:38.647396 18423 catalog_manager.cc:5697] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: config changed from index 11 to 12, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:38.714781 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:38.716013 24611 consensus_queue.cc:1048] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:24:38.742085 19241 raft_consensus.cc:1275] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:38.771062 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e9507595fc484ec1b5cf1d1b2482debf with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:38.775692 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ba7e5c69124062865d447b2968bc2e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:38.782886 18527 consensus_queue.cc:237] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:38.794479 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:38.799203 18427 catalog_manager.cc:5697] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 9 to 10, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New cstate: current_term: 11 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:38.804178 19245 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:38.805930 18680 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:38.805896 24627 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:38.814754 24613 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:38.818763 24613 raft_consensus.cc:2955] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:38.821952 19245 raft_consensus.cc:2955] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:38.832212 18665 tablet_service.cc:1558] Processing DeleteTablet for tablet e9507595fc484ec1b5cf1d1b2482debf with delete_type TABLET_DATA_TOMBSTONED (TS a0dee333a83a45f1ab0c1bb6d094afd1 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:49600
I20260709 12:24:38.827422 18680 raft_consensus.cc:2955] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:38.847682 24625 consensus_queue.cc:1048] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:38.864512 18413 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 406a6f5175ee42239ec8464ef19d6f14 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:38.875005 19210 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:38.889324 24532 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:38.921818 24637 tablet_replica.cc:333] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:24:38.936391 24492 raft_consensus.cc:2955] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:38.936478 18424 catalog_manager.cc:5697] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: config changed from index 12 to 13, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New cstate: current_term: 16 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:38.978212 18605 raft_consensus.cc:2955] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:38.988006 24637 raft_consensus.cc:2243] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:38.989264 24637 raft_consensus.cc:2272] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:39.011425 19245 raft_consensus.cc:2955] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:39.033402 18587 tablet_service.cc:1558] Processing DeleteTablet for tablet 406a6f5175ee42239ec8464ef19d6f14 with delete_type TABLET_DATA_TOMBSTONED (TS c7bd71f1f37c45f28b52c154e59356b9 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:38962
I20260709 12:24:39.034483 24637 ts_tablet_manager.cc:1916] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:39.053606 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c2c31f23053e4804b0fb872f29fde999 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:39.085615 24638 tablet_replica.cc:333] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:39.086390 18527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
mode: GRACEFUL
new_leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:36318
I20260709 12:24:39.093552 18527 raft_consensus.cc:606] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Received request to transfer leadership to TS c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:39.087026 24638 raft_consensus.cc:2243] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:39.116873 24638 raft_consensus.cc:2272] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:39.100425 18427 catalog_manager.cc:5697] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 8 to 9, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New cstate: current_term: 10 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:39.129120 24638 ts_tablet_manager.cc:1916] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:39.146860 18672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613"
dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
mode: GRACEFUL
new_leader_uuid: "8c29c312e4544452b1162d7f81a58cb4"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:24:39.147562 18672 raft_consensus.cc:606] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Received request to transfer leadership to TS 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:39.149896 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:39.151791 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:39.163463 24637 ts_tablet_manager.cc:1929] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 12:24:39.164002 24637 log.cc:1199] T e9507595fc484ec1b5cf1d1b2482debf P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-2-root/wals/e9507595fc484ec1b5cf1d1b2482debf
I20260709 12:24:39.165866 18411 catalog_manager.cc:5028] TS a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): tablet e9507595fc484ec1b5cf1d1b2482debf (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:24:39.171375 18512 tablet_service.cc:1558] Processing DeleteTablet for tablet c2c31f23053e4804b0fb872f29fde999 with delete_type TABLET_DATA_TOMBSTONED (TS 2f9872512f1646bc835906bd0e98c6a7 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:57364
I20260709 12:24:39.178138 24639 tablet_replica.cc:333] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:39.192919 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:39.203859 24638 ts_tablet_manager.cc:1929] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 12:24:39.204432 24638 log.cc:1199] T 406a6f5175ee42239ec8464ef19d6f14 P c7bd71f1f37c45f28b52c154e59356b9: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-1-root/wals/406a6f5175ee42239ec8464ef19d6f14
I20260709 12:24:39.206988 18411 catalog_manager.cc:5028] TS c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): tablet 406a6f5175ee42239ec8464ef19d6f14 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:24:39.220243 24639 raft_consensus.cc:2243] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:39.230868 24639 raft_consensus.cc:2272] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:39.250887 24639 ts_tablet_manager.cc:1916] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:39.341934 24639 ts_tablet_manager.cc:1929] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.8
I20260709 12:24:39.342592 24639 log.cc:1199] T c2c31f23053e4804b0fb872f29fde999 P 2f9872512f1646bc835906bd0e98c6a7: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-0-root/wals/c2c31f23053e4804b0fb872f29fde999
I20260709 12:24:39.355618 18413 catalog_manager.cc:5028] TS 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): tablet c2c31f23053e4804b0fb872f29fde999 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:24:39.409870 24628 raft_consensus.cc:993] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7: : Instructing follower c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:24:39.410526 24628 raft_consensus.cc:1081] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Signalling peer c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:24:39.420928 18598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:40954
I20260709 12:24:39.421622 18598 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:39.421964 18598 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:39.517941 18598 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:39.523608 18598 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:39.524498 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:39.525197 18527 raft_consensus.cc:3055] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:39.525503 18527 raft_consensus.cc:740] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:39.526369 18527 consensus_queue.cc:260] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:39.526762 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:39.527364 19245 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:39.529723 24561 raft_consensus.cc:993] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1: : Instructing follower 8c29c312e4544452b1162d7f81a58cb4 to start an election
I20260709 12:24:39.530336 24561 raft_consensus.cc:1081] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Signalling peer 8c29c312e4544452b1162d7f81a58cb4 to start an election
I20260709 12:24:39.531831 18527 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:39.533421 19241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613"
dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
 from {username='slave'} at 127.0.0.1:33382
I20260709 12:24:39.534003 19241 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:39.534358 19241 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:39.550289 18527 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 14.
I20260709 12:24:39.551970 18572 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:39.552898 24609 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:39.554672 24609 raft_consensus.cc:697] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:39.555619 24609 consensus_queue.cc:237] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:39.562983 19245 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 14.
I20260709 12:24:39.576927 19241 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:39.580907 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:39.581830 18527 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:39.587080 18672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:39.587906 18672 raft_consensus.cc:3055] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:39.588230 18672 raft_consensus.cc:740] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:39.591158 19241 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:39.589211 18672 consensus_queue.cc:260] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:39.601296 18672 raft_consensus.cc:3060] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:39.634184 18672 raft_consensus.cc:2468] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:24:39.634032 18424 catalog_manager.cc:5697] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 13 to 14, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 14 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:39.635707 19210 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:39.636917 24603 raft_consensus.cc:2804] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:39.637447 24603 raft_consensus.cc:697] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:24:39.638402 24603 consensus_queue.cc:237] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:39.656075 18527 raft_consensus.cc:2468] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 10.
I20260709 12:24:39.692922 18424 catalog_manager.cc:5697] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 9 to 10, leader changed from a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 10 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:40.022696 19245 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:24:40.025693 24481 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:40.086891 18530 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:24:40.090813 24603 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:40.106906 18523 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:24:40.108654 24605 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:40.128036 18672 raft_consensus.cc:1275] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:24:40.132949 24532 consensus_queue.cc:1048] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:40.270864 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:40.360246 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 96561.9us
I20260709 12:24:40.416412 18672 consensus_queue.cc:237] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:40.439455 18605 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:24:40.441812 18644 consensus_peers.cc:597] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 15e3196fc974445e967d05514226ac45. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:40.442574 24655 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:40.462392 18523 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:24:40.464079 24561 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:40.471884 24611 raft_consensus.cc:2955] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:40.476101 18597 raft_consensus.cc:2955] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:40.492048 18605 consensus_queue.cc:237] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:40.497468 18424 catalog_manager.cc:5697] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 16 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:40.514633 18523 raft_consensus.cc:2955] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:40.522667 18597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2586476710143e281df940fcb3d3238"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:40.532490 18597 raft_consensus.cc:606] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:40.540854 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:40.542794 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:40.544394 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:40.586107 18523 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:24:40.586421 18672 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:24:40.587939 18570 consensus_peers.cc:597] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c30a47c4d7e24c07809e11073578b22c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:40.589224 24605 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:40.591058 24609 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:24:40.670272 24609 raft_consensus.cc:2955] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:40.700732 18523 raft_consensus.cc:2955] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:40.699645 18678 consensus_queue.cc:237] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:40.726639 24654 raft_consensus.cc:993] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:40.727205 24654 raft_consensus.cc:1081] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:40.729290 18521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2586476710143e281df940fcb3d3238"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:24:40.729941 18521 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:40.730319 18521 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:40.732874 18605 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:24:40.736259 18530 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:24:40.737504 24561 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:40.738628 24655 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:24:40.745767 18644 consensus_peers.cc:597] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6874b99e69744371a73c71762816db62. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:40.755450 18521 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:40.759059 18521 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:40.760526 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:40.761178 18598 raft_consensus.cc:3055] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:40.761473 18598 raft_consensus.cc:740] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:40.762193 18598 consensus_queue.cc:260] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:40.763275 18598 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:40.776571 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:40.777390 18678 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:40.777103 24655 raft_consensus.cc:2955] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:40.786681 18598 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 15.
I20260709 12:24:40.787145 18605 raft_consensus.cc:2955] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:40.752586 18423 catalog_manager.cc:5697] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 14 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:40.822813 18424 catalog_manager.cc:5697] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 14 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:40.898078 18523 consensus_queue.cc:237] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:40.914445 18494 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:40.915454 24669 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:40.919543 24669 raft_consensus.cc:697] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:40.920710 24669 consensus_queue.cc:237] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:40.927697 18678 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 15.
I20260709 12:24:40.941413 18672 raft_consensus.cc:2955] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:40.975173 18598 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:24:40.976748 18427 catalog_manager.cc:5697] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 14 to 15, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 15 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:40.977939 24670 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:24:40.985623 18494 consensus_peers.cc:597] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e5079e43d75f41f9b2acb31e4798ce95. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:40.998291 18523 raft_consensus.cc:2955] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:41.021438 18598 raft_consensus.cc:2955] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:41.019846 24669 raft_consensus.cc:2955] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:41.055651 18427 catalog_manager.cc:5697] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index -1 to 12, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 17 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:41.057336 18678 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:24:41.055629 24675 ts_tablet_manager.cc:933] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:41.083528 24675 tablet_copy_client.cc:323] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.130:37079
I20260709 12:24:41.086644 18616 tablet_copy_service.cc:140] P c7bd71f1f37c45f28b52c154e59356b9: Received BeginTabletCopySession request for tablet c30a47c4d7e24c07809e11073578b22c from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:39798)
I20260709 12:24:41.087302 18616 tablet_copy_service.cc:161] P c7bd71f1f37c45f28b52c154e59356b9: Beginning new tablet copy session on tablet c30a47c4d7e24c07809e11073578b22c from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:39798: session id = 8c29c312e4544452b1162d7f81a58cb4-c30a47c4d7e24c07809e11073578b22c
I20260709 12:24:41.095049 24613 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:41.097819 18616 tablet_copy_source_session.cc:215] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:41.137189 18678 raft_consensus.cc:2955] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:41.168443 24675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c30a47c4d7e24c07809e11073578b22c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.168992 24676 ts_tablet_manager.cc:933] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:41.240056 24676 tablet_copy_client.cc:323] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.131:36757
I20260709 12:24:41.270884 18690 tablet_copy_service.cc:140] P a0dee333a83a45f1ab0c1bb6d094afd1: Received BeginTabletCopySession request for tablet 15e3196fc974445e967d05514226ac45 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:50938)
I20260709 12:24:41.271559 18690 tablet_copy_service.cc:161] P a0dee333a83a45f1ab0c1bb6d094afd1: Beginning new tablet copy session on tablet 15e3196fc974445e967d05514226ac45 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:50938: session id = 8c29c312e4544452b1162d7f81a58cb4-15e3196fc974445e967d05514226ac45
I20260709 12:24:41.280944 18690 tablet_copy_source_session.cc:215] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:41.292408 24676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e3196fc974445e967d05514226ac45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.312530 24675 tablet_copy_client.cc:806] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:41.313259 24675 tablet_copy_client.cc:670] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:41.328475 24675 tablet_copy_client.cc:538] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:41.355090 24676 tablet_copy_client.cc:806] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:41.355772 24676 tablet_copy_client.cc:670] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:41.357357 24675 tablet_bootstrap.cc:492] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:24:41.370029 18678 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:41.372248 24670 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:41.374867 24676 tablet_copy_client.cc:538] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:41.380504 24684 ts_tablet_manager.cc:933] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:41.390925 24676 tablet_bootstrap.cc:492] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:24:41.426129 24684 tablet_copy_client.cc:323] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.131:36757
I20260709 12:24:41.430169 18690 tablet_copy_service.cc:140] P a0dee333a83a45f1ab0c1bb6d094afd1: Received BeginTabletCopySession request for tablet 6874b99e69744371a73c71762816db62 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:50938)
I20260709 12:24:41.430769 18690 tablet_copy_service.cc:161] P a0dee333a83a45f1ab0c1bb6d094afd1: Beginning new tablet copy session on tablet 6874b99e69744371a73c71762816db62 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:50938: session id = 8c29c312e4544452b1162d7f81a58cb4-6874b99e69744371a73c71762816db62
I20260709 12:24:41.441619 18605 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:41.443475 24670 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:41.449843 18690 tablet_copy_source_session.cc:215] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:41.439049 24688 ts_tablet_manager.cc:933] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
I20260709 12:24:41.481757 24684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6874b99e69744371a73c71762816db62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.655972 24688 tablet_copy_client.cc:323] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.129:45155
I20260709 12:24:41.662541 18540 tablet_copy_service.cc:140] P 2f9872512f1646bc835906bd0e98c6a7: Received BeginTabletCopySession request for tablet e5079e43d75f41f9b2acb31e4798ce95 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:43124)
I20260709 12:24:41.663182 18540 tablet_copy_service.cc:161] P 2f9872512f1646bc835906bd0e98c6a7: Beginning new tablet copy session on tablet e5079e43d75f41f9b2acb31e4798ce95 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:43124: session id = 8c29c312e4544452b1162d7f81a58cb4-e5079e43d75f41f9b2acb31e4798ce95
I20260709 12:24:41.673520 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:41.689216 18540 tablet_copy_source_session.cc:215] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:41.693756 24688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5079e43d75f41f9b2acb31e4798ce95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.753278 24684 tablet_copy_client.cc:806] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:41.754074 24684 tablet_copy_client.cc:670] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:41.760237 24684 tablet_copy_client.cc:538] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:41.786441 24684 tablet_bootstrap.cc:492] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:24:41.809774 24676 tablet_bootstrap.cc:492] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=2 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.810933 24676 tablet_bootstrap.cc:492] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:24:41.833098 24676 ts_tablet_manager.cc:1403] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.421s	user 0.064s	sys 0.010s
I20260709 12:24:41.836664 24688 tablet_copy_client.cc:806] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:41.852161 24688 tablet_copy_client.cc:670] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:41.840194 18523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59141dbba91a4f249871144353b43d37"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
mode: GRACEFUL
new_leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:36318
I20260709 12:24:41.868213 18523 raft_consensus.cc:606] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Received request to transfer leadership to TS c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:41.869930 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:41.871964 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:41.872995 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:41.877539 24688 tablet_copy_client.cc:538] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:41.885072 24676 raft_consensus.cc:359] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:41.886130 24676 raft_consensus.cc:740] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:24:41.886909 24676 consensus_queue.cc:260] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:41.910908 24676 ts_tablet_manager.cc:1434] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.000s
I20260709 12:24:41.915593 19245 raft_consensus.cc:1217] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.9->[16.10-16.10]   Dedup: 16.10->[]
I20260709 12:24:41.885720 24675 tablet_bootstrap.cc:492] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.930263 24675 tablet_bootstrap.cc:492] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:24:41.936635 24675 ts_tablet_manager.cc:1403] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.580s	user 0.049s	sys 0.010s
I20260709 12:24:41.938912 18690 tablet_copy_service.cc:342] P a0dee333a83a45f1ab0c1bb6d094afd1: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-15e3196fc974445e967d05514226ac45 received from {username='slave'} at 127.0.0.1:50938
I20260709 12:24:41.944135 18690 tablet_copy_service.cc:434] P a0dee333a83a45f1ab0c1bb6d094afd1: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-15e3196fc974445e967d05514226ac45 on tablet 15e3196fc974445e967d05514226ac45 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:41.950167 24688 tablet_bootstrap.cc:492] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:24:41.946962 24675 raft_consensus.cc:359] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:41.954191 24675 raft_consensus.cc:740] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:24:41.954907 24675 consensus_queue.cc:260] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:41.958942 24675 ts_tablet_manager.cc:1434] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:24:41.970595 18616 tablet_copy_service.cc:342] P c7bd71f1f37c45f28b52c154e59356b9: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-c30a47c4d7e24c07809e11073578b22c received from {username='slave'} at 127.0.0.1:39798
I20260709 12:24:41.972632 18616 tablet_copy_service.cc:434] P c7bd71f1f37c45f28b52c154e59356b9: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-c30a47c4d7e24c07809e11073578b22c on tablet c30a47c4d7e24c07809e11073578b22c with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:42.007402 24684 tablet_bootstrap.cc:492] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:42.008850 24684 tablet_bootstrap.cc:492] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:24:42.025134 24684 ts_tablet_manager.cc:1403] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.239s	user 0.037s	sys 0.008s
I20260709 12:24:42.031508 24684 raft_consensus.cc:359] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:42.035634 24669 raft_consensus.cc:993] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7: : Instructing follower c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:24:42.038232 24684 raft_consensus.cc:740] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:24:42.038445 24669 raft_consensus.cc:1081] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Signalling peer c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:24:42.039019 24684 consensus_queue.cc:260] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:42.042532 18598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59141dbba91a4f249871144353b43d37"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:40954
I20260709 12:24:42.043195 24684 ts_tablet_manager.cc:1434] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:24:42.043332 18598 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:42.043800 18598 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:42.058614 18690 tablet_copy_service.cc:342] P a0dee333a83a45f1ab0c1bb6d094afd1: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-6874b99e69744371a73c71762816db62 received from {username='slave'} at 127.0.0.1:50938
I20260709 12:24:42.059214 18690 tablet_copy_service.cc:434] P a0dee333a83a45f1ab0c1bb6d094afd1: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-6874b99e69744371a73c71762816db62 on tablet 6874b99e69744371a73c71762816db62 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:42.066111 19245 raft_consensus.cc:1217] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.10->[14.11-14.11]   Dedup: 14.11->[]
I20260709 12:24:42.149410 18598 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:42.154498 18523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:42.155165 18523 raft_consensus.cc:3055] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:42.155459 18523 raft_consensus.cc:740] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:42.156206 18523 consensus_queue.cc:260] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:42.157326 18523 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:42.163720 24688 tablet_bootstrap.cc:492] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:42.164799 24688 tablet_bootstrap.cc:492] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:24:42.165534 24688 ts_tablet_manager.cc:1403] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.216s	user 0.039s	sys 0.011s
I20260709 12:24:42.169529 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:42.170132 18678 raft_consensus.cc:3060] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:42.181967 18678 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 16.
I20260709 12:24:42.182909 18598 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:42.183804 24688 raft_consensus.cc:359] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:42.184232 18570 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:42.184563 18523 raft_consensus.cc:2468] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 16.
I20260709 12:24:42.185217 24694 raft_consensus.cc:2804] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:42.185730 24694 raft_consensus.cc:697] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:42.186635 24694 consensus_queue.cc:237] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:42.193204 24688 raft_consensus.cc:740] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:24:42.194003 24688 consensus_queue.cc:260] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:42.200973 24688 ts_tablet_manager.cc:1434] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:24:42.206915 18540 tablet_copy_service.cc:342] P 2f9872512f1646bc835906bd0e98c6a7: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-e5079e43d75f41f9b2acb31e4798ce95 received from {username='slave'} at 127.0.0.1:43124
I20260709 12:24:42.207459 18540 tablet_copy_service.cc:434] P 2f9872512f1646bc835906bd0e98c6a7: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-e5079e43d75f41f9b2acb31e4798ce95 on tablet e5079e43d75f41f9b2acb31e4798ce95 with peer 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:42.234732 18424 catalog_manager.cc:5697] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 15 to 16, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 16 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:42.438647 19239 raft_consensus.cc:1217] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.11->[17.12-17.12]   Dedup: 17.12->[]
I20260709 12:24:42.454142 24561 raft_consensus.cc:1064] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:24:42.457003 24561 consensus_queue.cc:237] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:42.479116 19239 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 LEARNER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:24:42.480271 18598 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:24:42.485592 24679 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:42.488494 24679 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:42.503307 18530 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:24:42.509172 24695 raft_consensus.cc:1064] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:24:42.511049 24680 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:42.519656 19241 raft_consensus.cc:1217] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 12:24:42.537750 24695 consensus_queue.cc:237] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:42.541772 24561 raft_consensus.cc:2955] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:42.550736 19241 raft_consensus.cc:2955] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:42.587045 18605 raft_consensus.cc:2955] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:42.589654 18424 catalog_manager.cc:5697] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:42.637409 18523 raft_consensus.cc:2955] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:42.687448 18672 consensus_queue.cc:237] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:42.692929 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 87438.4us
I20260709 12:24:42.694924 18678 raft_consensus.cc:1275] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:24:42.696024 18523 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:24:42.698292 19239 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [term 14 LEARNER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:24:42.698462 24696 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:42.700413 18672 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:24:42.700826 18523 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:42.707238 24561 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:42.710294 24712 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:42.715507 24679 raft_consensus.cc:2955] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:42.717046 24696 consensus_queue.cc:1048] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:42.718429 24694 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:42.721573 18521 raft_consensus.cc:2955] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:42.728678 19239 raft_consensus.cc:1275] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:42.745507 24680 consensus_queue.cc:1048] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:42.758387 18424 catalog_manager.cc:5697] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: config changed from index 11 to 12, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New cstate: current_term: 16 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:42.758440 19239 raft_consensus.cc:2955] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:42.770165 18521 raft_consensus.cc:1275] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:24:42.910831 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 70193.9us
I20260709 12:24:42.930552 18587 tablet_service.cc:1558] Processing DeleteTablet for tablet 15e3196fc974445e967d05514226ac45 with delete_type TABLET_DATA_TOMBSTONED (TS c7bd71f1f37c45f28b52c154e59356b9 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:38962
I20260709 12:24:42.928624 24719 consensus_queue.cc:1048] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 12:24:43.012570 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:43.038491 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 113572us
I20260709 12:24:43.062142 24732 raft_consensus.cc:2955] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
W20260709 12:24:43.072775 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 164683us
W20260709 12:24:43.094810 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 46957.9us
I20260709 12:24:43.109117 24729 tablet_replica.cc:333] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:43.110387 24729 raft_consensus.cc:2243] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:43.111202 24729 raft_consensus.cc:2272] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:43.142832 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 15e3196fc974445e967d05514226ac45 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:24:43.146456 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 55647.1us
W20260709 12:24:43.145902 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 66726us
I20260709 12:24:43.162448 24729 ts_tablet_manager.cc:1916] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:43.168188 18523 raft_consensus.cc:2955] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:43.174820 24561 raft_consensus.cc:1064] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:24:43.177194 24561 consensus_queue.cc:237] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:43.230561 19241 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 LEARNER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:24:43.232690 24725 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:43.244496 18598 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:24:43.283885 18597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:43.284570 18597 raft_consensus.cc:606] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Received request to transfer leadership to TS 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:43.246210 24561 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:43.291909 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:43.294134 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:43.295248 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:43.325521 19241 raft_consensus.cc:2955] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:43.333796 18678 raft_consensus.cc:2955] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:43.378836 18424 catalog_manager.cc:5697] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 11 to 12, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:43.387902 24719 raft_consensus.cc:993] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:43.388469 24719 raft_consensus.cc:1081] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Signalling peer 2f9872512f1646bc835906bd0e98c6a7 to start an election
I20260709 12:24:43.394383 18529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
 from {username='slave'} at 127.0.0.1:57384
I20260709 12:24:43.395016 18529 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:43.395383 18529 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:43.421446 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 45012.9us
I20260709 12:24:43.425681 18529 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:43.448316 18529 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:24:43.502215 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 60457.2us
I20260709 12:24:43.558799 24729 ts_tablet_manager.cc:1929] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 12:24:43.559657 24729 log.cc:1199] T 15e3196fc974445e967d05514226ac45 P c7bd71f1f37c45f28b52c154e59356b9: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-1-root/wals/15e3196fc974445e967d05514226ac45
I20260709 12:24:43.563395 18411 catalog_manager.cc:5028] TS c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): tablet 15e3196fc974445e967d05514226ac45 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
W20260709 12:24:43.565430 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 64866.2us
I20260709 12:24:43.859068 18529 raft_consensus.cc:1240] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Rejecting Update request from peer c7bd71f1f37c45f28b52c154e59356b9 for earlier term 11. Current term is 12. Ops: []
W20260709 12:24:43.867949 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 44756.6us
I20260709 12:24:43.888239 24737 consensus_queue.cc:1059] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:43.893981 24726 raft_consensus.cc:3055] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:43.894606 24726 raft_consensus.cc:740] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:43.922004 24561 raft_consensus.cc:2955] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:43.895637 24726 consensus_queue.cc:260] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:43.946468 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 72867.3us
W20260709 12:24:43.951395 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 77598.1us
I20260709 12:24:43.953037 18598 raft_consensus.cc:2955] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
W20260709 12:24:43.973937 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 104992us
I20260709 12:24:44.013415 24726 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:44.015900 24723 raft_consensus.cc:1064] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:24:44.043727 24723 consensus_queue.cc:237] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:44.056140 18530 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:24:44.064821 19241 raft_consensus.cc:2955] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:44.073091 24757 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:44.073813 24757 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:44.076162 24757 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:44.079030 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:44.081205 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:44.082052 19245 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:44.113912 19245 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 12.
I20260709 12:24:44.114804 24751 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:24:44.123294 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 112093us
I20260709 12:24:44.118757 18427 catalog_manager.cc:5697] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:44.124429 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:44.139937 24630 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:44.140620 24630 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:44.142812 24630 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:44.158902 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:44.159739 19248 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 17.
I20260709 12:24:44.160898 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:44.171283 18604 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:24:44.182453 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:44.183365 18604 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 17.
I20260709 12:24:44.183717 19248 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 LEARNER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:24:44.188741 18672 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:24:44.195369 18597 consensus_queue.cc:237] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:44.179382 18598 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 12.
I20260709 12:24:44.229964 19210 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:44.232168 24750 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:44.232606 24750 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:44.232986 24750 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:44.233831 18494 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:24:44.235327 18570 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:24:44.235689 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 98901.7us
I20260709 12:24:44.252144 24764 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:44.254993 24764 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:44.255375 24764 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:44.258865 19245 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:24:44.251575 24761 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 12:24:44.248356 24723 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:44.262382 24723 raft_consensus.cc:697] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:44.263630 24723 consensus_queue.cc:237] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:44.278684 24762 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:44.298942 18521 raft_consensus.cc:2955] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } attrs { replace: true } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:44.303993 24750 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:44.278017 24764 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:44.311213 24764 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 18 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:44.312934 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
W20260709 12:24:44.315733 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 68185.6us
I20260709 12:24:44.314653 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:44.329779 18572 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:44.333282 18598 raft_consensus.cc:1240] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Rejecting Update request from peer 2f9872512f1646bc835906bd0e98c6a7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:44.340931 24750 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 18 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:44.341172 24726 raft_consensus.cc:2955] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:44.330487 24768 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 12:24:44.344246 24765 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:24:44.348042 19245 raft_consensus.cc:2955] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:44.352416 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:44.353283 18597 raft_consensus.cc:2393] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 18: Already voted for candidate c7bd71f1f37c45f28b52c154e59356b9 in this term.
I20260709 12:24:44.357689 18672 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:24:44.359943 24764 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:44.365682 18530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:44.367568 18678 raft_consensus.cc:2955] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:44.376434 19212 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:44.380409 24738 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:24:44.396427 24770 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:44.424283 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c30a47c4d7e24c07809e11073578b22c with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:44.431219 18426 catalog_manager.cc:5697] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 12 to 13, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New cstate: current_term: 14 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:44.453209 18512 tablet_service.cc:1558] Processing DeleteTablet for tablet c30a47c4d7e24c07809e11073578b22c with delete_type TABLET_DATA_TOMBSTONED (TS 2f9872512f1646bc835906bd0e98c6a7 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:57364
I20260709 12:24:44.472903 24774 tablet_replica.cc:333] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:44.473994 24774 raft_consensus.cc:2243] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:44.474977 24774 raft_consensus.cc:2272] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:44.477983 24774 ts_tablet_manager.cc:1916] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:44.496601 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:44.512905 24761 consensus_queue.cc:1059] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:24:44.514014 24723 raft_consensus.cc:3055] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:44.514385 24723 raft_consensus.cc:740] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:44.515539 24723 consensus_queue.cc:260] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:44.517143 24723 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:44.575253 24764 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:44.575939 24764 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:44.578645 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2f9872512f1646bc835906bd0e98c6a7" is_pre_election: true
I20260709 12:24:44.580816 24764 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:44.582307 24774 ts_tablet_manager.cc:1929] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.12
I20260709 12:24:44.583591 18675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:44.585551 18570 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:44.586858 24764 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:44.558852 18426 catalog_manager.cc:5697] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 11 to 12, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129). New cstate: current_term: 12 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:44.596565 24774 log.cc:1199] T c30a47c4d7e24c07809e11073578b22c P 2f9872512f1646bc835906bd0e98c6a7: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-0-root/wals/c30a47c4d7e24c07809e11073578b22c
I20260709 12:24:44.598848 18413 catalog_manager.cc:5028] TS 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): tablet c30a47c4d7e24c07809e11073578b22c (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:24:44.621803 24723 raft_consensus.cc:2955] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:44.635859 19245 raft_consensus.cc:2955] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:44.633738 18597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
mode: GRACEFUL
new_leader_uuid: "8c29c312e4544452b1162d7f81a58cb4"
 from {username='slave'} at 127.0.0.1:55912
I20260709 12:24:44.639508 18597 raft_consensus.cc:606] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Received request to transfer leadership to TS 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:44.644276 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:44.646438 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:44.654774 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:44.662137 18678 raft_consensus.cc:2955] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:44.670264 18426 catalog_manager.cc:5697] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 12 to 13, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:44.676920 18597 raft_consensus.cc:2955] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:44.759338 18530 consensus_queue.cc:237] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:44.770812 18678 consensus_queue.cc:237] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:44.784297 19245 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:24:44.785918 24770 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:44.787328 18521 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:24:44.789333 24561 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:44.789530 19241 raft_consensus.cc:1275] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:24:44.794087 24561 consensus_queue.cc:1048] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:44.808445 24726 raft_consensus.cc:993] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9: : Instructing follower 8c29c312e4544452b1162d7f81a58cb4 to start an election
I20260709 12:24:44.808944 24726 raft_consensus.cc:1081] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Signalling peer 8c29c312e4544452b1162d7f81a58cb4 to start an election
I20260709 12:24:44.810802 19245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419"
dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
 from {username='slave'} at 127.0.0.1:33388
I20260709 12:24:44.811472 19245 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:44.811897 19245 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:44.797843 24769 raft_consensus.cc:2955] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:44.820793 24724 raft_consensus.cc:2955] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:44.826326 19239 raft_consensus.cc:2955] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:44.822652 19245 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:44.823222 19248 raft_consensus.cc:2955] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:44.857791 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:44.858425 18521 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:44.859272 19245 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:44.867272 18521 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 15.
I20260709 12:24:44.868659 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6874b99e69744371a73c71762816db62 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:44.872116 18426 catalog_manager.cc:5697] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 11 to 12, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New cstate: current_term: 14 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:44.877403 19212 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4; no voters: 
I20260709 12:24:44.881297 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:44.881989 18598 raft_consensus.cc:3055] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:44.882274 18598 raft_consensus.cc:740] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:44.883056 18598 consensus_queue.cc:260] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:44.885401 24738 raft_consensus.cc:2804] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:44.888105 24738 raft_consensus.cc:697] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:24:44.892782 18587 tablet_service.cc:1558] Processing DeleteTablet for tablet 6874b99e69744371a73c71762816db62 with delete_type TABLET_DATA_TOMBSTONED (TS c7bd71f1f37c45f28b52c154e59356b9 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:38962
I20260709 12:24:44.894840 18598 raft_consensus.cc:3060] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:44.900885 24777 tablet_replica.cc:333] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:44.895685 24738 consensus_queue.cc:237] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:44.902199 24777 raft_consensus.cc:2243] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:44.903178 24777 raft_consensus.cc:2272] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:44.908851 18605 raft_consensus.cc:1275] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:44.909334 19239 raft_consensus.cc:1275] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:44.910116 18530 raft_consensus.cc:2955] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:44.922711 18597 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:24:44.972298 18413 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e5079e43d75f41f9b2acb31e4798ce95 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:44.955081 24736 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
W20260709 12:24:44.973534 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 84847.7us
I20260709 12:24:44.977385 24770 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:44.942687 24777 ts_tablet_manager.cc:1916] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:44.986053 18424 catalog_manager.cc:5697] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: config changed from index 13 to 14, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New cstate: current_term: 17 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:44.989763 18424 catalog_manager.cc:5697] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 14 to 15, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 15 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.036487 18665 tablet_service.cc:1558] Processing DeleteTablet for tablet e5079e43d75f41f9b2acb31e4798ce95 with delete_type TABLET_DATA_TOMBSTONED (TS a0dee333a83a45f1ab0c1bb6d094afd1 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:49600
I20260709 12:24:44.975342 18598 raft_consensus.cc:2468] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 15.
I20260709 12:24:44.962231 24768 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
I20260709 12:24:45.093438 24777 ts_tablet_manager.cc:1929] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 12:24:45.094457 24777 log.cc:1199] T 6874b99e69744371a73c71762816db62 P c7bd71f1f37c45f28b52c154e59356b9: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-1-root/wals/6874b99e69744371a73c71762816db62
I20260709 12:24:45.096539 18411 catalog_manager.cc:5028] TS c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): tablet 6874b99e69744371a73c71762816db62 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:24:45.097165 24781 tablet_replica.cc:333] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:24:45.098248 24781 raft_consensus.cc:2243] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.098994 24781 raft_consensus.cc:2272] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.114717 18598 raft_consensus.cc:2955] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:45.124593 24781 ts_tablet_manager.cc:1916] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:45.285504 24781 ts_tablet_manager.cc:1929] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.13
I20260709 12:24:45.285899 24781 log.cc:1199] T e5079e43d75f41f9b2acb31e4798ce95 P a0dee333a83a45f1ab0c1bb6d094afd1: Deleting WAL directory at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599638884573-17346-0/minicluster-data/ts-2-root/wals/e5079e43d75f41f9b2acb31e4798ce95
I20260709 12:24:45.287686 18411 catalog_manager.cc:5028] TS a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): tablet e5079e43d75f41f9b2acb31e4798ce95 (table test-workload [id=19f6690326ef4c70903c44294c3fea9c]) successfully deleted
I20260709 12:24:45.406827 18605 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:24:45.408553 24733 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:45.442078 18521 raft_consensus.cc:1275] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:24:45.446066 24744 consensus_queue.cc:1048] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:45.866321 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:45.974510 24768 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.975047 24768 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:45.977350 24768 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:45.981204 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:45.981472 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:45.981971 19245 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 18.
I20260709 12:24:45.982388 18598 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 18.
I20260709 12:24:45.990077 18494 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:45.991104 24768 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:45.991523 24768 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.991902 24768 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:45.999969 24768 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:46.013376 24768 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 19 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:46.032589 18530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317"
dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
mode: GRACEFUL
new_leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:36318
I20260709 12:24:46.033270 18530 raft_consensus.cc:606] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Received request to transfer leadership to TS c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:46.034312 18597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:46.034911 18597 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:46.044998 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:46.045656 19245 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:46.072592 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:46.074883 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:46.072679 19245 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 19.
I20260709 12:24:46.077687 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:46.098800 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 64517.8us
I20260709 12:24:46.100015 18597 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f9872512f1646bc835906bd0e98c6a7 in term 19.
W20260709 12:24:46.107206 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 65058.5us
I20260709 12:24:46.114553 18494 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:46.128829 24768 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:46.137033 24768 raft_consensus.cc:697] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 19 LEADER]: Becoming Leader. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:46.138033 24768 consensus_queue.cc:237] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:46.260897 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 109611us
I20260709 12:24:46.277361 18427 catalog_manager.cc:5697] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "2f9872512f1646bc835906bd0e98c6a7" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:46.304298 18604 consensus_queue.cc:237] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
W20260709 12:24:46.318831 18570 consensus_peers.cc:597] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ce446d878cef426395147773f6c9a25e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:46.322201 18679 raft_consensus.cc:1275] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:24:46.326160 24757 consensus_queue.cc:1048] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:46.331275 18530 raft_consensus.cc:1275] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:24:46.333366 24757 consensus_queue.cc:1048] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:46.352254 24801 raft_consensus.cc:993] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7: : Instructing follower c7bd71f1f37c45f28b52c154e59356b9 to start an election
I20260709 12:24:46.354537 24801 raft_consensus.cc:1081] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Signalling peer c7bd71f1f37c45f28b52c154e59356b9 to start an election
W20260709 12:24:46.373764 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 46566.6us
I20260709 12:24:46.385819 24726 raft_consensus.cc:2955] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:46.387867 18675 raft_consensus.cc:2955] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:46.399246 18597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317"
dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
 from {username='slave'} at 127.0.0.1:40954
I20260709 12:24:46.399971 18597 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:46.400404 18597 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:46.409528 18597 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:46.425266 18597 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:24:46.460682 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 43620.8us
I20260709 12:24:46.569211 18424 catalog_manager.cc:5697] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 10 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
W20260709 12:24:46.580394 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 166554us
I20260709 12:24:46.645809 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:46.646409 18678 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:46.695273 18521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "2f9872512f1646bc835906bd0e98c6a7"
I20260709 12:24:46.695928 18521 raft_consensus.cc:3055] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:46.696192 18521 raft_consensus.cc:740] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2f9872512f1646bc835906bd0e98c6a7, State: Running, Role: LEADER
I20260709 12:24:46.704694 18526 raft_consensus.cc:2955] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:46.696767 18521 consensus_queue.cc:260] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:46.707121 18521 raft_consensus.cc:3060] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:46.736191 18521 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 16.
I20260709 12:24:46.740212 18572 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:46.742762 24811 raft_consensus.cc:2804] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:46.743320 24811 raft_consensus.cc:697] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:46.744280 24811 consensus_queue.cc:237] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:46.786247 18597 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 19 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:24:46.800869 18678 raft_consensus.cc:2468] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 16.
I20260709 12:24:46.808173 24816 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:24:46.864140 18598 consensus_queue.cc:237] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:46.931164 19245 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 19 FOLLOWER]: Refusing update from remote peer 2f9872512f1646bc835906bd0e98c6a7: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:24:46.946897 24768 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:24:46.953646 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 73627us
I20260709 12:24:46.983129 18680 raft_consensus.cc:1275] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:24:46.985484 24794 consensus_queue.cc:1048] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:24:46.988211 18570 consensus_peers.cc:597] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879): Couldn't send request to peer 8c29c312e4544452b1162d7f81a58cb4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9f9c25fcde974c42918932833eac1523. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:46.998000 18521 raft_consensus.cc:1275] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:24:47.000094 24757 consensus_queue.cc:1048] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:47.012946 24828 ts_tablet_manager.cc:933] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:47.023526 24787 raft_consensus.cc:2955] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:47.024756 18521 raft_consensus.cc:2955] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:47.035784 18680 raft_consensus.cc:2955] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:47.056546 24828 tablet_copy_client.cc:323] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.130:37079
I20260709 12:24:47.058269 18616 tablet_copy_service.cc:140] P c7bd71f1f37c45f28b52c154e59356b9: Received BeginTabletCopySession request for tablet ce446d878cef426395147773f6c9a25e from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:39798)
I20260709 12:24:47.058780 18616 tablet_copy_service.cc:161] P c7bd71f1f37c45f28b52c154e59356b9: Beginning new tablet copy session on tablet ce446d878cef426395147773f6c9a25e from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:39798: session id = 8c29c312e4544452b1162d7f81a58cb4-ce446d878cef426395147773f6c9a25e
I20260709 12:24:47.108829 18427 catalog_manager.cc:5697] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index -1 to 8, NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) added. New cstate: current_term: 12 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } } }
I20260709 12:24:47.250264 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:47.259423 18616 tablet_copy_source_session.cc:215] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:47.268466 24828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce446d878cef426395147773f6c9a25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:47.283269 18426 catalog_manager.cc:5697] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 15 to 16, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 16 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:47.307277 18521 raft_consensus.cc:1275] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:47.312976 24836 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:47.372584 18680 raft_consensus.cc:1275] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:47.389895 24726 consensus_queue.cc:1048] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:47.457152 24828 tablet_copy_client.cc:806] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
W20260709 12:24:47.484335 24838 log.cc:927] Time spent T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:24:47.486204 24840 ts_tablet_manager.cc:933] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4: Initiating tablet copy from peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:47.528342 24840 tablet_copy_client.cc:323] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.240.130:37079
I20260709 12:24:47.501618 24828 tablet_copy_client.cc:670] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:47.574003 18616 tablet_copy_service.cc:140] P c7bd71f1f37c45f28b52c154e59356b9: Received BeginTabletCopySession request for tablet 9f9c25fcde974c42918932833eac1523 from peer 8c29c312e4544452b1162d7f81a58cb4 ({username='slave'} at 127.0.0.1:39798)
I20260709 12:24:47.575378 18616 tablet_copy_service.cc:161] P c7bd71f1f37c45f28b52c154e59356b9: Beginning new tablet copy session on tablet 9f9c25fcde974c42918932833eac1523 from peer 8c29c312e4544452b1162d7f81a58cb4 at {username='slave'} at 127.0.0.1:39798: session id = 8c29c312e4544452b1162d7f81a58cb4-9f9c25fcde974c42918932833eac1523
I20260709 12:24:47.574265 24828 tablet_copy_client.cc:538] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:47.604080 18616 tablet_copy_source_session.cc:215] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:47.624933 24840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9c25fcde974c42918932833eac1523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:47.640656 24828 tablet_bootstrap.cc:492] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:24:47.693282 24840 tablet_copy_client.cc:806] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:47.694615 24840 tablet_copy_client.cc:670] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Starting download of 1 WAL segments...
W20260709 12:24:47.695485 18627 debug-util.cc:398] Leaking SignalData structure 0x7b0800356f80 after lost signal to thread 17349
W20260709 12:24:47.696910 18627 debug-util.cc:398] Leaking SignalData structure 0x7b08003283e0 after lost signal to thread 18461
W20260709 12:24:47.698556 18627 debug-util.cc:398] Leaking SignalData structure 0x7b0800095be0 after lost signal to thread 18554
W20260709 12:24:47.699967 18627 debug-util.cc:398] Leaking SignalData structure 0x7b080022e100 after lost signal to thread 18630
I20260709 12:24:47.700019 24840 tablet_copy_client.cc:538] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:24:47.702215 18627 debug-util.cc:398] Leaking SignalData structure 0x7b08000ca520 after lost signal to thread 18705
W20260709 12:24:47.703886 18627 debug-util.cc:398] Leaking SignalData structure 0x7b08003a58c0 after lost signal to thread 19274
W20260709 12:24:47.704284 18627 debug-util.cc:398] Leaking SignalData structure 0x7b08002006c0 after lost signal to thread 24724
W20260709 12:24:47.704773 18627 debug-util.cc:398] Leaking SignalData structure 0x7b080033a0c0 after lost signal to thread 24788
I20260709 12:24:47.734069 24840 tablet_bootstrap.cc:492] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap starting.
I20260709 12:24:47.801954 17346 tablet_server.cc:179] TabletServer@127.16.240.129:0 shutting down...
W20260709 12:24:47.804845 19212 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
I20260709 12:24:47.827237 24828 tablet_bootstrap.cc:492] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:47.837196 24828 tablet_bootstrap.cc:492] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
W20260709 12:24:47.847077 19212 consensus_peers.cc:597] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:47.848161 19212 consensus_peers.cc:597] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:47.859051 24828 ts_tablet_manager.cc:1403] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.219s	user 0.035s	sys 0.011s
W20260709 12:24:47.863772 18572 consensus_peers.cc:597] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:47.888458 18572 consensus_peers.cc:597] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:47.898145 19212 consensus_peers.cc:597] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:47.913338 24828 raft_consensus.cc:359] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
W20260709 12:24:47.921950 19212 consensus_peers.cc:597] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:47.921398 24828 raft_consensus.cc:740] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:24:47.930649 24828 consensus_queue.cc:260] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
W20260709 12:24:47.934824 18572 consensus_peers.cc:597] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:47.943545 18572 consensus_peers.cc:597] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:47.963042 18572 consensus_peers.cc:597] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:47.965528 18572 consensus_peers.cc:597] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:47.986629 19212 consensus_peers.cc:597] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:48.005532 19245 raft_consensus.cc:1217] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.7->[10.8-10.8]   Dedup: 10.8->[]
W20260709 12:24:48.040010 18572 consensus_peers.cc:597] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:48.044200 19212 consensus_peers.cc:597] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:48.081185 19212 consensus_peers.cc:597] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:48.111835 18572 consensus_peers.cc:597] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:48.101316 24828 ts_tablet_manager.cc:1434] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.232s	user 0.010s	sys 0.000s
W20260709 12:24:48.128207 18572 consensus_peers.cc:597] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:48.131817 18646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 52913.8us
W20260709 12:24:48.133540 19212 consensus_peers.cc:597] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:48.135259 19212 consensus_peers.cc:597] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:48.138615 18646 consensus_peers.cc:597] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:48.142733 18646 consensus_peers.cc:597] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:48.142841 18616 tablet_copy_service.cc:342] P c7bd71f1f37c45f28b52c154e59356b9: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-ce446d878cef426395147773f6c9a25e received from {username='slave'} at 127.0.0.1:39798
I20260709 12:24:48.143424 18616 tablet_copy_service.cc:434] P c7bd71f1f37c45f28b52c154e59356b9: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-ce446d878cef426395147773f6c9a25e on tablet ce446d878cef426395147773f6c9a25e with peer 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:24:48.143606 18646 consensus_peers.cc:597] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:48.144836 24840 tablet_bootstrap.cc:492] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:24:48.144887 18646 consensus_peers.cc:597] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:48.147181 19212 consensus_peers.cc:597] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:48.157552 18646 consensus_peers.cc:597] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:48.148582 24840 tablet_bootstrap.cc:492] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4: Bootstrap complete.
I20260709 12:24:48.188015 24840 ts_tablet_manager.cc:1403] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4: Time spent bootstrapping tablet: real 0.454s	user 0.037s	sys 0.038s
I20260709 12:24:48.202406 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:48.204838 17346 tablet_replica.cc:333] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:48.206264 17346 raft_consensus.cc:2243] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:48.207563 17346 raft_consensus.cc:2272] T 08cf98d6828c446ebc2e69eda1b33719 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.213929 17346 tablet_replica.cc:333] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:48.216428 24840 raft_consensus.cc:359] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:48.217397 24840 raft_consensus.cc:740] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Initialized, Role: LEARNER
I20260709 12:24:48.218364 24840 consensus_queue.cc:260] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: NON_VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: true } }
I20260709 12:24:48.222472 24840 ts_tablet_manager.cc:1434] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.002s
I20260709 12:24:48.224747 17346 raft_consensus.cc:2243] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:48.225634 17346 raft_consensus.cc:2272] T 172bc8a62f9b4215b7395487dd4afd2b P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.229478 17346 tablet_replica.cc:333] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:48.230644 17346 raft_consensus.cc:2243] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:24:48.239601 18616 tablet_copy_service.cc:342] P c7bd71f1f37c45f28b52c154e59356b9: Request end of tablet copy session 8c29c312e4544452b1162d7f81a58cb4-9f9c25fcde974c42918932833eac1523 received from {username='slave'} at 127.0.0.1:39798
I20260709 12:24:48.240078 18616 tablet_copy_service.cc:434] P c7bd71f1f37c45f28b52c154e59356b9: ending tablet copy session 8c29c312e4544452b1162d7f81a58cb4-9f9c25fcde974c42918932833eac1523 on tablet 9f9c25fcde974c42918932833eac1523 with peer 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:24:48.247597 18646 consensus_peers.cc:597] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:48.249161 19212 consensus_peers.cc:597] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:48.342447 19212 consensus_peers.cc:597] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:48.399674 19212 consensus_peers.cc:597] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:48.402598 17346 raft_consensus.cc:2272] T 55f8787198c1435695beded3041a941e P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.427580 19248 raft_consensus.cc:1217] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.7->[12.8-12.8]   Dedup: 12.8->[]
W20260709 12:24:48.440522 18572 consensus_peers.cc:597] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:48.474074 18572 consensus_peers.cc:597] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:48.479686 17346 tablet_replica.cc:333] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:48.480623 17346 raft_consensus.cc:2243] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:48.481498 17346 raft_consensus.cc:2272] T 9f9c25fcde974c42918932833eac1523 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.526603 17346 tablet_replica.cc:333] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:48.527494 17346 raft_consensus.cc:2243] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:24:48.528822 17346 raft_consensus.cc:2272] T 169aeacb13cc43bb853d44de2d778477 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.565712 24787 raft_consensus.cc:1064] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:24:48.572567 24787 consensus_queue.cc:237] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:48.657945 19248 raft_consensus.cc:1275] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEARNER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:48.661866 18680 raft_consensus.cc:1275] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:48.666209 24787 consensus_queue.cc:1048] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:48.681612 17346 tablet_replica.cc:333] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:48.682744 17346 raft_consensus.cc:2243] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:48.683529 17346 raft_consensus.cc:2272] T d52124cfb8a140deaab206a18aadc308 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.710611 17346 tablet_replica.cc:333] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:48.712000 24789 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:48.712639 24789 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:48.718979 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:48.722429 24789 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:48.689177 24726 consensus_queue.cc:1048] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:48.711614 17346 raft_consensus.cc:2243] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:48.733352 17346 raft_consensus.cc:2272] T cdefe54c01e0436d82e68981b642554b P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.745285 17346 tablet_replica.cc:333] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:48.746400 17346 raft_consensus.cc:2243] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:48.747238 17346 raft_consensus.cc:2272] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.788777 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1dfac6f7ba4189ae36a57e87879b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:48.800920 17346 tablet_replica.cc:333] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:48.801898 17346 raft_consensus.cc:2243] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:24:48.687266 18572 consensus_peers.cc:597] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:48.826565 18572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 139332us
I20260709 12:24:48.803076 17346 raft_consensus.cc:2272] T 3be3087e258443e7b525ec57e79f3e2f P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.837409 17346 tablet_replica.cc:333] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:48.838665 17346 raft_consensus.cc:2243] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:24:48.843981 17346 raft_consensus.cc:2272] T 6e95bb922f31462b9debb1f2a9ff7e19 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.846251 24787 raft_consensus.cc:2955] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:48.858254 18494 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:48.868357 18680 raft_consensus.cc:2955] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:48.886454 17346 tablet_replica.cc:333] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:48.890188 17346 raft_consensus.cc:2243] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:48.891049 17346 raft_consensus.cc:2272] T 4eceb66ae237462f8f0e7e3b03872311 P 2f9872512f1646bc835906bd0e98c6a7 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.900031 24789 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:48.901031 24789 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:48.904510 24789 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:24:48.916561 18494 raft_consensus.cc:2686] T 8e1dfac6f7ba4189ae36a57e87879b22 P 2f9872512f1646bc835906bd0e98c6a7: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:24:48.918422 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 60384.5us
I20260709 12:24:48.920817 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:48.929342 24850 raft_consensus.cc:1064] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9: attempting to promote NON_VOTER 8c29c312e4544452b1162d7f81a58cb4 to VOTER
I20260709 12:24:48.932682 24850 consensus_queue.cc:237] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:48.939626 24793 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:48.940769 17346 tablet_replica.cc:333] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:48.940320 24793 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:48.942853 24793 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:48.947285 17346 raft_consensus.cc:2243] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:48.944726 24793 raft_consensus.cc:493] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:48.959369 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d337bc5c46924f42af3a8e39c86bfa17" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:48.971508 24793 raft_consensus.cc:515] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:48.974282 24793 leader_election.cc:290] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:48.975736 24793 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:48.976764 24793 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:48.991434 18426 catalog_manager.cc:5697] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:48.960626 24789 raft_consensus.cc:493] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:49.003005 19243 raft_consensus.cc:1275] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 LEARNER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:24:49.004946 24836 consensus_queue.cc:1048] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:49.006795 18678 raft_consensus.cc:1275] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:24:49.009591 24851 consensus_queue.cc:1048] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:49.013078 17346 raft_consensus.cc:2272] T 512f9ba3d0d04063899283c39177bcdf P 2f9872512f1646bc835906bd0e98c6a7 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.002915 24789 raft_consensus.cc:515] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:49.020656 24789 leader_election.cc:290] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:49.028896 17346 tablet_replica.cc:333] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.029870 17346 raft_consensus.cc:2243] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:49.034512 18494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 76494.1us
I20260709 12:24:49.036454 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:49.037097 24862 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:49.037746 24862 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:49.038699 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59141dbba91a4f249871144353b43d37" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:49.040191 24862 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:49.046118 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:49.045673 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eebfbd8106141a5903392238ce5a613" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:49.055225 17346 raft_consensus.cc:2272] T ce446d878cef426395147773f6c9a25e P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.068182 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:49.070995 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fb557c332c4f69a4267b6505d3f923" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:49.067044 24793 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:49.077400 24736 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:49.078343 17346 tablet_replica.cc:333] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.075673 24860 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:49.087292 24860 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:49.081066 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:49.090304 24860 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:49.094955 17346 raft_consensus.cc:2243] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.101837 24736 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:49.104813 24736 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:49.119910 24793 raft_consensus.cc:493] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:49.120875 24793 raft_consensus.cc:515] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:49.125355 24793 leader_election.cc:290] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:49.126204 17346 raft_consensus.cc:2272] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.140632 24859 raft_consensus.cc:493] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:49.141691 24859 raft_consensus.cc:515] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:49.147323 24793 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:49.148921 24793 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:49.151238 24793 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:49.152704 18494 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:49.153482 24859 leader_election.cc:290] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:49.154474 24793 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:49.155208 24793 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:49.159969 24793 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:49.161154 24859 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:24:49.161659 18572 consensus_peers.cc:597] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:49.162446 17346 tablet_replica.cc:333] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.163390 17346 raft_consensus.cc:2243] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:24:49.164474 17346 raft_consensus.cc:2272] T b7e559fc600a4308a080243995e9f1e8 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.167407 17346 tablet_replica.cc:333] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.171979 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:49.173318 17346 raft_consensus.cc:2243] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.173965 17346 raft_consensus.cc:2272] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.174337 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0dcb322f11f4eb39aa973579cafa317" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:49.176678 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171eb098d126492b96266e36d8a6ba81" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:49.180235 24865 raft_consensus.cc:493] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:49.180922 24865 raft_consensus.cc:515] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:49.189334 19248 raft_consensus.cc:2955] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } attrs { replace: true } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:49.198017 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:49.200683 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:49.204039 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3196fc974445e967d05514226ac45" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:49.203629 24726 raft_consensus.cc:2955] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:49.215286 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874b99e69744371a73c71762816db62" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:49.210897 19239 raft_consensus.cc:2955] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
W20260709 12:24:49.216603 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 183511us
I20260709 12:24:49.224292 24865 leader_election.cc:290] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:49.224197 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:49.232622 17346 tablet_replica.cc:333] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.237112 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:49.240100 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:49.240774 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678726cf80464d89802570ca4d73600f" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:49.241176 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:49.244617 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c92947c3174627a5618c85f17edeb3" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:49.246021 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c1709156f048cd8184a38476ebfe0d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:49.248356 24865 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:24:49.249408 24826 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:49.250133 24826 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:49.253057 17346 raft_consensus.cc:2243] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.254068 24826 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:49.249555 18680 raft_consensus.cc:2955] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:49.248919 24865 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:49.256160 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845d4cff87f249e1ab9060dd308d4b22" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:49.256840 24793 raft_consensus.cc:493] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
W20260709 12:24:49.257131 19212 leader_election.cc:336] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:49.257499 24789 raft_consensus.cc:493] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:49.265738 24865 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:49.266165 24789 raft_consensus.cc:515] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:49.258147 24859 raft_consensus.cc:493] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:49.267971 24859 raft_consensus.cc:515] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:49.268849 24789 leader_election.cc:290] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:49.271514 24859 leader_election.cc:290] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:49.265764 24793 raft_consensus.cc:515] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:49.274710 24793 leader_election.cc:290] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:49.275553 24860 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:49.276230 24860 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:49.278748 24860 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:49.290343 17346 raft_consensus.cc:2272] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.293874 17346 tablet_replica.cc:333] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.294872 17346 raft_consensus.cc:2243] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:24:49.295822 17346 raft_consensus.cc:2272] T 30ca83d13be54a41b9c5aaebfc89de05 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.296277 24865 raft_consensus.cc:493] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c29c312e4544452b1162d7f81a58cb4)
I20260709 12:24:49.300743 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:49.307024 24865 raft_consensus.cc:515] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:49.309993 24865 leader_election.cc:290] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:49.314381 17346 tablet_replica.cc:333] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.315534 17346 raft_consensus.cc:2243] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:24:49.316731 17346 raft_consensus.cc:2272] T 60d3f1fac491465fb48a6000ace325f2 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.319703 17346 tablet_replica.cc:333] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.328181 17346 raft_consensus.cc:2243] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:24:49.330116 17346 raft_consensus.cc:2272] T e5079e43d75f41f9b2acb31e4798ce95 P 2f9872512f1646bc835906bd0e98c6a7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.305887 18494 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:49.332337 24865 raft_consensus.cc:2749] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:49.340386 19210 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:49.336054 18494 leader_election.cc:304] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:49.342032 24865 raft_consensus.cc:2749] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:49.342717 18494 leader_election.cc:304] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:24:49.343500 18494 raft_consensus.cc:2686] T e3fb557c332c4f69a4267b6505d3f923 P 2f9872512f1646bc835906bd0e98c6a7: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:24:49.345824 17346 tablet_replica.cc:333] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.346815 17346 raft_consensus.cc:2243] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.353772 17346 raft_consensus.cc:2272] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.357077 17346 tablet_replica.cc:333] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.358075 17346 raft_consensus.cc:2243] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.358892 17346 raft_consensus.cc:2272] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.359975 24826 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:49.362218 17346 tablet_replica.cc:333] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.363390 17346 raft_consensus.cc:2243] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:24:49.364593 17346 raft_consensus.cc:2272] T b52424a465944d0ba861991c593bdc17 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.375644 17346 tablet_replica.cc:333] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.376521 17346 raft_consensus.cc:2243] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:24:49.376431 18598 consensus_queue.cc:237] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:49.377381 17346 raft_consensus.cc:2272] T 6840b12ab24d4f62b563a6d5d868d0c4 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.382512 19239 raft_consensus.cc:1275] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:49.384111 24850 consensus_queue.cc:1048] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:49.387773 18680 raft_consensus.cc:1275] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:49.391269 24850 consensus_queue.cc:1048] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:49.399718 24726 raft_consensus.cc:2955] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:49.401474 18678 raft_consensus.cc:2955] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:49.406656 19239 raft_consensus.cc:2955] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:49.410205 17346 tablet_replica.cc:333] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.411372 17346 raft_consensus.cc:2243] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.433218 18411 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ce446d878cef426395147773f6c9a25e with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:49.430884 18424 catalog_manager.cc:5697] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: config changed from index 8 to 9, 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:49.436266 17346 raft_consensus.cc:2272] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.439375 17346 tablet_replica.cc:333] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.445462 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:49.448069 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a2490fb6904f8ca5c4cab03767d419" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:24:49.455224 18495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.456291 17346 raft_consensus.cc:2243] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.457031 17346 raft_consensus.cc:2272] T 2cbe068cca5f4e01bf21b7df39ac7d89 P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.463039 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:49.467512 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e48d46c1f784719adae94c79efd88c8" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:49.468297 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:49.471889 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9141b3d8f87474d8f4752290efe5963" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:49.479622 24850 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:49.480248 24850 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:49.482626 24850 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:49.485373 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:49.486047 19241 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 14.
W20260709 12:24:49.486327 18572 leader_election.cc:336] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:49.487473 18570 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:49.488768 24850 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:49.489332 17346 tablet_replica.cc:333] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.490238 17346 raft_consensus.cc:2243] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.490911 17346 raft_consensus.cc:2272] T 6bcb0137def74cb3b0f0590e5e746d02 P 2f9872512f1646bc835906bd0e98c6a7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.489262 24850 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:49.495105 24850 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:49.512048 18427 catalog_manager.cc:5697] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: config changed from index 9 to 10, VOTER 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) evicted. New cstate: current_term: 10 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } } }
I20260709 12:24:49.514747 17346 tablet_replica.cc:333] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.515707 17346 raft_consensus.cc:2243] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.516759 17346 raft_consensus.cc:2272] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.518816 24850 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:49.524029 18572 leader_election.cc:336] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:49.527304 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
W20260709 12:24:49.529079 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 58419.7us
I20260709 12:24:49.531858 24850 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:49.532193 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f8787198c1435695beded3041a941e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:49.532791 19241 raft_consensus.cc:3060] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:49.545506 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea90be13249389635103ccb1dfee6" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:49.545795 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:49.552502 17346 tablet_replica.cc:333] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.553464 17346 raft_consensus.cc:2243] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.554323 17346 raft_consensus.cc:2272] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.554369 19241 raft_consensus.cc:2468] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 15.
I20260709 12:24:49.558696 18570 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:49.559840 24726 raft_consensus.cc:2804] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:49.560341 24726 raft_consensus.cc:697] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:49.561160 24726 consensus_queue.cc:237] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:49.582571 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ba9bae3e1f4f9a97bb68834d01038c" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:49.584594 17346 tablet_replica.cc:333] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.585544 17346 raft_consensus.cc:2243] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.586314 17346 raft_consensus.cc:2272] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.587105 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:49.588930 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f654a3c5be411f92ffc5ed5b6b70a1" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:24:49.590719 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.606529 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:49.606451 17346 tablet_replica.cc:333] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.611518 17346 raft_consensus.cc:2243] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.612203 17346 raft_consensus.cc:2272] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.615036 17346 tablet_replica.cc:333] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.615727 18424 catalog_manager.cc:5697] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 14 to 15, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 15 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:49.630410 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92b776ce9bf460fbd0c74b31953276d" candidate_uuid: "2f9872512f1646bc835906bd0e98c6a7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:49.643950 17346 raft_consensus.cc:2243] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.644727 17346 raft_consensus.cc:2272] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.644752 18494 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:49.649158 24793 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:49.649536 17346 tablet_replica.cc:333] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.650362 17346 raft_consensus.cc:2243] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.651007 17346 raft_consensus.cc:2272] T 59141dbba91a4f249871144353b43d37 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:49.650882 18413 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 117209us
I20260709 12:24:49.652432 18494 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:24:49.658710 18494 raft_consensus.cc:2686] T 15e3196fc974445e967d05514226ac45 P 2f9872512f1646bc835906bd0e98c6a7: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:24:49.665319 18413 catalog_manager.cc:4755] TS 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ce446d878cef426395147773f6c9a25e: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 12:24:49.682468 18493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.663398 18494 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:24:49.692334 18494 raft_consensus.cc:2686] T 6874b99e69744371a73c71762816db62 P 2f9872512f1646bc835906bd0e98c6a7: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:24:49.695721 18494 leader_election.cc:304] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:49.682701 17346 tablet_replica.cc:333] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.697371 24793 raft_consensus.cc:2749] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:49.697117 17346 raft_consensus.cc:2243] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:24:49.709381 18494 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:24:49.710188 18494 raft_consensus.cc:2686] T 06c92947c3174627a5618c85f17edeb3 P 2f9872512f1646bc835906bd0e98c6a7: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:24:49.713923 17346 raft_consensus.cc:2272] T e9507595fc484ec1b5cf1d1b2482debf P 2f9872512f1646bc835906bd0e98c6a7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.717029 17346 tablet_replica.cc:333] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.717941 17346 raft_consensus.cc:2243] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.718595 17346 raft_consensus.cc:2272] T 171eb098d126492b96266e36d8a6ba81 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.711061 18494 leader_election.cc:304] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:24:49.720109 18494 raft_consensus.cc:2686] T 49c1709156f048cd8184a38476ebfe0d P 2f9872512f1646bc835906bd0e98c6a7: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:24:49.721580 17346 tablet_replica.cc:333] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.722816 17346 raft_consensus.cc:2243] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:24:49.724015 17346 raft_consensus.cc:2272] T a2586476710143e281df940fcb3d3238 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.727314 17346 tablet_replica.cc:333] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.730336 18494 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:24:49.731159 18494 raft_consensus.cc:2686] T f0dcb322f11f4eb39aa973579cafa317 P 2f9872512f1646bc835906bd0e98c6a7: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:24:49.733889 18494 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:24:49.735443 18494 raft_consensus.cc:2686] T 845d4cff87f249e1ab9060dd308d4b22 P 2f9872512f1646bc835906bd0e98c6a7: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:24:49.738675 18494 leader_election.cc:304] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:49.743320 24865 raft_consensus.cc:2749] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:49.745019 18494 leader_election.cc:304] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:24:49.745761 18494 raft_consensus.cc:2686] T f9141b3d8f87474d8f4752290efe5963 P 2f9872512f1646bc835906bd0e98c6a7: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:24:49.746865 18494 leader_election.cc:304] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:24:49.750203 18494 raft_consensus.cc:2686] T 400ea90be13249389635103ccb1dfee6 P 2f9872512f1646bc835906bd0e98c6a7: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:24:49.751145 18494 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:49.751976 24865 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:49.753305 18494 leader_election.cc:304] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:24:49.756309 18494 raft_consensus.cc:2686] T d92b776ce9bf460fbd0c74b31953276d P 2f9872512f1646bc835906bd0e98c6a7: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:24:49.755107 17346 raft_consensus.cc:2243] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.755560 24871 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:49.759603 24871 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:49.762092 24871 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:49.763411 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:49.770098 24850 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:49.770740 24850 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:24:49.780572 18572 leader_election.cc:336] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:49.781397 24850 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:49.782985 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:49.784716 18570 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:49.785552 24850 raft_consensus.cc:2749] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:49.789675 17346 raft_consensus.cc:2272] T 13a2490fb6904f8ca5c4cab03767d419 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.814119 18494 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:24:49.814910 18494 raft_consensus.cc:2686] T 5e48d46c1f784719adae94c79efd88c8 P 2f9872512f1646bc835906bd0e98c6a7: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:24:49.816730 18494 leader_election.cc:304] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f9872512f1646bc835906bd0e98c6a7; no voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:49.817581 24865 raft_consensus.cc:2749] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:49.825551 17346 tablet_replica.cc:333] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
W20260709 12:24:49.837708 18646 leader_election.cc:336] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:49.840044 18646 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:49.840895 24871 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:49.841861 17346 raft_consensus.cc:2243] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:24:49.843122 17346 raft_consensus.cc:2272] T 3c6a528af94f43f980dcff59f8ba646e P 2f9872512f1646bc835906bd0e98c6a7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.846581 17346 tablet_replica.cc:333] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.847499 17346 raft_consensus.cc:2243] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.848304 17346 raft_consensus.cc:2272] T 8eebfbd8106141a5903392238ce5a613 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.851336 17346 tablet_replica.cc:333] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.852231 17346 raft_consensus.cc:2243] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.853042 17346 raft_consensus.cc:2272] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 2f9872512f1646bc835906bd0e98c6a7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.855835 17346 tablet_replica.cc:333] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.856662 17346 raft_consensus.cc:2243] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:24:49.857892 17346 raft_consensus.cc:2272] T 406a6f5175ee42239ec8464ef19d6f14 P 2f9872512f1646bc835906bd0e98c6a7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.861430 17346 tablet_replica.cc:333] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.862334 17346 raft_consensus.cc:2243] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.863493 17346 raft_consensus.cc:2272] T 678726cf80464d89802570ca4d73600f P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.866586 17346 tablet_replica.cc:333] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.867419 17346 raft_consensus.cc:2243] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.868808 17346 raft_consensus.cc:2272] T d337bc5c46924f42af3a8e39c86bfa17 P 2f9872512f1646bc835906bd0e98c6a7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.878098 17346 tablet_replica.cc:333] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.880498 17346 raft_consensus.cc:2243] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:24:49.881956 17346 raft_consensus.cc:2272] T 9786988480ef4569bc65f17fa6b60fd2 P 2f9872512f1646bc835906bd0e98c6a7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.890774 17346 tablet_replica.cc:333] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7: stopping tablet replica
I20260709 12:24:49.892006 17346 raft_consensus.cc:2243] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.892860 17346 raft_consensus.cc:2272] T a0ba9bae3e1f4f9a97bb68834d01038c P 2f9872512f1646bc835906bd0e98c6a7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.893651 24850 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:49.894304 24850 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:49.896740 24850 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:49.900760 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:49.901408 18680 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 15.
W20260709 12:24:49.901491 18572 leader_election.cc:336] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:49.902594 18570 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:49.904417 24850 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:49.904835 24850 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:49.905192 24850 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:49.912727 24871 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:49.913362 24871 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:49.915591 24871 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:49.917491 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:24:49.922976 18646 leader_election.cc:336] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:49.923450 18646 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:49.924544 24850 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:49.925056 24853 raft_consensus.cc:2749] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:49.927877 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169aeacb13cc43bb853d44de2d778477" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:49.928458 18680 raft_consensus.cc:3060] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:24:49.941295 18572 leader_election.cc:336] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:49.944152 18680 raft_consensus.cc:2468] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 16.
I20260709 12:24:49.927894 24850 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:49.945410 18570 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:49.951702 24850 raft_consensus.cc:2804] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:49.956321 24850 raft_consensus.cc:697] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:49.957353 24850 consensus_queue.cc:237] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:49.995335 18426 catalog_manager.cc:5697] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 15 to 16, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 16 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:50.082772 24871 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.083446 24871 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:50.095134 24871 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:50.098834 18646 leader_election.cc:336] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:50.105697 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:50.108276 18644 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:50.110741 24853 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:50.140247 24852 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.140828 24852 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:50.142949 24852 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:50.147312 18646 leader_election.cc:336] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:50.153687 19239 raft_consensus.cc:1275] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:50.157433 24726 consensus_queue.cc:1048] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:24:50.161535 18572 consensus_peers.cc:597] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:50.164047 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:50.164815 18598 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:24:50.184764 18644 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:50.186185 24852 raft_consensus.cc:2804] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:50.186584 24852 raft_consensus.cc:493] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.186941 24852 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:50.195263 18572 consensus_peers.cc:597] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:50.195464 24852 raft_consensus.cc:515] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:50.202816 24852 leader_election.cc:290] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:50.203820 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95bb922f31462b9debb1f2a9ff7e19" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:50.204432 18604 raft_consensus.cc:3060] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:50.208146 24733 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.208745 24733 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:50.209794 18646 leader_election.cc:336] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:50.210886 24733 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:24:50.212414 18572 consensus_peers.cc:597] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:50.214196 19212 leader_election.cc:336] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:50.220361 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:50.221069 18680 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 16.
I20260709 12:24:50.222271 19210 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:50.223045 24733 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:50.223410 24733 raft_consensus.cc:493] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.223796 24733 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:50.231460 24733 raft_consensus.cc:515] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:50.237907 17346 connection.cc:466] server connection from 127.0.0.1:43124 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43124 (request call id 2198) could send its response
I20260709 12:24:50.246354 24733 leader_election.cc:290] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 17 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:50.255797 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be3087e258443e7b525ec57e79f3e2f" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:50.256490 18680 raft_consensus.cc:3060] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:50.260445 18604 raft_consensus.cc:2468] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:24:50.270232 18680 raft_consensus.cc:2468] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 17.
I20260709 12:24:50.272286 19210 leader_election.cc:304] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:24:50.272301 24876 log.cc:927] Time spent T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:24:50.277065 24866 raft_consensus.cc:2804] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:50.288847 18644 leader_election.cc:304] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:50.292479 24852 raft_consensus.cc:2804] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:50.297705 24852 raft_consensus.cc:697] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:50.298820 24852 consensus_queue.cc:237] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:50.302390 24866 raft_consensus.cc:697] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [term 17 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:24:50.325162 24850 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.325845 24850 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:50.332199 24850 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:50.345709 24850 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.346843 24850 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:50.350265 24850 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:50.364864 24866 consensus_queue.cc:237] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:50.367229 19212 leader_election.cc:336] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:50.368428 19212 consensus_peers.cc:597] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:50.374807 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 58673.8us
I20260709 12:24:50.376680 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:50.379810 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:24:50.396354 19212 consensus_peers.cc:597] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:50.451203 18680 raft_consensus.cc:1275] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:24:50.452636 18424 catalog_manager.cc:5697] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 11 to 12, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 12 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:50.446760 18572 leader_election.cc:336] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:50.456216 18572 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:50.456962 24885 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.456199 18427 catalog_manager.cc:5697] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 16 to 17, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 17 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:50.468259 18572 leader_election.cc:336] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:50.468353 24889 raft_consensus.cc:2749] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:50.472244 18572 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
W20260709 12:24:50.474221 18572 consensus_peers.cc:597] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:50.472895 24885 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:50.474576 24887 consensus_queue.cc:1048] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:50.476162 24887 raft_consensus.cc:2749] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:50.477407 24885 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:50.480901 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:24:50.514671 19212 consensus_peers.cc:597] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:50.525944 19212 consensus_peers.cc:597] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:50.537043 24852 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.537678 24852 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:24:50.544890 18646 leader_election.cc:336] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:50.547739 18572 leader_election.cc:336] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:50.547991 24852 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:50.547871 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:50.549675 18604 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 14.
I20260709 12:24:50.551110 18644 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:50.552031 24852 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:50.552520 24852 raft_consensus.cc:493] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.552973 24852 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:24:50.554898 19212 consensus_peers.cc:597] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:50.558027 18572 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:50.558792 24836 raft_consensus.cc:2749] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:50.566788 24871 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.567612 24871 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:24:50.583144 19212 consensus_peers.cc:597] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:50.585719 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:50.588822 24871 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:50.589591 18572 consensus_peers.cc:597] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:50.593140 18646 leader_election.cc:336] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:50.593822 18646 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:50.595269 24871 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:24:50.590102 18572 consensus_peers.cc:597] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:50.605573 18572 consensus_peers.cc:597] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:50.613796 24852 raft_consensus.cc:515] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:24:50.621404 19212 consensus_peers.cc:597] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:50.622465 18646 leader_election.cc:336] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:50.624954 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e559fc600a4308a080243995e9f1e8" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:50.625526 18604 raft_consensus.cc:3060] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:50.635195 18604 raft_consensus.cc:2468] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 15.
I20260709 12:24:50.636986 18644 leader_election.cc:304] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:50.637907 24871 raft_consensus.cc:2804] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:50.638404 24871 raft_consensus.cc:697] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:50.639324 24871 consensus_queue.cc:237] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:24:50.643218 19212 consensus_peers.cc:597] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:50.635773 24852 leader_election.cc:290] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:50.668694 24836 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.669422 24836 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:50.672614 24853 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.673166 24853 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:50.674907 24836 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:24:50.679545 18572 leader_election.cc:336] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:50.680692 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:50.682660 18570 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:50.691632 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
W20260709 12:24:50.692014 18646 leader_election.cc:336] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:50.693387 18644 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
W20260709 12:24:50.694124 19212 consensus_peers.cc:597] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:50.694944 24853 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:50.695561 24871 raft_consensus.cc:2749] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:50.696542 24836 raft_consensus.cc:2749] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:50.702242 18427 catalog_manager.cc:5697] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 14 to 15, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 15 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:50.711531 18646 consensus_peers.cc:597] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:50.720146 24885 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.720842 24885 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:50.730460 24866 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.731081 24866 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:50.733412 24866 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:50.739797 19212 consensus_peers.cc:597] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:50.740665 19212 leader_election.cc:336] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:50.742897 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:50.743954 24885 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:50.747349 24879 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.747988 24879 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:50.749584 18572 leader_election.cc:336] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:50.750599 24836 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.750967 24879 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:50.751154 24836 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:50.754065 24836 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:50.755872 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:50.757655 18680 raft_consensus.cc:1275] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:24:50.761366 24733 consensus_queue.cc:1048] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:24:50.761680 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:50.762425 19248 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 19.
I20260709 12:24:50.762820 19210 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:50.765460 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:50.769843 24733 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:24:50.779172 19212 leader_election.cc:336] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:50.779683 19212 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:50.781598 24866 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:50.782943 18572 leader_election.cc:336] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:50.785879 18570 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:50.788194 24726 raft_consensus.cc:2749] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:24:50.805114 19212 consensus_peers.cc:597] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:50.815445 18570 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:50.831676 24885 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:50.832193 24885 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.833421 24885 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:24:50.851011 19212 consensus_peers.cc:597] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:50.865269 18598 raft_consensus.cc:1275] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:24:50.867736 24871 consensus_queue.cc:1048] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:24:50.880460 18572 consensus_peers.cc:597] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:50.881943 19212 consensus_peers.cc:597] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:50.896083 24836 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.897118 24836 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:50.899427 24836 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:50.901417 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:50.902149 18680 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 15.
I20260709 12:24:50.905498 18570 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:50.907495 24836 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:50.907913 24836 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.908241 24836 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:50.927670 24879 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.928694 24879 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:50.930934 24879 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:50.938992 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:50.939761 18598 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 17.
W20260709 12:24:50.941306 19212 leader_election.cc:336] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:50.950611 24733 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
W20260709 12:24:50.930886 18572 consensus_peers.cc:597] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:50.951221 24733 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:50.953300 24733 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:50.954892 24871 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.955587 24871 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:50.957340 24726 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.957906 24726 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:50.959014 24871 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:50.965590 19210 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:50.965914 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:50.966673 18680 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 16.
I20260709 12:24:50.967594 24733 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:50.968117 24733 raft_consensus.cc:493] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.968564 24733 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:50.961411 24885 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:50.967110 24866 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:50.976008 24866 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:50.978308 24866 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:50.981979 24885 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 20 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:50.982597 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:51.003273 18598 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 15.
I20260709 12:24:50.960018 24726 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:24:50.983950 18646 leader_election.cc:336] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:50.995357 18572 leader_election.cc:336] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:50.998008 18570 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:51.000284 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a528af94f43f980dcff59f8ba646e" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:51.007172 19241 raft_consensus.cc:3060] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:50.993387 24836 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:51.013499 24836 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:51.018431 24836 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:51.018837 24836 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:51.019209 24836 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:51.020183 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:51.020884 18598 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 16.
I20260709 12:24:51.022408 18644 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:51.023833 24871 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:51.023937 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2586476710143e281df940fcb3d3238" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:51.024461 24871 raft_consensus.cc:493] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:51.024655 18680 raft_consensus.cc:3060] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:51.025024 24871 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:51.027051 24836 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:51.035650 18680 raft_consensus.cc:2468] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 16.
I20260709 12:24:51.035842 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:51.037330 24836 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 17 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:51.037436 18673 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 14.
W20260709 12:24:51.037998 18646 consensus_peers.cc:597] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:51.016671 19241 raft_consensus.cc:2468] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 20.
I20260709 12:24:51.041697 19210 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
I20260709 12:24:51.043089 19210 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:51.044081 24879 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:51.044798 24879 raft_consensus.cc:493] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:51.045279 24879 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:24:51.049103 18572 leader_election.cc:336] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:51.049937 18572 leader_election.cc:336] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:51.050992 18572 consensus_peers.cc:597] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:51.051270 24866 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:51.051808 24866 raft_consensus.cc:493] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:51.052240 24866 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:24:51.052928 19212 leader_election.cc:336] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:51.053974 19212 leader_election.cc:336] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:51.066304 24733 raft_consensus.cc:515] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:51.051422 18572 leader_election.cc:336] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:51.067448 18570 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:51.072359 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52424a465944d0ba861991c593bdc17" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:51.072542 24726 raft_consensus.cc:2804] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:51.073194 18680 raft_consensus.cc:3060] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:51.073251 24726 raft_consensus.cc:697] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 20 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:51.074419 24733 leader_election.cc:290] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 18 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:51.074432 24726 consensus_queue.cc:237] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:51.079312 18572 leader_election.cc:336] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:51.082506 19212 consensus_peers.cc:597] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:51.083118 19212 leader_election.cc:336] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:51.083380 18646 consensus_peers.cc:597] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:51.083714 18413 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 99121.2us
W20260709 12:24:51.086572 18413 catalog_manager.cc:4755] TS 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ce446d878cef426395147773f6c9a25e: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:51.086915 18570 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:51.087721 24885 raft_consensus.cc:2804] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:51.088238 24885 raft_consensus.cc:697] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:51.089107 24885 consensus_queue.cc:237] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:51.090301 24871 raft_consensus.cc:515] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:51.098286 24879 raft_consensus.cc:515] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:51.101415 18598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3f1fac491465fb48a6000ace325f2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:51.102165 18598 raft_consensus.cc:3060] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:51.113793 24866 raft_consensus.cc:515] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:51.116153 18646 leader_election.cc:336] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:51.117691 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ca83d13be54a41b9c5aaebfc89de05" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:51.118376 18673 raft_consensus.cc:3060] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:24:51.120894 18646 consensus_peers.cc:597] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:51.124253 18646 consensus_peers.cc:597] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:51.116235 24866 leader_election.cc:290] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:51.124748 24871 leader_election.cc:290] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:51.126277 18598 raft_consensus.cc:2468] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 16.
I20260709 12:24:51.126677 18673 raft_consensus.cc:2468] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 15.
I20260709 12:24:51.128255 18644 leader_election.cc:304] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:51.129832 19210 leader_election.cc:304] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:24:51.130807 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 43987.3us
I20260709 12:24:51.131075 24901 raft_consensus.cc:2804] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:51.131726 24901 raft_consensus.cc:697] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:24:51.132882 24901 consensus_queue.cc:237] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:51.131899 24871 raft_consensus.cc:2804] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:51.144404 18680 raft_consensus.cc:2468] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 17.
I20260709 12:24:51.142753 24871 raft_consensus.cc:697] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:51.146253 24871 consensus_queue.cc:237] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:24:51.148801 19212 leader_election.cc:336] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:51.150472 24879 leader_election.cc:290] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 17 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:51.169842 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5079e43d75f41f9b2acb31e4798ce95" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:51.170133 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6840b12ab24d4f62b563a6d5d868d0c4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:51.170540 18604 raft_consensus.cc:3060] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:51.170782 18605 raft_consensus.cc:3060] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:51.179280 18605 raft_consensus.cc:2468] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 17.
I20260709 12:24:51.162941 18598 raft_consensus.cc:1275] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:51.183693 24852 consensus_queue.cc:1048] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:24:51.184574 18646 consensus_peers.cc:597] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:51.180866 18604 raft_consensus.cc:2468] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 18.
I20260709 12:24:51.186156 18427 catalog_manager.cc:5697] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 14 to 15, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 15 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:51.196369 18572 consensus_peers.cc:597] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:51.207106 19212 leader_election.cc:336] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:51.217132 18570 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:51.218349 24887 raft_consensus.cc:2804] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:51.242957 19210 leader_election.cc:304] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:51.245652 19210 leader_election.cc:304] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:51.262075 24871 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:51.262751 24871 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:51.264358 18424 catalog_manager.cc:5697] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 15 to 16, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 16 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:51.252359 24901 raft_consensus.cc:2804] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:51.266819 18427 catalog_manager.cc:5697] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 19 to 20, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 20 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.268924 24901 raft_consensus.cc:697] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
W20260709 12:24:51.269682 17346 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 18551)
I20260709 12:24:51.269887 24901 consensus_queue.cc:237] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:51.265184 24871 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:51.254412 24879 raft_consensus.cc:2804] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:51.274585 18605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9" is_pre_election: true
I20260709 12:24:51.275162 24879 raft_consensus.cc:697] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [term 18 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:24:51.276212 24879 consensus_queue.cc:237] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:51.275457 18605 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
I20260709 12:24:51.251704 24887 raft_consensus.cc:697] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:51.281332 18644 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:24:51.294556 18646 consensus_peers.cc:597] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:51.295101 18646 leader_election.cc:336] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:51.285269 24853 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:51.298059 24853 raft_consensus.cc:493] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:51.300750 24853 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:51.302922 24733 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:51.303453 24733 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:51.280368 24887 consensus_queue.cc:237] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:51.310482 24733 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:51.313877 24908 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:51.315276 24884 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:51.318849 24884 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:51.322053 24884 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:24:51.339780 18644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:37079, user_credentials={real_user=slave}} blocked reactor thread for 57452.1us
I20260709 12:24:51.344354 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:51.345021 19248 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 16.
I20260709 12:24:51.349225 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:51.350059 18680 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 16.
W20260709 12:24:51.354698 18646 leader_election.cc:336] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:51.350463 19212 leader_election.cc:336] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:51.360464 24853 raft_consensus.cc:515] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:51.363021 24853 leader_election.cc:290] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:51.314577 24908 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:51.367143 24908 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:51.369848 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:51.370630 19241 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 12.
I20260709 12:24:51.372577 18570 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 
W20260709 12:24:51.373726 18572 leader_election.cc:336] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:51.379032 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9786988480ef4569bc65f17fa6b60fd2" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c7bd71f1f37c45f28b52c154e59356b9"
I20260709 12:24:51.379621 18604 raft_consensus.cc:3060] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:51.385779 19210 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:51.386837 18604 raft_consensus.cc:2468] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:24:51.391405 24733 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:51.391867 24733 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:51.392217 24733 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:51.397665 18424 catalog_manager.cc:5697] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 15 to 16, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 16 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.400665 24733 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:51.408399 18424 catalog_manager.cc:5697] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 16 to 17, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 17 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.413677 24733 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 17 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:51.384039 24908 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:51.418700 24908 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:51.419183 24908 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:51.404405 18644 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:51.437883 18427 catalog_manager.cc:5697] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 16 to 17, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 17 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:51.462961 18646 leader_election.cc:336] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:51.436111 24852 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:51.466336 24852 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2f9872512f1646bc835906bd0e98c6a7)
I20260709 12:24:51.466773 24852 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:24:51.468396 19212 leader_election.cc:336] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:51.486498 18644 leader_election.cc:304] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:51.483389 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:51.498538 24853 raft_consensus.cc:2804] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:51.499190 24853 raft_consensus.cc:697] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
W20260709 12:24:51.560278 18572 consensus_peers.cc:597] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:51.541963 24908 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:51.540099 24853 consensus_queue.cc:237] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:51.612676 18427 catalog_manager.cc:5697] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 17 to 18, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 18 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:51.632169 18570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:45879, user_credentials={real_user=slave}} blocked reactor thread for 48111.8us
I20260709 12:24:51.652640 24908 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:24:51.662376 19212 consensus_peers.cc:597] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:51.647987 24852 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:51.669430 18572 leader_election.cc:336] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:51.670179 18572 consensus_peers.cc:597] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:51.671128 24852 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:51.672003 18680 raft_consensus.cc:2393] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c29c312e4544452b1162d7f81a58cb4 in current term 17: Already voted for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in this term.
W20260709 12:24:51.677472 18646 consensus_peers.cc:597] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:51.682602 18646 leader_election.cc:336] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:51.695914 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:51.696821 19241 raft_consensus.cc:2393] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a0dee333a83a45f1ab0c1bb6d094afd1 in current term 17: Already voted for candidate 8c29c312e4544452b1162d7f81a58cb4 in this term.
I20260709 12:24:51.709518 19210 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:24:51.712530 24899 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:24:51.716650 19212 consensus_peers.cc:597] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:51.719693 18680 raft_consensus.cc:1275] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:24:51.723306 18646 consensus_peers.cc:597] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:51.728080 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9507595fc484ec1b5cf1d1b2482debf" candidate_uuid: "c7bd71f1f37c45f28b52c154e59356b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:51.728752 19241 raft_consensus.cc:3060] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:51.740754 19248 raft_consensus.cc:1275] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:24:51.742718 18680 raft_consensus.cc:1275] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:51.736315 19241 raft_consensus.cc:2468] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bd71f1f37c45f28b52c154e59356b9 in term 13.
I20260709 12:24:51.749475 18427 catalog_manager.cc:5697] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 10 to 11, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 11 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:51.750885 24921 consensus_queue.cc:1048] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:51.748729 18680 raft_consensus.cc:1275] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:24:51.757997 24899 consensus_queue.cc:1048] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:51.765271 18644 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, 8c29c312e4544452b1162d7f81a58cb4
I20260709 12:24:51.766144 24925 raft_consensus.cc:2749] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:24:51.766299 24887 consensus_queue.cc:1048] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:24:51.768556 18570 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:51.769400 24887 raft_consensus.cc:2804] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:51.769938 24887 raft_consensus.cc:697] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Becoming Leader. State: Replica: c7bd71f1f37c45f28b52c154e59356b9, State: Running, Role: LEADER
I20260709 12:24:51.770866 24887 consensus_queue.cc:237] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:51.783320 24921 consensus_queue.cc:1048] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:24:51.787099 18427 catalog_manager.cc:5697] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 reported cstate change: term changed from 12 to 13, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130). New cstate: current_term: 13 leader_uuid: "c7bd71f1f37c45f28b52c154e59356b9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.881322 18605 raft_consensus.cc:1275] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:24:51.887923 18572 consensus_peers.cc:597] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:51.902311 18572 consensus_peers.cc:597] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:51.908807 18605 raft_consensus.cc:1275] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:24:51.909763 18604 raft_consensus.cc:1275] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:24:51.923496 24853 consensus_queue.cc:1048] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:24:51.925432 24899 consensus_queue.cc:1048] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 12:24:51.945091 24879 consensus_queue.cc:1048] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
W20260709 12:24:51.995060 19212 consensus_peers.cc:597] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:51.995532 19212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 69082.4us
I20260709 12:24:52.103065 18597 raft_consensus.cc:1275] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:24:52.106910 24871 consensus_queue.cc:1048] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:24:52.195402 18572 consensus_peers.cc:597] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:52.205847 18646 consensus_peers.cc:597] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:52.222834 18413 catalog_manager.cc:4755] TS 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ce446d878cef426395147773f6c9a25e: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:52.270170 17346 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 18551)
I20260709 12:24:52.405772 19248 raft_consensus.cc:1275] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Refusing update from remote peer c7bd71f1f37c45f28b52c154e59356b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:52.409077 24921 consensus_queue.cc:1048] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:24:52.576133 18572 consensus_peers.cc:597] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:52.706883 18572 consensus_peers.cc:597] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:52.713762 18572 consensus_peers.cc:597] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:52.791594 19212 consensus_peers.cc:597] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:52.806887 18572 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111) [suppressed 379 similar messages]
W20260709 12:24:52.811196 18572 consensus_peers.cc:597] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:52.924022 19212 consensus_peers.cc:597] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:52.997298 19212 consensus_peers.cc:597] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:53.010888 19212 consensus_peers.cc:597] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:53.030802 18572 consensus_peers.cc:597] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:53.033051 19212 consensus_peers.cc:597] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:53.098269 19212 consensus_peers.cc:597] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:53.095264 18572 consensus_peers.cc:597] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:53.099537 18572 consensus_peers.cc:597] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:53.114907 19212 consensus_peers.cc:597] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:53.146592 19212 consensus_peers.cc:597] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:53.170897 18572 consensus_peers.cc:597] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:53.262998 19212 consensus_peers.cc:597] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:53.273208 18646 consensus_peers.cc:597] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:53.274932 19212 consensus_peers.cc:597] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:53.349874 18646 consensus_peers.cc:597] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:53.383865 18572 consensus_peers.cc:597] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:53.406579 17346 tablet_server.cc:196] TabletServer@127.16.240.129:0 shutdown complete.
W20260709 12:24:53.408895 18572 consensus_peers.cc:597] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:53.443861 19212 consensus_peers.cc:597] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:53.500716 24910 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.501525 24910 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:53.514719 24910 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:53.516268 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:53.518457 18678 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 17.
I20260709 12:24:53.525593 19210 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:53.526683 24910 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:53.527227 24910 raft_consensus.cc:493] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.527863 24910 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:24:53.530380 19212 leader_election.cc:336] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:53.566303 19212 consensus_peers.cc:597] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:53.580721 18572 consensus_peers.cc:597] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:53.582230 24910 raft_consensus.cc:515] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:53.587369 24910 leader_election.cc:290] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 18 election: Requested vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:53.590307 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406a6f5175ee42239ec8464ef19d6f14" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:53.591111 18678 raft_consensus.cc:3060] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:24:53.596400 19212 leader_election.cc:336] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:53.598153 18678 raft_consensus.cc:2468] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 18.
I20260709 12:24:53.604481 19210 leader_election.cc:304] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7
I20260709 12:24:53.605572 24733 raft_consensus.cc:2804] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:53.606099 24733 raft_consensus.cc:697] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 18 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:24:53.607059 24733 consensus_queue.cc:237] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:53.619624 18646 consensus_peers.cc:597] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:53.670678 18646 consensus_peers.cc:597] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:53.700037 18427 catalog_manager.cc:5697] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 16 to 18, leader changed from 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 18 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:53.711062 18646 consensus_peers.cc:597] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:53.798758 18646 consensus_peers.cc:597] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:53.801123 17346 tablet_server.cc:179] TabletServer@127.16.240.130:0 shutting down...
W20260709 12:24:53.808370 19212 consensus_peers.cc:597] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:53.856280 19210 consensus_peers.cc:597] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:53.858861 18644 consensus_peers.cc:597] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:53.863946 19212 consensus_peers.cc:597] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:53.865033 18646 consensus_peers.cc:597] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:53.882843 19212 consensus_peers.cc:597] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:53.893606 18644 consensus_peers.cc:597] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:53.929848 19210 consensus_peers.cc:597] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:53.938028 18646 consensus_peers.cc:597] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:53.960632 18644 consensus_peers.cc:597] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:53.961509 18644 consensus_peers.cc:597] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:54.024299 19210 consensus_peers.cc:597] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:54.032558 18644 consensus_peers.cc:597] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:54.041208 18644 consensus_peers.cc:597] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:54.043288 19210 consensus_peers.cc:597] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:54.048455 18644 consensus_peers.cc:597] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:54.065681 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:54.067533 17346 tablet_replica.cc:333] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.068790 17346 raft_consensus.cc:2243] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.070731 17346 raft_consensus.cc:2272] T 08cf98d6828c446ebc2e69eda1b33719 P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:54.073202 18644 consensus_peers.cc:597] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:54.078255 17346 tablet_replica.cc:333] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.079295 17346 raft_consensus.cc:2243] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.080026 17346 raft_consensus.cc:2272] T 172bc8a62f9b4215b7395487dd4afd2b P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:54.081971 19210 consensus_peers.cc:597] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:54.096773 17346 tablet_replica.cc:333] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.098677 17346 raft_consensus.cc:2243] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:24:54.100232 17346 raft_consensus.cc:2272] T 9f9c25fcde974c42918932833eac1523 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:54.106557 19212 consensus_peers.cc:597] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:54.107189 18572 consensus_peers.cc:597] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:54.121112 18644 consensus_peers.cc:597] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:54.126904 17346 tablet_replica.cc:333] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.127930 17346 raft_consensus.cc:2243] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:24:54.129333 17346 raft_consensus.cc:2272] T 169aeacb13cc43bb853d44de2d778477 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.137642 17346 tablet_replica.cc:333] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.138530 17346 raft_consensus.cc:2243] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.139107 17346 raft_consensus.cc:2272] T e3fb557c332c4f69a4267b6505d3f923 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:54.141242 18644 consensus_peers.cc:597] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:54.161896 17346 tablet_replica.cc:333] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.162958 17346 raft_consensus.cc:2243] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.163677 17346 raft_consensus.cc:2272] T f6c6156a485f436881bf4d1fb67194d2 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.167006 17346 tablet_replica.cc:333] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.167973 17346 raft_consensus.cc:2243] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.169034 17346 raft_consensus.cc:2272] T 6ddef1433d2344c9a83050fe07ac225b P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.175498 17346 tablet_replica.cc:333] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.176491 17346 raft_consensus.cc:2243] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.184653 17346 raft_consensus.cc:2272] T 6e95bb922f31462b9debb1f2a9ff7e19 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:54.187119 18644 consensus_peers.cc:597] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:54.191675 17346 tablet_replica.cc:333] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
W20260709 12:24:54.197190 18644 consensus_peers.cc:597] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:54.202950 18644 consensus_peers.cc:597] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:54.204396 17346 raft_consensus.cc:2243] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:24:54.205632 17346 raft_consensus.cc:2272] T 8e1dfac6f7ba4189ae36a57e87879b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:54.213291 19210 consensus_peers.cc:597] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:54.220058 17346 tablet_replica.cc:333] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.221041 17346 raft_consensus.cc:2243] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:24:54.229815 17346 raft_consensus.cc:2272] T a5481f6762264d10bd4a98a8b0e678e4 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.241878 17346 tablet_replica.cc:333] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.242983 17346 raft_consensus.cc:2243] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.243626 17346 raft_consensus.cc:2272] T 512f9ba3d0d04063899283c39177bcdf P c7bd71f1f37c45f28b52c154e59356b9 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.259795 17346 tablet_replica.cc:333] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.262107 17346 raft_consensus.cc:2243] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:24:54.262470 18680 raft_consensus.cc:1275] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:24:54.263346 17346 raft_consensus.cc:2272] T ce446d878cef426395147773f6c9a25e P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.270001 17346 tablet_replica.cc:333] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.274703 17346 raft_consensus.cc:2243] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:24:54.275840 17346 raft_consensus.cc:2272] T f0dcb322f11f4eb39aa973579cafa317 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.287472 17346 tablet_replica.cc:333] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.288439 17346 raft_consensus.cc:2243] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:54.288597 18572 consensus_peers.cc:597] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:54.294811 17346 raft_consensus.cc:2272] T b7e559fc600a4308a080243995e9f1e8 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.294864 24910 consensus_queue.cc:1048] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:54.297844 17346 tablet_replica.cc:333] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.298702 17346 raft_consensus.cc:2243] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.309207 17346 raft_consensus.cc:2272] T c3c52474787041b099fe01aa8c862c04 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.312484 17346 tablet_replica.cc:333] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.322589 17346 raft_consensus.cc:2243] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Raft consensus shutting down.
W20260709 12:24:54.333803 18644 consensus_peers.cc:597] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:54.334488 18644 consensus_peers.cc:597] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:54.342547 17346 raft_consensus.cc:2272] T 845d4cff87f249e1ab9060dd308d4b22 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.351058 17346 tablet_replica.cc:333] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.352373 17346 raft_consensus.cc:2243] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.353067 17346 raft_consensus.cc:2272] T 60d3f1fac491465fb48a6000ace325f2 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:54.360460 19210 consensus_peers.cc:597] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:54.367087 17346 tablet_replica.cc:333] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
W20260709 12:24:54.371822 18413 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.16.240.129:45155, user_credentials={real_user=slave}} blocked reactor thread for 54151.4us
I20260709 12:24:54.373229 17346 raft_consensus.cc:2243] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:24:54.378062 17346 raft_consensus.cc:2272] T b52424a465944d0ba861991c593bdc17 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.384914 17346 tablet_replica.cc:333] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
W20260709 12:24:54.388815 18413 catalog_manager.cc:4755] TS 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ce446d878cef426395147773f6c9a25e: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:54.395382 17346 raft_consensus.cc:2243] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.396131 17346 raft_consensus.cc:2272] T 6840b12ab24d4f62b563a6d5d868d0c4 P c7bd71f1f37c45f28b52c154e59356b9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.399029 17346 tablet_replica.cc:333] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.399914 17346 raft_consensus.cc:2243] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Raft consensus shutting down.
W20260709 12:24:54.403179 19212 consensus_peers.cc:597] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:54.404667 17346 raft_consensus.cc:2272] T c1f654a3c5be411f92ffc5ed5b6b70a1 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:54.415709 19210 consensus_peers.cc:597] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:54.416700 19210 consensus_peers.cc:597] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:54.435212 19212 consensus_peers.cc:597] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:54.439285 17346 tablet_replica.cc:333] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.442905 17346 raft_consensus.cc:2243] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.445245 17346 raft_consensus.cc:2272] T 91ba7e5c69124062865d447b2968bc2e P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:54.463922 18646 consensus_peers.cc:597] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:54.503456 17346 tablet_replica.cc:333] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.504529 17346 raft_consensus.cc:2243] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.505290 17346 raft_consensus.cc:2272] T 5ab652408d034870b0f276a90a6132d7 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:54.518712 18572 consensus_peers.cc:597] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:54.523188 17346 tablet_replica.cc:333] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.551159 17346 raft_consensus.cc:2243] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:24:54.568809 17346 raft_consensus.cc:2272] T 6bcb0137def74cb3b0f0590e5e746d02 P c7bd71f1f37c45f28b52c154e59356b9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.572031 17346 tablet_replica.cc:333] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.572995 17346 raft_consensus.cc:2243] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:24:54.574167 17346 raft_consensus.cc:2272] T 2cbe068cca5f4e01bf21b7df39ac7d89 P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.598685 17346 tablet_replica.cc:333] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.613586 17346 raft_consensus.cc:2243] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.615672 17346 raft_consensus.cc:2272] T 222ae469827d4570aa1d61844f01eae9 P c7bd71f1f37c45f28b52c154e59356b9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.618795 17346 tablet_replica.cc:333] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.620814 17346 raft_consensus.cc:2243] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:24:54.634053 17346 raft_consensus.cc:2272] T 55f8787198c1435695beded3041a941e P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.637303 17346 tablet_replica.cc:333] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.638551 17346 raft_consensus.cc:2243] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.639278 17346 raft_consensus.cc:2272] T 9786988480ef4569bc65f17fa6b60fd2 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.644282 17346 tablet_replica.cc:333] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.645170 17346 raft_consensus.cc:2243] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.645766 17346 raft_consensus.cc:2272] T f9141b3d8f87474d8f4752290efe5963 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.648507 17346 tablet_replica.cc:333] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.649582 17346 raft_consensus.cc:2243] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:24:54.650888 17346 raft_consensus.cc:2272] T 59141dbba91a4f249871144353b43d37 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.654219 17346 tablet_replica.cc:333] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.655220 17346 raft_consensus.cc:2243] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.655998 17346 raft_consensus.cc:2272] T 75f0f0df600b45d1b1ba9f3a58145915 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.658880 17346 tablet_replica.cc:333] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.659682 17346 raft_consensus.cc:2243] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:24:54.660892 17346 raft_consensus.cc:2272] T e9507595fc484ec1b5cf1d1b2482debf P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.669552 17346 tablet_replica.cc:333] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
W20260709 12:24:54.669437 18646 consensus_peers.cc:597] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:54.671039 17346 raft_consensus.cc:2243] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:24:54.672300 17346 raft_consensus.cc:2272] T 171eb098d126492b96266e36d8a6ba81 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.681005 17346 tablet_replica.cc:333] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.681944 17346 raft_consensus.cc:2243] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.682659 17346 raft_consensus.cc:2272] T 400ea90be13249389635103ccb1dfee6 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.685678 17346 tablet_replica.cc:333] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.686553 17346 raft_consensus.cc:2243] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.687618 17346 raft_consensus.cc:2272] T c2c31f23053e4804b0fb872f29fde999 P c7bd71f1f37c45f28b52c154e59356b9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.692994 17346 tablet_replica.cc:333] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.693825 17346 raft_consensus.cc:2243] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.695729 17346 raft_consensus.cc:2272] T 298b8c963d93464e999fee75e74e9781 P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.702481 17346 tablet_replica.cc:333] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.703262 17346 raft_consensus.cc:2243] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.703933 17346 raft_consensus.cc:2272] T d92b776ce9bf460fbd0c74b31953276d P c7bd71f1f37c45f28b52c154e59356b9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.707046 17346 tablet_replica.cc:333] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.708982 17346 raft_consensus.cc:2243] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:24:54.710214 17346 raft_consensus.cc:2272] T f8f93d163b9441dd9c044b6224aff070 P c7bd71f1f37c45f28b52c154e59356b9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.713548 17346 tablet_replica.cc:333] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.714355 17346 raft_consensus.cc:2243] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.715072 17346 raft_consensus.cc:2272] T e5079e43d75f41f9b2acb31e4798ce95 P c7bd71f1f37c45f28b52c154e59356b9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.727365 17346 tablet_replica.cc:333] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.728230 17346 raft_consensus.cc:2243] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.728863 17346 raft_consensus.cc:2272] T 13a2490fb6904f8ca5c4cab03767d419 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.731588 17346 tablet_replica.cc:333] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.732498 17346 raft_consensus.cc:2243] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:54.733359 17346 raft_consensus.cc:2272] T 10f0fd04dea343f1a51febdac9b97f7b P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.736228 17346 tablet_replica.cc:333] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.736990 17346 raft_consensus.cc:2243] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:24:54.739178 17346 raft_consensus.cc:2272] T bb60480c703d4fb3b06a0d4f669bc90c P c7bd71f1f37c45f28b52c154e59356b9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.741968 17346 tablet_replica.cc:333] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.745018 17346 raft_consensus.cc:2243] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:24:54.746236 17346 raft_consensus.cc:2272] T 3c6a528af94f43f980dcff59f8ba646e P c7bd71f1f37c45f28b52c154e59356b9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.757117 17346 tablet_replica.cc:333] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.757931 17346 raft_consensus.cc:2243] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:24:54.759086 17346 raft_consensus.cc:2272] T c30a47c4d7e24c07809e11073578b22c P c7bd71f1f37c45f28b52c154e59356b9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.780560 17346 tablet_replica.cc:333] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.781613 17346 raft_consensus.cc:2243] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:24:54.783164 17346 raft_consensus.cc:2272] T a2586476710143e281df940fcb3d3238 P c7bd71f1f37c45f28b52c154e59356b9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:54.801637 17346 tablet_replica.cc:333] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9: stopping tablet replica
I20260709 12:24:54.806475 17346 raft_consensus.cc:2243] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:24:54.807782 17346 raft_consensus.cc:2272] T d337bc5c46924f42af3a8e39c86bfa17 P c7bd71f1f37c45f28b52c154e59356b9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.114948 24853 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.115466 24853 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:55.117453 24853 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:55.123600 18646 leader_election.cc:336] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:55.145706 18644 leader_election.cc:336] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:55.148406 18644 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:55.150710 24967 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:55.157470 24964 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.158149 24964 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:55.161830 24964 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:24:55.168820 19210 leader_election.cc:336] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
W20260709 12:24:55.170297 19212 leader_election.cc:336] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:55.172345 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:55.174567 19212 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:55.188015 24964 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:55.351370 19212 consensus_peers.cc:597] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:24:55.417706 24967 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.418359 24967 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:55.421320 24967 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:55.428371 18646 leader_election.cc:336] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:55.430186 24964 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.431306 24964 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:55.430554 24967 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.433676 24967 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:55.445673 24967 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:55.442067 24964 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:55.465411 19210 leader_election.cc:336] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:55.495106 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:55.498590 24967 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.500381 24967 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:55.509812 24853 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.514963 24853 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:55.517905 24853 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:24:55.522773 19212 leader_election.cc:336] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:55.526989 24970 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.533175 24970 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:55.535563 24970 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:55.524632 19212 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:55.541401 24967 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:55.542140 24970 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:24:55.542956 19212 consensus_peers.cc:597] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:55.544931 18646 leader_election.cc:336] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:55.549721 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:55.550518 19248 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
W20260709 12:24:55.553459 18646 leader_election.cc:336] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:55.555401 19212 consensus_peers.cc:597] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:55.556845 19210 leader_election.cc:336] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:55.561694 24970 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.562381 24970 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:55.564608 24970 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:24:55.566864 18644 leader_election.cc:336] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:55.567444 18644 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:55.568290 24853 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:55.568511 18644 leader_election.cc:336] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:55.569017 18644 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:55.572417 18680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:55.572542 24974 raft_consensus.cc:2749] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:55.574070 18680 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 15.
I20260709 12:24:55.586547 24974 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.587262 24974 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:55.589659 24974 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:55.590384 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
W20260709 12:24:55.593182 18644 leader_election.cc:336] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:55.593742 18644 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:55.595919 24974 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:55.598739 18646 leader_election.cc:336] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:55.602963 19210 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:24:55.605082 19212 consensus_peers.cc:597] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:55.610234 18644 leader_election.cc:336] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:55.610517 24964 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:55.610952 24964 raft_consensus.cc:493] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.611356 24964 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:24:55.614266 19210 leader_election.cc:336] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:55.614723 19210 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:55.619195 24970 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:55.619531 24964 raft_consensus.cc:515] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:55.621628 24964 leader_election.cc:290] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:55.610934 18644 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:55.622841 24853 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:24:55.631479 19212 consensus_peers.cc:597] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:55.632287 19212 consensus_peers.cc:597] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:55.635869 19212 consensus_peers.cc:597] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:55.644541 19210 leader_election.cc:336] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:55.652101 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5481f6762264d10bd4a98a8b0e678e4" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:55.652791 18673 raft_consensus.cc:3060] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:24:55.653249 18644 leader_election.cc:336] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:55.655519 18644 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:55.657038 24853 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:24:55.673820 18646 consensus_peers.cc:597] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:55.681823 19212 consensus_peers.cc:597] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:24:55.683187 18673 raft_consensus.cc:2468] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 16.
I20260709 12:24:55.698571 24974 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.699324 24974 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:55.706516 24974 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:55.708674 18646 leader_election.cc:336] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:55.714143 19210 leader_election.cc:304] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:55.719704 24970 raft_consensus.cc:2804] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:55.720257 24970 raft_consensus.cc:697] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:24:55.721675 24970 consensus_queue.cc:237] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:55.727023 18644 leader_election.cc:336] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:55.729687 24910 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.732429 18644 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:55.732575 24910 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:55.735193 24910 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:55.735869 24974 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:55.740419 24974 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.740950 24974 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:55.742579 19212 leader_election.cc:336] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:55.743029 24974 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:55.763242 18426 catalog_manager.cc:5697] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 15 to 16, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 16 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:55.769759 19212 consensus_peers.cc:597] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:24:55.770675 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:55.771411 19248 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 10.
W20260709 12:24:55.786953 18644 leader_election.cc:336] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
W20260709 12:24:55.788899 19212 consensus_peers.cc:597] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:55.789307 19210 leader_election.cc:336] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:55.792621 19210 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:55.793570 24970 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:55.803161 18644 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:55.806656 24974 raft_consensus.cc:2804] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:55.807085 24974 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.807449 24974 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:55.812249 24853 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.812813 24853 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:55.814827 24853 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:55.820232 24974 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:55.831794 24853 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.839130 24853 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:55.837265 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:55.837846 24973 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.841089 24853 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:55.841385 24973 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:55.841946 24970 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.842473 24970 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:55.844547 24970 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:55.843508 24973 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:24:55.838503 19212 consensus_peers.cc:597] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:55.851262 18646 leader_election.cc:336] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:55.860904 24970 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.861842 24970 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:55.864851 24970 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:55.868134 19212 leader_election.cc:336] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:55.874912 24974 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:24:55.879279 19212 leader_election.cc:336] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:55.887796 18644 leader_election.cc:336] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:55.889472 18644 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:24:55.888820 19210 leader_election.cc:336] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:55.890247 19210 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:55.891093 24970 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.891779 24970 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:55.894034 24970 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:55.896711 24910 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:55.901752 24974 raft_consensus.cc:2749] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:55.907236 19241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:55.910414 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce446d878cef426395147773f6c9a25e" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:55.911063 19248 raft_consensus.cc:3060] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:55.913959 18644 leader_election.cc:336] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:55.914528 18644 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:55.919020 19248 raft_consensus.cc:2468] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
W20260709 12:24:55.919102 19210 leader_election.cc:336] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:55.919795 24974 raft_consensus.cc:2749] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:24:55.921809 18644 leader_election.cc:336] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
W20260709 12:24:55.923846 18644 leader_election.cc:336] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:55.924335 19210 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:55.927037 24910 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:24:55.927276 19210 leader_election.cc:336] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:55.926143 18644 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 8c29c312e4544452b1162d7f81a58cb4, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:55.929694 24974 raft_consensus.cc:2749] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:24:55.938763 18646 consensus_peers.cc:597] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:55.951457 18646 consensus_peers.cc:597] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:24:55.955963 18644 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:55.957446 24974 raft_consensus.cc:2804] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:55.958232 24974 raft_consensus.cc:697] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:55.959232 24974 consensus_queue.cc:237] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:55.980592 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:55.983739 24853 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.984578 24853 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:55.993572 24853 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:55.994566 24910 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:55.995151 24910 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:55.997509 24910 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:56.010851 24973 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:56.011656 24973 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:56.013972 24973 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
W20260709 12:24:56.021210 19212 leader_election.cc:336] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:56.022329 18646 leader_election.cc:336] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:56.023025 18646 consensus_peers.cc:597] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:56.049742 19210 leader_election.cc:336] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:56.050479 19210 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:56.051823 24970 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:24:56.052942 19210 consensus_peers.cc:597] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:56.055477 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:56.056865 24853 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:56.057327 19246 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 11.
I20260709 12:24:56.057430 24853 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:56.059684 24853 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:56.066383 19210 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:56.067546 24910 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:24:56.071105 18646 leader_election.cc:336] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:56.077633 17346 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 18627)
W20260709 12:24:56.082504 18644 leader_election.cc:336] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:56.082348 18426 catalog_manager.cc:5697] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 10 to 11, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 11 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:56.084534 18644 leader_election.cc:336] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:56.085289 18644 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:56.086333 24853 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:56.092182 24853 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:56.092869 24853 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:56.095060 24853 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:56.097342 18644 leader_election.cc:336] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:56.120031 18644 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:24:56.115608 19212 consensus_peers.cc:597] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:24:56.123464 24853 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:24:56.128178 19210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:36757, user_credentials={real_user=slave}} blocked reactor thread for 55947.2us
W20260709 12:24:56.124229 18646 leader_election.cc:336] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:56.131467 18644 leader_election.cc:336] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:56.132333 18644 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:56.133131 24853 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:56.143160 18644 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:56.145128 24973 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:56.145514 24973 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:56.145872 24973 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:56.149009 24910 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:56.149600 24910 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:56.152064 24910 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:24:56.161803 18644 consensus_peers.cc:597] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:56.155655 24973 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:56.169652 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:56.171577 18673 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 14.
I20260709 12:24:56.174023 24973 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:56.179778 19210 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:56.180730 24910 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:56.181146 24910 raft_consensus.cc:493] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:56.181515 24910 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:24:56.190647 18644 leader_election.cc:336] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:56.208954 24970 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:56.209689 24970 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:56.212832 24970 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:56.225600 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb60480c703d4fb3b06a0d4f669bc90c" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4"
I20260709 12:24:56.226374 19239 raft_consensus.cc:3060] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:56.225767 19210 leader_election.cc:336] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:56.232084 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:24:56.232827 18673 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 13.
I20260709 12:24:56.234894 19239 raft_consensus.cc:2468] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
I20260709 12:24:56.242375 24910 raft_consensus.cc:515] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:56.245219 24910 leader_election.cc:290] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:24:56.254382 18644 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:56.255913 24974 raft_consensus.cc:2804] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:56.256469 24974 raft_consensus.cc:697] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Becoming Leader. State: Replica: a0dee333a83a45f1ab0c1bb6d094afd1, State: Running, Role: LEADER
I20260709 12:24:56.257380 24974 consensus_queue.cc:237] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:56.266218 18644 consensus_peers.cc:597] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:56.269115 24910 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:56.269783 24910 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:56.271963 24910 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:56.270699 19212 consensus_peers.cc:597] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:56.279078 18426 catalog_manager.cc:5697] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 reported cstate change: term changed from 11 to 12, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131). New cstate: current_term: 12 leader_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:56.282922 19212 consensus_peers.cc:597] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:56.289624 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30a47c4d7e24c07809e11073578b22c" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:56.290355 18673 raft_consensus.cc:3060] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:56.298764 18673 raft_consensus.cc:2468] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 15.
I20260709 12:24:56.286038 19210 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
W20260709 12:24:56.321866 19210 leader_election.cc:336] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:56.324188 24910 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:56.324679 24910 raft_consensus.cc:493] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:56.325037 24910 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:24:56.335983 19212 leader_election.cc:336] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:56.342329 19210 leader_election.cc:304] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:56.345616 24970 raft_consensus.cc:2804] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:56.346741 24970 raft_consensus.cc:697] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [term 15 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
W20260709 12:24:56.348583 18646 consensus_peers.cc:597] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:24:56.348587 24970 consensus_queue.cc:237] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:56.351269 18673 raft_consensus.cc:1275] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:24:56.366328 19210 leader_election.cc:336] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:56.369138 24910 raft_consensus.cc:515] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:56.370205 19210 leader_election.cc:336] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:56.371870 19210 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:24:56.374090 18644 consensus_peers.cc:597] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:56.375864 24986 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:56.395661 24910 leader_election.cc:290] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 election: Requested vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:24:56.395967 18646 consensus_peers.cc:597] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:24:56.404242 18426 catalog_manager.cc:5697] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 14 to 15, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 15 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:56.442423 18646 consensus_peers.cc:597] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:24:56.462905 24910 consensus_queue.cc:1048] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:24:56.469841 19210 consensus_peers.cc:597] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:56.478422 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f93d163b9441dd9c044b6224aff070" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1"
I20260709 12:24:56.483083 18678 raft_consensus.cc:3060] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:24:56.472636 19212 consensus_peers.cc:597] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:24:56.491616 18678 raft_consensus.cc:2468] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 14.
W20260709 12:24:56.496976 18644 consensus_peers.cc:597] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:56.500397 18644 consensus_peers.cc:597] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:56.502300 18644 consensus_peers.cc:597] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:56.501595 19210 leader_election.cc:304] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 
I20260709 12:24:56.508533 24986 raft_consensus.cc:2804] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:56.509055 24986 raft_consensus.cc:697] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 LEADER]: Becoming Leader. State: Replica: 8c29c312e4544452b1162d7f81a58cb4, State: Running, Role: LEADER
I20260709 12:24:56.509852 19239 raft_consensus.cc:1275] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:24:56.509958 24986 consensus_queue.cc:237] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:56.528576 18646 consensus_peers.cc:597] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:56.542338 19210 leader_election.cc:336] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
W20260709 12:24:56.548161 19210 consensus_peers.cc:597] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:56.547259 18644 consensus_peers.cc:597] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:56.553494 18426 catalog_manager.cc:5697] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 reported cstate change: term changed from 13 to 14, leader changed from c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130) to 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132). New cstate: current_term: 14 leader_uuid: "8c29c312e4544452b1162d7f81a58cb4" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:56.567862 24982 consensus_queue.cc:1048] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:24:56.569245 19210 consensus_peers.cc:597] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:56.594653 18644 consensus_peers.cc:597] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:56.595108 18644 consensus_peers.cc:597] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:56.621742 18644 consensus_peers.cc:597] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:56.633906 19210 consensus_peers.cc:597] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:56.653445 19210 consensus_peers.cc:597] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:56.665509 19210 consensus_peers.cc:597] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:56.693333 18644 consensus_peers.cc:597] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:56.698288 19210 consensus_peers.cc:597] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:56.704547 18644 consensus_peers.cc:597] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:56.810719 18644 consensus_peers.cc:597] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:56.834746 24973 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:56.835039 19239 raft_consensus.cc:1275] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Refusing update from remote peer a0dee333a83a45f1ab0c1bb6d094afd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:56.835316 24973 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:56.837729 24973 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:56.862497 18646 leader_election.cc:336] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:56.864619 24982 consensus_queue.cc:1048] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:24:56.863170 19210 consensus_peers.cc:597] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:56.866006 19210 consensus_peers.cc:597] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:56.871178 19212 consensus_peers.cc:597] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:56.875694 18644 consensus_peers.cc:597] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:56.896771 18644 consensus_peers.cc:597] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:56.901117 18644 consensus_peers.cc:597] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:56.901678 18644 leader_election.cc:336] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:56.902398 18644 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:56.903364 24982 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:56.916473 18678 raft_consensus.cc:1275] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:24:56.940249 24983 consensus_queue.cc:1048] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:24:56.941454 18644 consensus_peers.cc:597] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:56.978967 18646 consensus_peers.cc:597] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:56.987915 19212 consensus_peers.cc:597] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:56.989634 19210 consensus_peers.cc:597] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:56.994550 18680 raft_consensus.cc:1275] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Refusing update from remote peer 8c29c312e4544452b1162d7f81a58cb4: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:24:56.999282 24970 consensus_queue.cc:1048] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:24:57.042187 19210 consensus_peers.cc:597] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:57.062382 18646 consensus_peers.cc:597] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:57.078118 17346 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 18627)
I20260709 12:24:57.103916 24973 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:57.104562 24973 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:57.107326 24973 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
W20260709 12:24:57.112979 18646 leader_election.cc:336] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:57.122386 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:57.123149 19248 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
W20260709 12:24:57.129123 18644 leader_election.cc:336] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:57.129781 18644 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:57.134481 24973 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:57.153025 24983 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:57.153604 24983 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:57.155762 24983 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:57.161679 19210 leader_election.cc:336] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
W20260709 12:24:57.165143 19212 leader_election.cc:336] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:57.166297 19212 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:57.167382 24983 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:24:57.324162 19212 consensus_peers.cc:597] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:57.425773 24995 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:57.426745 24995 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:57.464700 24995 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:57.466126 18646 leader_election.cc:336] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:57.476066 18644 leader_election.cc:336] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:57.476702 18644 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:57.482038 24995 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:57.575379 24995 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:57.576237 24995 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:57.579960 24995 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:57.590812 18646 leader_election.cc:336] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:57.592923 18644 leader_election.cc:336] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:57.593487 18644 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:57.594295 24995 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:57.633251 24986 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:57.634389 24986 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:57.638164 24986 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:57.643472 24995 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:57.650573 24995 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:57.651626 24986 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:57.652514 24986 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:57.655169 24986 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:57.666268 18644 leader_election.cc:336] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
W20260709 12:24:57.645561 19210 leader_election.cc:336] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
W20260709 12:24:57.668118 19212 leader_election.cc:336] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:57.671588 18646 leader_election.cc:336] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:57.675964 18646 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:57.675169 19212 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:57.677608 24982 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:57.677629 24986 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:57.676641 24995 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:57.692813 19212 leader_election.cc:336] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:57.728101 19210 leader_election.cc:336] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:57.728386 24982 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:57.728669 19210 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:57.729727 24985 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:57.729518 24982 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:24:57.735826 18701 debug-util.cc:398] Leaking SignalData structure 0x7b08001cca60 after lost signal to thread 17349
W20260709 12:24:57.737877 18701 debug-util.cc:398] Leaking SignalData structure 0x7b08002cdec0 after lost signal to thread 18461
W20260709 12:24:57.741927 18701 debug-util.cc:398] Leaking SignalData structure 0x7b080017d4c0 after lost signal to thread 18705
W20260709 12:24:57.746302 18701 debug-util.cc:398] Leaking SignalData structure 0x7b08001eb740 after lost signal to thread 19274
W20260709 12:24:57.762660 18646 leader_election.cc:336] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:57.764140 24982 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:57.776645 18644 leader_election.cc:336] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:57.778610 18644 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:57.780990 24982 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:57.801056 19212 consensus_peers.cc:597] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:57.827265 18646 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111) [suppressed 597 similar messages]
W20260709 12:24:57.857784 19212 consensus_peers.cc:597] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:24:57.872391 24982 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:57.873183 24982 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:57.875520 24982 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:57.883944 18646 leader_election.cc:336] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:57.909569 18644 leader_election.cc:336] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:57.911985 18644 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:57.914228 24995 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:58.046787 24982 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:58.047546 24982 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:58.052032 24982 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:58.056125 18646 leader_election.cc:336] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:58.056620 18644 leader_election.cc:336] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:58.057055 18644 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:58.058527 24982 raft_consensus.cc:2749] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:58.061565 24982 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:58.064985 24982 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:24:58.074487 19212 consensus_peers.cc:597] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:58.078815 17346 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 18627)
W20260709 12:24:58.084581 19212 consensus_peers.cc:597] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:24:58.087033 24982 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
W20260709 12:24:58.093997 18646 leader_election.cc:336] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:58.098691 19212 consensus_peers.cc:597] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:58.106609 18644 leader_election.cc:336] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:58.126459 18644 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:58.129566 24982 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:58.143455 19212 consensus_peers.cc:597] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:24:58.156323 24983 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:58.157032 24983 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:58.165599 24983 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:58.169152 19210 leader_election.cc:336] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
W20260709 12:24:58.173935 19212 leader_election.cc:336] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:58.174501 19212 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:58.175941 24983 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:24:58.228076 19212 consensus_peers.cc:597] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:58.233606 18646 consensus_peers.cc:597] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:58.267223 19212 consensus_peers.cc:597] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:24:58.276819 24983 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:58.277524 24983 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:58.279863 24983 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:58.289263 19212 leader_election.cc:336] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:58.292541 19210 leader_election.cc:336] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:58.293088 19210 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:58.295780 24983 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:24:58.306341 18646 consensus_peers.cc:597] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:58.309566 19212 consensus_peers.cc:597] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:24:58.342342 24982 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:58.343052 24982 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:58.345572 24982 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:58.351577 18646 leader_election.cc:336] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:58.362749 18644 leader_election.cc:336] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:58.363775 18644 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:58.365006 24982 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:24:58.408985 19212 consensus_peers.cc:597] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:58.411320 18646 consensus_peers.cc:597] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:24:58.413879 24983 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:58.414683 24983 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:24:58.417893 24983 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:58.425711 19210 leader_election.cc:336] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
W20260709 12:24:58.426661 19212 leader_election.cc:336] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:58.427192 19212 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:58.428047 24983 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:24:58.491813 19212 consensus_peers.cc:597] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:58.518740 18646 consensus_peers.cc:597] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:58.540979 18413 catalog_manager.cc:4755] TS 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ce446d878cef426395147773f6c9a25e: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:58.601333 19210 consensus_peers.cc:597] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:58.642966 18644 consensus_peers.cc:597] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:58.659654 19210 consensus_peers.cc:597] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:58.714354 19212 consensus_peers.cc:597] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:58.729789 19212 consensus_peers.cc:597] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:24:58.801230 24974 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:58.802170 24974 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:58.812179 18646 leader_election.cc:336] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:58.813966 24974 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 8c29c312e4544452b1162d7f81a58cb4 (127.16.240.132:45879)
I20260709 12:24:58.828611 19239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c29c312e4544452b1162d7f81a58cb4" is_pre_election: true
I20260709 12:24:58.829939 19239 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0dee333a83a45f1ab0c1bb6d094afd1 in term 12.
W20260709 12:24:58.848582 18644 leader_election.cc:336] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:58.849226 18644 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:58.858606 24974 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:58.858963 18644 consensus_peers.cc:597] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:58.870410 19210 consensus_peers.cc:597] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:58.876192 18646 consensus_peers.cc:597] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:58.887426 19212 consensus_peers.cc:597] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:58.910120 18644 consensus_peers.cc:597] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:58.911336 18646 consensus_peers.cc:597] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:58.991052 19210 consensus_peers.cc:597] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:59.009233 24983 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:59.010027 24983 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:59.019083 19212 leader_election.cc:336] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:59.020395 24983 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:59.026503 18644 consensus_peers.cc:597] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:59.050771 18646 consensus_peers.cc:597] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:59.051508 18646 consensus_peers.cc:597] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:59.058182 19210 leader_election.cc:336] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:59.058892 19210 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:59.064249 25005 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:24:59.061784 19212 consensus_peers.cc:597] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:59.062723 18644 consensus_peers.cc:597] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:59.081099 17346 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 18627)
W20260709 12:24:59.081593 19210 consensus_peers.cc:597] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:59.090197 18644 consensus_peers.cc:597] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:59.095060 19212 consensus_peers.cc:597] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:59.108695 18644 consensus_peers.cc:597] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:59.119365 18644 consensus_peers.cc:597] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:59.140913 19210 consensus_peers.cc:597] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:59.159571 19210 consensus_peers.cc:597] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:59.257786 19210 consensus_peers.cc:597] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:59.264832 18644 consensus_peers.cc:597] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:59.276039 24974 raft_consensus.cc:493] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:59.276908 24974 raft_consensus.cc:515] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
W20260709 12:24:59.281388 18644 consensus_peers.cc:597] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:59.284185 24982 raft_consensus.cc:493] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:59.284785 24982 raft_consensus.cc:515] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:59.287192 24982 leader_election.cc:290] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:59.281512 24974 leader_election.cc:290] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:59.289963 18644 leader_election.cc:336] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
W20260709 12:24:59.291322 18646 leader_election.cc:336] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:59.295457 18644 leader_election.cc:336] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:59.296025 18646 leader_election.cc:304] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:59.297005 24974 raft_consensus.cc:2749] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:59.300169 24983 raft_consensus.cc:493] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:59.300758 24983 raft_consensus.cc:515] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:59.303387 18646 leader_election.cc:336] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:59.303970 18646 leader_election.cc:304] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:59.306546 24982 raft_consensus.cc:2749] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:59.308516 24983 leader_election.cc:290] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:59.309093 19212 leader_election.cc:336] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:59.315407 19210 leader_election.cc:336] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:59.316035 19210 leader_election.cc:304] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:59.317245 25005 raft_consensus.cc:2749] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:24:59.325341 18644 consensus_peers.cc:597] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:59.329151 18644 consensus_peers.cc:597] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:59.389603 19210 consensus_peers.cc:597] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:59.420810 25006 raft_consensus.cc:493] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:59.421497 25006 raft_consensus.cc:515] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:59.423866 24982 raft_consensus.cc:493] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:59.424176 25006 leader_election.cc:290] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
I20260709 12:24:59.424537 24982 raft_consensus.cc:515] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:59.427192 24982 leader_election.cc:290] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:59.428807 18644 leader_election.cc:336] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
W20260709 12:24:59.431509 18646 leader_election.cc:336] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:24:59.432845 18644 leader_election.cc:336] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:59.432998 18646 leader_election.cc:304] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:24:59.434520 18646 leader_election.cc:336] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:59.436756 24982 raft_consensus.cc:2749] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:59.437216 18646 leader_election.cc:304] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:59.448794 24982 raft_consensus.cc:2749] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:24:59.461774 18644 consensus_peers.cc:597] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:59.472594 18646 consensus_peers.cc:597] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:59.475998 18644 consensus_peers.cc:597] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:59.504226 19210 consensus_peers.cc:597] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:59.507118 18644 consensus_peers.cc:597] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:59.510160 18644 consensus_peers.cc:597] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:59.548084 19212 consensus_peers.cc:597] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:59.551518 18644 consensus_peers.cc:597] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:59.560999 19212 consensus_peers.cc:597] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:59.607442 19210 consensus_peers.cc:597] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:59.659956 19210 consensus_peers.cc:597] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:59.777981 18646 consensus_peers.cc:597] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:24:59.809057 24983 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:59.809757 24983 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:24:59.820696 19212 leader_election.cc:336] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:59.828357 24983 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:59.838341 19210 leader_election.cc:336] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:24:59.841118 19210 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:59.844790 24983 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:59.906366 24982 raft_consensus.cc:493] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:24:59.906879 24982 raft_consensus.cc:515] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:24:59.908949 24982 leader_election.cc:290] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:24:59.915795 18644 leader_election.cc:336] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
W20260709 12:24:59.917725 18646 leader_election.cc:336] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:24:59.918169 18646 leader_election.cc:304] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:24:59.919420 24982 raft_consensus.cc:2749] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:24:59.995518 19212 consensus_peers.cc:597] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:00.014806 25005 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:25:00.015422 25005 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:25:00.022704 25005 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:25:00.023905 19210 leader_election.cc:336] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
W20260709 12:25:00.026154 19212 leader_election.cc:336] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:25:00.026983 19212 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:25:00.029757 25005 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:00.316213 19212 consensus_peers.cc:597] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:00.415249 19212 consensus_peers.cc:597] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:00.415907 19212 consensus_peers.cc:597] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:00.457178 24974 raft_consensus.cc:493] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:25:00.457741 24974 raft_consensus.cc:515] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:25:00.459810 24974 leader_election.cc:290] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:25:00.466123 18646 leader_election.cc:336] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:25:00.471890 19212 consensus_peers.cc:597] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:00.485074 18644 leader_election.cc:336] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:25:00.490087 18644 leader_election.cc:304] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:25:00.490985 24974 raft_consensus.cc:2749] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:00.665879 18646 consensus_peers.cc:597] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:00.677673 19212 consensus_peers.cc:597] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:00.724941 24983 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:25:00.725636 24983 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:25:00.728449 24983 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:25:00.730834 18673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9c25fcde974c42918932833eac1523" candidate_uuid: "8c29c312e4544452b1162d7f81a58cb4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" is_pre_election: true
I20260709 12:25:00.731626 18673 raft_consensus.cc:2468] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c29c312e4544452b1162d7f81a58cb4 in term 12.
W20260709 12:25:00.733281 19212 leader_election.cc:336] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:25:00.739044 19210 leader_election.cc:336] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:25:00.739647 19210 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4, a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:25:00.740536 24983 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:00.781236 25007 raft_consensus.cc:493] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:25:00.781877 25007 raft_consensus.cc:515] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:25:00.784104 25007 leader_election.cc:290] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155)
W20260709 12:25:00.787469 19212 consensus_peers.cc:597] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:00.792294 18644 leader_election.cc:336] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
W20260709 12:25:00.801030 18646 leader_election.cc:336] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:25:00.801621 18646 leader_election.cc:304] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:25:00.803329 25007 raft_consensus.cc:2749] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:00.827704 19210 consensus_peers.cc:597] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:00.831682 18646 consensus_peers.cc:597] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:00.834636 19212 consensus_peers.cc:597] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:00.840667 19212 consensus_peers.cc:597] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:00.943512 18646 consensus_peers.cc:597] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:00.969930 17346 tablet_server.cc:196] TabletServer@127.16.240.130:0 shutdown complete.
I20260709 12:25:00.978935 25007 raft_consensus.cc:493] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:25:00.979625 25007 raft_consensus.cc:515] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:25:00.982191 25007 leader_election.cc:290] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:25:00.991925 19212 consensus_peers.cc:597] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:00.996969 18646 leader_election.cc:336] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:25:01.015444 18644 leader_election.cc:336] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:25:01.018105 18644 leader_election.cc:304] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:25:01.020272 25007 raft_consensus.cc:2749] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:01.048522 25005 raft_consensus.cc:493] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:25:01.049093 25005 raft_consensus.cc:515] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:25:01.051368 25005 leader_election.cc:290] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:25:01.056669 19212 leader_election.cc:336] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:25:01.058029 18646 consensus_peers.cc:597] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:01.070943 19210 leader_election.cc:336] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:25:01.072715 19210 leader_election.cc:304] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:25:01.072244 19212 consensus_peers.cc:597] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:01.075739 24983 raft_consensus.cc:2749] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:01.075771 25005 raft_consensus.cc:493] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:25:01.078733 25005 raft_consensus.cc:515] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:25:01.081013 25005 leader_election.cc:290] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:25:01.089175 19212 leader_election.cc:336] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:25:01.104359 19210 leader_election.cc:336] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:25:01.104817 19210 leader_election.cc:304] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:25:01.107982 25005 raft_consensus.cc:2749] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:01.119738 24982 raft_consensus.cc:493] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:25:01.120348 24982 raft_consensus.cc:515] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } }
I20260709 12:25:01.122364 24982 leader_election.cc:290] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:25:01.127074 18646 leader_election.cc:336] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:25:01.127810 18644 leader_election.cc:336] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:25:01.128259 18644 leader_election.cc:304] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0dee333a83a45f1ab0c1bb6d094afd1; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:25:01.129101 24982 raft_consensus.cc:2749] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:25:01.138019 19210 consensus_peers.cc:597] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:01.146636 18644 consensus_peers.cc:597] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:01.157876 19212 consensus_peers.cc:597] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:01.191852 19212 consensus_peers.cc:597] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:01.218278 19212 consensus_peers.cc:597] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:01.227541 18644 consensus_peers.cc:597] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:01.296523 19212 consensus_peers.cc:597] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:01.314342 18644 consensus_peers.cc:597] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:01.355412 17346 tablet_server.cc:179] TabletServer@127.16.240.131:0 shutting down...
W20260709 12:25:01.359511 19210 consensus_peers.cc:597] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:01.386835 19210 consensus_peers.cc:597] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Couldn't send request to peer a0dee333a83a45f1ab0c1bb6d094afd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:01.390638 19210 consensus_peers.cc:597] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Couldn't send request to peer a0dee333a83a45f1ab0c1bb6d094afd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:01.419970 18646 consensus_peers.cc:597] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:01.437211 19210 consensus_peers.cc:597] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:01.458061 18646 consensus_peers.cc:597] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:01.461162 18646 consensus_peers.cc:597] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:01.474152 19210 consensus_peers.cc:597] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Couldn't send request to peer a0dee333a83a45f1ab0c1bb6d094afd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:01.484012 18644 consensus_peers.cc:597] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:01.485827 19210 consensus_peers.cc:597] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 -> Peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Couldn't send request to peer a0dee333a83a45f1ab0c1bb6d094afd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:01.493162 18644 consensus_peers.cc:597] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:01.496927 19210 consensus_peers.cc:597] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Couldn't send request to peer a0dee333a83a45f1ab0c1bb6d094afd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:01.514334 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:01.516952 17346 tablet_replica.cc:333] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:01.518150 17346 raft_consensus.cc:2243] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:25:01.519598 17346 raft_consensus.cc:2272] T 08cf98d6828c446ebc2e69eda1b33719 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:01.521612 19210 consensus_peers.cc:597] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:01.526448 19210 consensus_peers.cc:597] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Couldn't send request to peer a0dee333a83a45f1ab0c1bb6d094afd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:01.534904 17346 tablet_replica.cc:333] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:01.536067 17346 raft_consensus.cc:2243] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:01.536767 17346 raft_consensus.cc:2272] T 169aeacb13cc43bb853d44de2d778477 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:01.539940 17346 tablet_replica.cc:333] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:01.541018 17346 raft_consensus.cc:2243] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:01.541781 17346 raft_consensus.cc:2272] T 6ddef1433d2344c9a83050fe07ac225b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:01.545434 17346 tablet_replica.cc:333] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:01.546512 17346 raft_consensus.cc:2243] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:01.548326 17346 raft_consensus.cc:2272] T 3be3087e258443e7b525ec57e79f3e2f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:01.552211 17346 tablet_replica.cc:333] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:01.553488 17346 raft_consensus.cc:2243] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:01.555032 17346 raft_consensus.cc:2272] T f6c6156a485f436881bf4d1fb67194d2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:01.558377 17346 tablet_replica.cc:333] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:01.559399 17346 raft_consensus.cc:2243] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:01.560765 17346 raft_consensus.cc:2272] T 9f9c25fcde974c42918932833eac1523 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:01.564411 17346 tablet_replica.cc:333] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:01.565413 17346 raft_consensus.cc:2243] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:01.569191 17346 raft_consensus.cc:2272] T 6e95bb922f31462b9debb1f2a9ff7e19 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:01.572608 17346 tablet_replica.cc:333] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:01.573674 17346 raft_consensus.cc:2243] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:01.574656 17346 raft_consensus.cc:2272] T 4eceb66ae237462f8f0e7e3b03872311 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:01.576946 18644 consensus_peers.cc:597] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:01.577937 17346 tablet_replica.cc:333] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
W20260709 12:25:01.578063 19210 consensus_peers.cc:597] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:01.595364 17346 raft_consensus.cc:2243] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:01.600972 17346 raft_consensus.cc:2272] T d52124cfb8a140deaab206a18aadc308 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:01.604827 18646 consensus_peers.cc:597] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:01.608808 25005 raft_consensus.cc:493] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:25:01.609406 25005 raft_consensus.cc:515] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:25:01.611680 25005 leader_election.cc:290] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:25:01.634414 18644 consensus_peers.cc:597] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:01.638971 18644 consensus_peers.cc:597] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:01.638423 17346 tablet_replica.cc:333] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
W20260709 12:25:01.637418 19210 leader_election.cc:336] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
W20260709 12:25:01.641652 19210 consensus_peers.cc:597] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 -> Peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Couldn't send request to peer a0dee333a83a45f1ab0c1bb6d094afd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:01.643188 19210 consensus_peers.cc:597] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 -> Peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Couldn't send request to peer a0dee333a83a45f1ab0c1bb6d094afd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:01.642522 17346 raft_consensus.cc:2243] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:01.646427 17346 raft_consensus.cc:2272] T cdefe54c01e0436d82e68981b642554b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:01.653800 17346 tablet_replica.cc:333] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
W20260709 12:25:01.650128 19212 leader_election.cc:336] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:25:01.680969 19212 leader_election.cc:304] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:25:01.684451 25005 raft_consensus.cc:2749] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:01.688858 17346 raft_consensus.cc:2243] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:01.703652 17346 raft_consensus.cc:2272] T 8e1dfac6f7ba4189ae36a57e87879b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:01.714969 17346 tablet_replica.cc:333] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
W20260709 12:25:01.721158 19210 consensus_peers.cc:597] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Couldn't send request to peer a0dee333a83a45f1ab0c1bb6d094afd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:01.727376 19210 consensus_peers.cc:597] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Couldn't send request to peer a0dee333a83a45f1ab0c1bb6d094afd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:01.730654 17346 raft_consensus.cc:2243] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:01.739115 17346 raft_consensus.cc:2272] T a5481f6762264d10bd4a98a8b0e678e4 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:01.734962 18644 consensus_peers.cc:597] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:01.762221 17346 tablet_replica.cc:333] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:01.768018 17346 raft_consensus.cc:2243] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:01.763021 19212 consensus_peers.cc:597] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:01.770499 17346 raft_consensus.cc:2272] T 49c1709156f048cd8184a38476ebfe0d P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:01.795419 17346 tablet_replica.cc:333] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:01.800599 17346 raft_consensus.cc:2243] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:01.802349 17346 raft_consensus.cc:2272] T ce446d878cef426395147773f6c9a25e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:01.797750 19210 consensus_peers.cc:597] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:01.803303 19210 consensus_peers.cc:597] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 -> Peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Couldn't send request to peer a0dee333a83a45f1ab0c1bb6d094afd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:01.803977 19210 consensus_peers.cc:597] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 -> Peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Couldn't send request to peer a0dee333a83a45f1ab0c1bb6d094afd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:01.804672 19210 consensus_peers.cc:597] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Couldn't send request to peer a0dee333a83a45f1ab0c1bb6d094afd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:01.799573 18644 consensus_peers.cc:597] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:01.817508 19210 consensus_peers.cc:597] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:01.823046 17346 tablet_replica.cc:333] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:01.835525 17346 raft_consensus.cc:2243] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:01.861268 17346 raft_consensus.cc:2272] T f0dcb322f11f4eb39aa973579cafa317 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:01.838101 25005 raft_consensus.cc:493] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:25:01.861922 25005 raft_consensus.cc:515] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:25:01.864192 25005 leader_election.cc:290] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:25:01.833603 18644 consensus_peers.cc:597] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:01.885726 18646 consensus_peers.cc:597] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:25:01.915997 17346 tablet_replica.cc:333] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:01.925174 17346 raft_consensus.cc:2243] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:01.929163 17346 raft_consensus.cc:2272] T c3c52474787041b099fe01aa8c862c04 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:01.916730 19212 leader_election.cc:336] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:25:01.921779 19210 consensus_peers.cc:597] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Couldn't send request to peer a0dee333a83a45f1ab0c1bb6d094afd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:01.942773 19210 consensus_peers.cc:597] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:01.948798 19210 consensus_peers.cc:597] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:01.948196 18644 consensus_peers.cc:597] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:01.941591 19212 consensus_peers.cc:597] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:25:01.970428 17346 tablet_replica.cc:333] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:01.982209 17346 raft_consensus.cc:2243] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:01.990271 17346 raft_consensus.cc:2272] T e3fb557c332c4f69a4267b6505d3f923 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:02.008280 19210 leader_election.cc:336] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:25:02.023068 19210 leader_election.cc:304] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:25:02.031584 19210 consensus_peers.cc:597] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:02.035657 18644 consensus_peers.cc:597] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:02.039614 17346 tablet_replica.cc:333] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.040596 17346 raft_consensus.cc:2243] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.041930 17346 raft_consensus.cc:2272] T b7e559fc600a4308a080243995e9f1e8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.044207 25012 raft_consensus.cc:2749] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:02.044924 17346 tablet_replica.cc:333] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.045802 17346 raft_consensus.cc:2243] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.047029 17346 raft_consensus.cc:2272] T 15e3196fc974445e967d05514226ac45 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.069298 17346 tablet_replica.cc:333] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.070204 17346 raft_consensus.cc:2243] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.071076 17346 raft_consensus.cc:2272] T 30ca83d13be54a41b9c5aaebfc89de05 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.081058 17346 tablet_replica.cc:333] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.082062 17346 raft_consensus.cc:2243] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.083580 17346 raft_consensus.cc:2272] T 60d3f1fac491465fb48a6000ace325f2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.086649 17346 tablet_replica.cc:333] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.097910 17346 raft_consensus.cc:2243] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.098696 17346 raft_consensus.cc:2272] T f8f93d163b9441dd9c044b6224aff070 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.101778 17346 tablet_replica.cc:333] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.102626 17346 raft_consensus.cc:2243] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.103633 17346 raft_consensus.cc:2272] T 91ba7e5c69124062865d447b2968bc2e P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.106561 17346 tablet_replica.cc:333] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.107412 17346 raft_consensus.cc:2243] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.120193 17346 raft_consensus.cc:2272] T 845d4cff87f249e1ab9060dd308d4b22 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.123090 17346 tablet_replica.cc:333] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.123984 17346 raft_consensus.cc:2243] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.125036 17346 raft_consensus.cc:2272] T 6874b99e69744371a73c71762816db62 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:02.126173 18644 consensus_peers.cc:597] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:02.128023 17346 tablet_replica.cc:333] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.133348 17346 raft_consensus.cc:2243] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.134531 17346 raft_consensus.cc:2272] T 5e48d46c1f784719adae94c79efd88c8 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.137303 17346 tablet_replica.cc:333] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.138094 17346 raft_consensus.cc:2243] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.139067 17346 raft_consensus.cc:2272] T 75f0f0df600b45d1b1ba9f3a58145915 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.142139 17346 tablet_replica.cc:333] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.152420 17346 raft_consensus.cc:2243] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.153239 17346 raft_consensus.cc:2272] T 59141dbba91a4f249871144353b43d37 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.156152 17346 tablet_replica.cc:333] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.156975 17346 raft_consensus.cc:2243] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.157788 17346 raft_consensus.cc:2272] T b52424a465944d0ba861991c593bdc17 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.160408 17346 tablet_replica.cc:333] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.167285 17346 raft_consensus.cc:2243] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.168131 17346 raft_consensus.cc:2272] T a2586476710143e281df940fcb3d3238 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.170929 17346 tablet_replica.cc:333] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.171813 17346 raft_consensus.cc:2243] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.173197 17346 raft_consensus.cc:2272] T 298b8c963d93464e999fee75e74e9781 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.176213 17346 tablet_replica.cc:333] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.177029 17346 raft_consensus.cc:2243] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.178303 17346 raft_consensus.cc:2272] T c2c31f23053e4804b0fb872f29fde999 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.181012 17346 tablet_replica.cc:333] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.181843 17346 raft_consensus.cc:2243] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.182615 17346 raft_consensus.cc:2272] T 678726cf80464d89802570ca4d73600f P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.185609 17346 tablet_replica.cc:333] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.186399 17346 raft_consensus.cc:2243] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.186981 17346 raft_consensus.cc:2272] T 8eebfbd8106141a5903392238ce5a613 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.189785 17346 tablet_replica.cc:333] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.190651 17346 raft_consensus.cc:2243] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.191565 17346 raft_consensus.cc:2272] T 406a6f5175ee42239ec8464ef19d6f14 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.195848 17346 tablet_replica.cc:333] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.196617 17346 raft_consensus.cc:2243] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.197806 17346 raft_consensus.cc:2272] T 5ab652408d034870b0f276a90a6132d7 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.200476 17346 tablet_replica.cc:333] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.201284 17346 raft_consensus.cc:2243] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.202448 17346 raft_consensus.cc:2272] T 222ae469827d4570aa1d61844f01eae9 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.205524 17346 tablet_replica.cc:333] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.206370 17346 raft_consensus.cc:2243] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:02.206946 19210 consensus_peers.cc:597] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:02.207392 17346 raft_consensus.cc:2272] T 6bcb0137def74cb3b0f0590e5e746d02 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.210470 17346 tablet_replica.cc:333] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.211380 17346 raft_consensus.cc:2243] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.212146 17346 raft_consensus.cc:2272] T 2cbe068cca5f4e01bf21b7df39ac7d89 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.215056 17346 tablet_replica.cc:333] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.215922 17346 raft_consensus.cc:2243] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.217166 17346 raft_consensus.cc:2272] T 06c92947c3174627a5618c85f17edeb3 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.220095 17346 tablet_replica.cc:333] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.220964 17346 raft_consensus.cc:2243] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.222265 17346 raft_consensus.cc:2272] T 9786988480ef4569bc65f17fa6b60fd2 P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.225186 17346 tablet_replica.cc:333] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.225997 17346 raft_consensus.cc:2243] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.226639 17346 raft_consensus.cc:2272] T a0ba9bae3e1f4f9a97bb68834d01038c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.229393 17346 tablet_replica.cc:333] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.230199 17346 raft_consensus.cc:2243] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.231487 17346 raft_consensus.cc:2272] T 10f0fd04dea343f1a51febdac9b97f7b P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.234319 17346 tablet_replica.cc:333] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.235061 17346 raft_consensus.cc:2243] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.236471 17346 raft_consensus.cc:2272] T bb60480c703d4fb3b06a0d4f669bc90c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.239336 17346 tablet_replica.cc:333] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1: stopping tablet replica
I20260709 12:25:02.240103 17346 raft_consensus.cc:2243] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.240958 17346 raft_consensus.cc:2272] T c30a47c4d7e24c07809e11073578b22c P a0dee333a83a45f1ab0c1bb6d094afd1 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:02.248833 19212 consensus_peers.cc:597] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:25:02.299432 25005 raft_consensus.cc:493] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:25:02.300050 25005 raft_consensus.cc:515] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:25:02.302742 25005 leader_election.cc:290] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:25:02.315805 19212 leader_election.cc:336] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:25:02.317818 19210 leader_election.cc:336] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:25:02.321503 19210 leader_election.cc:304] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:25:02.323274 19210 leader_election.cc:336] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:02.325423 25005 raft_consensus.cc:2749] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:02.378621 19210 connection.cc:769] client connection to 127.16.240.131:36757 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:25:02.699978 19212 consensus_peers.cc:597] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:02.759847 19212 consensus_peers.cc:597] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:02.847977 19212 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111) [suppressed 619 similar messages]
W20260709 12:25:02.875537 19212 consensus_peers.cc:597] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:02.902849 19212 consensus_peers.cc:597] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:02.966987 25005 raft_consensus.cc:493] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:25:02.967579 25005 raft_consensus.cc:515] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:25:02.969563 25005 leader_election.cc:290] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:25:02.973230 25012 raft_consensus.cc:493] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:25:02.973795 25012 raft_consensus.cc:515] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
W20260709 12:25:02.975375 19210 leader_election.cc:336] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Network error: Client connection negotiation failed: client connection to 127.16.240.131:36757: connect: Connection refused (error 111)
I20260709 12:25:02.976981 25012 leader_election.cc:290] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:25:02.981170 19210 leader_election.cc:336] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Network error: Client connection negotiation failed: client connection to 127.16.240.131:36757: connect: Connection refused (error 111)
W20260709 12:25:03.206629 19212 consensus_peers.cc:597] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:03.213764 25012 raft_consensus.cc:493] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:25:03.213871 25005 raft_consensus.cc:493] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:25:03.214556 25012 raft_consensus.cc:515] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:25:03.214707 25005 raft_consensus.cc:515] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:25:03.216771 25005 leader_election.cc:290] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:25:03.216841 25012 leader_election.cc:290] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:25:03.222782 19212 leader_election.cc:336] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:25:03.223549 19210 leader_election.cc:336] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Network error: Client connection negotiation failed: client connection to 127.16.240.131:36757: connect: Connection refused (error 111)
W20260709 12:25:03.224138 19210 leader_election.cc:336] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Network error: Client connection negotiation failed: client connection to 127.16.240.131:36757: connect: Connection refused (error 111)
I20260709 12:25:03.224501 19210 leader_election.cc:304] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:25:03.225387 25012 raft_consensus.cc:2749] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:03.267181 19212 consensus_peers.cc:597] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:03.303679 19212 consensus_peers.cc:597] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:03.315303 25012 raft_consensus.cc:493] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:25:03.316243 25012 raft_consensus.cc:515] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:25:03.316975 25005 raft_consensus.cc:493] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:25:03.317497 25005 raft_consensus.cc:515] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:25:03.319072 25012 leader_election.cc:290] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:25:03.319365 25005 leader_election.cc:290] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:25:03.323804 19210 leader_election.cc:336] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Network error: Client connection negotiation failed: client connection to 127.16.240.131:36757: connect: Connection refused (error 111)
W20260709 12:25:03.324323 19210 leader_election.cc:336] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Network error: Client connection negotiation failed: client connection to 127.16.240.131:36757: connect: Connection refused (error 111)
W20260709 12:25:03.330210 19212 consensus_peers.cc:597] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:03.391090 19212 consensus_peers.cc:597] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:03.413962 19210 leader_election.cc:336] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:25:03.415323 19210 leader_election.cc:304] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:25:03.416363 19210 leader_election.cc:336] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:25:03.416718 25005 raft_consensus.cc:2749] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:03.417358 19210 leader_election.cc:304] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
W20260709 12:25:03.416872 19212 consensus_peers.cc:597] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:03.418190 25005 raft_consensus.cc:2749] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:03.419739 19210 leader_election.cc:336] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:25:03.420188 19210 leader_election.cc:304] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:25:03.420909 25012 raft_consensus.cc:2749] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:03.421062 19210 leader_election.cc:336] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:25:03.421561 19210 leader_election.cc:304] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:25:03.422257 25012 raft_consensus.cc:2749] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:03.422425 19210 leader_election.cc:336] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:25:03.422926 19210 leader_election.cc:304] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:25:03.423609 25012 raft_consensus.cc:2749] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:03.439206 25012 raft_consensus.cc:493] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:25:03.440107 25012 raft_consensus.cc:515] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:25:03.442217 25012 leader_election.cc:290] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:25:03.442723 25012 raft_consensus.cc:493] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:25:03.444020 25005 raft_consensus.cc:493] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:25:03.444558 25005 raft_consensus.cc:515] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:25:03.446547 25005 leader_election.cc:290] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:25:03.443199 25012 raft_consensus.cc:515] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:25:03.448661 25012 leader_election.cc:290] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:25:03.449246 25005 raft_consensus.cc:493] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:25:03.449960 25005 raft_consensus.cc:515] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:25:03.451882 25005 leader_election.cc:290] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:25:03.459101 19210 leader_election.cc:336] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Network error: Client connection negotiation failed: client connection to 127.16.240.131:36757: connect: Connection refused (error 111)
W20260709 12:25:03.459679 19210 leader_election.cc:336] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Network error: Client connection negotiation failed: client connection to 127.16.240.131:36757: connect: Connection refused (error 111)
W20260709 12:25:03.462477 19212 leader_election.cc:336] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:25:03.463107 19212 leader_election.cc:304] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:25:03.463938 25005 raft_consensus.cc:2749] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:03.468703 19210 leader_election.cc:336] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:25:03.469195 19210 leader_election.cc:304] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:25:03.470000 25015 raft_consensus.cc:2749] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:03.470150 19210 leader_election.cc:336] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
W20260709 12:25:03.470784 19210 leader_election.cc:336] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
W20260709 12:25:03.471472 19210 leader_election.cc:336] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Network error: Client connection negotiation failed: client connection to 127.16.240.131:36757: connect: Connection refused (error 111)
I20260709 12:25:03.471873 19210 leader_election.cc:304] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:25:03.472599 25015 raft_consensus.cc:2749] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:03.472728 19210 leader_election.cc:336] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Network error: Client connection negotiation failed: client connection to 127.16.240.131:36757: connect: Connection refused (error 111)
I20260709 12:25:03.473248 19210 leader_election.cc:304] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:25:03.474017 25015 raft_consensus.cc:2749] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:03.502038 19212 consensus_peers.cc:597] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:03.509764 25005 raft_consensus.cc:493] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:25:03.510385 25005 raft_consensus.cc:515] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:25:03.512571 25005 leader_election.cc:290] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:25:03.517941 19210 leader_election.cc:336] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
W20260709 12:25:03.518787 19210 leader_election.cc:336] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Network error: Client connection negotiation failed: client connection to 127.16.240.131:36757: connect: Connection refused (error 111)
I20260709 12:25:03.519200 19210 leader_election.cc:304] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:25:03.519959 25005 raft_consensus.cc:2749] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:03.534812 19212 consensus_peers.cc:597] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:03.559422 25005 raft_consensus.cc:493] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:25:03.559967 25005 raft_consensus.cc:515] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:25:03.561882 25005 leader_election.cc:290] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:25:03.566499 19210 leader_election.cc:336] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
W20260709 12:25:03.568675 19210 leader_election.cc:336] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Network error: Client connection negotiation failed: client connection to 127.16.240.131:36757: connect: Connection refused (error 111)
I20260709 12:25:03.569123 19210 leader_election.cc:304] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:25:03.569864 25005 raft_consensus.cc:2749] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:03.580768 17346 tablet_server.cc:196] TabletServer@127.16.240.131:0 shutdown complete.
W20260709 12:25:03.606175 18458 debug-util.cc:398] Leaking SignalData structure 0x7b080000a320 after lost signal to thread 17349
W20260709 12:25:03.607522 18458 debug-util.cc:398] Leaking SignalData structure 0x7b08003616c0 after lost signal to thread 18461
W20260709 12:25:03.609882 18458 debug-util.cc:398] Leaking SignalData structure 0x7b08002fd880 after lost signal to thread 19274
W20260709 12:25:03.636034 19212 consensus_peers.cc:597] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:03.640089 25005 raft_consensus.cc:493] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:25:03.640699 25005 raft_consensus.cc:515] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:25:03.642866 25005 leader_election.cc:290] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
I20260709 12:25:03.654807 25005 raft_consensus.cc:493] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:25:03.655370 25005 raft_consensus.cc:515] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:25:03.657410 25005 leader_election.cc:290] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:25:03.661155 19210 leader_election.cc:336] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Network error: Client connection negotiation failed: client connection to 127.16.240.131:36757: connect: Connection refused (error 111)
W20260709 12:25:03.666710 19210 leader_election.cc:336] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Network error: Client connection negotiation failed: client connection to 127.16.240.131:36757: connect: Connection refused (error 111)
W20260709 12:25:03.669140 19212 leader_election.cc:336] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:25:03.669704 19212 leader_election.cc:304] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:25:03.670979 25005 raft_consensus.cc:2749] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:03.681197 19210 leader_election.cc:336] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
I20260709 12:25:03.681711 19210 leader_election.cc:304] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: a0dee333a83a45f1ab0c1bb6d094afd1, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:25:03.682476 25005 raft_consensus.cc:2749] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:03.696621 25005 raft_consensus.cc:493] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a0dee333a83a45f1ab0c1bb6d094afd1)
I20260709 12:25:03.697244 25005 raft_consensus.cc:515] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "a0dee333a83a45f1ab0c1bb6d094afd1" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 36757 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:25:03.699450 25005 leader_election.cc:290] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757)
W20260709 12:25:03.705305 19212 leader_election.cc:336] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
W20260709 12:25:03.716118 19210 leader_election.cc:336] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Network error: Client connection negotiation failed: client connection to 127.16.240.131:36757: connect: Connection refused (error 111)
I20260709 12:25:03.716848 19210 leader_election.cc:304] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, a0dee333a83a45f1ab0c1bb6d094afd1
I20260709 12:25:03.719462 25015 raft_consensus.cc:2749] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:03.732167 17346 tablet_server.cc:179] TabletServer@127.16.240.132:0 shutting down...
I20260709 12:25:03.767596 25016 raft_consensus.cc:493] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c7bd71f1f37c45f28b52c154e59356b9)
I20260709 12:25:03.768399 25016 raft_consensus.cc:515] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2f9872512f1646bc835906bd0e98c6a7" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45155 } } peers { permanent_uuid: "c7bd71f1f37c45f28b52c154e59356b9" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37079 } } peers { permanent_uuid: "8c29c312e4544452b1162d7f81a58cb4" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 45879 } attrs { promote: false } }
I20260709 12:25:03.777639 25016 leader_election.cc:290] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155), c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079)
W20260709 12:25:03.781224 19210 leader_election.cc:336] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111)
W20260709 12:25:03.781865 19212 leader_election.cc:336] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:25:03.782498 19212 leader_election.cc:304] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c29c312e4544452b1162d7f81a58cb4; no voters: 2f9872512f1646bc835906bd0e98c6a7, c7bd71f1f37c45f28b52c154e59356b9
I20260709 12:25:03.783381 25016 raft_consensus.cc:2749] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:03.781915 19210 consensus_peers.cc:597] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 -> Peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Couldn't send request to peer a0dee333a83a45f1ab0c1bb6d094afd1. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.131:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:03.816481 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:03.817657 17346 tablet_replica.cc:333] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.818804 17346 raft_consensus.cc:2243] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:03.819700 17346 raft_consensus.cc:2272] T 9f9c25fcde974c42918932833eac1523 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.824602 17346 tablet_replica.cc:333] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.825634 17346 raft_consensus.cc:2243] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:03.829514 17346 raft_consensus.cc:2272] T ce446d878cef426395147773f6c9a25e P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.833225 17346 tablet_replica.cc:333] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.835136 17346 raft_consensus.cc:2243] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:25:03.836802 17346 raft_consensus.cc:2272] T e5079e43d75f41f9b2acb31e4798ce95 P 8c29c312e4544452b1162d7f81a58cb4 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:03.839083 19210 consensus_peers.cc:597] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer a0dee333a83a45f1ab0c1bb6d094afd1 (127.16.240.131:36757): Couldn't send request to peer a0dee333a83a45f1ab0c1bb6d094afd1. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.131:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:03.840535 17346 tablet_replica.cc:333] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.841735 17346 raft_consensus.cc:2243] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:03.842733 17346 raft_consensus.cc:2272] T 15e3196fc974445e967d05514226ac45 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.846737 17346 tablet_replica.cc:333] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.847783 17346 raft_consensus.cc:2243] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:03.848819 17346 raft_consensus.cc:2272] T e9507595fc484ec1b5cf1d1b2482debf P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:03.851565 19210 consensus_peers.cc:597] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 -> Peer c7bd71f1f37c45f28b52c154e59356b9 (127.16.240.130:37079): Couldn't send request to peer c7bd71f1f37c45f28b52c154e59356b9. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:37079: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:25:03.852401 17346 tablet_replica.cc:333] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.853492 17346 raft_consensus.cc:2243] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:25:03.855080 17346 raft_consensus.cc:2272] T 406a6f5175ee42239ec8464ef19d6f14 P 8c29c312e4544452b1162d7f81a58cb4 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.859017 17346 tablet_replica.cc:333] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.860006 17346 raft_consensus.cc:2243] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:03.860949 17346 raft_consensus.cc:2272] T bb60480c703d4fb3b06a0d4f669bc90c P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.864710 17346 tablet_replica.cc:333] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.865731 17346 raft_consensus.cc:2243] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:03.866736 17346 raft_consensus.cc:2272] T 10f0fd04dea343f1a51febdac9b97f7b P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.870362 17346 tablet_replica.cc:333] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.871368 17346 raft_consensus.cc:2243] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [term 17 LEADER]: Raft consensus shutting down.
W20260709 12:25:03.872346 19212 consensus_peers.cc:597] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 -> Peer 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): Couldn't send request to peer 2f9872512f1646bc835906bd0e98c6a7. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:03.872928 17346 raft_consensus.cc:2272] T 3be3087e258443e7b525ec57e79f3e2f P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.877588 17346 tablet_replica.cc:333] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.878561 17346 raft_consensus.cc:2243] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:25:03.880048 17346 raft_consensus.cc:2272] T a5481f6762264d10bd4a98a8b0e678e4 P 8c29c312e4544452b1162d7f81a58cb4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.883529 17346 tablet_replica.cc:333] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.884573 17346 raft_consensus.cc:2243] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:25:03.886027 17346 raft_consensus.cc:2272] T c30a47c4d7e24c07809e11073578b22c P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.889227 17346 tablet_replica.cc:333] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.890107 17346 raft_consensus.cc:2243] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:03.891426 17346 raft_consensus.cc:2272] T 3c6a528af94f43f980dcff59f8ba646e P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.894692 17346 tablet_replica.cc:333] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.895634 17346 raft_consensus.cc:2243] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:03.896535 17346 raft_consensus.cc:2272] T c2c31f23053e4804b0fb872f29fde999 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.900002 17346 tablet_replica.cc:333] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.900967 17346 raft_consensus.cc:2243] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:03.901835 17346 raft_consensus.cc:2272] T c1f654a3c5be411f92ffc5ed5b6b70a1 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.905521 17346 tablet_replica.cc:333] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.906638 17346 raft_consensus.cc:2243] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:03.908008 17346 raft_consensus.cc:2272] T 8eebfbd8106141a5903392238ce5a613 P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.911715 17346 tablet_replica.cc:333] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.912786 17346 raft_consensus.cc:2243] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:03.914139 17346 raft_consensus.cc:2272] T 400ea90be13249389635103ccb1dfee6 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.917623 17346 tablet_replica.cc:333] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.918656 17346 raft_consensus.cc:2243] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:03.919602 17346 raft_consensus.cc:2272] T 298b8c963d93464e999fee75e74e9781 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.923537 17346 tablet_replica.cc:333] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.924515 17346 raft_consensus.cc:2243] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:25:03.925976 17346 raft_consensus.cc:2272] T 30ca83d13be54a41b9c5aaebfc89de05 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.929273 17346 tablet_replica.cc:333] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.930488 17346 raft_consensus.cc:2243] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:25:03.932051 17346 raft_consensus.cc:2272] T 6840b12ab24d4f62b563a6d5d868d0c4 P 8c29c312e4544452b1162d7f81a58cb4 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.935387 17346 tablet_replica.cc:333] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.936264 17346 raft_consensus.cc:2243] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:03.936976 17346 raft_consensus.cc:2272] T c3c52474787041b099fe01aa8c862c04 P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.940613 17346 tablet_replica.cc:333] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.941499 17346 raft_consensus.cc:2243] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:03.942672 17346 raft_consensus.cc:2272] T 49c1709156f048cd8184a38476ebfe0d P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.945838 17346 tablet_replica.cc:333] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.946707 17346 raft_consensus.cc:2243] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:03.947417 17346 raft_consensus.cc:2272] T 6874b99e69744371a73c71762816db62 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.950780 17346 tablet_replica.cc:333] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.951613 17346 raft_consensus.cc:2243] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:03.952795 17346 raft_consensus.cc:2272] T cdefe54c01e0436d82e68981b642554b P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.955906 17346 tablet_replica.cc:333] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.956763 17346 raft_consensus.cc:2243] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:03.957417 17346 raft_consensus.cc:2272] T 75f0f0df600b45d1b1ba9f3a58145915 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.960493 17346 tablet_replica.cc:333] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.961365 17346 raft_consensus.cc:2243] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:25:03.962707 17346 raft_consensus.cc:2272] T 4eceb66ae237462f8f0e7e3b03872311 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.965850 17346 tablet_replica.cc:333] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.966717 17346 raft_consensus.cc:2243] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:03.967621 17346 raft_consensus.cc:2272] T 06c92947c3174627a5618c85f17edeb3 P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.971182 17346 tablet_replica.cc:333] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.972070 17346 raft_consensus.cc:2243] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:03.972775 17346 raft_consensus.cc:2272] T 222ae469827d4570aa1d61844f01eae9 P 8c29c312e4544452b1162d7f81a58cb4 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.975797 17346 tablet_replica.cc:333] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.976641 17346 raft_consensus.cc:2243] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:03.977308 17346 raft_consensus.cc:2272] T 5ab652408d034870b0f276a90a6132d7 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.980293 17346 tablet_replica.cc:333] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.981145 17346 raft_consensus.cc:2243] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:03.981935 17346 raft_consensus.cc:2272] T d337bc5c46924f42af3a8e39c86bfa17 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.985479 17346 tablet_replica.cc:333] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.986294 17346 raft_consensus.cc:2243] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:03.987548 17346 raft_consensus.cc:2272] T 678726cf80464d89802570ca4d73600f P 8c29c312e4544452b1162d7f81a58cb4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.990712 17346 tablet_replica.cc:333] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.991591 17346 raft_consensus.cc:2243] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:03.992771 17346 raft_consensus.cc:2272] T d92b776ce9bf460fbd0c74b31953276d P 8c29c312e4544452b1162d7f81a58cb4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.995958 17346 tablet_replica.cc:333] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:03.996865 17346 raft_consensus.cc:2243] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:03.998126 17346 raft_consensus.cc:2272] T a0ba9bae3e1f4f9a97bb68834d01038c P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.001235 17346 tablet_replica.cc:333] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:04.002074 17346 raft_consensus.cc:2243] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.003108 17346 raft_consensus.cc:2272] T f6c6156a485f436881bf4d1fb67194d2 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.006094 17346 tablet_replica.cc:333] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:04.006968 17346 raft_consensus.cc:2243] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.008141 17346 raft_consensus.cc:2272] T 6ddef1433d2344c9a83050fe07ac225b P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.011437 17346 tablet_replica.cc:333] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:04.012327 17346 raft_consensus.cc:2243] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.013484 17346 raft_consensus.cc:2272] T 512f9ba3d0d04063899283c39177bcdf P 8c29c312e4544452b1162d7f81a58cb4 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.016492 17346 tablet_replica.cc:333] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:04.017257 17346 raft_consensus.cc:2243] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.017792 17346 raft_consensus.cc:2272] T 5e48d46c1f784719adae94c79efd88c8 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.020467 17346 tablet_replica.cc:333] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:04.021081 17346 raft_consensus.cc:2243] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.021966 17346 raft_consensus.cc:2272] T 13a2490fb6904f8ca5c4cab03767d419 P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.024994 17346 tablet_replica.cc:333] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:04.025695 17346 raft_consensus.cc:2243] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.026341 17346 raft_consensus.cc:2272] T 55f8787198c1435695beded3041a941e P 8c29c312e4544452b1162d7f81a58cb4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.029608 17346 tablet_replica.cc:333] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:04.030572 17346 raft_consensus.cc:2243] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.031852 17346 raft_consensus.cc:2272] T 171eb098d126492b96266e36d8a6ba81 P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.034431 17346 tablet_replica.cc:333] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:04.034976 17346 raft_consensus.cc:2243] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.035918 17346 raft_consensus.cc:2272] T f9141b3d8f87474d8f4752290efe5963 P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.037945 17346 tablet_replica.cc:333] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:04.038512 17346 raft_consensus.cc:2243] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.039404 17346 raft_consensus.cc:2272] T f8f93d163b9441dd9c044b6224aff070 P 8c29c312e4544452b1162d7f81a58cb4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.041946 17346 tablet_replica.cc:333] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:04.042490 17346 raft_consensus.cc:2243] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.044060 17346 raft_consensus.cc:2272] T d52124cfb8a140deaab206a18aadc308 P 8c29c312e4544452b1162d7f81a58cb4 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.046531 17346 tablet_replica.cc:333] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:04.047173 17346 raft_consensus.cc:2243] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.048190 17346 raft_consensus.cc:2272] T 91ba7e5c69124062865d447b2968bc2e P 8c29c312e4544452b1162d7f81a58cb4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.051363 17346 tablet_replica.cc:333] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4: stopping tablet replica
I20260709 12:25:04.051947 17346 raft_consensus.cc:2243] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.052893 17346 raft_consensus.cc:2272] T 172bc8a62f9b4215b7395487dd4afd2b P 8c29c312e4544452b1162d7f81a58cb4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.494352 17346 tablet_server.cc:196] TabletServer@127.16.240.132:0 shutdown complete.
I20260709 12:25:04.625880 17346 master.cc:562] Master@127.16.240.190:43515 shutting down...
W20260709 12:25:04.676488 18475 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:25:04.676750 18475 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:25:04.676918 18475 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:25:06.790381 18413 catalog_manager.cc:4755] TS 2f9872512f1646bc835906bd0e98c6a7 (127.16.240.129:45155): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ce446d878cef426395147773f6c9a25e: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45155: connect: Connection refused (error 111)
I20260709 12:25:06.988998 17346 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.989787 17346 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.990151 17346 tablet_replica.cc:333] T 00000000000000000000000000000000 P 01c309cccd034172a8532c59d6c80638: stopping tablet replica
I20260709 12:25:07.204733 17346 master.cc:584] Master@127.16.240.190:43515 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (207922 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:25:07.313658 17346 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.240.190:37775
I20260709 12:25:07.315678 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:07.323694 25020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:07.323798 25019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:07.324855 25022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:07.328313 17346 server_base.cc:1061] running on GCE node
I20260709 12:25:07.331677 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:07.332000 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:07.332127 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599907332116 us; error 0 us; skew 500 ppm
I20260709 12:25:07.332767 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:07.335726 17346 webserver.cc:533] Webserver started at http://127.16.240.190:34277/ using document root <none> and password file <none>
I20260709 12:25:07.336349 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:07.336555 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:07.336866 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:07.338146 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/master-0-root/instance:
uuid: "b145ad0df8d04146b31731e3ff1e189c"
format_stamp: "Formatted at 2026-07-09 12:25:07 on dist-test-slave-7xpw"
I20260709 12:25:07.342885 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:25:07.346587 25027 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:07.347536 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:25:07.348114 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/master-0-root
uuid: "b145ad0df8d04146b31731e3ff1e189c"
format_stamp: "Formatted at 2026-07-09 12:25:07 on dist-test-slave-7xpw"
I20260709 12:25:07.348383 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:07.402312 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:07.404347 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:07.451217 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.190:37775
I20260709 12:25:07.451409 25079 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.190:37775 every 8 connection(s)
I20260709 12:25:07.456594 25080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.469892 25080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c: Bootstrap starting.
I20260709 12:25:07.476233 25080 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.481927 25080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c: No bootstrap required, opened a new log
I20260709 12:25:07.484731 25080 raft_consensus.cc:359] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b145ad0df8d04146b31731e3ff1e189c" member_type: VOTER }
I20260709 12:25:07.485736 25080 raft_consensus.cc:385] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.485983 25080 raft_consensus.cc:740] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b145ad0df8d04146b31731e3ff1e189c, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.486714 25080 consensus_queue.cc:260] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b145ad0df8d04146b31731e3ff1e189c" member_type: VOTER }
I20260709 12:25:07.487188 25080 raft_consensus.cc:399] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:07.487392 25080 raft_consensus.cc:493] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:07.487638 25080 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.492734 25080 raft_consensus.cc:515] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b145ad0df8d04146b31731e3ff1e189c" member_type: VOTER }
I20260709 12:25:07.493281 25080 leader_election.cc:304] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b145ad0df8d04146b31731e3ff1e189c; no voters: 
I20260709 12:25:07.494467 25080 leader_election.cc:290] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:07.494952 25083 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:07.496822 25083 raft_consensus.cc:697] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c [term 1 LEADER]: Becoming Leader. State: Replica: b145ad0df8d04146b31731e3ff1e189c, State: Running, Role: LEADER
I20260709 12:25:07.497846 25080 sys_catalog.cc:565] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:07.497797 25083 consensus_queue.cc:237] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b145ad0df8d04146b31731e3ff1e189c" member_type: VOTER }
I20260709 12:25:07.506382 25084 sys_catalog.cc:455] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b145ad0df8d04146b31731e3ff1e189c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b145ad0df8d04146b31731e3ff1e189c" member_type: VOTER } }
I20260709 12:25:07.507048 25084 sys_catalog.cc:458] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:07.506999 25085 sys_catalog.cc:455] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c [sys.catalog]: SysCatalogTable state changed. Reason: New leader b145ad0df8d04146b31731e3ff1e189c. Latest consensus state: current_term: 1 leader_uuid: "b145ad0df8d04146b31731e3ff1e189c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b145ad0df8d04146b31731e3ff1e189c" member_type: VOTER } }
I20260709 12:25:07.508092 25085 sys_catalog.cc:458] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:07.509479 25093 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:07.515524 25093 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:07.517627 17346 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:07.526134 25093 catalog_manager.cc:1383] Generated new cluster ID: 378dc02eda454afe8a40c69b4756359d
I20260709 12:25:07.526489 25093 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:07.546514 25093 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:07.548007 25093 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:07.564881 25093 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c: Generated new TSK 0
I20260709 12:25:07.565580 25093 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:07.585932 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:07.594120 25101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:07.595191 25102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:07.597326 25104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:07.599524 17346 server_base.cc:1061] running on GCE node
I20260709 12:25:07.601742 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:07.601969 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:07.602226 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599907602186 us; error 0 us; skew 500 ppm
I20260709 12:25:07.602900 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:07.605851 17346 webserver.cc:533] Webserver started at http://127.16.240.129:36317/ using document root <none> and password file <none>
I20260709 12:25:07.606416 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:07.606630 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:07.606988 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:07.608361 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-0-root/instance:
uuid: "434d5783f9374eab8f587e0fe6c15b1c"
format_stamp: "Formatted at 2026-07-09 12:25:07 on dist-test-slave-7xpw"
I20260709 12:25:07.613495 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:25:07.617523 25109 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:07.618291 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 12:25:07.618575 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-0-root
uuid: "434d5783f9374eab8f587e0fe6c15b1c"
format_stamp: "Formatted at 2026-07-09 12:25:07 on dist-test-slave-7xpw"
I20260709 12:25:07.619033 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:07.647917 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:07.649216 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:07.651078 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:07.653630 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:07.653820 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:07.654165 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:07.654351 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:07.706300 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.129:38537
I20260709 12:25:07.706543 25172 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.129:38537 every 8 connection(s)
I20260709 12:25:07.712255 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:07.722119 25177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:07.722946 25178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:07.727308 17346 server_base.cc:1061] running on GCE node
W20260709 12:25:07.728696 25181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:07.728765 25173 heartbeater.cc:344] Connected to a master server at 127.16.240.190:37775
I20260709 12:25:07.729715 25173 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:07.730618 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:07.730916 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:07.730778 25173 heartbeater.cc:507] Master 127.16.240.190:37775 requested a full tablet report, sending...
I20260709 12:25:07.731302 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599907731274 us; error 0 us; skew 500 ppm
I20260709 12:25:07.732049 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:07.733908 25045 ts_manager.cc:194] Registered new tserver with Master: 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:07.735086 17346 webserver.cc:533] Webserver started at http://127.16.240.130:39805/ using document root <none> and password file <none>
I20260709 12:25:07.735817 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:07.736123 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:07.736428 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:07.736935 25045 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44820
I20260709 12:25:07.737983 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-1-root/instance:
uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
format_stamp: "Formatted at 2026-07-09 12:25:07 on dist-test-slave-7xpw"
I20260709 12:25:07.743381 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:25:07.747627 25185 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:07.748714 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:25:07.749137 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-1-root
uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
format_stamp: "Formatted at 2026-07-09 12:25:07 on dist-test-slave-7xpw"
I20260709 12:25:07.749517 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:07.770251 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:07.771615 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:07.773274 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:07.776221 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:07.776474 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:07.776731 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:07.776926 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:07.823329 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.130:41903
I20260709 12:25:07.823469 25247 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.130:41903 every 8 connection(s)
I20260709 12:25:07.829304 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:07.837414 25251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:07.838862 25252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:07.842381 25248 heartbeater.cc:344] Connected to a master server at 127.16.240.190:37775
I20260709 12:25:07.842832 25248 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:07.843698 25248 heartbeater.cc:507] Master 127.16.240.190:37775 requested a full tablet report, sending...
I20260709 12:25:07.846302 17346 server_base.cc:1061] running on GCE node
W20260709 12:25:07.846684 25254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:07.846798 25045 ts_manager.cc:194] Registered new tserver with Master: d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:07.847975 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:07.848237 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:07.848428 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599907848413 us; error 0 us; skew 500 ppm
I20260709 12:25:07.848831 25045 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44828
I20260709 12:25:07.849113 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:07.853366 17346 webserver.cc:533] Webserver started at http://127.16.240.131:35267/ using document root <none> and password file <none>
I20260709 12:25:07.853875 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:07.854089 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:07.854360 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:07.855827 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-2-root/instance:
uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
format_stamp: "Formatted at 2026-07-09 12:25:07 on dist-test-slave-7xpw"
I20260709 12:25:07.860946 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:25:07.864954 25259 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:07.866339 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:25:07.866876 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-2-root
uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
format_stamp: "Formatted at 2026-07-09 12:25:07 on dist-test-slave-7xpw"
I20260709 12:25:07.867234 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:07.903352 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:07.904781 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:07.906600 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:07.909729 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:07.909983 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:07.910245 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:07.910430 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:07.966068 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.131:45473
I20260709 12:25:07.966220 25322 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.131:45473 every 8 connection(s)
I20260709 12:25:07.972078 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:07.981586 25326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:07.986449 25327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:07.991348 25329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:07.992386 25323 heartbeater.cc:344] Connected to a master server at 127.16.240.190:37775
I20260709 12:25:07.992390 17346 server_base.cc:1061] running on GCE node
I20260709 12:25:07.992871 25323 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:07.993544 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:07.993830 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:07.993783 25323 heartbeater.cc:507] Master 127.16.240.190:37775 requested a full tablet report, sending...
I20260709 12:25:07.994225 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599907994189 us; error 0 us; skew 500 ppm
I20260709 12:25:07.994971 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:07.996779 25045 ts_manager.cc:194] Registered new tserver with Master: a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:07.998286 17346 webserver.cc:533] Webserver started at http://127.16.240.132:42311/ using document root <none> and password file <none>
I20260709 12:25:07.998874 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:07.998876 25045 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44838
I20260709 12:25:07.999356 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:07.999804 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:08.001497 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-3-root/instance:
uuid: "0fa8f2c80074488084fea821c4bb293d"
format_stamp: "Formatted at 2026-07-09 12:25:07 on dist-test-slave-7xpw"
I20260709 12:25:08.007448 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:25:08.011560 25334 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:08.012923 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:25:08.013252 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-3-root
uuid: "0fa8f2c80074488084fea821c4bb293d"
format_stamp: "Formatted at 2026-07-09 12:25:07 on dist-test-slave-7xpw"
I20260709 12:25:08.013509 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:08.042191 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:08.043496 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:08.045135 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:08.048592 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:08.048822 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:08.049134 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:08.049270 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:08.098899 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.132:40887
I20260709 12:25:08.099118 25396 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.132:40887 every 8 connection(s)
I20260709 12:25:08.116726 25397 heartbeater.cc:344] Connected to a master server at 127.16.240.190:37775
I20260709 12:25:08.117257 25397 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:08.118110 25397 heartbeater.cc:507] Master 127.16.240.190:37775 requested a full tablet report, sending...
I20260709 12:25:08.120687 25045 ts_manager.cc:194] Registered new tserver with Master: 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:08.121678 17346 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.018313754s
I20260709 12:25:08.122943 25045 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44846
I20260709 12:25:08.161024 25045 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44854:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:25:08.452001 25136 tablet_service.cc:1511] Processing CreateTablet for tablet a616947e81bf446584593e882f8bdeaa (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:08.452263 25138 tablet_service.cc:1511] Processing CreateTablet for tablet 2dc0dd4f13f243639d68c6d9a0e3afd3 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:08.453651 25136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a616947e81bf446584593e882f8bdeaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.454922 25137 tablet_service.cc:1511] Processing CreateTablet for tablet 91840ed520ab444d9bd1acb13b5b6b89 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:08.456453 25137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91840ed520ab444d9bd1acb13b5b6b89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.461268 25213 tablet_service.cc:1511] Processing CreateTablet for tablet 91840ed520ab444d9bd1acb13b5b6b89 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:08.462318 25138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dc0dd4f13f243639d68c6d9a0e3afd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.463263 25213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91840ed520ab444d9bd1acb13b5b6b89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.463122 25135 tablet_service.cc:1511] Processing CreateTablet for tablet 935b81351905468d8fa751d430f33ef2 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:08.464625 25135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 935b81351905468d8fa751d430f33ef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.464946 25212 tablet_service.cc:1511] Processing CreateTablet for tablet a616947e81bf446584593e882f8bdeaa (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:08.466452 25212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a616947e81bf446584593e882f8bdeaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.468890 25134 tablet_service.cc:1511] Processing CreateTablet for tablet 77d13683d814408081fbbece9be522ed (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:08.469309 25211 tablet_service.cc:1511] Processing CreateTablet for tablet dcf5a5e68833468a8206894be4a16f56 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:08.470507 25134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77d13683d814408081fbbece9be522ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.470789 25211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcf5a5e68833468a8206894be4a16f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.472786 25133 tablet_service.cc:1511] Processing CreateTablet for tablet dbb0eab5dcee4f95b7c284dea379c795 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:08.472926 25210 tablet_service.cc:1511] Processing CreateTablet for tablet 935b81351905468d8fa751d430f33ef2 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:08.474285 25133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb0eab5dcee4f95b7c284dea379c795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.476503 25131 tablet_service.cc:1511] Processing CreateTablet for tablet f4269cf1528545fd94e1d53fcf6cf48d (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:08.477728 25210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 935b81351905468d8fa751d430f33ef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.478116 25131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4269cf1528545fd94e1d53fcf6cf48d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.480578 25209 tablet_service.cc:1511] Processing CreateTablet for tablet 77d13683d814408081fbbece9be522ed (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:08.483203 25130 tablet_service.cc:1511] Processing CreateTablet for tablet 272d9a9f4ef849db8e59fad827bc81d0 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:08.485285 25130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272d9a9f4ef849db8e59fad827bc81d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.487078 25129 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba86635097441c08a6ca206ab0bfe9a (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:08.488556 25129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba86635097441c08a6ca206ab0bfe9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.489579 25209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77d13683d814408081fbbece9be522ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.493696 25208 tablet_service.cc:1511] Processing CreateTablet for tablet fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:08.496294 25207 tablet_service.cc:1511] Processing CreateTablet for tablet f4269cf1528545fd94e1d53fcf6cf48d (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:08.498818 25206 tablet_service.cc:1511] Processing CreateTablet for tablet 272d9a9f4ef849db8e59fad827bc81d0 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:08.500381 25206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272d9a9f4ef849db8e59fad827bc81d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.505550 25205 tablet_service.cc:1511] Processing CreateTablet for tablet 752795059ef543b9a98b6dba09b04230 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:08.507455 25205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752795059ef543b9a98b6dba09b04230. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:08.513579 25092 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:08.514629 25208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc7a0e6ac8cd4e8eb2e4549b0f9b64f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.516232 25207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4269cf1528545fd94e1d53fcf6cf48d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.544169 25357 tablet_service.cc:1511] Processing CreateTablet for tablet fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:08.546240 25357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc7a0e6ac8cd4e8eb2e4549b0f9b64f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.549414 25358 tablet_service.cc:1511] Processing CreateTablet for tablet dbb0eab5dcee4f95b7c284dea379c795 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:08.559633 25361 tablet_service.cc:1511] Processing CreateTablet for tablet a616947e81bf446584593e882f8bdeaa (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:08.566516 25136 tablet_service.cc:1511] Processing CreateTablet for tablet 37de5b1c577f426488d8649c7b56a9a0 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:08.568053 25136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37de5b1c577f426488d8649c7b56a9a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.562695 25360 tablet_service.cc:1511] Processing CreateTablet for tablet dcf5a5e68833468a8206894be4a16f56 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:08.570174 25356 tablet_service.cc:1511] Processing CreateTablet for tablet 272d9a9f4ef849db8e59fad827bc81d0 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:08.563235 25358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb0eab5dcee4f95b7c284dea379c795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.574162 25355 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba86635097441c08a6ca206ab0bfe9a (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:08.575192 25356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272d9a9f4ef849db8e59fad827bc81d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.576124 25360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcf5a5e68833468a8206894be4a16f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.561444 25362 tablet_service.cc:1511] Processing CreateTablet for tablet 2dc0dd4f13f243639d68c6d9a0e3afd3 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:08.576735 25354 tablet_service.cc:1511] Processing CreateTablet for tablet 752795059ef543b9a98b6dba09b04230 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:08.577476 25362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dc0dd4f13f243639d68c6d9a0e3afd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.578128 25354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752795059ef543b9a98b6dba09b04230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.579401 25361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a616947e81bf446584593e882f8bdeaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.566062 25359 tablet_service.cc:1511] Processing CreateTablet for tablet 77d13683d814408081fbbece9be522ed (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:08.581311 25359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77d13683d814408081fbbece9be522ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.563840 25204 tablet_service.cc:1511] Processing CreateTablet for tablet 37de5b1c577f426488d8649c7b56a9a0 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:08.583359 25204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37de5b1c577f426488d8649c7b56a9a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.584967 25355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba86635097441c08a6ca206ab0bfe9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.603317 25418 tablet_bootstrap.cc:492] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:08.625643 25353 tablet_service.cc:1511] Processing CreateTablet for tablet 83e2e1ecd7474df9add48f60c06a4a0f (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:08.627530 25353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83e2e1ecd7474df9add48f60c06a4a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.638316 25418 tablet_bootstrap.cc:654] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:08.652098 25287 tablet_service.cc:1511] Processing CreateTablet for tablet 91840ed520ab444d9bd1acb13b5b6b89 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:08.653708 25287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91840ed520ab444d9bd1acb13b5b6b89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.656961 25205 tablet_service.cc:1511] Processing CreateTablet for tablet 83e2e1ecd7474df9add48f60c06a4a0f (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:08.657066 25286 tablet_service.cc:1511] Processing CreateTablet for tablet dcf5a5e68833468a8206894be4a16f56 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:08.658711 25286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcf5a5e68833468a8206894be4a16f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.659049 25285 tablet_service.cc:1511] Processing CreateTablet for tablet 935b81351905468d8fa751d430f33ef2 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:08.660609 25285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 935b81351905468d8fa751d430f33ef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.664813 25205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83e2e1ecd7474df9add48f60c06a4a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.667431 25129 tablet_service.cc:1511] Processing CreateTablet for tablet 83e2e1ecd7474df9add48f60c06a4a0f (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:08.668373 25283 tablet_service.cc:1511] Processing CreateTablet for tablet fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:08.668955 25129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83e2e1ecd7474df9add48f60c06a4a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.669791 25283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc7a0e6ac8cd4e8eb2e4549b0f9b64f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.673035 25284 tablet_service.cc:1511] Processing CreateTablet for tablet dbb0eab5dcee4f95b7c284dea379c795 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:08.674525 25284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb0eab5dcee4f95b7c284dea379c795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.677546 25282 tablet_service.cc:1511] Processing CreateTablet for tablet f4269cf1528545fd94e1d53fcf6cf48d (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:08.679472 25282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4269cf1528545fd94e1d53fcf6cf48d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.681624 25281 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba86635097441c08a6ca206ab0bfe9a (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:08.684798 25280 tablet_service.cc:1511] Processing CreateTablet for tablet 752795059ef543b9a98b6dba09b04230 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:08.689188 25279 tablet_service.cc:1511] Processing CreateTablet for tablet 37de5b1c577f426488d8649c7b56a9a0 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:08.649302 25288 tablet_service.cc:1511] Processing CreateTablet for tablet 2dc0dd4f13f243639d68c6d9a0e3afd3 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:08.691813 25281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba86635097441c08a6ca206ab0bfe9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.692757 25279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37de5b1c577f426488d8649c7b56a9a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.697321 25421 tablet_bootstrap.cc:492] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:08.698316 25360 tablet_service.cc:1511] Processing CreateTablet for tablet 2bb84b6ee4f14cdc9a40ffd59ca4f42c (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:08.699976 25280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752795059ef543b9a98b6dba09b04230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.703437 25288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dc0dd4f13f243639d68c6d9a0e3afd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.711647 25360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bb84b6ee4f14cdc9a40ffd59ca4f42c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.726156 25133 tablet_service.cc:1511] Processing CreateTablet for tablet 2bb84b6ee4f14cdc9a40ffd59ca4f42c (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:08.726473 25213 tablet_service.cc:1511] Processing CreateTablet for tablet 0d0304837699431197f7e780344f1093 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:08.728087 25213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d0304837699431197f7e780344f1093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.740605 25173 heartbeater.cc:499] Master 127.16.240.190:37775 was elected leader, sending a full tablet report...
I20260709 12:25:08.742566 25418 tablet_bootstrap.cc:492] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:08.743424 25418 ts_tablet_manager.cc:1403] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.141s	user 0.017s	sys 0.007s
I20260709 12:25:08.746408 25418 raft_consensus.cc:359] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:08.747336 25418 raft_consensus.cc:385] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:08.747644 25418 raft_consensus.cc:740] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:08.748629 25418 consensus_queue.cc:260] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:08.774469 25358 tablet_service.cc:1511] Processing CreateTablet for tablet 0d0304837699431197f7e780344f1093 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:08.776103 25358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d0304837699431197f7e780344f1093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.788731 25133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bb84b6ee4f14cdc9a40ffd59ca4f42c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.807191 25419 tablet_bootstrap.cc:492] T 935b81351905468d8fa751d430f33ef2 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:08.814885 25280 tablet_service.cc:1511] Processing CreateTablet for tablet 2bb84b6ee4f14cdc9a40ffd59ca4f42c (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:08.816906 25280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bb84b6ee4f14cdc9a40ffd59ca4f42c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.831305 25419 tablet_bootstrap.cc:654] T 935b81351905468d8fa751d430f33ef2 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:08.832463 25211 tablet_service.cc:1511] Processing CreateTablet for tablet 51b6c4b190bf487a9d40c062b4195403 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:08.837554 25136 tablet_service.cc:1511] Processing CreateTablet for tablet 51b6c4b190bf487a9d40c062b4195403 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:08.839118 25136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51b6c4b190bf487a9d40c062b4195403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.856945 25421 tablet_bootstrap.cc:654] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:08.860277 25248 heartbeater.cc:499] Master 127.16.240.190:37775 was elected leader, sending a full tablet report...
I20260709 12:25:08.863354 25286 tablet_service.cc:1511] Processing CreateTablet for tablet 0d0304837699431197f7e780344f1093 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:08.865764 25286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d0304837699431197f7e780344f1093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.867975 25211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51b6c4b190bf487a9d40c062b4195403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.890339 25356 tablet_service.cc:1511] Processing CreateTablet for tablet 354e6422b7944df78b231965e1774820 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:08.893481 25356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 354e6422b7944df78b231965e1774820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.918545 25285 tablet_service.cc:1511] Processing CreateTablet for tablet 51b6c4b190bf487a9d40c062b4195403 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:08.930994 25423 tablet_bootstrap.cc:492] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:08.931981 25285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51b6c4b190bf487a9d40c062b4195403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.940146 25419 tablet_bootstrap.cc:492] T 935b81351905468d8fa751d430f33ef2 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:08.940793 25419 ts_tablet_manager.cc:1403] T 935b81351905468d8fa751d430f33ef2 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.134s	user 0.014s	sys 0.026s
I20260709 12:25:08.948760 25418 ts_tablet_manager.cc:1434] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.205s	user 0.013s	sys 0.019s
I20260709 12:25:08.948865 25422 raft_consensus.cc:493] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.952353 25422 raft_consensus.cc:515] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:08.956315 25422 leader_election.cc:290] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:08.968693 25418 tablet_bootstrap.cc:492] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:08.974141 25213 tablet_service.cc:1511] Processing CreateTablet for tablet 354e6422b7944df78b231965e1774820 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
W20260709 12:25:08.974998 25174 tablet.cc:2406] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:25:08.975608 25281 tablet_service.cc:1511] Processing CreateTablet for tablet 192689638be442acb52df50f2137f664 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:08.978016 25281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 192689638be442acb52df50f2137f664. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.979143 25418 tablet_bootstrap.cc:654] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:08.977072 25213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 354e6422b7944df78b231965e1774820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.982296 25423 tablet_bootstrap.cc:654] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:08.966423 25133 tablet_service.cc:1511] Processing CreateTablet for tablet 354e6422b7944df78b231965e1774820 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:08.985348 25133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 354e6422b7944df78b231965e1774820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.964612 25419 raft_consensus.cc:359] T 935b81351905468d8fa751d430f33ef2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:08.988400 25419 raft_consensus.cc:385] T 935b81351905468d8fa751d430f33ef2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:08.988781 25419 raft_consensus.cc:740] T 935b81351905468d8fa751d430f33ef2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:08.990288 25419 consensus_queue.cc:260] T 935b81351905468d8fa751d430f33ef2 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:09.002748 25323 heartbeater.cc:499] Master 127.16.240.190:37775 was elected leader, sending a full tablet report...
I20260709 12:25:09.018023 25356 tablet_service.cc:1511] Processing CreateTablet for tablet 192689638be442acb52df50f2137f664 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:09.019392 25356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 192689638be442acb52df50f2137f664. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.024156 25130 tablet_service.cc:1511] Processing CreateTablet for tablet 192689638be442acb52df50f2137f664 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:09.025586 25130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 192689638be442acb52df50f2137f664. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.027968 25205 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc47554d5e54ab4826c21fdd6126df0 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:09.029430 25205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc47554d5e54ab4826c21fdd6126df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.030001 25280 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc47554d5e54ab4826c21fdd6126df0 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:09.031327 25280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc47554d5e54ab4826c21fdd6126df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.035579 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91840ed520ab444d9bd1acb13b5b6b89" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
W20260709 12:25:09.045217 25110 leader_election.cc:343] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:09.037266 25360 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc47554d5e54ab4826c21fdd6126df0 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:09.046834 25360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc47554d5e54ab4826c21fdd6126df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.048786 25421 tablet_bootstrap.cc:492] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:09.049361 25421 ts_tablet_manager.cc:1403] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.352s	user 0.018s	sys 0.017s
I20260709 12:25:09.052776 25421 raft_consensus.cc:359] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:09.053524 25421 raft_consensus.cc:385] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.053836 25421 raft_consensus.cc:740] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.061223 25419 ts_tablet_manager.cc:1434] T 935b81351905468d8fa751d430f33ef2 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.120s	user 0.011s	sys 0.011s
I20260709 12:25:09.062834 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91840ed520ab444d9bd1acb13b5b6b89" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:09.066526 25136 tablet_service.cc:1511] Processing CreateTablet for tablet f6be441f38874ae7bb28069feed26b69 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
W20260709 12:25:09.067139 25113 leader_election.cc:343] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:09.067658 25113 leader_election.cc:304] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:09.069196 25422 raft_consensus.cc:2749] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:09.070799 25285 tablet_service.cc:1511] Processing CreateTablet for tablet f6be441f38874ae7bb28069feed26b69 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:25:09.072690 25285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6be441f38874ae7bb28069feed26b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.075446 25419 tablet_bootstrap.cc:492] T 272d9a9f4ef849db8e59fad827bc81d0 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:09.059114 25421 consensus_queue.cc:260] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:09.076627 25136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6be441f38874ae7bb28069feed26b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.089468 25135 tablet_service.cc:1511] Processing CreateTablet for tablet a6ef2af3aa69454aa946797dc87d6e9d (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:09.090847 25135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ef2af3aa69454aa946797dc87d6e9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.093744 25358 tablet_service.cc:1511] Processing CreateTablet for tablet a6ef2af3aa69454aa946797dc87d6e9d (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:09.095144 25358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ef2af3aa69454aa946797dc87d6e9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.080847 25211 tablet_service.cc:1511] Processing CreateTablet for tablet f6be441f38874ae7bb28069feed26b69 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:25:09.097606 25211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6be441f38874ae7bb28069feed26b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.116945 25423 tablet_bootstrap.cc:492] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:09.117564 25423 ts_tablet_manager.cc:1403] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.187s	user 0.013s	sys 0.008s
I20260709 12:25:09.128082 25397 heartbeater.cc:499] Master 127.16.240.190:37775 was elected leader, sending a full tablet report...
I20260709 12:25:09.135125 25418 tablet_bootstrap.cc:492] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:09.139878 25418 ts_tablet_manager.cc:1403] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.173s	user 0.015s	sys 0.004s
I20260709 12:25:09.143178 25418 raft_consensus.cc:359] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:09.129413 25423 raft_consensus.cc:359] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:09.144439 25418 raft_consensus.cc:385] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.144639 25423 raft_consensus.cc:385] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.147722 25423 raft_consensus.cc:740] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.148622 25213 tablet_service.cc:1511] Processing CreateTablet for tablet a6ef2af3aa69454aa946797dc87d6e9d (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:09.148918 25423 consensus_queue.cc:260] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:09.150666 25213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ef2af3aa69454aa946797dc87d6e9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.162597 25419 tablet_bootstrap.cc:654] T 272d9a9f4ef849db8e59fad827bc81d0 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.146206 25418 raft_consensus.cc:740] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.172518 25204 tablet_service.cc:1511] Processing CreateTablet for tablet f50c1e80871a4f21a31521e37160b99f (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:09.174034 25204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f50c1e80871a4f21a31521e37160b99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.176066 25286 tablet_service.cc:1511] Processing CreateTablet for tablet f50c1e80871a4f21a31521e37160b99f (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:09.177588 25286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f50c1e80871a4f21a31521e37160b99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.177237 25361 tablet_service.cc:1511] Processing CreateTablet for tablet f50c1e80871a4f21a31521e37160b99f (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:09.178654 25361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f50c1e80871a4f21a31521e37160b99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.180773 25285 tablet_service.cc:1511] Processing CreateTablet for tablet 4ae8b407c5d34cfb85a405355e2befda (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:09.181499 25423 ts_tablet_manager.cc:1434] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.004s
I20260709 12:25:09.182214 25285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ae8b407c5d34cfb85a405355e2befda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.182720 25423 tablet_bootstrap.cc:492] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:09.172559 25133 tablet_service.cc:1511] Processing CreateTablet for tablet 4ae8b407c5d34cfb85a405355e2befda (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:09.185700 25133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ae8b407c5d34cfb85a405355e2befda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.188894 25421 ts_tablet_manager.cc:1434] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.139s	user 0.021s	sys 0.047s
I20260709 12:25:09.188588 25418 consensus_queue.cc:260] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:09.189276 25358 tablet_service.cc:1511] Processing CreateTablet for tablet 4ae8b407c5d34cfb85a405355e2befda (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:09.190835 25358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ae8b407c5d34cfb85a405355e2befda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.191030 25418 ts_tablet_manager.cc:1434] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 12:25:09.193930 25423 tablet_bootstrap.cc:654] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.213776 25422 raft_consensus.cc:493] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.214428 25418 tablet_bootstrap.cc:492] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:09.214334 25422 raft_consensus.cc:515] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:09.220860 25422 leader_election.cc:290] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:09.221427 25205 tablet_service.cc:1511] Processing CreateTablet for tablet 30586f82b3764222905aebbb6896d886 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:09.223098 25205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30586f82b3764222905aebbb6896d886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.223400 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a616947e81bf446584593e882f8bdeaa" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
W20260709 12:25:09.225328 25110 leader_election.cc:343] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:09.225333 25421 tablet_bootstrap.cc:492] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:09.243723 25130 tablet_service.cc:1511] Processing CreateTablet for tablet 30586f82b3764222905aebbb6896d886 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:09.252363 25130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30586f82b3764222905aebbb6896d886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.266594 25419 tablet_bootstrap.cc:492] T 272d9a9f4ef849db8e59fad827bc81d0 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:09.267403 25419 ts_tablet_manager.cc:1403] T 272d9a9f4ef849db8e59fad827bc81d0 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.192s	user 0.014s	sys 0.003s
I20260709 12:25:09.270397 25280 tablet_service.cc:1511] Processing CreateTablet for tablet 30586f82b3764222905aebbb6896d886 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:09.271862 25280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30586f82b3764222905aebbb6896d886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.272998 25421 tablet_bootstrap.cc:654] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.279089 25356 tablet_service.cc:1511] Processing CreateTablet for tablet 5c47c723f1bb4cd7b3ca0e8376ebb5e8 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:09.280592 25356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c47c723f1bb4cd7b3ca0e8376ebb5e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.288236 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a616947e81bf446584593e882f8bdeaa" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
W20260709 12:25:09.290151 25112 leader_election.cc:343] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:09.290735 25112 leader_election.cc:304] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:09.271165 25419 raft_consensus.cc:359] T 272d9a9f4ef849db8e59fad827bc81d0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:09.291590 25281 tablet_service.cc:1511] Processing CreateTablet for tablet b349920766b74e3aa849cd67521bf887 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:09.289923 25205 tablet_service.cc:1511] Processing CreateTablet for tablet 5c47c723f1bb4cd7b3ca0e8376ebb5e8 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:09.292104 25419 raft_consensus.cc:385] T 272d9a9f4ef849db8e59fad827bc81d0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.291929 25422 raft_consensus.cc:2749] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:09.292511 25419 raft_consensus.cc:740] T 272d9a9f4ef849db8e59fad827bc81d0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.293093 25205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c47c723f1bb4cd7b3ca0e8376ebb5e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.293996 25136 tablet_service.cc:1511] Processing CreateTablet for tablet 5c47c723f1bb4cd7b3ca0e8376ebb5e8 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:09.294637 25281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b349920766b74e3aa849cd67521bf887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.295403 25136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c47c723f1bb4cd7b3ca0e8376ebb5e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.295588 25418 tablet_bootstrap.cc:654] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.298832 25419 consensus_queue.cc:260] T 272d9a9f4ef849db8e59fad827bc81d0 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:09.305862 25419 ts_tablet_manager.cc:1434] T 272d9a9f4ef849db8e59fad827bc81d0 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:25:09.311612 25423 tablet_bootstrap.cc:492] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:09.312288 25423 ts_tablet_manager.cc:1403] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.130s	user 0.047s	sys 0.023s
I20260709 12:25:09.315582 25423 raft_consensus.cc:359] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:09.316375 25423 raft_consensus.cc:385] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.316666 25423 raft_consensus.cc:740] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.317425 25423 consensus_queue.cc:260] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:09.327999 25419 tablet_bootstrap.cc:492] T 752795059ef543b9a98b6dba09b04230 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:09.334100 25418 tablet_bootstrap.cc:492] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:09.334715 25418 ts_tablet_manager.cc:1403] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.121s	user 0.012s	sys 0.000s
I20260709 12:25:09.337567 25432 raft_consensus.cc:493] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.338173 25432 raft_consensus.cc:515] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:09.345180 25358 tablet_service.cc:1511] Processing CreateTablet for tablet b349920766b74e3aa849cd67521bf887 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:09.347290 25358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b349920766b74e3aa849cd67521bf887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.348502 25432 leader_election.cc:290] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:09.338173 25418 raft_consensus.cc:359] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:09.350806 25418 raft_consensus.cc:385] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.351261 25418 raft_consensus.cc:740] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.353667 25418 consensus_queue.cc:260] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:09.357405 25421 tablet_bootstrap.cc:492] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:09.359470 25421 ts_tablet_manager.cc:1403] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.134s	user 0.024s	sys 0.017s
I20260709 12:25:09.361723 25423 ts_tablet_manager.cc:1434] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 12:25:09.362450 25419 tablet_bootstrap.cc:654] T 752795059ef543b9a98b6dba09b04230 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.363106 25423 tablet_bootstrap.cc:492] T dcf5a5e68833468a8206894be4a16f56 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:09.371963 25133 tablet_service.cc:1511] Processing CreateTablet for tablet b349920766b74e3aa849cd67521bf887 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:09.373819 25133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b349920766b74e3aa849cd67521bf887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.376672 25285 tablet_service.cc:1511] Processing CreateTablet for tablet 0190ce7515c34431903f97febee4323e (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:09.378371 25285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0190ce7515c34431903f97febee4323e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.378499 25361 tablet_service.cc:1511] Processing CreateTablet for tablet 0190ce7515c34431903f97febee4323e (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:09.380025 25361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0190ce7515c34431903f97febee4323e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.382732 25213 tablet_service.cc:1511] Processing CreateTablet for tablet 0190ce7515c34431903f97febee4323e (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:09.378505 25418 ts_tablet_manager.cc:1434] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.043s	user 0.010s	sys 0.001s
I20260709 12:25:09.384433 25213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0190ce7515c34431903f97febee4323e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.385006 25418 tablet_bootstrap.cc:492] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:09.366518 25421 raft_consensus.cc:359] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:09.392769 25130 tablet_service.cc:1511] Processing CreateTablet for tablet afcc5ac5532e4841a4f0a182a39a1914 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:09.394344 25130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afcc5ac5532e4841a4f0a182a39a1914. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.398627 25431 raft_consensus.cc:493] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.399359 25431 raft_consensus.cc:515] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:09.400038 25429 raft_consensus.cc:493] T 935b81351905468d8fa751d430f33ef2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.400575 25429 raft_consensus.cc:515] T 935b81351905468d8fa751d430f33ef2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:09.389250 25421 raft_consensus.cc:385] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.410499 25429 leader_election.cc:290] T 935b81351905468d8fa751d430f33ef2 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:09.409197 25421 raft_consensus.cc:740] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.428033 25286 tablet_service.cc:1511] Processing CreateTablet for tablet afcc5ac5532e4841a4f0a182a39a1914 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:09.429751 25286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afcc5ac5532e4841a4f0a182a39a1914. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.430722 25135 tablet_service.cc:1511] Processing CreateTablet for tablet ff3d2388e4f54ed59c7760fab0dfc1ec (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:09.432210 25135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff3d2388e4f54ed59c7760fab0dfc1ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.425554 25431 leader_election.cc:290] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:09.438489 25423 tablet_bootstrap.cc:654] T dcf5a5e68833468a8206894be4a16f56 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.457091 25422 raft_consensus.cc:493] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.459393 25422 raft_consensus.cc:515] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:09.415793 25421 consensus_queue.cc:260] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:09.461856 25422 leader_election.cc:290] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:09.462991 25421 ts_tablet_manager.cc:1434] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.103s	user 0.008s	sys 0.000s
I20260709 12:25:09.463594 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc0dd4f13f243639d68c6d9a0e3afd3" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
W20260709 12:25:09.465246 25113 leader_election.cc:343] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:09.467360 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc0dd4f13f243639d68c6d9a0e3afd3" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:09.480746 25421 tablet_bootstrap.cc:492] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
W20260709 12:25:09.479837 25112 leader_election.cc:343] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:09.488268 25112 leader_election.cc:304] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:09.496969 25422 raft_consensus.cc:2749] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:09.497709 25360 tablet_service.cc:1511] Processing CreateTablet for tablet ff3d2388e4f54ed59c7760fab0dfc1ec (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:09.499131 25360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff3d2388e4f54ed59c7760fab0dfc1ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.500828 25281 tablet_service.cc:1511] Processing CreateTablet for tablet 6b1f8b45199a40aeaf77fa2e23107375 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:09.502257 25281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b1f8b45199a40aeaf77fa2e23107375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.513753 25421 tablet_bootstrap.cc:654] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:09.518450 25092 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:09.520053 25423 tablet_bootstrap.cc:492] T dcf5a5e68833468a8206894be4a16f56 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:09.532613 25438 raft_consensus.cc:493] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.520798 25423 ts_tablet_manager.cc:1403] T dcf5a5e68833468a8206894be4a16f56 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.158s	user 0.008s	sys 0.009s
I20260709 12:25:09.524708 25418 tablet_bootstrap.cc:654] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.533265 25438 raft_consensus.cc:515] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:09.559250 25131 tablet_service.cc:1511] Processing CreateTablet for tablet 6b1f8b45199a40aeaf77fa2e23107375 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:09.561718 25131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b1f8b45199a40aeaf77fa2e23107375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.570555 25419 tablet_bootstrap.cc:492] T 752795059ef543b9a98b6dba09b04230 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:09.571010 25438 leader_election.cc:290] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:09.571219 25419 ts_tablet_manager.cc:1403] T 752795059ef543b9a98b6dba09b04230 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.264s	user 0.042s	sys 0.014s
I20260709 12:25:09.575173 25419 raft_consensus.cc:359] T 752795059ef543b9a98b6dba09b04230 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:09.581635 25419 raft_consensus.cc:385] T 752795059ef543b9a98b6dba09b04230 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.583848 25419 raft_consensus.cc:740] T 752795059ef543b9a98b6dba09b04230 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.589248 25148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935b81351905468d8fa751d430f33ef2" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
W20260709 12:25:09.591544 25263 leader_election.cc:343] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:09.587049 25419 consensus_queue.cc:260] T 752795059ef543b9a98b6dba09b04230 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:09.578337 25423 raft_consensus.cc:359] T dcf5a5e68833468a8206894be4a16f56 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:09.593459 25423 raft_consensus.cc:385] T dcf5a5e68833468a8206894be4a16f56 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.605386 25431 raft_consensus.cc:493] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.605973 25431 raft_consensus.cc:515] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:09.609321 25431 leader_election.cc:290] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:09.597554 25423 raft_consensus.cc:740] T dcf5a5e68833468a8206894be4a16f56 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.619374 25423 consensus_queue.cc:260] T dcf5a5e68833468a8206894be4a16f56 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:09.620411 25213 tablet_service.cc:1511] Processing CreateTablet for tablet afcc5ac5532e4841a4f0a182a39a1914 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:09.621943 25423 ts_tablet_manager.cc:1434] T dcf5a5e68833468a8206894be4a16f56 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.002s
I20260709 12:25:09.621881 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf5a5e68833468a8206894be4a16f56" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:09.621966 25213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afcc5ac5532e4841a4f0a182a39a1914. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.623322 25423 tablet_bootstrap.cc:492] T 37de5b1c577f426488d8649c7b56a9a0 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:09.628490 25205 tablet_service.cc:1511] Processing CreateTablet for tablet ff3d2388e4f54ed59c7760fab0dfc1ec (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:09.631479 25358 tablet_service.cc:1511] Processing CreateTablet for tablet b1ea711322544c2999f94b52b35af150 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 12:25:09.634577 25335 leader_election.cc:343] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:09.635557 25358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ea711322544c2999f94b52b35af150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.639267 25205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff3d2388e4f54ed59c7760fab0dfc1ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.645721 25204 tablet_service.cc:1511] Processing CreateTablet for tablet b1ea711322544c2999f94b52b35af150 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:09.647257 25204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ea711322544c2999f94b52b35af150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.649300 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935b81351905468d8fa751d430f33ef2" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:09.650067 25223 raft_consensus.cc:2468] T 935b81351905468d8fa751d430f33ef2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 0.
I20260709 12:25:09.650530 25356 tablet_service.cc:1511] Processing CreateTablet for tablet 6b1f8b45199a40aeaf77fa2e23107375 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:09.651405 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752795059ef543b9a98b6dba09b04230" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:09.652078 25356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b1f8b45199a40aeaf77fa2e23107375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.652182 25222 raft_consensus.cc:2468] T 752795059ef543b9a98b6dba09b04230 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 0.
I20260709 12:25:09.653621 25260 leader_election.cc:304] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:09.654881 25438 raft_consensus.cc:2804] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:09.655284 25438 raft_consensus.cc:493] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.655628 25438 raft_consensus.cc:3060] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:09.657771 25260 leader_election.cc:304] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:09.660034 25432 raft_consensus.cc:2804] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:09.660487 25432 raft_consensus.cc:493] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.660866 25432 raft_consensus.cc:3060] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:09.663132 25423 tablet_bootstrap.cc:654] T 37de5b1c577f426488d8649c7b56a9a0 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.664661 25419 ts_tablet_manager.cc:1434] T 752795059ef543b9a98b6dba09b04230 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.093s	user 0.009s	sys 0.000s
I20260709 12:25:09.665808 25419 tablet_bootstrap.cc:492] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:09.667431 25211 tablet_service.cc:1511] Processing CreateTablet for tablet 2ecc3ffe78cf4eb091836a5e7d2393cc (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:09.669085 25211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ecc3ffe78cf4eb091836a5e7d2393cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.681344 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752795059ef543b9a98b6dba09b04230" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:09.691402 25135 tablet_service.cc:1511] Processing CreateTablet for tablet 2ecc3ffe78cf4eb091836a5e7d2393cc (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:09.693011 25135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ecc3ffe78cf4eb091836a5e7d2393cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.696223 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf5a5e68833468a8206894be4a16f56" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:09.697063 25298 raft_consensus.cc:2468] T dcf5a5e68833468a8206894be4a16f56 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 0.
I20260709 12:25:09.698643 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb0eab5dcee4f95b7c284dea379c795" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
W20260709 12:25:09.699610 25262 leader_election.cc:343] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:09.700145 25338 leader_election.cc:304] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:09.687425 25419 tablet_bootstrap.cc:654] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.701053 25281 tablet_service.cc:1511] Processing CreateTablet for tablet 2ecc3ffe78cf4eb091836a5e7d2393cc (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
W20260709 12:25:09.701644 25338 leader_election.cc:343] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:09.702370 25431 raft_consensus.cc:2804] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:09.702606 25281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ecc3ffe78cf4eb091836a5e7d2393cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.702821 25431 raft_consensus.cc:493] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.703246 25431 raft_consensus.cc:3060] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:09.703467 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935b81351905468d8fa751d430f33ef2" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:09.708168 25286 tablet_service.cc:1511] Processing CreateTablet for tablet b1ea711322544c2999f94b52b35af150 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:09.709301 25418 tablet_bootstrap.cc:492] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:09.710000 25418 ts_tablet_manager.cc:1403] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.325s	user 0.022s	sys 0.015s
I20260709 12:25:09.714474 25438 raft_consensus.cc:515] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:09.714951 25418 raft_consensus.cc:359] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:09.710071 25286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ea711322544c2999f94b52b35af150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.715788 25148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935b81351905468d8fa751d430f33ef2" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
W20260709 12:25:09.717733 25189 leader_election.cc:343] T 935b81351905468d8fa751d430f33ef2 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:09.718001 25148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935b81351905468d8fa751d430f33ef2" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
W20260709 12:25:09.719519 25263 leader_election.cc:343] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:09.687273 25432 raft_consensus.cc:515] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:09.723321 25298 raft_consensus.cc:2393] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3979c425abd4ac7b2ca30e1dec9a154 in current term 1: Already voted for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in this term.
I20260709 12:25:09.741925 25204 tablet_service.cc:1511] Processing CreateTablet for tablet 63327743a40345e4b149aca740d0944a (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:09.730624 25421 tablet_bootstrap.cc:492] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:09.746618 25421 ts_tablet_manager.cc:1403] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.271s	user 0.013s	sys 0.007s
I20260709 12:25:09.746721 25189 leader_election.cc:304] T 935b81351905468d8fa751d430f33ef2 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:09.734949 25429 raft_consensus.cc:493] T 272d9a9f4ef849db8e59fad827bc81d0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.750723 25429 raft_consensus.cc:515] T 272d9a9f4ef849db8e59fad827bc81d0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:09.753691 25429 leader_election.cc:290] T 272d9a9f4ef849db8e59fad827bc81d0 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:09.754307 25429 raft_consensus.cc:3060] T 935b81351905468d8fa751d430f33ef2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:09.754066 25285 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd0775b429544fcb31e2834c279b159 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:09.755918 25285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd0775b429544fcb31e2834c279b159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.756899 25360 tablet_service.cc:1511] Processing CreateTablet for tablet 63327743a40345e4b149aca740d0944a (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:09.758292 25360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63327743a40345e4b149aca740d0944a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.763278 25438 leader_election.cc:290] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Requested vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:09.743490 25204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63327743a40345e4b149aca740d0944a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.720857 25418 raft_consensus.cc:385] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.714474 25431 raft_consensus.cc:515] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:09.778749 25431 leader_election.cc:290] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:09.779529 25361 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd0775b429544fcb31e2834c279b159 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:09.781651 25361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd0775b429544fcb31e2834c279b159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.785645 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf5a5e68833468a8206894be4a16f56" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:09.786404 25432 leader_election.cc:290] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:09.787490 25148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb0eab5dcee4f95b7c284dea379c795" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:09.770973 25418 raft_consensus.cc:740] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
W20260709 12:25:09.793927 25335 leader_election.cc:343] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:09.800011 25338 leader_election.cc:343] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:09.804081 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf5a5e68833468a8206894be4a16f56" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:09.804399 25338 leader_election.cc:304] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:09.804188 25131 tablet_service.cc:1511] Processing CreateTablet for tablet 63327743a40345e4b149aca740d0944a (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:09.804898 25298 raft_consensus.cc:3060] T dcf5a5e68833468a8206894be4a16f56 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:09.805867 25131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63327743a40345e4b149aca740d0944a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.808141 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752795059ef543b9a98b6dba09b04230" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
W20260709 12:25:09.809791 25262 leader_election.cc:343] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:09.812099 25421 raft_consensus.cc:359] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:09.813377 25421 raft_consensus.cc:385] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.829520 25421 raft_consensus.cc:740] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
W20260709 12:25:09.795739 25189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:45473, user_credentials={real_user=slave}} blocked reactor thread for 49129.7us
I20260709 12:25:09.819519 25431 raft_consensus.cc:2749] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:09.826236 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d9a9f4ef849db8e59fad827bc81d0" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:09.833467 25298 raft_consensus.cc:2468] T dcf5a5e68833468a8206894be4a16f56 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 1.
I20260709 12:25:09.838794 25280 tablet_service.cc:1511] Processing CreateTablet for tablet 9d39dac4e3e343f2985681aa3c5e5718 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:09.836449 25418 consensus_queue.cc:260] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:09.840333 25280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d39dac4e3e343f2985681aa3c5e5718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.839986 25135 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd0775b429544fcb31e2834c279b159 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
W20260709 12:25:09.841881 25188 leader_election.cc:343] T 272d9a9f4ef849db8e59fad827bc81d0 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:09.842674 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935b81351905468d8fa751d430f33ef2" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:09.843463 25148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d9a9f4ef849db8e59fad827bc81d0" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:09.844539 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752795059ef543b9a98b6dba09b04230" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:09.846885 25338 leader_election.cc:304] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:09.847636 25419 tablet_bootstrap.cc:492] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:09.848688 25223 raft_consensus.cc:3060] T 752795059ef543b9a98b6dba09b04230 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:09.848984 25419 ts_tablet_manager.cc:1403] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.183s	user 0.022s	sys 0.034s
W20260709 12:25:09.850342 25189 leader_election.cc:343] T 272d9a9f4ef849db8e59fad827bc81d0 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:09.852618 25458 raft_consensus.cc:2804] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:09.854981 25419 raft_consensus.cc:359] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:09.857446 25421 consensus_queue.cc:260] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:09.858423 25431 raft_consensus.cc:493] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.858989 25423 tablet_bootstrap.cc:492] T 37de5b1c577f426488d8649c7b56a9a0 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:09.858919 25431 raft_consensus.cc:515] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:09.859607 25423 ts_tablet_manager.cc:1403] T 37de5b1c577f426488d8649c7b56a9a0 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.237s	user 0.020s	sys 0.022s
I20260709 12:25:09.860261 25133 tablet_service.cc:1511] Processing CreateTablet for tablet 640ac5b087574063b50e6611b7e8da5b (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:09.861878 25133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 640ac5b087574063b50e6611b7e8da5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.865502 25354 tablet_service.cc:1511] Processing CreateTablet for tablet 9d39dac4e3e343f2985681aa3c5e5718 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:09.863364 25423 raft_consensus.cc:359] T 37de5b1c577f426488d8649c7b56a9a0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:09.867646 25354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d39dac4e3e343f2985681aa3c5e5718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.870014 25418 ts_tablet_manager.cc:1434] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.159s	user 0.014s	sys 0.000s
I20260709 12:25:09.871275 25418 tablet_bootstrap.cc:492] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:09.872713 25205 tablet_service.cc:1511] Processing CreateTablet for tablet 9d39dac4e3e343f2985681aa3c5e5718 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:09.873333 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e2e1ecd7474df9add48f60c06a4a0f" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:09.874248 25205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d39dac4e3e343f2985681aa3c5e5718. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:09.874969 25335 leader_election.cc:343] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:09.856983 25419 raft_consensus.cc:385] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.876324 25419 raft_consensus.cc:740] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.868587 25423 raft_consensus.cc:385] T 37de5b1c577f426488d8649c7b56a9a0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.877193 25423 raft_consensus.cc:740] T 37de5b1c577f426488d8649c7b56a9a0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.878041 25423 consensus_queue.cc:260] T 37de5b1c577f426488d8649c7b56a9a0 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:09.878435 25431 leader_election.cc:290] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:09.879295 25429 raft_consensus.cc:2749] T 935b81351905468d8fa751d430f33ef2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:09.851063 25189 leader_election.cc:304] T 272d9a9f4ef849db8e59fad827bc81d0 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:09.888231 25148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e2e1ecd7474df9add48f60c06a4a0f" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:09.888973 25457 raft_consensus.cc:2749] T 272d9a9f4ef849db8e59fad827bc81d0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:09.880646 25423 ts_tablet_manager.cc:1434] T 37de5b1c577f426488d8649c7b56a9a0 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:25:09.883057 25135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd0775b429544fcb31e2834c279b159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.891170 25423 tablet_bootstrap.cc:492] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:09.892612 25422 raft_consensus.cc:493] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.893199 25422 raft_consensus.cc:515] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:09.886075 25458 raft_consensus.cc:697] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d [term 1 LEADER]: Becoming Leader. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Running, Role: LEADER
I20260709 12:25:09.895804 25422 leader_election.cc:290] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:09.896523 25458 consensus_queue.cc:237] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:09.897073 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba86635097441c08a6ca206ab0bfe9a" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:09.897519 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba86635097441c08a6ca206ab0bfe9a" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
W20260709 12:25:09.898710 25112 leader_election.cc:343] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:09.899245 25113 leader_election.cc:343] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:09.899765 25113 leader_election.cc:304] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:09.899492 25419 consensus_queue.cc:260] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:09.900113 25423 tablet_bootstrap.cc:654] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.901607 25422 raft_consensus.cc:2749] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:09.902580 25419 ts_tablet_manager.cc:1434] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.001s
I20260709 12:25:09.906641 25223 raft_consensus.cc:2468] T 752795059ef543b9a98b6dba09b04230 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:09.911875 25260 leader_election.cc:304] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:09.913097 25432 raft_consensus.cc:2804] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:09.913654 25432 raft_consensus.cc:697] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:09.913794 25419 tablet_bootstrap.cc:492] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:09.914546 25432 consensus_queue.cc:237] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:09.932628 25211 tablet_service.cc:1511] Processing CreateTablet for tablet 640ac5b087574063b50e6611b7e8da5b (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:09.934108 25211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 640ac5b087574063b50e6611b7e8da5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.941833 25222 raft_consensus.cc:2468] T 935b81351905468d8fa751d430f33ef2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:09.944556 25260 leader_election.cc:304] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:09.946075 25438 raft_consensus.cc:2804] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:25:09.949565 25338 leader_election.cc:343] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:09.958518 25338 leader_election.cc:304] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:09.959729 25431 raft_consensus.cc:2749] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:09.982525 25285 tablet_service.cc:1511] Processing CreateTablet for tablet 640ac5b087574063b50e6611b7e8da5b (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:09.984900 25285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 640ac5b087574063b50e6611b7e8da5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.980257 25438 raft_consensus.cc:697] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:09.986315 25423 tablet_bootstrap.cc:492] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:09.986193 25438 consensus_queue.cc:237] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:09.987257 25423 ts_tablet_manager.cc:1403] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.096s	user 0.030s	sys 0.016s
I20260709 12:25:09.991326 25419 tablet_bootstrap.cc:654] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.991458 25423 raft_consensus.cc:359] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:09.992228 25432 raft_consensus.cc:493] T 37de5b1c577f426488d8649c7b56a9a0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.992182 25043 catalog_manager.cc:5697] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fa8f2c80074488084fea821c4bb293d (127.16.240.132). New cstate: current_term: 1 leader_uuid: "0fa8f2c80074488084fea821c4bb293d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:09.992949 25432 raft_consensus.cc:515] T 37de5b1c577f426488d8649c7b56a9a0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:09.995605 25423 raft_consensus.cc:385] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.995994 25423 raft_consensus.cc:740] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.996784 25423 consensus_queue.cc:260] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:09.998323 25361 tablet_service.cc:1511] Processing CreateTablet for tablet cc69e13d835645099f9e0e5bea99665a (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:09.999197 25423 ts_tablet_manager.cc:1434] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.003s
I20260709 12:25:09.998982 25044 catalog_manager.cc:5697] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 0 to 1, leader changed from <none> to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:10.008385 25432 leader_election.cc:290] T 37de5b1c577f426488d8649c7b56a9a0 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:10.008845 25421 ts_tablet_manager.cc:1434] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.262s	user 0.026s	sys 0.008s
I20260709 12:25:10.010320 25423 tablet_bootstrap.cc:492] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:10.010419 25421 tablet_bootstrap.cc:492] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:10.000166 25148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37de5b1c577f426488d8649c7b56a9a0" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:10.015550 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37de5b1c577f426488d8649c7b56a9a0" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:10.016705 25131 tablet_service.cc:1511] Processing CreateTablet for tablet cc69e13d835645099f9e0e5bea99665a (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:10.018088 25131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc69e13d835645099f9e0e5bea99665a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:10.015964 25263 leader_election.cc:343] T 37de5b1c577f426488d8649c7b56a9a0 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:10.020514 25260 leader_election.cc:343] T 37de5b1c577f426488d8649c7b56a9a0 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.021068 25260 leader_election.cc:304] T 37de5b1c577f426488d8649c7b56a9a0 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:10.021528 25358 tablet_service.cc:1511] Processing CreateTablet for tablet cb9f447960df41a5ade2459879b92b17 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:10.022095 25432 raft_consensus.cc:2749] T 37de5b1c577f426488d8649c7b56a9a0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:10.022377 25204 tablet_service.cc:1511] Processing CreateTablet for tablet cc69e13d835645099f9e0e5bea99665a (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:10.024816 25286 tablet_service.cc:1511] Processing CreateTablet for tablet cb9f447960df41a5ade2459879b92b17 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:10.025705 25423 tablet_bootstrap.cc:654] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.026209 25286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9f447960df41a5ade2459879b92b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.028184 25204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc69e13d835645099f9e0e5bea99665a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.032756 25361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc69e13d835645099f9e0e5bea99665a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.033612 25358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9f447960df41a5ade2459879b92b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.045511 25418 tablet_bootstrap.cc:654] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.051316 25429 raft_consensus.cc:493] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.051919 25429 raft_consensus.cc:515] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:10.054252 25429 leader_election.cc:290] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:10.054791 25421 tablet_bootstrap.cc:654] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.056165 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d13683d814408081fbbece9be522ed" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
W20260709 12:25:10.057781 25188 leader_election.cc:343] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.059626 25148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d13683d814408081fbbece9be522ed" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
W20260709 12:25:10.061220 25189 leader_election.cc:343] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.061691 25189 leader_election.cc:304] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:10.062873 25429 raft_consensus.cc:2749] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:10.064075 25130 tablet_service.cc:1511] Processing CreateTablet for tablet cb9f447960df41a5ade2459879b92b17 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:10.065980 25130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9f447960df41a5ade2459879b92b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.068161 25280 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf33e1087ea4e7f98b37dd2c130c635 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:10.069519 25280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf33e1087ea4e7f98b37dd2c130c635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.070295 25360 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf33e1087ea4e7f98b37dd2c130c635 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:10.071691 25360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf33e1087ea4e7f98b37dd2c130c635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.072798 25213 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf33e1087ea4e7f98b37dd2c130c635 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:10.074160 25213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf33e1087ea4e7f98b37dd2c130c635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.104528 25210 tablet_service.cc:1511] Processing CreateTablet for tablet 46a01e9d0014411a83a8edbf3b5504f6 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:25:10.106447 25210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a01e9d0014411a83a8edbf3b5504f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.114005 25133 tablet_service.cc:1511] Processing CreateTablet for tablet 46a01e9d0014411a83a8edbf3b5504f6 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:25:10.116641 25133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a01e9d0014411a83a8edbf3b5504f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.126202 25354 tablet_service.cc:1511] Processing CreateTablet for tablet d4f5d4fb33b4421daaf5b63cafcd4f4b (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:25:10.126816 25281 tablet_service.cc:1511] Processing CreateTablet for tablet 46a01e9d0014411a83a8edbf3b5504f6 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:25:10.127780 25354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f5d4fb33b4421daaf5b63cafcd4f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.128137 25281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a01e9d0014411a83a8edbf3b5504f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.129522 25136 tablet_service.cc:1511] Processing CreateTablet for tablet d4f5d4fb33b4421daaf5b63cafcd4f4b (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:25:10.130157 25284 tablet_service.cc:1511] Processing CreateTablet for tablet 3459b31870574ae4aa816cf5ee28162b (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:10.130884 25136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f5d4fb33b4421daaf5b63cafcd4f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.131449 25284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3459b31870574ae4aa816cf5ee28162b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.133793 25211 tablet_service.cc:1511] Processing CreateTablet for tablet d4f5d4fb33b4421daaf5b63cafcd4f4b (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:25:10.134232 25438 raft_consensus.cc:493] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.135203 25211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f5d4fb33b4421daaf5b63cafcd4f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.134832 25438 raft_consensus.cc:515] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:10.138411 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91840ed520ab444d9bd1acb13b5b6b89" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
W20260709 12:25:10.143440 25260 leader_election.cc:343] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.144506 25356 tablet_service.cc:1511] Processing CreateTablet for tablet 3459b31870574ae4aa816cf5ee28162b (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:10.153434 25356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3459b31870574ae4aa816cf5ee28162b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.158877 25129 tablet_service.cc:1511] Processing CreateTablet for tablet 3459b31870574ae4aa816cf5ee28162b (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:10.160768 25129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3459b31870574ae4aa816cf5ee28162b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.166771 25205 tablet_service.cc:1511] Processing CreateTablet for tablet bffd5eeaa9c14effb9e1ffc29a23ff01 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:10.168282 25205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bffd5eeaa9c14effb9e1ffc29a23ff01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.168830 25418 tablet_bootstrap.cc:492] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:10.169494 25418 ts_tablet_manager.cc:1403] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.298s	user 0.016s	sys 0.013s
I20260709 12:25:10.170078 25212 tablet_service.cc:1511] Processing CreateTablet for tablet e99adf4dd9ed4adbb8f70f7fd8aeaeb8 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:10.171422 25212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e99adf4dd9ed4adbb8f70f7fd8aeaeb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.175557 25283 tablet_service.cc:1511] Processing CreateTablet for tablet bffd5eeaa9c14effb9e1ffc29a23ff01 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:10.177487 25283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bffd5eeaa9c14effb9e1ffc29a23ff01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.180554 25438 leader_election.cc:290] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:10.181242 25148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91840ed520ab444d9bd1acb13b5b6b89" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:10.181185 25282 tablet_service.cc:1511] Processing CreateTablet for tablet e99adf4dd9ed4adbb8f70f7fd8aeaeb8 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:10.182224 25148 raft_consensus.cc:2468] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 0.
I20260709 12:25:10.183226 25282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e99adf4dd9ed4adbb8f70f7fd8aeaeb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.184106 25263 leader_election.cc:304] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:10.185794 25134 tablet_service.cc:1511] Processing CreateTablet for tablet e99adf4dd9ed4adbb8f70f7fd8aeaeb8 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:10.187304 25134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e99adf4dd9ed4adbb8f70f7fd8aeaeb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.168439 25359 tablet_service.cc:1511] Processing CreateTablet for tablet eb4d589309f24d3e955fb45b2c6fe3af (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:10.189950 25359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4d589309f24d3e955fb45b2c6fe3af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.193169 25358 tablet_service.cc:1511] Processing CreateTablet for tablet bffd5eeaa9c14effb9e1ffc29a23ff01 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:10.194965 25358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bffd5eeaa9c14effb9e1ffc29a23ff01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.211962 25438 raft_consensus.cc:2804] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.212488 25438 raft_consensus.cc:493] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.212839 25438 raft_consensus.cc:3060] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.213567 25418 raft_consensus.cc:359] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:10.214556 25418 raft_consensus.cc:385] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.215059 25418 raft_consensus.cc:740] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
W20260709 12:25:10.216614 25464 log.cc:927] Time spent T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:25:10.234002 25418 consensus_queue.cc:260] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:10.256289 25419 tablet_bootstrap.cc:492] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:10.277598 25205 tablet_service.cc:1511] Processing CreateTablet for tablet eb4d589309f24d3e955fb45b2c6fe3af (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:10.279139 25423 tablet_bootstrap.cc:492] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:10.279779 25423 ts_tablet_manager.cc:1403] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.276s	user 0.027s	sys 0.026s
I20260709 12:25:10.282843 25419 ts_tablet_manager.cc:1403] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.379s	user 0.021s	sys 0.013s
I20260709 12:25:10.284135 25284 tablet_service.cc:1511] Processing CreateTablet for tablet 9c46968756c14269bc487ced0f6e74bd (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:10.285588 25284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c46968756c14269bc487ced0f6e74bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.286252 25135 tablet_service.cc:1511] Processing CreateTablet for tablet 9c46968756c14269bc487ced0f6e74bd (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:10.286181 25419 raft_consensus.cc:359] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:10.287781 25135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c46968756c14269bc487ced0f6e74bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.287982 25204 tablet_service.cc:1511] Processing CreateTablet for tablet bf2bfe7ad58c42f1aff0feb1c9880d9b (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:10.291714 25356 tablet_service.cc:1511] Processing CreateTablet for tablet 9c46968756c14269bc487ced0f6e74bd (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:10.279151 25205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4d589309f24d3e955fb45b2c6fe3af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.293268 25356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c46968756c14269bc487ced0f6e74bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.294304 25204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf2bfe7ad58c42f1aff0feb1c9880d9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.301083 25130 tablet_service.cc:1511] Processing CreateTablet for tablet eb4d589309f24d3e955fb45b2c6fe3af (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:10.302656 25130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4d589309f24d3e955fb45b2c6fe3af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.305083 25418 ts_tablet_manager.cc:1434] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.135s	user 0.007s	sys 0.001s
I20260709 12:25:10.287469 25419 raft_consensus.cc:385] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.261737 25438 raft_consensus.cc:515] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:10.311691 25421 tablet_bootstrap.cc:492] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:10.318558 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91840ed520ab444d9bd1acb13b5b6b89" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:10.320523 25148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91840ed520ab444d9bd1acb13b5b6b89" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:10.320571 25419 raft_consensus.cc:740] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.334628 25419 consensus_queue.cc:260] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:10.339425 25419 ts_tablet_manager.cc:1434] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 12:25:10.340639 25148 raft_consensus.cc:3060] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.341727 25361 tablet_service.cc:1511] Processing CreateTablet for tablet bf2bfe7ad58c42f1aff0feb1c9880d9b (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:10.343132 25361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf2bfe7ad58c42f1aff0feb1c9880d9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.323832 25418 tablet_bootstrap.cc:492] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:10.319188 25438 leader_election.cc:290] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:10.332208 25421 ts_tablet_manager.cc:1403] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.322s	user 0.031s	sys 0.021s
I20260709 12:25:10.350339 25286 tablet_service.cc:1511] Processing CreateTablet for tablet bf2bfe7ad58c42f1aff0feb1c9880d9b (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:10.351807 25286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf2bfe7ad58c42f1aff0feb1c9880d9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.354161 25133 tablet_service.cc:1511] Processing CreateTablet for tablet d072f6ab35314a9ebd29bbfe4d0eb1f0 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 12:25:10.344082 25260 leader_election.cc:343] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.340641 25419 tablet_bootstrap.cc:492] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:10.368001 25133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d072f6ab35314a9ebd29bbfe4d0eb1f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.363837 25211 tablet_service.cc:1511] Processing CreateTablet for tablet d072f6ab35314a9ebd29bbfe4d0eb1f0 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:25:10.394111 25135 tablet_service.cc:1511] Processing CreateTablet for tablet ef05435bfb3044ffb451ca8373c097c7 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:10.395135 25458 consensus_queue.cc:1048] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:10.395730 25135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef05435bfb3044ffb451ca8373c097c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.313200 25423 raft_consensus.cc:359] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:10.399945 25423 raft_consensus.cc:385] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.400377 25423 raft_consensus.cc:740] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.401325 25423 consensus_queue.cc:260] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
W20260709 12:25:10.409403 25335 consensus_peers.cc:597] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:10.416195 25205 tablet_service.cc:1511] Processing CreateTablet for tablet ef05435bfb3044ffb451ca8373c097c7 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:10.417587 25463 consensus_queue.cc:1048] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:10.421134 25429 raft_consensus.cc:493] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.421959 25429 raft_consensus.cc:515] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:10.425571 25422 raft_consensus.cc:493] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.426599 25422 raft_consensus.cc:515] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:10.430488 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc7a0e6ac8cd4e8eb2e4549b0f9b64f0" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:10.432068 25429 leader_election.cc:290] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:10.381232 25360 tablet_service.cc:1511] Processing CreateTablet for tablet ef05435bfb3044ffb451ca8373c097c7 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:10.449366 25360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef05435bfb3044ffb451ca8373c097c7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:10.450030 25263 consensus_peers.cc:597] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:10.449580 25361 tablet_service.cc:1511] Processing CreateTablet for tablet 58caedf294044506b135b8990d49e180 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:10.384073 25282 tablet_service.cc:1511] Processing CreateTablet for tablet d072f6ab35314a9ebd29bbfe4d0eb1f0 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:25:10.434962 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc7a0e6ac8cd4e8eb2e4549b0f9b64f0" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:10.436661 25422 leader_election.cc:290] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:10.453289 25282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d072f6ab35314a9ebd29bbfe4d0eb1f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.437115 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d13683d814408081fbbece9be522ed" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:10.437928 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d13683d814408081fbbece9be522ed" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:10.454802 25223 raft_consensus.cc:2468] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
W20260709 12:25:10.456278 25112 leader_election.cc:343] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.456868 25110 leader_election.cc:304] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:10.441001 25418 tablet_bootstrap.cc:654] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.439821 25423 ts_tablet_manager.cc:1434] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.124s	user 0.004s	sys 0.004s
W20260709 12:25:10.443974 25188 leader_election.cc:343] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.378767 25148 raft_consensus.cc:2468] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:10.461630 25422 raft_consensus.cc:2804] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.462109 25422 raft_consensus.cc:493] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.462468 25422 raft_consensus.cc:3060] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.464973 25211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d072f6ab35314a9ebd29bbfe4d0eb1f0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:10.465828 25189 leader_election.cc:343] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.471992 25263 leader_election.cc:304] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:10.473946 25463 raft_consensus.cc:2804] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:10.474722 25463 raft_consensus.cc:697] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:10.476027 25463 consensus_queue.cc:237] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:10.478232 25281 tablet_service.cc:1511] Processing CreateTablet for tablet 58caedf294044506b135b8990d49e180 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:10.481137 25133 tablet_service.cc:1511] Processing CreateTablet for tablet 58caedf294044506b135b8990d49e180 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:10.482468 25133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58caedf294044506b135b8990d49e180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.482892 25189 leader_election.cc:304] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:10.466956 25361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58caedf294044506b135b8990d49e180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.479671 25281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58caedf294044506b135b8990d49e180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.499641 25205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef05435bfb3044ffb451ca8373c097c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.501665 25210 tablet_service.cc:1511] Processing CreateTablet for tablet ffa2c58c6d37474c908e6f924b95db30 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:10.504328 25284 tablet_service.cc:1511] Processing CreateTablet for tablet ffa2c58c6d37474c908e6f924b95db30 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:10.505899 25284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa2c58c6d37474c908e6f924b95db30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.508673 25423 tablet_bootstrap.cc:492] T f4269cf1528545fd94e1d53fcf6cf48d P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:10.492311 25429 raft_consensus.cc:2749] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:10.521378 25421 raft_consensus.cc:359] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:10.522209 25421 raft_consensus.cc:385] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.522519 25421 raft_consensus.cc:740] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.524881 25438 raft_consensus.cc:493] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.525439 25438 raft_consensus.cc:515] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:10.527673 25438 leader_election.cc:290] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:10.528968 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc0dd4f13f243639d68c6d9a0e3afd3" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:10.529662 25438 consensus_queue.cc:1048] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:10.531384 25262 leader_election.cc:343] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:10.534557 25262 consensus_peers.cc:597] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Couldn't send request to peer 0fa8f2c80074488084fea821c4bb293d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:10.538745 25356 tablet_service.cc:1511] Processing CreateTablet for tablet ffa2c58c6d37474c908e6f924b95db30 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:10.540251 25356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa2c58c6d37474c908e6f924b95db30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.546082 25133 tablet_service.cc:1511] Processing CreateTablet for tablet 574e4322900441a18f11a2568ab6fd64 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:10.547504 25133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574e4322900441a18f11a2568ab6fd64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.523861 25421 consensus_queue.cc:260] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:10.549191 25204 tablet_service.cc:1511] Processing CreateTablet for tablet 574e4322900441a18f11a2568ab6fd64 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:10.547430 25419 tablet_bootstrap.cc:654] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.550690 25421 ts_tablet_manager.cc:1434] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.192s	user 0.004s	sys 0.003s
I20260709 12:25:10.576995 25210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa2c58c6d37474c908e6f924b95db30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.577831 25421 tablet_bootstrap.cc:492] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:10.580789 25204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574e4322900441a18f11a2568ab6fd64. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:10.594525 25260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:41903, user_credentials={real_user=slave}} blocked reactor thread for 66466.6us
W20260709 12:25:10.607107 25092 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:10.642494 25423 tablet_bootstrap.cc:700] T f4269cf1528545fd94e1d53fcf6cf48d P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent opening tablet: real 0.107s	user 0.004s	sys 0.000s
I20260709 12:25:10.643283 25423 tablet_bootstrap.cc:654] T f4269cf1528545fd94e1d53fcf6cf48d P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.583032 25285 tablet_service.cc:1511] Processing CreateTablet for tablet 574e4322900441a18f11a2568ab6fd64 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:10.651124 25418 tablet_bootstrap.cc:492] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:10.651432 25285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574e4322900441a18f11a2568ab6fd64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.651145 25133 tablet_service.cc:1511] Processing CreateTablet for tablet e01f82f06bdb4424b0d871882d6c8c3b (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:10.656031 25356 tablet_service.cc:1511] Processing CreateTablet for tablet e01f82f06bdb4424b0d871882d6c8c3b (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:10.656311 25133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e01f82f06bdb4424b0d871882d6c8c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.657109 25356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e01f82f06bdb4424b0d871882d6c8c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.659548 25421 tablet_bootstrap.cc:654] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.655037 25418 ts_tablet_manager.cc:1403] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.328s	user 0.010s	sys 0.011s
I20260709 12:25:10.669996 25418 raft_consensus.cc:359] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:10.670794 25418 raft_consensus.cc:385] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.671123 25418 raft_consensus.cc:740] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.672241 25205 tablet_service.cc:1511] Processing CreateTablet for tablet e01f82f06bdb4424b0d871882d6c8c3b (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:10.673542 25205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e01f82f06bdb4424b0d871882d6c8c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.670799 25148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc0dd4f13f243639d68c6d9a0e3afd3" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:10.676537 25148 raft_consensus.cc:2468] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 0.
I20260709 12:25:10.678664 25422 raft_consensus.cc:515] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:10.682286 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d13683d814408081fbbece9be522ed" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:10.682972 25221 raft_consensus.cc:3060] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.682921 25283 tablet_service.cc:1511] Processing CreateTablet for tablet 2b324fb11adf4924bd497717bc12ff4c (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:10.684192 25354 tablet_service.cc:1511] Processing CreateTablet for tablet 2b324fb11adf4924bd497717bc12ff4c (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:10.684689 25283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b324fb11adf4924bd497717bc12ff4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.685518 25354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b324fb11adf4924bd497717bc12ff4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.690047 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d13683d814408081fbbece9be522ed" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:10.691018 25263 leader_election.cc:304] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:10.691937 25477 raft_consensus.cc:2804] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.692351 25477 raft_consensus.cc:493] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.692678 25477 raft_consensus.cc:3060] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.693161 25422 leader_election.cc:290] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
W20260709 12:25:10.693835 25112 leader_election.cc:343] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.705606 25043 catalog_manager.cc:5697] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 0 to 1, leader changed from <none> to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:10.707795 25043 catalog_manager.cc:5697] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 0 to 1, leader changed from <none> to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:10.721057 25477 raft_consensus.cc:515] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:10.724320 25148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc0dd4f13f243639d68c6d9a0e3afd3" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:10.724983 25148 raft_consensus.cc:3060] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.732101 25418 consensus_queue.cc:260] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:10.733896 25148 raft_consensus.cc:2468] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:10.734629 25418 ts_tablet_manager.cc:1434] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.000s
I20260709 12:25:10.736415 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc0dd4f13f243639d68c6d9a0e3afd3" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:10.770694 25263 leader_election.cc:304] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:10.771554 25133 tablet_service.cc:1511] Processing CreateTablet for tablet 2b324fb11adf4924bd497717bc12ff4c (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:10.758877 25422 raft_consensus.cc:493] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.773681 25133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b324fb11adf4924bd497717bc12ff4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.751178 25477 leader_election.cc:290] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Requested vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:10.785434 25418 tablet_bootstrap.cc:492] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:10.774166 25422 raft_consensus.cc:515] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:10.771629 25438 raft_consensus.cc:2804] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:25:10.813504 25262 leader_election.cc:343] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.813892 25204 tablet_service.cc:1511] Processing CreateTablet for tablet 969efca8af254e2e885d546c22e637aa (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:25:10.814170 25130 tablet_service.cc:1511] Processing CreateTablet for tablet 1b4c35aae32446d4895fa10bcdc4d1eb (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:10.815304 25204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 969efca8af254e2e885d546c22e637aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.816681 25422 leader_election.cc:290] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:10.820039 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb0eab5dcee4f95b7c284dea379c795" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:10.820571 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb0eab5dcee4f95b7c284dea379c795" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:10.821256 25371 raft_consensus.cc:2468] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
W20260709 12:25:10.822093 25113 leader_election.cc:343] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.822677 25113 leader_election.cc:304] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c; no voters: a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:10.825659 25422 raft_consensus.cc:2804] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.826485 25422 raft_consensus.cc:493] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.826874 25422 raft_consensus.cc:3060] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.815590 25130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4c35aae32446d4895fa10bcdc4d1eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.828305 25423 tablet_bootstrap.cc:492] T f4269cf1528545fd94e1d53fcf6cf48d P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:10.828857 25423 ts_tablet_manager.cc:1403] T f4269cf1528545fd94e1d53fcf6cf48d P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.336s	user 0.026s	sys 0.015s
I20260709 12:25:10.805847 25438 raft_consensus.cc:697] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:10.830994 25438 consensus_queue.cc:237] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:10.804813 25221 raft_consensus.cc:2468] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 1.
I20260709 12:25:10.836306 25110 leader_election.cc:304] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
W20260709 12:25:10.779083 25338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:45473, user_credentials={real_user=slave}} blocked reactor thread for 44046.1us
I20260709 12:25:10.852824 25286 tablet_service.cc:1511] Processing CreateTablet for tablet 969efca8af254e2e885d546c22e637aa (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:25:10.854591 25286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 969efca8af254e2e885d546c22e637aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.860728 25211 tablet_service.cc:1511] Processing CreateTablet for tablet 1b4c35aae32446d4895fa10bcdc4d1eb (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:10.870188 25281 tablet_service.cc:1511] Processing CreateTablet for tablet 1b4c35aae32446d4895fa10bcdc4d1eb (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:10.871021 25283 tablet_service.cc:1511] Processing CreateTablet for tablet 05b8c7cdce0c46fdb50c370f6f53001e (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:10.872386 25283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b8c7cdce0c46fdb50c370f6f53001e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.873819 25419 tablet_bootstrap.cc:492] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:10.874271 25281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4c35aae32446d4895fa10bcdc4d1eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.874383 25419 ts_tablet_manager.cc:1403] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.534s	user 0.015s	sys 0.011s
I20260709 12:25:10.874661 25210 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd48573282443f78bd7580dcd9c4bc2 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:10.876250 25361 tablet_service.cc:1511] Processing CreateTablet for tablet 969efca8af254e2e885d546c22e637aa (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:25:10.878809 25361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 969efca8af254e2e885d546c22e637aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.879122 25356 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd48573282443f78bd7580dcd9c4bc2 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:10.880283 25356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd48573282443f78bd7580dcd9c4bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.882223 25423 raft_consensus.cc:359] T f4269cf1528545fd94e1d53fcf6cf48d P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:10.882997 25423 raft_consensus.cc:385] T f4269cf1528545fd94e1d53fcf6cf48d P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.883287 25423 raft_consensus.cc:740] T f4269cf1528545fd94e1d53fcf6cf48d P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.884146 25360 tablet_service.cc:1511] Processing CreateTablet for tablet 05b8c7cdce0c46fdb50c370f6f53001e (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:10.885500 25360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b8c7cdce0c46fdb50c370f6f53001e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.886759 25422 raft_consensus.cc:515] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:10.889988 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb0eab5dcee4f95b7c284dea379c795" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
W20260709 12:25:10.891580 25113 leader_election.cc:343] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.894460 25210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd48573282443f78bd7580dcd9c4bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.877930 25419 raft_consensus.cc:359] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:10.896301 25211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4c35aae32446d4895fa10bcdc4d1eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.896494 25419 raft_consensus.cc:385] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.898679 25419 raft_consensus.cc:740] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.901194 25418 tablet_bootstrap.cc:654] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.924288 25422 leader_election.cc:290] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:10.925104 25422 raft_consensus.cc:2804] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:10.925684 25422 raft_consensus.cc:697] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:10.926628 25422 consensus_queue.cc:237] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:10.927086 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb0eab5dcee4f95b7c284dea379c795" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:10.927836 25371 raft_consensus.cc:3060] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.899801 25419 consensus_queue.cc:260] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:10.932662 25045 catalog_manager.cc:5697] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 0 to 1, leader changed from <none> to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:10.933429 25110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:41903, user_credentials={real_user=slave}} blocked reactor thread for 97227.9us
I20260709 12:25:10.934001 25438 consensus_queue.cc:1048] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:10.951661 25371 raft_consensus.cc:2468] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 1.
I20260709 12:25:10.935019 25423 consensus_queue.cc:260] T f4269cf1528545fd94e1d53fcf6cf48d P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:10.956879 25490 raft_consensus.cc:493] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.958674 25490 raft_consensus.cc:515] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:10.958151 25419 ts_tablet_manager.cc:1434] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.004s
I20260709 12:25:10.958151 25423 ts_tablet_manager.cc:1434] T f4269cf1528545fd94e1d53fcf6cf48d P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.129s	user 0.007s	sys 0.001s
I20260709 12:25:10.966321 25419 tablet_bootstrap.cc:492] T 91840ed520ab444d9bd1acb13b5b6b89 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:10.967020 25458 raft_consensus.cc:493] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.967578 25458 raft_consensus.cc:515] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:10.969982 25458 leader_election.cc:290] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:10.970752 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc7a0e6ac8cd4e8eb2e4549b0f9b64f0" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:10.971521 25223 raft_consensus.cc:2468] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 0.
I20260709 12:25:10.971995 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc7a0e6ac8cd4e8eb2e4549b0f9b64f0" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:10.973249 25335 leader_election.cc:304] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
W20260709 12:25:10.974124 25338 leader_election.cc:343] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.974300 25458 raft_consensus.cc:2804] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.975517 25458 raft_consensus.cc:493] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.976212 25458 raft_consensus.cc:3060] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.991102 25423 tablet_bootstrap.cc:492] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:10.991381 25421 tablet_bootstrap.cc:492] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:10.992053 25421 ts_tablet_manager.cc:1403] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.414s	user 0.044s	sys 0.021s
I20260709 12:25:10.997284 25112 leader_election.cc:304] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c; no voters: a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:11.002077 25421 raft_consensus.cc:359] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:11.003114 25421 raft_consensus.cc:385] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.003532 25421 raft_consensus.cc:740] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.004583 25421 consensus_queue.cc:260] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:11.002818 25491 raft_consensus.cc:2804] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:11.008977 25491 raft_consensus.cc:697] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:11.009907 25491 consensus_queue.cc:237] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.017993 25421 ts_tablet_manager.cc:1434] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 12:25:11.018997 25418 tablet_bootstrap.cc:492] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:11.019577 25418 ts_tablet_manager.cc:1403] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.234s	user 0.016s	sys 0.003s
I20260709 12:25:11.021602 25490 leader_election.cc:290] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:11.024523 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a616947e81bf446584593e882f8bdeaa" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:11.027318 25130 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd48573282443f78bd7580dcd9c4bc2 (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:11.016294 25458 raft_consensus.cc:515] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
W20260709 12:25:11.029392 25112 leader_election.cc:343] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.030056 25418 raft_consensus.cc:359] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:11.030943 25418 raft_consensus.cc:385] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.031283 25418 raft_consensus.cc:740] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.032285 25419 tablet_bootstrap.cc:654] T 91840ed520ab444d9bd1acb13b5b6b89 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.033059 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc7a0e6ac8cd4e8eb2e4549b0f9b64f0" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:11.033675 25223 raft_consensus.cc:3060] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.034947 25418 consensus_queue.cc:260] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:11.035964 25429 raft_consensus.cc:493] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.036471 25429 raft_consensus.cc:515] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:11.038620 25429 leader_election.cc:290] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:11.041036 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4269cf1528545fd94e1d53fcf6cf48d" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:11.041708 25147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4269cf1528545fd94e1d53fcf6cf48d" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:11.042495 25458 leader_election.cc:290] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:11.043314 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc7a0e6ac8cd4e8eb2e4549b0f9b64f0" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
W20260709 12:25:11.044848 25189 leader_election.cc:343] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:11.045334 25338 leader_election.cc:343] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.041800 25298 raft_consensus.cc:2468] T f4269cf1528545fd94e1d53fcf6cf48d P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:11.047130 25418 ts_tablet_manager.cc:1434] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:25:11.040587 25130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd48573282443f78bd7580dcd9c4bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.047453 25189 leader_election.cc:304] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:11.048976 25429 raft_consensus.cc:2804] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:11.049376 25429 raft_consensus.cc:493] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.030674 25421 tablet_bootstrap.cc:492] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:11.049737 25429 raft_consensus.cc:3060] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.051278 25418 tablet_bootstrap.cc:492] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:11.057840 25423 tablet_bootstrap.cc:654] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.057956 25133 tablet_service.cc:1511] Processing CreateTablet for tablet 05b8c7cdce0c46fdb50c370f6f53001e (DEFAULT_TABLE table=test-workload [id=30cefe08ff1a4f0f8fc37f0e95808b3b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:11.059309 25133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b8c7cdce0c46fdb50c370f6f53001e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.060133 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a616947e81bf446584593e882f8bdeaa" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
W20260709 12:25:11.061817 25110 leader_election.cc:343] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.062284 25110 leader_election.cc:304] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:11.063190 25491 raft_consensus.cc:2749] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:11.063537 25260 consensus_peers.cc:597] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:11.068564 25418 tablet_bootstrap.cc:654] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.055537 25045 catalog_manager.cc:5697] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 1 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:11.071359 25223 raft_consensus.cc:2468] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 1.
I20260709 12:25:11.073199 25335 leader_election.cc:304] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:11.074584 25458 raft_consensus.cc:2804] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:11.075992 25458 raft_consensus.cc:697] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [term 1 LEADER]: Becoming Leader. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Running, Role: LEADER
I20260709 12:25:11.076898 25458 consensus_queue.cc:237] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:11.081789 25421 tablet_bootstrap.cc:654] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.079284 25429 raft_consensus.cc:515] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:11.088845 25429 leader_election.cc:290] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Requested vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:11.091208 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4269cf1528545fd94e1d53fcf6cf48d" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:11.092300 25298 raft_consensus.cc:3060] T f4269cf1528545fd94e1d53fcf6cf48d P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.093566 25419 tablet_bootstrap.cc:492] T 91840ed520ab444d9bd1acb13b5b6b89 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:11.094165 25419 ts_tablet_manager.cc:1403] T 91840ed520ab444d9bd1acb13b5b6b89 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.128s	user 0.014s	sys 0.000s
I20260709 12:25:11.095160 25418 tablet_bootstrap.cc:492] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:11.095709 25418 ts_tablet_manager.cc:1403] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.007s
I20260709 12:25:11.097646 25419 raft_consensus.cc:359] T 91840ed520ab444d9bd1acb13b5b6b89 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:11.098459 25419 raft_consensus.cc:385] T 91840ed520ab444d9bd1acb13b5b6b89 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.098771 25419 raft_consensus.cc:740] T 91840ed520ab444d9bd1acb13b5b6b89 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.098608 25043 catalog_manager.cc:5697] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fa8f2c80074488084fea821c4bb293d (127.16.240.132). New cstate: current_term: 1 leader_uuid: "0fa8f2c80074488084fea821c4bb293d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:11.102371 25423 tablet_bootstrap.cc:492] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:11.102936 25423 ts_tablet_manager.cc:1403] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.112s	user 0.008s	sys 0.006s
I20260709 12:25:11.105886 25423 raft_consensus.cc:359] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:11.106623 25423 raft_consensus.cc:385] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.106901 25423 raft_consensus.cc:740] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.107556 25423 consensus_queue.cc:260] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:11.109800 25423 ts_tablet_manager.cc:1434] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:25:11.110589 25419 consensus_queue.cc:260] T 91840ed520ab444d9bd1acb13b5b6b89 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:11.098601 25418 raft_consensus.cc:359] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:11.111704 25418 raft_consensus.cc:385] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.111784 25421 tablet_bootstrap.cc:492] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:11.112087 25418 raft_consensus.cc:740] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.112532 25421 ts_tablet_manager.cc:1403] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.082s	user 0.013s	sys 0.002s
I20260709 12:25:11.112829 25418 consensus_queue.cc:260] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:11.113399 25419 ts_tablet_manager.cc:1434] T 91840ed520ab444d9bd1acb13b5b6b89 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:25:11.114835 25419 tablet_bootstrap.cc:492] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:11.115025 25418 ts_tablet_manager.cc:1434] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 12:25:11.116077 25418 tablet_bootstrap.cc:492] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:11.116514 25421 raft_consensus.cc:359] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:11.117329 25421 raft_consensus.cc:385] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.117673 25421 raft_consensus.cc:740] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.118170 25045 catalog_manager.cc:5697] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 1 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:11.118660 25421 consensus_queue.cc:260] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:11.124037 25423 tablet_bootstrap.cc:492] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:11.125617 25421 ts_tablet_manager.cc:1434] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:25:11.127040 25421 tablet_bootstrap.cc:492] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:11.130337 25423 tablet_bootstrap.cc:654] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.132247 25418 tablet_bootstrap.cc:654] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.122964 25419 tablet_bootstrap.cc:654] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.134477 25421 tablet_bootstrap.cc:654] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.147605 25148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4269cf1528545fd94e1d53fcf6cf48d" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
W20260709 12:25:11.149273 25189 leader_election.cc:343] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.152984 25423 tablet_bootstrap.cc:492] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:11.153546 25423 ts_tablet_manager.cc:1403] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.001s
I20260709 12:25:11.154215 25421 tablet_bootstrap.cc:492] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:11.154855 25421 ts_tablet_manager.cc:1403] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.013s
I20260709 12:25:11.156513 25423 raft_consensus.cc:359] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.157330 25423 raft_consensus.cc:385] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.157709 25423 raft_consensus.cc:740] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.158464 25423 consensus_queue.cc:260] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.159081 25421 raft_consensus.cc:359] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.161443 25421 raft_consensus.cc:385] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.161861 25421 raft_consensus.cc:740] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.165771 25418 tablet_bootstrap.cc:492] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:11.166371 25418 ts_tablet_manager.cc:1403] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.000s
I20260709 12:25:11.169864 25418 raft_consensus.cc:359] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:11.170825 25421 consensus_queue.cc:260] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.170859 25298 raft_consensus.cc:2468] T f4269cf1528545fd94e1d53fcf6cf48d P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:11.175470 25189 leader_election.cc:304] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:11.176739 25429 raft_consensus.cc:2804] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:11.177168 25419 tablet_bootstrap.cc:492] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:11.177814 25419 ts_tablet_manager.cc:1403] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.008s
I20260709 12:25:11.172838 25418 raft_consensus.cc:385] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.180684 25418 raft_consensus.cc:740] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.185060 25419 raft_consensus.cc:359] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.186678 25423 ts_tablet_manager.cc:1434] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 12:25:11.187238 25419 raft_consensus.cc:385] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.187662 25419 raft_consensus.cc:740] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.188446 25423 tablet_bootstrap.cc:492] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:11.188488 25419 consensus_queue.cc:260] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.190974 25418 consensus_queue.cc:260] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:11.193547 25478 raft_consensus.cc:493] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.194340 25478 raft_consensus.cc:515] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:11.196172 25491 raft_consensus.cc:493] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.196887 25491 raft_consensus.cc:515] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:11.199808 25418 ts_tablet_manager.cc:1434] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.001s
I20260709 12:25:11.200913 25418 tablet_bootstrap.cc:492] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:11.206785 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935b81351905468d8fa751d430f33ef2" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:11.212544 25419 ts_tablet_manager.cc:1434] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.034s	user 0.016s	sys 0.013s
I20260709 12:25:11.213106 25485 raft_consensus.cc:493] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.213827 25419 tablet_bootstrap.cc:492] T dcf5a5e68833468a8206894be4a16f56 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:11.213688 25485 raft_consensus.cc:515] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:11.208444 25458 raft_consensus.cc:493] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.216594 25458 raft_consensus.cc:515] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:11.218943 25458 leader_election.cc:290] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:11.209306 25421 ts_tablet_manager.cc:1434] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.000s
I20260709 12:25:11.220850 25421 tablet_bootstrap.cc:492] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:11.221153 25419 tablet_bootstrap.cc:654] T dcf5a5e68833468a8206894be4a16f56 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.221122 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935b81351905468d8fa751d430f33ef2" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:11.223330 25113 leader_election.cc:304] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:11.224395 25422 raft_consensus.cc:2749] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:11.225252 25148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc0dd4f13f243639d68c6d9a0e3afd3" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:11.226315 25148 raft_consensus.cc:2393] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fa8f2c80074488084fea821c4bb293d in current term 1: Already voted for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in this term.
I20260709 12:25:11.226452 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d9a9f4ef849db8e59fad827bc81d0" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:11.225271 25147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d9a9f4ef849db8e59fad827bc81d0" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:11.227097 25223 raft_consensus.cc:2468] T 272d9a9f4ef849db8e59fad827bc81d0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 0.
I20260709 12:25:11.228081 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc7a0e6ac8cd4e8eb2e4549b0f9b64f0" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:11.228605 25335 leader_election.cc:304] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:11.229141 25222 raft_consensus.cc:2393] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a28f2edcd70f4eb08f16021ba3e2cf14 in current term 1: Already voted for candidate 0fa8f2c80074488084fea821c4bb293d in this term.
W20260709 12:25:11.230094 25338 leader_election.cc:343] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.216584 25485 leader_election.cc:290] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:11.230829 25458 raft_consensus.cc:2804] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:11.231319 25458 raft_consensus.cc:493] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.231630 25458 raft_consensus.cc:3060] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.225244 25491 leader_election.cc:290] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:11.236672 25419 tablet_bootstrap.cc:492] T dcf5a5e68833468a8206894be4a16f56 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:11.237111 25429 raft_consensus.cc:697] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:11.233278 25478 leader_election.cc:290] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:11.237251 25419 ts_tablet_manager.cc:1403] T dcf5a5e68833468a8206894be4a16f56 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.005s
I20260709 12:25:11.238319 25429 consensus_queue.cc:237] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:11.210368 25418 tablet_bootstrap.cc:654] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.239624 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc7a0e6ac8cd4e8eb2e4549b0f9b64f0" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:11.241025 25419 raft_consensus.cc:359] T dcf5a5e68833468a8206894be4a16f56 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:11.241402 25262 leader_election.cc:304] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:11.241775 25419 raft_consensus.cc:385] T dcf5a5e68833468a8206894be4a16f56 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.242276 25478 raft_consensus.cc:3060] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.209649 25423 tablet_bootstrap.cc:654] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.242084 25419 raft_consensus.cc:740] T dcf5a5e68833468a8206894be4a16f56 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.253096 25419 consensus_queue.cc:260] T dcf5a5e68833468a8206894be4a16f56 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:11.227020 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc0dd4f13f243639d68c6d9a0e3afd3" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:11.255613 25419 ts_tablet_manager.cc:1434] T dcf5a5e68833468a8206894be4a16f56 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 12:25:11.256300 25338 leader_election.cc:304] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:11.256677 25419 tablet_bootstrap.cc:492] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:11.257570 25485 raft_consensus.cc:3060] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.243050 25458 raft_consensus.cc:515] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:11.262403 25147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d9a9f4ef849db8e59fad827bc81d0" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:11.263422 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272d9a9f4ef849db8e59fad827bc81d0" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
W20260709 12:25:11.264043 25338 leader_election.cc:343] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.252120 25478 raft_consensus.cc:2749] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:11.264484 25222 raft_consensus.cc:3060] T 272d9a9f4ef849db8e59fad827bc81d0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.263975 25419 tablet_bootstrap.cc:654] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.247663 25421 tablet_bootstrap.cc:654] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.280927 25222 raft_consensus.cc:2468] T 272d9a9f4ef849db8e59fad827bc81d0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 1.
I20260709 12:25:11.282991 25335 leader_election.cc:304] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:11.284642 25480 raft_consensus.cc:2804] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:11.296355 25458 leader_election.cc:290] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Requested vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:11.301733 25508 raft_consensus.cc:493] T dcf5a5e68833468a8206894be4a16f56 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.301981 25491 raft_consensus.cc:493] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.302357 25508 raft_consensus.cc:515] T dcf5a5e68833468a8206894be4a16f56 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:11.302637 25491 raft_consensus.cc:515] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:11.306124 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf5a5e68833468a8206894be4a16f56" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:11.307911 25491 leader_election.cc:290] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:11.309789 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4269cf1528545fd94e1d53fcf6cf48d" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:11.309922 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4269cf1528545fd94e1d53fcf6cf48d" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:11.311194 25298 raft_consensus.cc:2393] T f4269cf1528545fd94e1d53fcf6cf48d P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 434d5783f9374eab8f587e0fe6c15b1c in current term 1: Already voted for candidate d3979c425abd4ac7b2ca30e1dec9a154 in this term.
I20260709 12:25:11.308147 25508 leader_election.cc:290] T dcf5a5e68833468a8206894be4a16f56 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:11.298493 25480 raft_consensus.cc:697] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [term 1 LEADER]: Becoming Leader. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Running, Role: LEADER
I20260709 12:25:11.318871 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf5a5e68833468a8206894be4a16f56" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:11.320796 25189 leader_election.cc:304] T dcf5a5e68833468a8206894be4a16f56 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:11.321569 25113 leader_election.cc:304] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:11.322197 25419 tablet_bootstrap.cc:492] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:11.322458 25429 raft_consensus.cc:2749] T dcf5a5e68833468a8206894be4a16f56 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:11.322705 25419 ts_tablet_manager.cc:1403] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.066s	user 0.020s	sys 0.019s
I20260709 12:25:11.322853 25491 raft_consensus.cc:3060] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.320611 25423 tablet_bootstrap.cc:492] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:11.325143 25423 ts_tablet_manager.cc:1403] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.137s	user 0.027s	sys 0.001s
I20260709 12:25:11.325891 25419 raft_consensus.cc:359] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:11.326599 25419 raft_consensus.cc:385] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.326853 25419 raft_consensus.cc:740] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.328004 25423 raft_consensus.cc:359] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.328773 25423 raft_consensus.cc:385] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.329067 25423 raft_consensus.cc:740] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.327557 25419 consensus_queue.cc:260] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:11.328135 25480 consensus_queue.cc:237] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:11.329759 25423 consensus_queue.cc:260] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.330878 25485 raft_consensus.cc:2749] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:11.332531 25463 raft_consensus.cc:493] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.332973 25423 ts_tablet_manager.cc:1434] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:25:11.334290 25423 tablet_bootstrap.cc:492] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:11.333091 25463 raft_consensus.cc:515] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.335887 25477 consensus_queue.cc:1048] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:11.336967 25463 leader_election.cc:290] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:11.338193 25147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb0eab5dcee4f95b7c284dea379c795" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:11.338478 25042 catalog_manager.cc:5697] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:11.340330 25423 tablet_bootstrap.cc:654] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.330734 25478 raft_consensus.cc:493] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.341208 25478 raft_consensus.cc:515] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.344875 25419 ts_tablet_manager.cc:1434] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:25:11.345965 25419 tablet_bootstrap.cc:492] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:11.346117 25421 tablet_bootstrap.cc:492] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:11.346607 25421 ts_tablet_manager.cc:1403] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.126s	user 0.009s	sys 0.004s
I20260709 12:25:11.350026 25485 raft_consensus.cc:493] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.349637 25421 raft_consensus.cc:359] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:11.350585 25421 raft_consensus.cc:385] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.351018 25421 raft_consensus.cc:740] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.350617 25485 raft_consensus.cc:515] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.352440 25491 raft_consensus.cc:2749] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:11.352849 25478 leader_election.cc:290] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:11.358788 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb0eab5dcee4f95b7c284dea379c795" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:11.359027 25418 tablet_bootstrap.cc:492] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:11.360002 25418 ts_tablet_manager.cc:1403] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.159s	user 0.018s	sys 0.019s
I20260709 12:25:11.360826 25371 raft_consensus.cc:2393] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a28f2edcd70f4eb08f16021ba3e2cf14 in current term 1: Already voted for candidate 434d5783f9374eab8f587e0fe6c15b1c in this term.
I20260709 12:25:11.361604 25147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba86635097441c08a6ca206ab0bfe9a" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:11.362152 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba86635097441c08a6ca206ab0bfe9a" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:11.362540 25147 raft_consensus.cc:2468] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 0.
I20260709 12:25:11.362905 25298 raft_consensus.cc:2468] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 0.
I20260709 12:25:11.364444 25338 leader_election.cc:304] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:11.365849 25514 raft_consensus.cc:2804] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:11.366245 25514 raft_consensus.cc:493] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.366570 25514 raft_consensus.cc:3060] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.367672 25262 leader_election.cc:304] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:11.364283 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba86635097441c08a6ca206ab0bfe9a" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:11.355383 25485 leader_election.cc:290] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:11.369318 25478 raft_consensus.cc:3060] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.368893 25263 leader_election.cc:304] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:11.372664 25463 raft_consensus.cc:2804] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:11.373055 25463 raft_consensus.cc:493] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.373385 25463 raft_consensus.cc:3060] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.376194 25147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba86635097441c08a6ca206ab0bfe9a" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:11.377291 25147 raft_consensus.cc:2468] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 0.
I20260709 12:25:11.380987 25491 raft_consensus.cc:493] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.381325 25478 raft_consensus.cc:2749] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:11.384615 25463 raft_consensus.cc:515] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.360105 25421 consensus_queue.cc:260] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:11.388211 25491 raft_consensus.cc:515] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:11.395239 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e2e1ecd7474df9add48f60c06a4a0f" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:11.395320 25491 leader_election.cc:290] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:11.395889 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e2e1ecd7474df9add48f60c06a4a0f" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:11.397221 25371 raft_consensus.cc:2468] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
W20260709 12:25:11.397432 25110 leader_election.cc:343] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.400229 25045 catalog_manager.cc:5697] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fa8f2c80074488084fea821c4bb293d (127.16.240.132). New cstate: current_term: 1 leader_uuid: "0fa8f2c80074488084fea821c4bb293d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:11.401521 25418 raft_consensus.cc:359] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:11.402315 25418 raft_consensus.cc:385] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.402665 25418 raft_consensus.cc:740] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.403481 25369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba86635097441c08a6ca206ab0bfe9a" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:11.405783 25112 leader_election.cc:304] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c; no voters: d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:11.407862 25463 leader_election.cc:290] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:11.408473 25421 ts_tablet_manager.cc:1434] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 12:25:11.409098 25147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba86635097441c08a6ca206ab0bfe9a" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:11.403589 25418 consensus_queue.cc:260] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:11.410837 25491 raft_consensus.cc:2804] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:11.411270 25491 raft_consensus.cc:493] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.411602 25491 raft_consensus.cc:3060] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.410831 25147 raft_consensus.cc:3060] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.416101 25369 raft_consensus.cc:3060] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.418989 25421 tablet_bootstrap.cc:492] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:11.421486 25514 raft_consensus.cc:515] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.422835 25370 raft_consensus.cc:2393] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a28f2edcd70f4eb08f16021ba3e2cf14 in current term 1: Already voted for candidate 0fa8f2c80074488084fea821c4bb293d in this term.
I20260709 12:25:11.423177 25147 raft_consensus.cc:2468] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:11.424612 25514 leader_election.cc:290] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:11.426005 25419 tablet_bootstrap.cc:654] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.426712 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba86635097441c08a6ca206ab0bfe9a" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:11.427635 25418 ts_tablet_manager.cc:1434] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.002s
I20260709 12:25:11.429140 25418 tablet_bootstrap.cc:492] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:11.427619 25298 raft_consensus.cc:2393] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0fa8f2c80074488084fea821c4bb293d in current term 1: Already voted for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in this term.
I20260709 12:25:11.429005 25491 raft_consensus.cc:515] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:11.434047 25423 tablet_bootstrap.cc:492] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:11.434703 25423 ts_tablet_manager.cc:1403] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.101s	user 0.034s	sys 0.022s
I20260709 12:25:11.438285 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e2e1ecd7474df9add48f60c06a4a0f" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:11.438573 25223 raft_consensus.cc:3060] T dcf5a5e68833468a8206894be4a16f56 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.439574 25263 leader_election.cc:304] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:11.441041 25463 raft_consensus.cc:2804] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:11.441573 25463 raft_consensus.cc:697] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:11.434823 25491 leader_election.cc:290] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:11.442476 25463 consensus_queue.cc:237] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
W20260709 12:25:11.444325 25110 leader_election.cc:343] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.444917 25418 tablet_bootstrap.cc:654] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.446215 25421 tablet_bootstrap.cc:654] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.447431 25369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e2e1ecd7474df9add48f60c06a4a0f" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:11.439427 25423 raft_consensus.cc:359] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:11.448134 25423 raft_consensus.cc:385] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.448493 25423 raft_consensus.cc:740] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.449278 25423 consensus_queue.cc:260] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:11.450160 25491 consensus_queue.cc:1048] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:11.451610 25423 ts_tablet_manager.cc:1434] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:25:11.452914 25423 tablet_bootstrap.cc:492] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:11.448149 25369 raft_consensus.cc:3060] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.462404 25147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba86635097441c08a6ca206ab0bfe9a" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:11.462949 25423 tablet_bootstrap.cc:654] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.469684 25147 raft_consensus.cc:2393] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0fa8f2c80074488084fea821c4bb293d in current term 1: Already voted for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in this term.
I20260709 12:25:11.471179 25429 raft_consensus.cc:493] T 91840ed520ab444d9bd1acb13b5b6b89 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.472432 25429 raft_consensus.cc:515] T 91840ed520ab444d9bd1acb13b5b6b89 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:11.429533 25478 consensus_queue.cc:1048] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260709 12:25:11.476501 25507 raft_consensus.cc:493] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.477083 25507 raft_consensus.cc:515] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:11.479372 25507 leader_election.cc:290] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:11.479708 25148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91840ed520ab444d9bd1acb13b5b6b89" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:11.477440 25429 leader_election.cc:290] T 91840ed520ab444d9bd1acb13b5b6b89 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:11.484879 25338 leader_election.cc:304] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:11.481534 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91840ed520ab444d9bd1acb13b5b6b89" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:11.486093 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37de5b1c577f426488d8649c7b56a9a0" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:11.486322 25147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37de5b1c577f426488d8649c7b56a9a0" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:11.486850 25297 raft_consensus.cc:2468] T 37de5b1c577f426488d8649c7b56a9a0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:11.486929 25147 raft_consensus.cc:2468] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:11.487989 25514 raft_consensus.cc:2749] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:11.483163 25491 consensus_queue.cc:1048] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:25:11.493875 25189 leader_election.cc:304] T 91840ed520ab444d9bd1acb13b5b6b89 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:11.495147 25507 raft_consensus.cc:2749] T 91840ed520ab444d9bd1acb13b5b6b89 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:11.495695 25189 leader_election.cc:304] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:11.497042 25507 raft_consensus.cc:2804] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:11.503877 25418 tablet_bootstrap.cc:492] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:11.504437 25418 ts_tablet_manager.cc:1403] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.076s	user 0.017s	sys 0.010s
I20260709 12:25:11.507359 25418 raft_consensus.cc:359] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:11.508091 25418 raft_consensus.cc:385] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.508378 25418 raft_consensus.cc:740] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.507128 25045 catalog_manager.cc:5697] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 0 to 1, leader changed from <none> to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:11.512344 25418 consensus_queue.cc:260] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:11.515815 25429 raft_consensus.cc:493] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.516394 25429 raft_consensus.cc:515] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.517778 25419 tablet_bootstrap.cc:492] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:11.517979 25369 raft_consensus.cc:2468] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 1.
I20260709 12:25:11.518340 25419 ts_tablet_manager.cc:1403] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.173s	user 0.009s	sys 0.012s
I20260709 12:25:11.519255 25421 tablet_bootstrap.cc:492] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:11.497876 25507 raft_consensus.cc:493] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.519774 25421 ts_tablet_manager.cc:1403] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.101s	user 0.011s	sys 0.006s
I20260709 12:25:11.520099 25146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a616947e81bf446584593e882f8bdeaa" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:11.527098 25146 raft_consensus.cc:2468] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:11.527303 25418 ts_tablet_manager.cc:1434] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:25:11.517792 25147 raft_consensus.cc:3060] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.529170 25189 leader_election.cc:304] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:11.530124 25508 raft_consensus.cc:2804] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:11.530601 25508 raft_consensus.cc:493] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.531023 25508 raft_consensus.cc:3060] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.536051 25112 leader_election.cc:304] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c; no voters: d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:11.537261 25491 raft_consensus.cc:2804] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:11.537776 25491 raft_consensus.cc:697] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:11.524439 25429 leader_election.cc:290] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:11.538631 25491 consensus_queue.cc:237] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:11.540357 25423 tablet_bootstrap.cc:492] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:11.540897 25423 ts_tablet_manager.cc:1403] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.088s	user 0.011s	sys 0.006s
I20260709 12:25:11.541193 25418 tablet_bootstrap.cc:492] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:11.542048 25369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a616947e81bf446584593e882f8bdeaa" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
W20260709 12:25:11.543664 25188 leader_election.cc:343] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.559002 25508 raft_consensus.cc:515] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.520007 25507 raft_consensus.cc:3060] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.564472 25423 raft_consensus.cc:359] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.565490 25423 raft_consensus.cc:385] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.565847 25423 raft_consensus.cc:740] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.563575 25369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a616947e81bf446584593e882f8bdeaa" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:11.569113 25423 consensus_queue.cc:260] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.574002 25508 leader_election.cc:290] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:11.575421 25419 raft_consensus.cc:359] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:11.576143 25419 raft_consensus.cc:385] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.576426 25419 raft_consensus.cc:740] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.589062 25423 ts_tablet_manager.cc:1434] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.001s
I20260709 12:25:11.596916 25423 tablet_bootstrap.cc:492] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:11.600340 25421 raft_consensus.cc:359] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:11.601421 25421 raft_consensus.cc:385] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.601780 25421 raft_consensus.cc:740] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.603997 25419 consensus_queue.cc:260] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:11.603152 25421 consensus_queue.cc:260] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
W20260709 12:25:11.589006 25188 leader_election.cc:343] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.613561 25419 ts_tablet_manager.cc:1434] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.095s	user 0.011s	sys 0.000s
I20260709 12:25:11.614935 25419 tablet_bootstrap.cc:492] T 0d0304837699431197f7e780344f1093 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:11.599247 25146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a616947e81bf446584593e882f8bdeaa" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:11.617523 25421 ts_tablet_manager.cc:1434] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.097s	user 0.008s	sys 0.001s
I20260709 12:25:11.618997 25421 tablet_bootstrap.cc:492] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:11.623799 25146 raft_consensus.cc:3060] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.643493 25423 tablet_bootstrap.cc:654] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.645531 25221 raft_consensus.cc:3060] T 91840ed520ab444d9bd1acb13b5b6b89 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.647822 25419 tablet_bootstrap.cc:654] T 0d0304837699431197f7e780344f1093 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.652817 25418 tablet_bootstrap.cc:654] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:11.649382 25092 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:11.660035 25485 consensus_queue.cc:1048] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:11.658907 25507 raft_consensus.cc:515] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:11.663295 25148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37de5b1c577f426488d8649c7b56a9a0" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:11.663987 25148 raft_consensus.cc:3060] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.679499 25485 consensus_queue.cc:1048] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:11.680181 25507 leader_election.cc:290] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Requested vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:11.695466 25418 tablet_bootstrap.cc:492] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:11.696265 25418 ts_tablet_manager.cc:1403] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.155s	user 0.016s	sys 0.000s
I20260709 12:25:11.706662 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37de5b1c577f426488d8649c7b56a9a0" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:11.707683 25298 raft_consensus.cc:3060] T 37de5b1c577f426488d8649c7b56a9a0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.693142 25485 raft_consensus.cc:493] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.716430 25146 raft_consensus.cc:2468] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:11.716993 25533 consensus_queue.cc:1048] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:11.718132 25189 leader_election.cc:304] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:11.719396 25507 raft_consensus.cc:2804] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:11.719954 25507 raft_consensus.cc:697] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:11.716466 25485 raft_consensus.cc:515] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:11.720901 25507 consensus_queue.cc:237] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
W20260709 12:25:11.721611 25530 log.cc:927] Time spent T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:25:11.724618 25370 raft_consensus.cc:3060] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.726111 25514 consensus_queue.cc:1048] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:11.727347 25421 tablet_bootstrap.cc:654] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.730158 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752795059ef543b9a98b6dba09b04230" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:11.730862 25485 leader_election.cc:290] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:11.733754 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752795059ef543b9a98b6dba09b04230" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:11.745898 25418 raft_consensus.cc:359] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.748054 25418 raft_consensus.cc:385] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.748327 25418 raft_consensus.cc:740] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.748920 25418 consensus_queue.cc:260] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.749976 25531 consensus_queue.cc:1048] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:25:11.764700 25335 leader_election.cc:304] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:11.765220 25148 raft_consensus.cc:2468] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:11.766374 25418 ts_tablet_manager.cc:1434] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 12:25:11.768762 25189 leader_election.cc:304] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:11.769519 25419 tablet_bootstrap.cc:492] T 0d0304837699431197f7e780344f1093 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:11.769724 25507 raft_consensus.cc:2804] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:11.770547 25438 raft_consensus.cc:493] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.771219 25438 raft_consensus.cc:515] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.773697 25438 leader_election.cc:290] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:11.770529 25507 raft_consensus.cc:697] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:11.774914 25369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb84b6ee4f14cdc9a40ffd59ca4f42c" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:11.775076 25507 consensus_queue.cc:237] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:11.779470 25418 tablet_bootstrap.cc:492] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:11.780675 25419 ts_tablet_manager.cc:1403] T 0d0304837699431197f7e780344f1093 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.166s	user 0.013s	sys 0.007s
I20260709 12:25:11.778087 25042 catalog_manager.cc:5697] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 1 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:11.803246 25531 raft_consensus.cc:493] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:11.804016 25262 leader_election.cc:343] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.803864 25531 raft_consensus.cc:515] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.805651 25147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb84b6ee4f14cdc9a40ffd59ca4f42c" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:11.806392 25147 raft_consensus.cc:2468] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 0.
I20260709 12:25:11.807473 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb84b6ee4f14cdc9a40ffd59ca4f42c" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:11.808244 25296 raft_consensus.cc:2468] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
I20260709 12:25:11.809581 25113 leader_election.cc:304] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:11.810021 25298 raft_consensus.cc:2468] T 37de5b1c577f426488d8649c7b56a9a0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:11.810734 25532 raft_consensus.cc:2804] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:11.811146 25532 raft_consensus.cc:493] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.811492 25532 raft_consensus.cc:3060] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.835701 25423 tablet_bootstrap.cc:492] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:11.836341 25423 ts_tablet_manager.cc:1403] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.245s	user 0.012s	sys 0.006s
I20260709 12:25:11.833400 25477 raft_consensus.cc:493] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.839840 25477 raft_consensus.cc:515] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:11.848835 25477 leader_election.cc:290] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:11.839496 25423 raft_consensus.cc:359] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:11.852918 25146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b6c4b190bf487a9d40c062b4195403" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:11.853103 25532 raft_consensus.cc:515] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.853626 25423 raft_consensus.cc:385] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.854422 25423 raft_consensus.cc:740] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.856020 25423 consensus_queue.cc:260] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:11.859681 25419 raft_consensus.cc:359] T 0d0304837699431197f7e780344f1093 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:11.860472 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b6c4b190bf487a9d40c062b4195403" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:11.859948 25147 raft_consensus.cc:3060] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.861919 25419 raft_consensus.cc:385] T 0d0304837699431197f7e780344f1093 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.862659 25419 raft_consensus.cc:740] T 0d0304837699431197f7e780344f1093 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.866477 25369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb84b6ee4f14cdc9a40ffd59ca4f42c" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:11.869629 25263 leader_election.cc:304] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:11.871305 25438 raft_consensus.cc:2804] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:11.871873 25438 raft_consensus.cc:493] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.872309 25438 raft_consensus.cc:3060] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:11.872395 25112 leader_election.cc:343] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.873765 25419 consensus_queue.cc:260] T 0d0304837699431197f7e780344f1093 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:11.878803 25419 ts_tablet_manager.cc:1434] T 0d0304837699431197f7e780344f1093 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.098s	user 0.005s	sys 0.002s
I20260709 12:25:11.879914 25507 consensus_queue.cc:1048] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:11.880667 25508 consensus_queue.cc:1048] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:11.880970 25260 leader_election.cc:343] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.881467 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb84b6ee4f14cdc9a40ffd59ca4f42c" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:11.884590 25418 tablet_bootstrap.cc:654] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.884639 25423 ts_tablet_manager.cc:1434] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.002s
I20260709 12:25:11.887996 25419 tablet_bootstrap.cc:492] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:11.887972 25423 tablet_bootstrap.cc:492] T f6be441f38874ae7bb28069feed26b69 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:11.893632 25485 consensus_queue.cc:1048] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:11.896770 25532 leader_election.cc:290] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:11.842662 25531 leader_election.cc:290] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:11.913988 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb84b6ee4f14cdc9a40ffd59ca4f42c" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
W20260709 12:25:11.917239 25263 leader_election.cc:343] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.917254 25514 raft_consensus.cc:2749] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:11.918002 25423 tablet_bootstrap.cc:654] T f6be441f38874ae7bb28069feed26b69 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:11.921989 25112 leader_election.cc:343] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.924319 25477 raft_consensus.cc:493] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.917804 25263 leader_election.cc:304] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:11.924927 25477 raft_consensus.cc:515] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:11.926856 25507 raft_consensus.cc:493] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.927312 25478 raft_consensus.cc:2749] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:11.927428 25507 raft_consensus.cc:515] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:11.929945 25507 leader_election.cc:290] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:11.931627 25419 tablet_bootstrap.cc:654] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.931653 25146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e2e1ecd7474df9add48f60c06a4a0f" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:11.931571 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0304837699431197f7e780344f1093" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:11.933463 25220 raft_consensus.cc:2468] T 0d0304837699431197f7e780344f1093 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 0.
I20260709 12:25:11.934619 25369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0304837699431197f7e780344f1093" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:11.935106 25477 leader_election.cc:290] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:11.936079 25260 leader_election.cc:304] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:11.939041 25421 tablet_bootstrap.cc:492] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:11.938928 25369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e2e1ecd7474df9add48f60c06a4a0f" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:11.939635 25421 ts_tablet_manager.cc:1403] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.321s	user 0.012s	sys 0.016s
I20260709 12:25:11.939905 25369 raft_consensus.cc:2393] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3979c425abd4ac7b2ca30e1dec9a154 in current term 1: Already voted for candidate 434d5783f9374eab8f587e0fe6c15b1c in this term.
W20260709 12:25:11.939512 25262 leader_election.cc:343] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.952368 25421 raft_consensus.cc:359] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.953611 25421 raft_consensus.cc:385] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.954030 25421 raft_consensus.cc:740] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.956210 25188 leader_election.cc:304] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:11.957448 25507 raft_consensus.cc:3060] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.963392 25463 consensus_queue.cc:1048] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:11.944124 25477 raft_consensus.cc:2804] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:11.965409 25477 raft_consensus.cc:493] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.965906 25477 raft_consensus.cc:3060] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.968725 25507 raft_consensus.cc:2749] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:11.980661 25418 tablet_bootstrap.cc:492] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:11.976183 25421 consensus_queue.cc:260] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:11.987037 25438 raft_consensus.cc:515] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.003038 25463 consensus_queue.cc:1048] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:12.002604 25423 tablet_bootstrap.cc:492] T f6be441f38874ae7bb28069feed26b69 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:12.006898 25423 ts_tablet_manager.cc:1403] T f6be441f38874ae7bb28069feed26b69 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.119s	user 0.019s	sys 0.013s
I20260709 12:25:12.010702 25419 tablet_bootstrap.cc:492] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:12.010779 25421 ts_tablet_manager.cc:1434] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.001s
I20260709 12:25:12.011451 25419 ts_tablet_manager.cc:1403] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.124s	user 0.016s	sys 0.006s
I20260709 12:25:12.012084 25421 tablet_bootstrap.cc:492] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:12.013806 25298 raft_consensus.cc:2393] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 434d5783f9374eab8f587e0fe6c15b1c in current term 1: Already voted for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in this term.
I20260709 12:25:12.014922 25438 leader_election.cc:290] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:12.005790 25418 ts_tablet_manager.cc:1403] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.230s	user 0.018s	sys 0.015s
I20260709 12:25:12.014485 25419 raft_consensus.cc:359] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.016952 25419 raft_consensus.cc:385] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.017606 25419 raft_consensus.cc:740] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.018810 25423 raft_consensus.cc:359] T f6be441f38874ae7bb28069feed26b69 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.019666 25423 raft_consensus.cc:385] T f6be441f38874ae7bb28069feed26b69 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.020013 25423 raft_consensus.cc:740] T f6be441f38874ae7bb28069feed26b69 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.021327 25423 consensus_queue.cc:260] T f6be441f38874ae7bb28069feed26b69 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.020509 25419 consensus_queue.cc:260] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.023150 25146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb84b6ee4f14cdc9a40ffd59ca4f42c" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:12.023885 25419 ts_tablet_manager.cc:1434] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:25:12.024012 25146 raft_consensus.cc:2393] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a28f2edcd70f4eb08f16021ba3e2cf14 in current term 1: Already voted for candidate 434d5783f9374eab8f587e0fe6c15b1c in this term.
I20260709 12:25:12.025524 25423 ts_tablet_manager.cc:1434] T f6be441f38874ae7bb28069feed26b69 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:25:12.025853 25369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb84b6ee4f14cdc9a40ffd59ca4f42c" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:12.026103 25113 leader_election.cc:304] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:12.026542 25423 tablet_bootstrap.cc:492] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:12.027338 25533 raft_consensus.cc:2749] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:12.030215 25477 raft_consensus.cc:515] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
W20260709 12:25:12.027412 25262 leader_election.cc:343] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:12.033639 25262 leader_election.cc:304] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:12.034217 25423 tablet_bootstrap.cc:654] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.034999 25463 raft_consensus.cc:2749] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:12.046132 25369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0304837699431197f7e780344f1093" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
W20260709 12:25:12.047806 25262 leader_election.cc:343] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:12.051672 25418 raft_consensus.cc:359] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.052738 25418 raft_consensus.cc:385] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.053033 25418 raft_consensus.cc:740] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.053895 25418 consensus_queue.cc:260] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.055694 25477 leader_election.cc:290] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:12.058692 25418 ts_tablet_manager.cc:1434] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.043s	user 0.003s	sys 0.003s
I20260709 12:25:12.060021 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0304837699431197f7e780344f1093" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:12.060998 25219 raft_consensus.cc:3060] T 0d0304837699431197f7e780344f1093 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.064004 25533 consensus_queue.cc:1048] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:12.066416 25533 consensus_queue.cc:1048] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:12.069269 25418 tablet_bootstrap.cc:492] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:12.070277 25421 tablet_bootstrap.cc:654] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.079934 25423 tablet_bootstrap.cc:492] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:12.080519 25423 ts_tablet_manager.cc:1403] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.033s
I20260709 12:25:12.082903 25219 raft_consensus.cc:2468] T 0d0304837699431197f7e780344f1093 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:12.084324 25260 leader_election.cc:304] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:12.085649 25478 raft_consensus.cc:493] T f6be441f38874ae7bb28069feed26b69 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.085464 25423 raft_consensus.cc:359] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:12.085892 25559 raft_consensus.cc:2804] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:12.086337 25423 raft_consensus.cc:385] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.086790 25423 raft_consensus.cc:740] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.086987 25559 raft_consensus.cc:697] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:12.087474 25423 consensus_queue.cc:260] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:12.089766 25423 ts_tablet_manager.cc:1434] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:25:12.086292 25478 raft_consensus.cc:515] T f6be441f38874ae7bb28069feed26b69 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.088068 25559 consensus_queue.cc:237] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:12.090926 25423 tablet_bootstrap.cc:492] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:12.093395 25145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6be441f38874ae7bb28069feed26b69" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:12.100343 25419 tablet_bootstrap.cc:492] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
W20260709 12:25:12.098757 25263 leader_election.cc:343] T f6be441f38874ae7bb28069feed26b69 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:12.108263 25418 tablet_bootstrap.cc:654] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.125065 25421 tablet_bootstrap.cc:492] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:12.125743 25421 ts_tablet_manager.cc:1403] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.114s	user 0.017s	sys 0.006s
I20260709 12:25:12.130435 25508 raft_consensus.cc:493] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.131080 25508 raft_consensus.cc:515] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.130703 25421 raft_consensus.cc:359] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.132149 25421 raft_consensus.cc:385] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.132606 25421 raft_consensus.cc:740] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.133522 25508 leader_election.cc:290] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:12.135639 25423 tablet_bootstrap.cc:654] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.141701 25478 leader_election.cc:290] T f6be441f38874ae7bb28069feed26b69 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:12.136351 25148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354e6422b7944df78b231965e1774820" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:12.133684 25421 consensus_queue.cc:260] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.137181 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354e6422b7944df78b231965e1774820" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:12.138293 25419 tablet_bootstrap.cc:654] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:12.146135 25189 leader_election.cc:343] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:12.146255 25043 catalog_manager.cc:5697] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.150427 25043 catalog_manager.cc:5697] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.160490 25421 ts_tablet_manager.cc:1434] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 12:25:12.161415 25421 tablet_bootstrap.cc:492] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
W20260709 12:25:12.157477 25188 leader_election.cc:343] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:12.159402 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6be441f38874ae7bb28069feed26b69" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:12.168556 25421 tablet_bootstrap.cc:654] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.157887 25533 raft_consensus.cc:493] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:12.172878 25260 leader_election.cc:343] T f6be441f38874ae7bb28069feed26b69 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:12.172991 25533 raft_consensus.cc:515] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.173507 25260 leader_election.cc:304] T f6be441f38874ae7bb28069feed26b69 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:12.175937 25533 leader_election.cc:290] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:12.176307 25508 consensus_queue.cc:1048] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:12.176831 25188 leader_election.cc:304] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:12.177089 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b6c4b190bf487a9d40c062b4195403" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:12.177755 25508 raft_consensus.cc:2749] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:12.177815 25298 raft_consensus.cc:2468] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
I20260709 12:25:12.178858 25438 raft_consensus.cc:2749] T f6be441f38874ae7bb28069feed26b69 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:12.180511 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b6c4b190bf487a9d40c062b4195403" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:12.181622 25113 leader_election.cc:304] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
W20260709 12:25:12.183856 25110 leader_election.cc:343] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:12.185333 25418 tablet_bootstrap.cc:492] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:12.185485 25514 raft_consensus.cc:493] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.185900 25418 ts_tablet_manager.cc:1403] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.126s	user 0.011s	sys 0.027s
I20260709 12:25:12.186030 25514 raft_consensus.cc:515] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.187969 25533 raft_consensus.cc:2804] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:12.188077 25514 leader_election.cc:290] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:12.188508 25533 raft_consensus.cc:493] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.188906 25533 raft_consensus.cc:3060] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.189384 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a616947e81bf446584593e882f8bdeaa" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:12.190586 25042 catalog_manager.cc:5697] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 0 to 1, leader changed from <none> to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.194161 25145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a616947e81bf446584593e882f8bdeaa" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:12.195073 25145 raft_consensus.cc:2393] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fa8f2c80074488084fea821c4bb293d in current term 1: Already voted for candidate d3979c425abd4ac7b2ca30e1dec9a154 in this term.
I20260709 12:25:12.196149 25338 leader_election.cc:304] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:12.197347 25514 raft_consensus.cc:3060] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.197635 25423 tablet_bootstrap.cc:492] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:12.198237 25423 ts_tablet_manager.cc:1403] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.108s	user 0.018s	sys 0.011s
I20260709 12:25:12.201655 25419 tablet_bootstrap.cc:492] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:12.202142 25419 ts_tablet_manager.cc:1403] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.102s	user 0.015s	sys 0.001s
I20260709 12:25:12.197366 25508 consensus_queue.cc:1048] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:25:12.208106 25533 raft_consensus.cc:515] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.210475 25533 leader_election.cc:290] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:12.211583 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b6c4b190bf487a9d40c062b4195403" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:12.212690 25296 raft_consensus.cc:3060] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.212778 25423 raft_consensus.cc:359] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.213511 25423 raft_consensus.cc:385] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.213779 25423 raft_consensus.cc:740] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.214504 25508 consensus_queue.cc:1048] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:12.215700 25418 raft_consensus.cc:359] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.216419 25418 raft_consensus.cc:385] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.216691 25418 raft_consensus.cc:740] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.217447 25418 consensus_queue.cc:260] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.220958 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b6c4b190bf487a9d40c062b4195403" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:12.204843 25419 raft_consensus.cc:359] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.223322 25419 raft_consensus.cc:385] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.223978 25419 raft_consensus.cc:740] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.225176 25419 consensus_queue.cc:260] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.227865 25419 ts_tablet_manager.cc:1434] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 12:25:12.228884 25419 tablet_bootstrap.cc:492] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:12.231663 25221 raft_consensus.cc:3060] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.232048 25423 consensus_queue.cc:260] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.219574 25418 ts_tablet_manager.cc:1434] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.033s	user 0.002s	sys 0.003s
I20260709 12:25:12.234663 25418 tablet_bootstrap.cc:492] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:12.236347 25438 raft_consensus.cc:493] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.238703 25423 ts_tablet_manager.cc:1434] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 12:25:12.239786 25423 tablet_bootstrap.cc:492] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:12.224043 25514 raft_consensus.cc:2749] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:12.237514 25438 raft_consensus.cc:515] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:12.250690 25296 raft_consensus.cc:2468] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 1.
I20260709 12:25:12.259763 25438 leader_election.cc:290] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:12.260066 25113 leader_election.cc:304] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:12.260967 25531 raft_consensus.cc:2804] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:12.261162 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc47554d5e54ab4826c21fdd6126df0" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:12.261484 25531 raft_consensus.cc:697] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:12.262411 25531 consensus_queue.cc:237] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
W20260709 12:25:12.266088 25260 leader_election.cc:343] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:12.267275 25429 consensus_queue.cc:1048] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:12.270378 25419 tablet_bootstrap.cc:654] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.266110 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc47554d5e54ab4826c21fdd6126df0" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
W20260709 12:25:12.272502 25262 leader_election.cc:343] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:12.272980 25262 leader_election.cc:304] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:12.275605 25557 raft_consensus.cc:2749] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:12.276655 25423 tablet_bootstrap.cc:654] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.276814 25514 raft_consensus.cc:493] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.277462 25514 raft_consensus.cc:515] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.279310 25421 tablet_bootstrap.cc:492] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:12.279898 25421 ts_tablet_manager.cc:1403] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.119s	user 0.013s	sys 0.005s
I20260709 12:25:12.283216 25514 leader_election.cc:290] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:12.283136 25421 raft_consensus.cc:359] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.284457 25531 raft_consensus.cc:493] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.284230 25221 raft_consensus.cc:2468] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 1.
I20260709 12:25:12.285209 25531 raft_consensus.cc:515] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.284188 25421 raft_consensus.cc:385] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.287997 25418 tablet_bootstrap.cc:654] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.286623 25421 raft_consensus.cc:740] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.290319 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354e6422b7944df78b231965e1774820" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:12.290542 25421 consensus_queue.cc:260] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.291501 25372 raft_consensus.cc:2468] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
I20260709 12:25:12.293458 25421 ts_tablet_manager.cc:1434] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:25:12.293491 25112 leader_election.cc:304] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c; no voters: 
I20260709 12:25:12.294977 25421 tablet_bootstrap.cc:492] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:12.295066 25531 leader_election.cc:290] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:12.296420 25531 raft_consensus.cc:2804] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:12.297331 25531 raft_consensus.cc:493] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.298079 25531 raft_consensus.cc:3060] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.301069 25145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb84b6ee4f14cdc9a40ffd59ca4f42c" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:12.301350 25557 raft_consensus.cc:493] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.301980 25145 raft_consensus.cc:2393] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fa8f2c80074488084fea821c4bb293d in current term 1: Already voted for candidate 434d5783f9374eab8f587e0fe6c15b1c in this term.
I20260709 12:25:12.301848 25557 raft_consensus.cc:515] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.304912 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "192689638be442acb52df50f2137f664" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:12.306941 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354e6422b7944df78b231965e1774820" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:12.313280 25221 raft_consensus.cc:2468] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
I20260709 12:25:12.315083 25557 leader_election.cc:290] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:12.315718 25423 tablet_bootstrap.cc:492] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
W20260709 12:25:12.316046 25262 leader_election.cc:343] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:12.316345 25423 ts_tablet_manager.cc:1403] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.077s	user 0.008s	sys 0.015s
I20260709 12:25:12.316540 25148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "192689638be442acb52df50f2137f664" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:12.316885 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb84b6ee4f14cdc9a40ffd59ca4f42c" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:12.317669 25298 raft_consensus.cc:2393] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fa8f2c80074488084fea821c4bb293d in current term 1: Already voted for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in this term.
W20260709 12:25:12.317976 25263 leader_election.cc:343] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:12.318465 25263 leader_election.cc:304] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:12.319839 25338 leader_election.cc:304] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:12.321079 25514 raft_consensus.cc:3060] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.323035 25421 tablet_bootstrap.cc:654] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.321440 25531 raft_consensus.cc:515] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.323665 25557 raft_consensus.cc:2749] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:12.342015 25531 leader_election.cc:290] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:12.342813 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354e6422b7944df78b231965e1774820" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:12.342969 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354e6422b7944df78b231965e1774820" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:12.344691 25221 raft_consensus.cc:3060] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.343413 25372 raft_consensus.cc:3060] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.353075 25043 catalog_manager.cc:5697] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 1 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.353840 25514 raft_consensus.cc:2749] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:12.362891 25423 raft_consensus.cc:359] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:12.365119 25372 raft_consensus.cc:2468] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 1.
I20260709 12:25:12.369179 25112 leader_election.cc:304] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c; no voters: 
I20260709 12:25:12.371276 25531 raft_consensus.cc:2804] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:12.371409 25419 tablet_bootstrap.cc:492] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:12.372720 25419 ts_tablet_manager.cc:1403] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.144s	user 0.014s	sys 0.015s
I20260709 12:25:12.372538 25221 raft_consensus.cc:2468] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 1.
I20260709 12:25:12.363684 25423 raft_consensus.cc:385] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.375311 25423 raft_consensus.cc:740] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.375521 25421 tablet_bootstrap.cc:492] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:12.376858 25421 ts_tablet_manager.cc:1403] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.004s
I20260709 12:25:12.371667 25418 tablet_bootstrap.cc:492] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:12.379063 25418 ts_tablet_manager.cc:1403] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.145s	user 0.024s	sys 0.027s
I20260709 12:25:12.380306 25421 raft_consensus.cc:359] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:12.381095 25421 raft_consensus.cc:385] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.381371 25421 raft_consensus.cc:740] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.372499 25531 raft_consensus.cc:697] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:12.382071 25421 consensus_queue.cc:260] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:12.383033 25531 consensus_queue.cc:237] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.386297 25419 raft_consensus.cc:359] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:12.387092 25419 raft_consensus.cc:385] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.386785 25423 consensus_queue.cc:260] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:12.387382 25419 raft_consensus.cc:740] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.389262 25423 ts_tablet_manager.cc:1434] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 12:25:12.389441 25421 ts_tablet_manager.cc:1434] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.005s
I20260709 12:25:12.390690 25421 tablet_bootstrap.cc:492] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:12.382114 25418 raft_consensus.cc:359] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.391599 25418 raft_consensus.cc:385] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.391889 25418 raft_consensus.cc:740] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.392786 25418 consensus_queue.cc:260] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.394538 25423 tablet_bootstrap.cc:492] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:12.396034 25419 consensus_queue.cc:260] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:12.398329 25419 ts_tablet_manager.cc:1434] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:25:12.399489 25419 tablet_bootstrap.cc:492] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:12.401360 25418 ts_tablet_manager.cc:1434] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:25:12.402458 25418 tablet_bootstrap.cc:492] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:12.412580 25421 tablet_bootstrap.cc:654] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.414036 25418 tablet_bootstrap.cc:654] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.417591 25423 tablet_bootstrap.cc:654] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.417907 25419 tablet_bootstrap.cc:654] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.432303 25423 tablet_bootstrap.cc:492] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:12.432663 25419 tablet_bootstrap.cc:492] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:12.432848 25423 ts_tablet_manager.cc:1403] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.000s
I20260709 12:25:12.433182 25419 ts_tablet_manager.cc:1403] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.002s
I20260709 12:25:12.433907 25044 catalog_manager.cc:5697] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 1 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.435880 25423 raft_consensus.cc:359] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.436661 25423 raft_consensus.cc:385] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.436458 25419 raft_consensus.cc:359] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.437005 25423 raft_consensus.cc:740] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.437716 25423 consensus_queue.cc:260] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.438704 25421 tablet_bootstrap.cc:492] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:12.439188 25421 ts_tablet_manager.cc:1403] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.001s
I20260709 12:25:12.439891 25423 ts_tablet_manager.cc:1434] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:25:12.440883 25423 tablet_bootstrap.cc:492] T b349920766b74e3aa849cd67521bf887 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:12.444643 25421 raft_consensus.cc:359] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.445272 25418 tablet_bootstrap.cc:492] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:12.445387 25419 raft_consensus.cc:385] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.445776 25419 raft_consensus.cc:740] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.445919 25418 ts_tablet_manager.cc:1403] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.000s
I20260709 12:25:12.445338 25421 raft_consensus.cc:385] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.446753 25421 raft_consensus.cc:740] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.447527 25421 consensus_queue.cc:260] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.449083 25421 ts_tablet_manager.cc:1434] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:25:12.448958 25418 raft_consensus.cc:359] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.449669 25418 raft_consensus.cc:385] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.449965 25418 raft_consensus.cc:740] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.450110 25421 tablet_bootstrap.cc:492] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:12.450505 25419 consensus_queue.cc:260] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.450801 25418 consensus_queue.cc:260] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.458012 25418 ts_tablet_manager.cc:1434] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 12:25:12.458485 25421 tablet_bootstrap.cc:654] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.459056 25418 tablet_bootstrap.cc:492] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:12.462841 25419 ts_tablet_manager.cc:1434] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:25:12.464388 25419 tablet_bootstrap.cc:492] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:12.467229 25423 tablet_bootstrap.cc:654] T b349920766b74e3aa849cd67521bf887 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.470623 25419 tablet_bootstrap.cc:654] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.471926 25418 tablet_bootstrap.cc:654] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.485357 25418 tablet_bootstrap.cc:492] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:12.486106 25418 ts_tablet_manager.cc:1403] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.002s
I20260709 12:25:12.489017 25557 raft_consensus.cc:493] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.489313 25421 tablet_bootstrap.cc:492] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:12.489956 25421 ts_tablet_manager.cc:1403] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.001s
I20260709 12:25:12.489729 25557 raft_consensus.cc:515] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:12.491286 25423 tablet_bootstrap.cc:492] T b349920766b74e3aa849cd67521bf887 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:12.491844 25423 ts_tablet_manager.cc:1403] T b349920766b74e3aa849cd67521bf887 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.051s	user 0.007s	sys 0.005s
I20260709 12:25:12.492130 25557 leader_election.cc:290] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:12.493055 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50c1e80871a4f21a31521e37160b99f" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:12.493108 25421 raft_consensus.cc:359] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:12.493968 25421 raft_consensus.cc:385] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.493786 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50c1e80871a4f21a31521e37160b99f" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
W20260709 12:25:12.494925 25260 leader_election.cc:343] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:12.495519 25421 raft_consensus.cc:740] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
W20260709 12:25:12.495653 25262 leader_election.cc:343] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:12.494758 25423 raft_consensus.cc:359] T b349920766b74e3aa849cd67521bf887 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.496273 25423 raft_consensus.cc:385] T b349920766b74e3aa849cd67521bf887 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.496197 25262 leader_election.cc:304] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:12.496676 25423 raft_consensus.cc:740] T b349920766b74e3aa849cd67521bf887 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.496483 25421 consensus_queue.cc:260] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:12.497637 25557 raft_consensus.cc:2749] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:12.489328 25418 raft_consensus.cc:359] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.498692 25418 raft_consensus.cc:385] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.498951 25418 raft_consensus.cc:740] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.497400 25423 consensus_queue.cc:260] T b349920766b74e3aa849cd67521bf887 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.500886 25423 ts_tablet_manager.cc:1434] T b349920766b74e3aa849cd67521bf887 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 12:25:12.501307 25419 tablet_bootstrap.cc:492] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:12.499619 25421 ts_tablet_manager.cc:1434] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 12:25:12.501636 25418 consensus_queue.cc:260] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.502739 25421 tablet_bootstrap.cc:492] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:12.503854 25418 ts_tablet_manager.cc:1434] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 12:25:12.504895 25418 tablet_bootstrap.cc:492] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:12.512023 25423 tablet_bootstrap.cc:492] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:12.513600 25421 tablet_bootstrap.cc:654] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.509320 25419 ts_tablet_manager.cc:1403] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.012s
I20260709 12:25:12.517388 25419 raft_consensus.cc:359] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.518123 25419 raft_consensus.cc:385] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.518391 25419 raft_consensus.cc:740] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.519006 25423 tablet_bootstrap.cc:654] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.519114 25419 consensus_queue.cc:260] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.521731 25418 tablet_bootstrap.cc:654] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.524021 25419 ts_tablet_manager.cc:1434] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:25:12.525077 25419 tablet_bootstrap.cc:492] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:12.531404 25423 tablet_bootstrap.cc:492] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:12.532713 25423 ts_tablet_manager.cc:1403] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.008s
I20260709 12:25:12.535797 25421 tablet_bootstrap.cc:492] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:12.536438 25421 ts_tablet_manager.cc:1403] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.006s
I20260709 12:25:12.537905 25419 tablet_bootstrap.cc:654] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.538646 25418 tablet_bootstrap.cc:492] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:12.539167 25418 ts_tablet_manager.cc:1403] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.005s
I20260709 12:25:12.539343 25421 raft_consensus.cc:359] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.540108 25421 raft_consensus.cc:385] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.540377 25421 raft_consensus.cc:740] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.541173 25421 consensus_queue.cc:260] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.541810 25423 raft_consensus.cc:359] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.541985 25418 raft_consensus.cc:359] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.542618 25423 raft_consensus.cc:385] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.542763 25418 raft_consensus.cc:385] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.542989 25423 raft_consensus.cc:740] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.543195 25418 raft_consensus.cc:740] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.544135 25419 tablet_bootstrap.cc:492] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:12.543958 25423 consensus_queue.cc:260] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.544150 25418 consensus_queue.cc:260] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.546142 25423 ts_tablet_manager.cc:1434] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:25:12.546602 25419 ts_tablet_manager.cc:1403] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.000s
I20260709 12:25:12.550671 25423 tablet_bootstrap.cc:492] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:12.549635 25419 raft_consensus.cc:359] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:12.551923 25418 ts_tablet_manager.cc:1434] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:25:12.553264 25418 tablet_bootstrap.cc:492] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:12.558923 25423 tablet_bootstrap.cc:654] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.559514 25418 tablet_bootstrap.cc:654] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.551857 25419 raft_consensus.cc:385] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.559955 25419 raft_consensus.cc:740] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.560760 25419 consensus_queue.cc:260] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:12.562500 25419 ts_tablet_manager.cc:1434] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:25:12.563301 25419 tablet_bootstrap.cc:492] T a6ef2af3aa69454aa946797dc87d6e9d P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:12.572275 25419 tablet_bootstrap.cc:654] T a6ef2af3aa69454aa946797dc87d6e9d P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.577575 25421 ts_tablet_manager.cc:1434] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 12:25:12.583654 25421 tablet_bootstrap.cc:492] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:12.590363 25421 tablet_bootstrap.cc:654] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.594422 25418 tablet_bootstrap.cc:492] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:12.595153 25418 ts_tablet_manager.cc:1403] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.006s
I20260709 12:25:12.600381 25419 tablet_bootstrap.cc:492] T a6ef2af3aa69454aa946797dc87d6e9d P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:12.599922 25418 raft_consensus.cc:359] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.600982 25419 ts_tablet_manager.cc:1403] T a6ef2af3aa69454aa946797dc87d6e9d P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.004s
I20260709 12:25:12.601136 25418 raft_consensus.cc:385] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.601595 25418 raft_consensus.cc:740] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.603647 25419 raft_consensus.cc:359] T a6ef2af3aa69454aa946797dc87d6e9d P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.604457 25419 raft_consensus.cc:385] T a6ef2af3aa69454aa946797dc87d6e9d P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.604102 25418 consensus_queue.cc:260] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.604759 25419 raft_consensus.cc:740] T a6ef2af3aa69454aa946797dc87d6e9d P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.605494 25419 consensus_queue.cc:260] T a6ef2af3aa69454aa946797dc87d6e9d P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.606357 25418 ts_tablet_manager.cc:1434] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:25:12.607502 25419 ts_tablet_manager.cc:1434] T a6ef2af3aa69454aa946797dc87d6e9d P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:25:12.607785 25418 tablet_bootstrap.cc:492] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:12.608568 25419 tablet_bootstrap.cc:492] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:12.614502 25419 tablet_bootstrap.cc:654] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.614675 25423 tablet_bootstrap.cc:492] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:12.615303 25423 ts_tablet_manager.cc:1403] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.009s
I20260709 12:25:12.617064 25372 raft_consensus.cc:3060] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.618974 25423 raft_consensus.cc:359] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.628233 25423 raft_consensus.cc:385] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.628656 25423 raft_consensus.cc:740] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.629586 25423 consensus_queue.cc:260] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.632738 25423 ts_tablet_manager.cc:1434] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:25:12.634182 25423 tablet_bootstrap.cc:492] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:12.639701 25418 tablet_bootstrap.cc:654] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.647593 25421 tablet_bootstrap.cc:492] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:12.648286 25421 ts_tablet_manager.cc:1403] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.065s	user 0.033s	sys 0.009s
I20260709 12:25:12.652094 25423 tablet_bootstrap.cc:654] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.651901 25421 raft_consensus.cc:359] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:12.652801 25421 raft_consensus.cc:385] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.653134 25421 raft_consensus.cc:740] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.653873 25421 consensus_queue.cc:260] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:12.654690 25557 consensus_queue.cc:1048] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:12.661369 25421 ts_tablet_manager.cc:1434] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:25:12.662498 25421 tablet_bootstrap.cc:492] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:12.671078 25421 tablet_bootstrap.cc:654] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.673399 25419 tablet_bootstrap.cc:492] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:12.674233 25419 ts_tablet_manager.cc:1403] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.066s	user 0.030s	sys 0.022s
I20260709 12:25:12.677737 25557 raft_consensus.cc:493] T b349920766b74e3aa849cd67521bf887 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.678339 25557 raft_consensus.cc:515] T b349920766b74e3aa849cd67521bf887 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.680733 25438 raft_consensus.cc:493] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.681344 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b349920766b74e3aa849cd67521bf887" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:12.681295 25438 raft_consensus.cc:515] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
W20260709 12:25:12.683017 25262 leader_election.cc:343] T b349920766b74e3aa849cd67521bf887 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:12.684381 25514 raft_consensus.cc:493] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.684923 25514 raft_consensus.cc:515] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.685225 25419 raft_consensus.cc:359] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.686256 25419 raft_consensus.cc:385] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.686653 25419 raft_consensus.cc:740] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.687167 25514 leader_election.cc:290] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:12.683615 25438 leader_election.cc:290] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:12.687642 25419 consensus_queue.cc:260] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.687940 25148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae8b407c5d34cfb85a405355e2befda" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:12.702366 25148 raft_consensus.cc:2468] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 0.
I20260709 12:25:12.687178 25145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b349920766b74e3aa849cd67521bf887" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:12.704002 25419 ts_tablet_manager.cc:1434] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.029s	user 0.013s	sys 0.000s
I20260709 12:25:12.689072 25146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ef2af3aa69454aa946797dc87d6e9d" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:12.705061 25146 raft_consensus.cc:2468] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 0.
I20260709 12:25:12.690135 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ef2af3aa69454aa946797dc87d6e9d" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:12.712611 25219 raft_consensus.cc:2468] T a6ef2af3aa69454aa946797dc87d6e9d P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 0.
I20260709 12:25:12.690479 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae8b407c5d34cfb85a405355e2befda" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
W20260709 12:25:12.714438 25092 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:12.715452 25418 tablet_bootstrap.cc:492] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:12.715399 25335 leader_election.cc:304] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:12.716388 25531 raft_consensus.cc:493] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.716908 25531 raft_consensus.cc:515] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.717290 25418 ts_tablet_manager.cc:1403] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.110s	user 0.032s	sys 0.039s
I20260709 12:25:12.697659 25557 leader_election.cc:290] T b349920766b74e3aa849cd67521bf887 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:12.695348 25423 tablet_bootstrap.cc:492] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:12.696489 25421 tablet_bootstrap.cc:492] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:12.720353 25423 ts_tablet_manager.cc:1403] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.086s	user 0.012s	sys 0.008s
I20260709 12:25:12.720572 25421 ts_tablet_manager.cc:1403] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.006s
I20260709 12:25:12.720933 25418 raft_consensus.cc:359] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.721665 25418 raft_consensus.cc:385] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.721935 25418 raft_consensus.cc:740] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.716920 25514 raft_consensus.cc:2804] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:12.722522 25514 raft_consensus.cc:493] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.722865 25572 raft_consensus.cc:493] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.723395 25572 raft_consensus.cc:515] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
W20260709 12:25:12.724222 25262 leader_election.cc:343] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:12.723374 25423 raft_consensus.cc:359] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.724677 25418 consensus_queue.cc:260] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.725313 25423 raft_consensus.cc:385] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.725637 25423 raft_consensus.cc:740] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
W20260709 12:25:12.725801 25263 leader_election.cc:343] T b349920766b74e3aa849cd67521bf887 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:12.726529 25418 ts_tablet_manager.cc:1434] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:25:12.726329 25423 consensus_queue.cc:260] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.722887 25514 raft_consensus.cc:3060] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.726333 25263 leader_election.cc:304] T b349920766b74e3aa849cd67521bf887 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:12.728814 25419 tablet_bootstrap.cc:492] T 0190ce7515c34431903f97febee4323e P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:12.721464 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "192689638be442acb52df50f2137f664" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:12.729837 25298 raft_consensus.cc:2468] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
I20260709 12:25:12.730822 25463 raft_consensus.cc:2749] T b349920766b74e3aa849cd67521bf887 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:12.731945 25418 tablet_bootstrap.cc:492] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:12.732326 25423 ts_tablet_manager.cc:1434] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:25:12.734189 25421 raft_consensus.cc:359] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.734920 25421 raft_consensus.cc:385] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.735198 25421 raft_consensus.cc:740] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.738729 25418 tablet_bootstrap.cc:654] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.739547 25419 tablet_bootstrap.cc:654] T 0190ce7515c34431903f97febee4323e P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.741779 25423 tablet_bootstrap.cc:492] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:12.725834 25572 leader_election.cc:290] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:12.744266 25146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6be441f38874ae7bb28069feed26b69" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:12.744993 25146 raft_consensus.cc:2468] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:12.745472 25463 consensus_queue.cc:1048] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:12.746454 25189 leader_election.cc:304] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:12.749985 25429 raft_consensus.cc:2804] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:12.750424 25429 raft_consensus.cc:493] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.750759 25429 raft_consensus.cc:3060] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.750952 25423 tablet_bootstrap.cc:654] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:12.762563 25508 raft_consensus.cc:493] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.766961 25421 consensus_queue.cc:260] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.774605 25421 ts_tablet_manager.cc:1434] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 12:25:12.786763 25458 raft_consensus.cc:493] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.866529 25458 raft_consensus.cc:515] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:12.771337 25508 raft_consensus.cc:515] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:12.870678 25508 leader_election.cc:290] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:12.792893 25531 leader_election.cc:290] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:12.794821 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "192689638be442acb52df50f2137f664" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:12.872363 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50c1e80871a4f21a31521e37160b99f" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:12.873343 25372 raft_consensus.cc:2468] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:12.874157 25458 leader_election.cc:290] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:12.875118 25458 raft_consensus.cc:493] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.875432 25188 leader_election.cc:304] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:12.871407 25508 raft_consensus.cc:493] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.827546 25572 raft_consensus.cc:493] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.877113 25572 raft_consensus.cc:515] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.876605 25508 raft_consensus.cc:515] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.879781 25458 raft_consensus.cc:515] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.881042 25572 leader_election.cc:290] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:12.883026 25458 leader_election.cc:290] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:12.885329 25508 leader_election.cc:290] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:12.886916 25572 raft_consensus.cc:2804] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:12.887506 25572 raft_consensus.cc:493] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.887967 25572 raft_consensus.cc:3060] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.834764 25612 raft_consensus.cc:493] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.838793 25611 raft_consensus.cc:493] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.892722 25612 raft_consensus.cc:515] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:12.892901 25611 raft_consensus.cc:515] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.894807 25421 tablet_bootstrap.cc:492] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:12.894932 25612 leader_election.cc:290] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:12.863389 25514 raft_consensus.cc:515] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:12.896239 25370 raft_consensus.cc:2468] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
I20260709 12:25:12.900204 25531 consensus_queue.cc:1048] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:12.895663 25611 leader_election.cc:290] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:12.903049 25423 tablet_bootstrap.cc:492] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:12.903740 25423 ts_tablet_manager.cc:1403] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.162s	user 0.019s	sys 0.020s
I20260709 12:25:12.903991 25112 leader_election.cc:304] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c; no voters: 
I20260709 12:25:12.905202 25532 raft_consensus.cc:2804] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:12.905632 25532 raft_consensus.cc:493] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.905949 25532 raft_consensus.cc:3060] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.897667 25429 raft_consensus.cc:515] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.907555 25531 raft_consensus.cc:493] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.910145 25531 raft_consensus.cc:515] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:12.914729 25531 leader_election.cc:290] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:12.914714 25429 leader_election.cc:290] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Requested vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:12.939965 25438 raft_consensus.cc:493] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:12.931473 25188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:40887, user_credentials={real_user=slave}} blocked reactor thread for 56049us
I20260709 12:25:12.951357 25514 leader_election.cc:290] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Requested vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:12.927489 25532 raft_consensus.cc:515] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.963485 25557 raft_consensus.cc:493] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.980820 25423 raft_consensus.cc:359] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:12.981474 25423 raft_consensus.cc:385] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:12.981729 25423 raft_consensus.cc:740] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:12.984195 25423 consensus_queue.cc:260] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:12.961807 25438 raft_consensus.cc:515] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:12.998905 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50c1e80871a4f21a31521e37160b99f" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:13.001161 25145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c47c723f1bb4cd7b3ca0e8376ebb5e8" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:13.001600 25148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae8b407c5d34cfb85a405355e2befda" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:12.982281 25557 raft_consensus.cc:515] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:13.065661 25423 ts_tablet_manager.cc:1434] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.162s	user 0.007s	sys 0.004s
I20260709 12:25:13.059322 25298 raft_consensus.cc:2468] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 0.
I20260709 12:25:13.069427 25423 tablet_bootstrap.cc:492] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:13.002563 25148 raft_consensus.cc:2468] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 0.
I20260709 12:25:13.045939 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c47c723f1bb4cd7b3ca0e8376ebb5e8" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:13.059134 25145 raft_consensus.cc:2468] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:13.082993 25514 raft_consensus.cc:493] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.084252 25147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "192689638be442acb52df50f2137f664" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:13.074370 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae8b407c5d34cfb85a405355e2befda" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:13.086098 25143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30586f82b3764222905aebbb6896d886" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
W20260709 12:25:13.101985 25188 leader_election.cc:343] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:13.102921 25463 raft_consensus.cc:493] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.105930 25369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc47554d5e54ab4826c21fdd6126df0" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:13.103209 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50c1e80871a4f21a31521e37160b99f" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:13.086537 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30586f82b3764222905aebbb6896d886" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
W20260709 12:25:13.119270 25608 log.cc:927] Time spent T 0d0304837699431197f7e780344f1093 P d3979c425abd4ac7b2ca30e1dec9a154: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:25:13.120198 25418 tablet_bootstrap.cc:492] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:13.120625 25557 leader_election.cc:290] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:13.121820 25145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ef2af3aa69454aa946797dc87d6e9d" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:13.122493 25145 raft_consensus.cc:3060] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.120795 25418 ts_tablet_manager.cc:1403] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.389s	user 0.033s	sys 0.053s
I20260709 12:25:13.114635 25147 raft_consensus.cc:2393] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fa8f2c80074488084fea821c4bb293d in current term 1: Already voted for candidate 434d5783f9374eab8f587e0fe6c15b1c in this term.
I20260709 12:25:13.107133 25296 raft_consensus.cc:2468] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 0.
I20260709 12:25:13.103525 25463 raft_consensus.cc:515] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:13.093261 25514 raft_consensus.cc:515] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:13.111521 25143 raft_consensus.cc:2468] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:13.126310 25438 leader_election.cc:290] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:13.127328 25295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "192689638be442acb52df50f2137f664" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:13.115995 25220 raft_consensus.cc:2468] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
I20260709 12:25:13.160722 25418 raft_consensus.cc:359] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:13.161293 25418 raft_consensus.cc:385] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:13.141201 25532 leader_election.cc:290] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:13.161562 25418 raft_consensus.cc:740] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:13.168385 25421 tablet_bootstrap.cc:654] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:13.169876 25418 consensus_queue.cc:260] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:13.175480 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30586f82b3764222905aebbb6896d886" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:13.158445 25369 raft_consensus.cc:2468] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:13.162705 25295 raft_consensus.cc:2468] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 0.
I20260709 12:25:13.182868 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "192689638be442acb52df50f2137f664" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:13.168697 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1f8b45199a40aeaf77fa2e23107375" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:13.186271 25368 raft_consensus.cc:3060] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.185461 25418 ts_tablet_manager.cc:1434] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.062s	user 0.010s	sys 0.000s
I20260709 12:25:13.188367 25418 tablet_bootstrap.cc:492] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:13.188990 25423 tablet_bootstrap.cc:654] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:13.194087 25418 tablet_bootstrap.cc:654] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:13.183817 25147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6be441f38874ae7bb28069feed26b69" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:13.194847 25147 raft_consensus.cc:3060] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.196461 25514 leader_election.cc:290] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:13.174189 25338 leader_election.cc:304] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:13.204721 25514 raft_consensus.cc:2804] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:13.205044 25147 raft_consensus.cc:2468] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:13.205137 25514 raft_consensus.cc:493] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.205739 25514 raft_consensus.cc:3060] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.205950 25145 raft_consensus.cc:2468] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 1.
I20260709 12:25:13.206791 25463 leader_election.cc:290] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:13.205204 25338 leader_election.cc:304] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:13.210115 25338 leader_election.cc:304] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:13.210918 25611 raft_consensus.cc:2804] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:13.211314 25611 raft_consensus.cc:493] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.211627 25611 raft_consensus.cc:3060] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.215582 25514 raft_consensus.cc:515] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:13.183573 25296 raft_consensus.cc:2468] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
I20260709 12:25:13.195144 25572 raft_consensus.cc:515] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:13.184115 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ef2af3aa69454aa946797dc87d6e9d" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:13.233438 25219 raft_consensus.cc:3060] T a6ef2af3aa69454aa946797dc87d6e9d P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.252010 25223 raft_consensus.cc:2393] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fa8f2c80074488084fea821c4bb293d in current term 1: Already voted for candidate d3979c425abd4ac7b2ca30e1dec9a154 in this term.
I20260709 12:25:13.230785 25532 consensus_queue.cc:1048] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:25:13.261030 25514 leader_election.cc:290] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:13.262107 25189 leader_election.cc:304] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:13.262696 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "192689638be442acb52df50f2137f664" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:13.263347 25298 raft_consensus.cc:3060] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.263538 25189 leader_election.cc:304] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:13.264532 25189 leader_election.cc:304] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:13.265367 25610 raft_consensus.cc:2804] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:13.246408 25531 consensus_queue.cc:1048] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:25:13.265841 25423 tablet_bootstrap.cc:492] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:13.267350 25423 ts_tablet_manager.cc:1403] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.201s	user 0.017s	sys 0.011s
I20260709 12:25:13.275264 25615 raft_consensus.cc:2804] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:13.275930 25615 raft_consensus.cc:697] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:13.276794 25615 consensus_queue.cc:237] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
W20260709 12:25:13.277865 25419 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.111s	sys 0.152s
W20260709 12:25:13.278249 25419 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.111s	sys 0.152s
I20260709 12:25:13.268765 25612 raft_consensus.cc:2804] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:13.279498 25338 leader_election.cc:304] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c; no voters: 
I20260709 12:25:13.279816 25612 raft_consensus.cc:493] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.280232 25612 raft_consensus.cc:3060] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.281543 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50c1e80871a4f21a31521e37160b99f" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:13.282222 25297 raft_consensus.cc:3060] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.285776 25188 leader_election.cc:304] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:13.287117 25429 raft_consensus.cc:2804] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:13.287797 25429 raft_consensus.cc:493] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.288305 25429 raft_consensus.cc:3060] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.288654 25419 tablet_bootstrap.cc:492] T 0190ce7515c34431903f97febee4323e P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:13.288522 25368 raft_consensus.cc:2468] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 1.
I20260709 12:25:13.265767 25610 raft_consensus.cc:493] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.289239 25609 raft_consensus.cc:2764] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:25:13.290355 25418 tablet_bootstrap.cc:492] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:13.289199 25419 ts_tablet_manager.cc:1403] T 0190ce7515c34431903f97febee4323e P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.561s	user 0.121s	sys 0.152s
I20260709 12:25:13.290987 25418 ts_tablet_manager.cc:1403] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.103s	user 0.016s	sys 0.013s
I20260709 12:25:13.289278 25610 raft_consensus.cc:3060] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.293082 25572 leader_election.cc:290] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:13.272270 25295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc47554d5e54ab4826c21fdd6126df0" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:13.293681 25419 raft_consensus.cc:359] T 0190ce7515c34431903f97febee4323e P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:13.294360 25295 raft_consensus.cc:2468] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 0.
I20260709 12:25:13.256171 25110 leader_election.cc:304] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
W20260709 12:25:13.298589 25110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:41903, user_credentials={real_user=slave}} blocked reactor thread for 47009.3us
I20260709 12:25:13.298767 25531 raft_consensus.cc:2804] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:13.299333 25531 raft_consensus.cc:493] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.299667 25531 raft_consensus.cc:3060] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.301225 25458 raft_consensus.cc:2804] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:13.301744 25458 raft_consensus.cc:697] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d [term 1 LEADER]: Becoming Leader. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Running, Role: LEADER
W20260709 12:25:13.300405 25616 log.cc:927] Time spent T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d: Append to log took a long time: real 0.204s	user 0.004s	sys 0.002s
I20260709 12:25:13.306195 25418 raft_consensus.cc:359] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:13.306953 25418 raft_consensus.cc:385] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:13.307220 25418 raft_consensus.cc:740] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:13.302616 25458 consensus_queue.cc:237] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:13.314050 25418 consensus_queue.cc:260] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:13.316710 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30586f82b3764222905aebbb6896d886" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:13.319187 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcc5ac5532e4841a4f0a182a39a1914" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:13.294476 25419 raft_consensus.cc:385] T 0190ce7515c34431903f97febee4323e P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:13.333640 25419 raft_consensus.cc:740] T 0190ce7515c34431903f97febee4323e P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:13.295583 25369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50c1e80871a4f21a31521e37160b99f" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:13.335366 25419 consensus_queue.cc:260] T 0190ce7515c34431903f97febee4323e P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:13.347337 25418 ts_tablet_manager.cc:1434] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.000s
W20260709 12:25:13.326217 25335 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:41903, user_credentials={real_user=slave}} blocked reactor thread for 83116.4us
I20260709 12:25:13.285808 25611 raft_consensus.cc:515] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:13.310773 25263 leader_election.cc:304] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:13.351605 25418 tablet_bootstrap.cc:492] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
W20260709 12:25:13.345479 25260 leader_election.cc:343] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:13.358505 25438 raft_consensus.cc:2804] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:13.358983 25438 raft_consensus.cc:493] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.359329 25438 raft_consensus.cc:3060] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.361938 25612 raft_consensus.cc:515] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:13.362643 25297 raft_consensus.cc:2468] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 1.
I20260709 12:25:13.363363 25223 raft_consensus.cc:2393] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a28f2edcd70f4eb08f16021ba3e2cf14 in current term 1: Already voted for candidate d3979c425abd4ac7b2ca30e1dec9a154 in this term.
I20260709 12:25:13.344488 25338 leader_election.cc:304] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
W20260709 12:25:13.364609 25263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:38537, user_credentials={real_user=slave}} blocked reactor thread for 93561.3us
I20260709 12:25:13.365409 25421 tablet_bootstrap.cc:492] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:13.365938 25421 ts_tablet_manager.cc:1403] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.471s	user 0.021s	sys 0.004s
I20260709 12:25:13.367151 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50c1e80871a4f21a31521e37160b99f" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:13.368081 25294 raft_consensus.cc:2393] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3979c425abd4ac7b2ca30e1dec9a154 in current term 1: Already voted for candidate 0fa8f2c80074488084fea821c4bb293d in this term.
I20260709 12:25:13.369287 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30586f82b3764222905aebbb6896d886" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:13.369609 25611 leader_election.cc:290] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:13.356004 25369 raft_consensus.cc:2393] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d3979c425abd4ac7b2ca30e1dec9a154 in current term 1: Already voted for candidate 0fa8f2c80074488084fea821c4bb293d in this term.
I20260709 12:25:13.370056 25293 raft_consensus.cc:2468] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:13.374027 25292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc47554d5e54ab4826c21fdd6126df0" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:13.373824 25438 raft_consensus.cc:515] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:13.366235 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6be441f38874ae7bb28069feed26b69" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
W20260709 12:25:13.386392 25338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:45473, user_credentials={real_user=slave}} blocked reactor thread for 47027.4us
I20260709 12:25:13.350524 25112 leader_election.cc:304] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c; no voters: 
I20260709 12:25:13.387595 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50c1e80871a4f21a31521e37160b99f" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:13.388494 25220 raft_consensus.cc:2393] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0fa8f2c80074488084fea821c4bb293d in current term 1: Already voted for candidate d3979c425abd4ac7b2ca30e1dec9a154 in this term.
I20260709 12:25:13.393354 25419 ts_tablet_manager.cc:1434] T 0190ce7515c34431903f97febee4323e P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.102s	user 0.007s	sys 0.000s
I20260709 12:25:13.394811 25419 tablet_bootstrap.cc:492] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
W20260709 12:25:13.370059 25262 leader_election.cc:343] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:13.381402 25292 raft_consensus.cc:2468] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:13.395591 25611 raft_consensus.cc:2804] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:13.400487 25611 raft_consensus.cc:493] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.400995 25611 raft_consensus.cc:3060] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.403093 25491 raft_consensus.cc:2804] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:13.403662 25491 raft_consensus.cc:697] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:13.404600 25491 consensus_queue.cc:237] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:13.408039 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50c1e80871a4f21a31521e37160b99f" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:13.409003 25296 raft_consensus.cc:2393] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d3979c425abd4ac7b2ca30e1dec9a154 in current term 1: Already voted for candidate 0fa8f2c80074488084fea821c4bb293d in this term.
W20260709 12:25:13.396657 25112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:40887, user_credentials={real_user=slave}} blocked reactor thread for 53222us
I20260709 12:25:13.412156 25532 consensus_queue.cc:1048] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:13.412722 25338 leader_election.cc:304] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:13.398974 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc47554d5e54ab4826c21fdd6126df0" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
W20260709 12:25:13.415830 25262 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:40887, user_credentials={real_user=slave}} blocked reactor thread for 45813.7us
I20260709 12:25:13.416276 25145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae8b407c5d34cfb85a405355e2befda" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:13.416929 25145 raft_consensus.cc:3060] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.418443 25143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30586f82b3764222905aebbb6896d886" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:13.419500 25146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1f8b45199a40aeaf77fa2e23107375" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:13.380224 25429 raft_consensus.cc:515] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:13.390455 25531 raft_consensus.cc:515] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:13.421283 25143 raft_consensus.cc:2393] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a28f2edcd70f4eb08f16021ba3e2cf14 in current term 1: Already voted for candidate 434d5783f9374eab8f587e0fe6c15b1c in this term.
I20260709 12:25:13.421711 25429 leader_election.cc:290] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:13.422932 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30586f82b3764222905aebbb6896d886" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:13.423848 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc47554d5e54ab4826c21fdd6126df0" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:13.424497 25223 raft_consensus.cc:2393] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fa8f2c80074488084fea821c4bb293d in current term 1: Already voted for candidate d3979c425abd4ac7b2ca30e1dec9a154 in this term.
I20260709 12:25:13.423732 25220 raft_consensus.cc:2393] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 434d5783f9374eab8f587e0fe6c15b1c in current term 1: Already voted for candidate d3979c425abd4ac7b2ca30e1dec9a154 in this term.
I20260709 12:25:13.427273 25557 raft_consensus.cc:493] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.428045 25557 raft_consensus.cc:515] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:13.424081 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6be441f38874ae7bb28069feed26b69" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:13.410952 25423 raft_consensus.cc:359] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:13.429556 25423 raft_consensus.cc:385] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:13.429912 25423 raft_consensus.cc:740] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:13.430720 25557 leader_election.cc:290] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:13.422945 25219 raft_consensus.cc:2468] T a6ef2af3aa69454aa946797dc87d6e9d P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 1.
I20260709 12:25:13.431551 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae8b407c5d34cfb85a405355e2befda" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:13.432374 25296 raft_consensus.cc:2393] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0fa8f2c80074488084fea821c4bb293d in current term 1: Already voted for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in this term.
I20260709 12:25:13.434346 25531 leader_election.cc:290] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:13.434749 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0190ce7515c34431903f97febee4323e" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:13.435022 25531 raft_consensus.cc:493] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.435545 25531 raft_consensus.cc:515] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:13.416285 25421 raft_consensus.cc:359] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:13.436472 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0190ce7515c34431903f97febee4323e" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:13.437131 25219 raft_consensus.cc:2468] T 0190ce7515c34431903f97febee4323e P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 0.
I20260709 12:25:13.431417 25621 raft_consensus.cc:2804] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:25:13.438480 25262 leader_election.cc:343] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:13.438640 25621 raft_consensus.cc:697] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [term 1 LEADER]: Becoming Leader. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Running, Role: LEADER
I20260709 12:25:13.439507 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3d2388e4f54ed59c7760fab0dfc1ec" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
W20260709 12:25:13.441614 25110 leader_election.cc:343] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:13.443574 25423 consensus_queue.cc:260] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:13.445712 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae8b407c5d34cfb85a405355e2befda" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:13.451378 25370 raft_consensus.cc:2393] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a28f2edcd70f4eb08f16021ba3e2cf14 in current term 1: Already voted for candidate 0fa8f2c80074488084fea821c4bb293d in this term.
I20260709 12:25:13.439604 25621 consensus_queue.cc:237] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:13.454227 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30586f82b3764222905aebbb6896d886" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:13.454909 25296 raft_consensus.cc:3060] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.437134 25421 raft_consensus.cc:385] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:13.427376 25610 raft_consensus.cc:515] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:13.456892 25421 raft_consensus.cc:740] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:13.473615 25418 tablet_bootstrap.cc:654] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:13.450001 25298 raft_consensus.cc:2468] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 1.
I20260709 12:25:13.392990 25297 raft_consensus.cc:2468] T f6be441f38874ae7bb28069feed26b69 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:13.480893 25423 ts_tablet_manager.cc:1434] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.213s	user 0.010s	sys 0.000s
I20260709 12:25:13.482452 25423 tablet_bootstrap.cc:492] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:13.481909 25421 consensus_queue.cc:260] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:13.464987 25531 leader_election.cc:290] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:13.495844 25531 raft_consensus.cc:493] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.496388 25531 raft_consensus.cc:515] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:13.496960 25611 raft_consensus.cc:515] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:13.497884 25421 ts_tablet_manager.cc:1434] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.132s	user 0.009s	sys 0.000s
I20260709 12:25:13.498641 25531 leader_election.cc:290] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:13.498937 25421 tablet_bootstrap.cc:492] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:13.502012 25368 raft_consensus.cc:2393] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d3979c425abd4ac7b2ca30e1dec9a154 in current term 1: Already voted for candidate 0fa8f2c80074488084fea821c4bb293d in this term.
I20260709 12:25:13.502224 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc47554d5e54ab4826c21fdd6126df0" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:13.503054 25218 raft_consensus.cc:2393] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0fa8f2c80074488084fea821c4bb293d in current term 1: Already voted for candidate d3979c425abd4ac7b2ca30e1dec9a154 in this term.
I20260709 12:25:13.503638 25610 leader_election.cc:290] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:13.496798 25423 tablet_bootstrap.cc:654] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:13.522684 25419 tablet_bootstrap.cc:654] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:13.507164 25611 leader_election.cc:290] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
W20260709 12:25:13.517695 25112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:40887, user_credentials={real_user=slave}} blocked reactor thread for 91839.3us
I20260709 12:25:13.533324 25143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcc5ac5532e4841a4f0a182a39a1914" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:13.534077 25143 raft_consensus.cc:2468] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 0.
W20260709 12:25:13.534346 25263 leader_election.cc:343] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:13.534552 25369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3d2388e4f54ed59c7760fab0dfc1ec" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:13.534898 25263 leader_election.cc:304] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:13.536286 25263 leader_election.cc:304] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:13.536420 25463 raft_consensus.cc:2749] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:13.509766 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c47c723f1bb4cd7b3ca0e8376ebb5e8" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
W20260709 12:25:13.539167 25188 leader_election.cc:343] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:13.513234 25189 leader_election.cc:304] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:13.539913 25143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae8b407c5d34cfb85a405355e2befda" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:13.540307 25429 raft_consensus.cc:2749] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:13.543094 25143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30586f82b3764222905aebbb6896d886" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:13.543892 25260 leader_election.cc:304] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:13.544502 25146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c47c723f1bb4cd7b3ca0e8376ebb5e8" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:13.545121 25146 raft_consensus.cc:3060] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.545328 25557 raft_consensus.cc:2804] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:13.545725 25557 raft_consensus.cc:493] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.546085 25557 raft_consensus.cc:3060] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.511199 25438 leader_election.cc:290] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:13.561151 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc47554d5e54ab4826c21fdd6126df0" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:13.562223 25297 raft_consensus.cc:3060] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.543944 25143 raft_consensus.cc:2393] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d3979c425abd4ac7b2ca30e1dec9a154 in current term 1: Already voted for candidate 434d5783f9374eab8f587e0fe6c15b1c in this term.
I20260709 12:25:13.513897 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcc5ac5532e4841a4f0a182a39a1914" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:13.568528 25298 raft_consensus.cc:2468] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
I20260709 12:25:13.563541 25146 raft_consensus.cc:2468] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:13.570344 25612 leader_election.cc:290] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Requested vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:13.510780 25145 raft_consensus.cc:2468] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 1.
W20260709 12:25:13.539152 25112 leader_election.cc:343] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:13.581197 25112 leader_election.cc:304] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:13.584075 25630 raft_consensus.cc:2749] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:13.586313 25112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:40887, user_credentials={real_user=slave}} blocked reactor thread for 47202.8us
I20260709 12:25:13.588637 25113 leader_election.cc:304] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:13.588711 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc47554d5e54ab4826c21fdd6126df0" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:13.589412 25263 leader_election.cc:304] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:13.590299 25630 raft_consensus.cc:2804] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:13.590731 25630 raft_consensus.cc:493] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.590621 25297 raft_consensus.cc:2468] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 1.
I20260709 12:25:13.591331 25630 raft_consensus.cc:3060] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.592025 25438 raft_consensus.cc:2804] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:13.592434 25438 raft_consensus.cc:493] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.592494 25263 leader_election.cc:304] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:13.592882 25438 raft_consensus.cc:3060] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.592705 25338 leader_election.cc:304] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:13.594017 25611 raft_consensus.cc:2804] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:13.594682 25611 raft_consensus.cc:697] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [term 1 LEADER]: Becoming Leader. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Running, Role: LEADER
I20260709 12:25:13.595920 25611 consensus_queue.cc:237] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:13.599628 25296 raft_consensus.cc:2468] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 1.
I20260709 12:25:13.601034 25618 raft_consensus.cc:2749] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:13.605343 25438 raft_consensus.cc:515] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:13.607810 25438 leader_election.cc:290] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Requested vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:13.609489 25189 leader_election.cc:304] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:13.611536 25042 catalog_manager.cc:5697] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fa8f2c80074488084fea821c4bb293d (127.16.240.132). New cstate: current_term: 1 leader_uuid: "0fa8f2c80074488084fea821c4bb293d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:13.614158 25042 catalog_manager.cc:5697] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fa8f2c80074488084fea821c4bb293d (127.16.240.132). New cstate: current_term: 1 leader_uuid: "0fa8f2c80074488084fea821c4bb293d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:13.617218 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcc5ac5532e4841a4f0a182a39a1914" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:13.617532 25043 catalog_manager.cc:5697] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:13.613385 25612 raft_consensus.cc:2804] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:13.563565 25557 raft_consensus.cc:515] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:13.619144 25612 raft_consensus.cc:697] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
W20260709 12:25:13.624552 25110 leader_election.cc:343] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:13.620184 25618 raft_consensus.cc:2749] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:13.639891 25419 tablet_bootstrap.cc:492] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:13.640487 25419 ts_tablet_manager.cc:1403] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.246s	user 0.012s	sys 0.006s
I20260709 12:25:13.644240 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcc5ac5532e4841a4f0a182a39a1914" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:13.652719 25418 tablet_bootstrap.cc:492] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:13.656334 25189 leader_election.cc:304] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:13.647429 25113 leader_election.cc:304] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:13.661082 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0190ce7515c34431903f97febee4323e" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:13.663657 25630 raft_consensus.cc:515] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
W20260709 12:25:13.666100 25262 leader_election.cc:343] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:13.661217 25612 consensus_queue.cc:237] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:13.628110 25338 leader_election.cc:304] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c; no voters: a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:13.668242 25419 raft_consensus.cc:359] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:13.669631 25419 raft_consensus.cc:385] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:13.669946 25419 raft_consensus.cc:740] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:13.670182 25429 raft_consensus.cc:2749] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:13.671196 25419 consensus_queue.cc:260] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:13.654628 25418 ts_tablet_manager.cc:1403] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.306s	user 0.018s	sys 0.000s
I20260709 12:25:13.674139 25421 tablet_bootstrap.cc:654] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:13.675737 25423 tablet_bootstrap.cc:492] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:13.676883 25423 ts_tablet_manager.cc:1403] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.195s	user 0.025s	sys 0.006s
I20260709 12:25:13.673857 25419 ts_tablet_manager.cc:1434] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.001s
I20260709 12:25:13.668220 25630 leader_election.cc:290] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:13.671726 25632 raft_consensus.cc:2804] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:13.679133 25419 tablet_bootstrap.cc:492] T afcc5ac5532e4841a4f0a182a39a1914 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
W20260709 12:25:13.676748 25338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:38537, user_credentials={real_user=slave}} blocked reactor thread for 48797.3us
I20260709 12:25:13.682884 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcc5ac5532e4841a4f0a182a39a1914" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:13.683055 25145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcc5ac5532e4841a4f0a182a39a1914" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:13.684007 25145 raft_consensus.cc:2393] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a28f2edcd70f4eb08f16021ba3e2cf14 in current term 1: Already voted for candidate 434d5783f9374eab8f587e0fe6c15b1c in this term.
I20260709 12:25:13.686455 25632 raft_consensus.cc:697] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:13.686223 25423 raft_consensus.cc:359] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:13.687029 25423 raft_consensus.cc:385] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:13.687316 25423 raft_consensus.cc:740] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:13.687997 25423 consensus_queue.cc:260] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:13.689677 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30586f82b3764222905aebbb6896d886" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:13.690654 25293 raft_consensus.cc:2393] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d3979c425abd4ac7b2ca30e1dec9a154 in current term 1: Already voted for candidate 434d5783f9374eab8f587e0fe6c15b1c in this term.
I20260709 12:25:13.676137 25557 leader_election.cc:290] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:13.691035 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcc5ac5532e4841a4f0a182a39a1914" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:13.692380 25297 raft_consensus.cc:2393] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 434d5783f9374eab8f587e0fe6c15b1c in current term 1: Already voted for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in this term.
I20260709 12:25:13.692392 25423 ts_tablet_manager.cc:1434] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:25:13.672406 25611 raft_consensus.cc:2804] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:13.697216 25423 tablet_bootstrap.cc:492] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:13.687549 25632 consensus_queue.cc:237] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:13.698434 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0190ce7515c34431903f97febee4323e" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
W20260709 12:25:13.699285 25260 leader_election.cc:343] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:13.699710 25189 leader_election.cc:304] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
W20260709 12:25:13.700963 25110 leader_election.cc:343] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:13.698395 25418 raft_consensus.cc:359] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:13.706710 25220 raft_consensus.cc:3060] T 0190ce7515c34431903f97febee4323e P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.708119 25419 tablet_bootstrap.cc:654] T afcc5ac5532e4841a4f0a182a39a1914 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:13.711161 25418 raft_consensus.cc:385] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:13.711696 25418 raft_consensus.cc:740] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:13.713776 25418 consensus_queue.cc:260] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:13.717386 25418 ts_tablet_manager.cc:1434] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 12:25:13.718822 25418 tablet_bootstrap.cc:492] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:13.714358 25113 leader_election.cc:304] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:13.720851 25220 raft_consensus.cc:2468] T 0190ce7515c34431903f97febee4323e P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:13.721639 25630 raft_consensus.cc:2749] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:13.706130 25611 raft_consensus.cc:697] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d [term 1 LEADER]: Becoming Leader. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Running, Role: LEADER
I20260709 12:25:13.724126 25612 raft_consensus.cc:2749] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:13.732638 25621 consensus_queue.cc:1048] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:25:13.741343 25611 consensus_queue.cc:237] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:13.744675 25423 tablet_bootstrap.cc:654] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:13.746477 25092 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:13.756702 25260 leader_election.cc:304] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:13.763814 25557 raft_consensus.cc:493] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.764127 25438 raft_consensus.cc:2804] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:13.764446 25557 raft_consensus.cc:515] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:13.766907 25438 raft_consensus.cc:697] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:13.768603 25438 consensus_queue.cc:237] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:13.769088 25557 leader_election.cc:290] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:13.772171 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ecc3ffe78cf4eb091836a5e7d2393cc" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:13.748452 25263 leader_election.cc:304] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:13.773135 25621 raft_consensus.cc:493] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.781342 25621 raft_consensus.cc:515] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:13.785336 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b349920766b74e3aa849cd67521bf887" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
W20260709 12:25:13.786067 25260 leader_election.cc:343] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:13.786168 25293 raft_consensus.cc:2468] T b349920766b74e3aa849cd67521bf887 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 0.
I20260709 12:25:13.787403 25621 leader_election.cc:290] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:13.794034 25338 leader_election.cc:304] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:13.795935 25632 consensus_queue.cc:1048] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:13.797591 25418 tablet_bootstrap.cc:654] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:13.807562 25421 tablet_bootstrap.cc:492] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:13.808535 25557 raft_consensus.cc:2749] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:13.810446 25421 ts_tablet_manager.cc:1403] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.312s	user 0.011s	sys 0.017s
I20260709 12:25:13.809752 25621 raft_consensus.cc:2804] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:13.800386 25612 consensus_queue.cc:1048] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
W20260709 12:25:13.816212 25263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:38537, user_credentials={real_user=slave}} blocked reactor thread for 112737us
I20260709 12:25:13.828692 25419 tablet_bootstrap.cc:492] T afcc5ac5532e4841a4f0a182a39a1914 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:13.829267 25419 ts_tablet_manager.cc:1403] T afcc5ac5532e4841a4f0a182a39a1914 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.151s	user 0.011s	sys 0.010s
I20260709 12:25:13.824240 25143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b349920766b74e3aa849cd67521bf887" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:13.830178 25143 raft_consensus.cc:2468] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 0.
I20260709 12:25:13.831708 25632 raft_consensus.cc:493] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.832242 25632 raft_consensus.cc:515] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:13.832348 25419 raft_consensus.cc:359] T afcc5ac5532e4841a4f0a182a39a1914 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:13.835639 25419 raft_consensus.cc:385] T afcc5ac5532e4841a4f0a182a39a1914 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:13.837023 25423 tablet_bootstrap.cc:492] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:13.837507 25423 ts_tablet_manager.cc:1403] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.140s	user 0.018s	sys 0.003s
I20260709 12:25:13.818674 25621 raft_consensus.cc:493] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.836000 25419 raft_consensus.cc:740] T afcc5ac5532e4841a4f0a182a39a1914 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:13.832413 25143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ecc3ffe78cf4eb091836a5e7d2393cc" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:13.840824 25419 consensus_queue.cc:260] T afcc5ac5532e4841a4f0a182a39a1914 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:13.835315 25438 raft_consensus.cc:493] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.839993 25621 raft_consensus.cc:3060] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.847681 25418 tablet_bootstrap.cc:492] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:13.848718 25418 ts_tablet_manager.cc:1403] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.130s	user 0.009s	sys 0.011s
I20260709 12:25:13.850273 25632 leader_election.cc:290] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:13.852108 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb84b6ee4f14cdc9a40ffd59ca4f42c" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:13.852867 25368 raft_consensus.cc:2468] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 1.
I20260709 12:25:13.852682 25418 raft_consensus.cc:359] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:13.853492 25418 raft_consensus.cc:385] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:13.853787 25418 raft_consensus.cc:740] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:13.854992 25418 consensus_queue.cc:260] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:13.854588 25112 leader_election.cc:304] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c; no voters: 
I20260709 12:25:13.858299 25531 raft_consensus.cc:2804] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:13.858749 25531 raft_consensus.cc:493] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.859109 25531 raft_consensus.cc:3060] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:13.866164 25418 ts_tablet_manager.cc:1434] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:25:13.867928 25418 tablet_bootstrap.cc:492] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:13.870464 25419 ts_tablet_manager.cc:1434] T afcc5ac5532e4841a4f0a182a39a1914 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:25:13.872056 25419 tablet_bootstrap.cc:492] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:13.856741 25438 raft_consensus.cc:515] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:13.877712 25418 tablet_bootstrap.cc:654] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:13.879350 25438 leader_election.cc:290] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:13.879649 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d39dac4e3e343f2985681aa3c5e5718" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:13.906224 25369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d39dac4e3e343f2985681aa3c5e5718" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:13.907091 25612 raft_consensus.cc:493] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.925177 25612 raft_consensus.cc:515] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:13.927572 25612 leader_election.cc:290] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
W20260709 12:25:13.929136 25653 log.cc:927] Time spent T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:25:13.929443 25369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ea711322544c2999f94b52b35af150" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
W20260709 12:25:13.930907 25188 leader_election.cc:343] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:13.844710 25611 consensus_queue.cc:1048] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.064s
W20260709 12:25:13.900163 25260 leader_election.cc:343] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:13.911286 25045 catalog_manager.cc:5697] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 1 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:13.908118 25421 raft_consensus.cc:359] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:13.914726 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb84b6ee4f14cdc9a40ffd59ca4f42c" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
W20260709 12:25:13.916244 25263 leader_election.cc:343] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:13.919399 25423 raft_consensus.cc:359] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:13.937160 25421 raft_consensus.cc:385] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:13.937309 25423 raft_consensus.cc:385] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:13.937740 25423 raft_consensus.cc:740] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:13.937605 25421 raft_consensus.cc:740] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:13.938592 25423 consensus_queue.cc:260] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:13.938724 25263 leader_election.cc:304] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:13.940207 25621 raft_consensus.cc:515] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:13.941429 25423 ts_tablet_manager.cc:1434] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.104s	user 0.007s	sys 0.000s
I20260709 12:25:13.942883 25423 tablet_bootstrap.cc:492] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:13.945119 25297 raft_consensus.cc:2468] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 1.
I20260709 12:25:13.948423 25632 consensus_queue.cc:1048] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:25:13.948261 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ea711322544c2999f94b52b35af150" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:13.962678 25296 raft_consensus.cc:2468] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:13.965934 25421 consensus_queue.cc:260] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:13.970944 25189 leader_election.cc:304] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:13.972360 25621 leader_election.cc:290] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:13.972792 25610 raft_consensus.cc:2804] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:13.973417 25610 raft_consensus.cc:493] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.973928 25610 raft_consensus.cc:3060] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.981439 25145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b349920766b74e3aa849cd67521bf887" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:13.982169 25145 raft_consensus.cc:3060] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:13.982568 25419 tablet_bootstrap.cc:654] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:13.936977 25262 leader_election.cc:343] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:13.951627 25042 catalog_manager.cc:5697] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 0 to 1, leader changed from <none> to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:14.001489 25421 ts_tablet_manager.cc:1434] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.191s	user 0.007s	sys 0.005s
I20260709 12:25:13.947530 25438 raft_consensus.cc:2749] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:14.002561 25421 tablet_bootstrap.cc:492] T 0190ce7515c34431903f97febee4323e P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:13.939917 25531 raft_consensus.cc:515] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:13.989872 25293 raft_consensus.cc:3060] T f6be441f38874ae7bb28069feed26b69 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:14.020488 25423 tablet_bootstrap.cc:654] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:14.018850 25572 raft_consensus.cc:493] T afcc5ac5532e4841a4f0a182a39a1914 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.022135 25572 raft_consensus.cc:515] T afcc5ac5532e4841a4f0a182a39a1914 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:14.029461 25531 leader_election.cc:290] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:14.017691 25262 leader_election.cc:304] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154
W20260709 12:25:14.031472 25262 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:40887, user_credentials={real_user=slave}} blocked reactor thread for 100470us
I20260709 12:25:14.033448 25618 raft_consensus.cc:2749] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:14.033517 25292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b349920766b74e3aa849cd67521bf887" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:14.034420 25292 raft_consensus.cc:3060] T b349920766b74e3aa849cd67521bf887 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:14.031720 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb84b6ee4f14cdc9a40ffd59ca4f42c" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:14.040689 25418 tablet_bootstrap.cc:492] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:14.038475 25610 raft_consensus.cc:515] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:14.041427 25418 ts_tablet_manager.cc:1403] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.174s	user 0.020s	sys 0.035s
I20260709 12:25:14.039448 25297 raft_consensus.cc:3060] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:14.045432 25145 raft_consensus.cc:2468] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 1.
I20260709 12:25:14.060674 25338 leader_election.cc:304] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c; no voters: 
I20260709 12:25:14.062810 25458 raft_consensus.cc:2804] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:14.063357 25458 raft_consensus.cc:697] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d [term 1 LEADER]: Becoming Leader. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Running, Role: LEADER
I20260709 12:25:14.064251 25458 consensus_queue.cc:237] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:14.064845 25044 catalog_manager.cc:5697] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:14.068441 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb84b6ee4f14cdc9a40ffd59ca4f42c" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:14.069177 25370 raft_consensus.cc:3060] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:14.077710 25297 raft_consensus.cc:2468] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 2.
I20260709 12:25:14.079108 25113 leader_election.cc:304] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:14.080374 25370 raft_consensus.cc:2468] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 2.
I20260709 12:25:14.081816 25572 leader_election.cc:290] T afcc5ac5532e4841a4f0a182a39a1914 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:14.084295 25146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcc5ac5532e4841a4f0a182a39a1914" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:14.085191 25146 raft_consensus.cc:2393] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3979c425abd4ac7b2ca30e1dec9a154 in current term 1: Already voted for candidate 434d5783f9374eab8f587e0fe6c15b1c in this term.
I20260709 12:25:14.090406 25610 leader_election.cc:290] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:14.091069 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ea711322544c2999f94b52b35af150" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:14.091588 25369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ea711322544c2999f94b52b35af150" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:14.092046 25294 raft_consensus.cc:3060] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:14.093304 25188 leader_election.cc:343] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:14.096457 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcc5ac5532e4841a4f0a182a39a1914" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:14.097747 25296 raft_consensus.cc:2393] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3979c425abd4ac7b2ca30e1dec9a154 in current term 1: Already voted for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in this term.
I20260709 12:25:14.100842 25421 tablet_bootstrap.cc:654] T 0190ce7515c34431903f97febee4323e P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:14.100523 25531 raft_consensus.cc:2804] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:14.099242 25189 leader_election.cc:304] T afcc5ac5532e4841a4f0a182a39a1914 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:14.118602 25610 raft_consensus.cc:3060] T afcc5ac5532e4841a4f0a182a39a1914 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:14.111788 25418 raft_consensus.cc:359] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:14.120777 25531 raft_consensus.cc:697] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 2 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:14.121279 25615 consensus_queue.cc:1048] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:25:14.127218 25531 consensus_queue.cc:237] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:14.127533 25659 consensus_queue.cc:1048] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:14.122502 25418 raft_consensus.cc:385] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:14.129443 25418 raft_consensus.cc:740] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:14.131064 25418 consensus_queue.cc:260] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:14.133066 25659 consensus_queue.cc:1048] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:14.129660 25458 consensus_queue.cc:1048] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:25:14.136729 25292 raft_consensus.cc:2468] T b349920766b74e3aa849cd67521bf887 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 1.
I20260709 12:25:14.141016 25419 tablet_bootstrap.cc:492] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:14.141520 25532 raft_consensus.cc:493] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.172145 25532 raft_consensus.cc:515] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:14.143942 25610 raft_consensus.cc:2749] T afcc5ac5532e4841a4f0a182a39a1914 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:14.124905 25294 raft_consensus.cc:2468] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:14.152552 25418 ts_tablet_manager.cc:1434] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.110s	user 0.008s	sys 0.000s
I20260709 12:25:14.153517 25043 catalog_manager.cc:5697] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fa8f2c80074488084fea821c4bb293d (127.16.240.132). New cstate: current_term: 1 leader_uuid: "0fa8f2c80074488084fea821c4bb293d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:14.176009 25418 tablet_bootstrap.cc:492] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:14.176586 25043 catalog_manager.cc:5697] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fa8f2c80074488084fea821c4bb293d (127.16.240.132). New cstate: current_term: 1 leader_uuid: "0fa8f2c80074488084fea821c4bb293d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:14.177827 25532 leader_election.cc:290] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:14.163832 25423 tablet_bootstrap.cc:492] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:14.178467 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1f8b45199a40aeaf77fa2e23107375" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:14.179488 25423 ts_tablet_manager.cc:1403] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.237s	user 0.019s	sys 0.005s
W20260709 12:25:14.180466 25112 leader_election.cc:343] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:14.181360 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1f8b45199a40aeaf77fa2e23107375" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:14.183362 25418 tablet_bootstrap.cc:654] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:14.182054 25189 leader_election.cc:304] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:14.193717 25419 ts_tablet_manager.cc:1403] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.322s	user 0.018s	sys 0.002s
I20260709 12:25:14.182018 25294 raft_consensus.cc:2468] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
I20260709 12:25:14.201524 25045 catalog_manager.cc:5697] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 1 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:14.204839 25419 raft_consensus.cc:359] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:14.205797 25419 raft_consensus.cc:385] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:14.206148 25419 raft_consensus.cc:740] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:14.211802 25419 consensus_queue.cc:260] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:14.220796 25419 ts_tablet_manager.cc:1434] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.005s
I20260709 12:25:14.193022 25610 raft_consensus.cc:2804] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:14.226720 25423 raft_consensus.cc:359] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:14.228936 25423 raft_consensus.cc:385] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:14.229369 25423 raft_consensus.cc:740] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:14.230189 25423 consensus_queue.cc:260] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:14.233711 25113 leader_election.cc:304] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:14.235198 25630 raft_consensus.cc:2804] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:14.235632 25630 raft_consensus.cc:493] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.235982 25630 raft_consensus.cc:3060] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:14.225179 25532 raft_consensus.cc:493] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.254335 25532 raft_consensus.cc:515] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:14.241197 25610 raft_consensus.cc:697] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:14.255606 25458 consensus_queue.cc:1048] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:14.255900 25610 consensus_queue.cc:237] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:14.258356 25532 leader_election.cc:290] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:14.243643 25419 tablet_bootstrap.cc:492] T ff3d2388e4f54ed59c7760fab0dfc1ec P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:14.267644 25423 ts_tablet_manager.cc:1434] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.088s	user 0.008s	sys 0.000s
I20260709 12:25:14.269315 25423 tablet_bootstrap.cc:492] T 1bf33e1087ea4e7f98b37dd2c130c635 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:14.270090 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ecc3ffe78cf4eb091836a5e7d2393cc" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:14.272898 25043 catalog_manager.cc:5697] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fa8f2c80074488084fea821c4bb293d (127.16.240.132). New cstate: current_term: 1 leader_uuid: "0fa8f2c80074488084fea821c4bb293d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:14.279258 25418 tablet_bootstrap.cc:492] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:14.280066 25418 ts_tablet_manager.cc:1403] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.104s	user 0.022s	sys 0.031s
I20260709 12:25:14.273243 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ecc3ffe78cf4eb091836a5e7d2393cc" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:14.289590 25298 raft_consensus.cc:2468] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
I20260709 12:25:14.291383 25421 tablet_bootstrap.cc:492] T 0190ce7515c34431903f97febee4323e P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:14.291785 25630 raft_consensus.cc:515] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
W20260709 12:25:14.292636 25110 leader_election.cc:343] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:14.294106 25262 consensus_peers.cc:597] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Couldn't send request to peer 0fa8f2c80074488084fea821c4bb293d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:14.297262 25113 leader_election.cc:304] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:14.298794 25421 ts_tablet_manager.cc:1403] T 0190ce7515c34431903f97febee4323e P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.296s	user 0.027s	sys 0.007s
I20260709 12:25:14.299235 25632 raft_consensus.cc:2804] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:14.299669 25632 raft_consensus.cc:493] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.300051 25632 raft_consensus.cc:3060] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:14.301362 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1f8b45199a40aeaf77fa2e23107375" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:14.302028 25298 raft_consensus.cc:3060] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:14.302845 25418 raft_consensus.cc:359] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:14.303519 25418 raft_consensus.cc:385] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:14.303992 25418 raft_consensus.cc:740] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:14.304615 25418 consensus_queue.cc:260] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:14.313858 25659 consensus_queue.cc:1048] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:14.316432 25418 ts_tablet_manager.cc:1434] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 12:25:14.316598 25421 raft_consensus.cc:359] T 0190ce7515c34431903f97febee4323e P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:14.317310 25611 raft_consensus.cc:493] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.317540 25418 tablet_bootstrap.cc:492] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:14.317478 25421 raft_consensus.cc:385] T 0190ce7515c34431903f97febee4323e P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:14.318372 25423 tablet_bootstrap.cc:654] T 1bf33e1087ea4e7f98b37dd2c130c635 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:14.317883 25611 raft_consensus.cc:515] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:14.318318 25421 raft_consensus.cc:740] T 0190ce7515c34431903f97febee4323e P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:14.322896 25611 leader_election.cc:290] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:14.327874 25421 consensus_queue.cc:260] T 0190ce7515c34431903f97febee4323e P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:14.326967 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c47c723f1bb4cd7b3ca0e8376ebb5e8" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:14.331244 25572 consensus_queue.cc:1048] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:25:14.346500 25370 raft_consensus.cc:3060] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:14.347280 25438 consensus_queue.cc:1048] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:14.336915 25610 raft_consensus.cc:493] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.360536 25630 leader_election.cc:290] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:14.373484 25421 ts_tablet_manager.cc:1434] T 0190ce7515c34431903f97febee4323e P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 12:25:14.387444 25421 tablet_bootstrap.cc:492] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
W20260709 12:25:14.369786 25112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:40887, user_credentials={real_user=slave}} blocked reactor thread for 70942.8us
I20260709 12:25:14.395892 25369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1f8b45199a40aeaf77fa2e23107375" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:14.398904 25144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c47c723f1bb4cd7b3ca0e8376ebb5e8" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:14.399825 25144 raft_consensus.cc:2393] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fa8f2c80074488084fea821c4bb293d in current term 1: Already voted for candidate d3979c425abd4ac7b2ca30e1dec9a154 in this term.
I20260709 12:25:14.365324 25531 consensus_queue.cc:1048] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:25:14.425328 25675 consensus_queue.cc:1048] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:25:14.430912 25438 raft_consensus.cc:493] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.431567 25438 raft_consensus.cc:515] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:14.434237 25438 leader_election.cc:290] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:14.436537 25369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd0775b429544fcb31e2834c279b159" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
W20260709 12:25:14.438272 25262 leader_election.cc:343] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:14.371039 25610 raft_consensus.cc:515] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:14.444636 25338 leader_election.cc:304] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:14.444636 25621 consensus_queue.cc:1048] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:14.454726 25632 raft_consensus.cc:515] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:14.456411 25298 raft_consensus.cc:2468] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 1.
I20260709 12:25:14.460811 25418 tablet_bootstrap.cc:654] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:14.471987 25042 catalog_manager.cc:5697] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 0 to 2, leader changed from <none> to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 2 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:14.477566 25419 tablet_bootstrap.cc:654] T ff3d2388e4f54ed59c7760fab0dfc1ec P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:14.488727 25113 leader_election.cc:304] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:14.490640 25675 raft_consensus.cc:2804] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:14.491182 25675 raft_consensus.cc:697] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:14.492153 25675 consensus_queue.cc:237] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:14.493135 25423 tablet_bootstrap.cc:492] T 1bf33e1087ea4e7f98b37dd2c130c635 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:14.493664 25423 ts_tablet_manager.cc:1403] T 1bf33e1087ea4e7f98b37dd2c130c635 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.225s	user 0.011s	sys 0.040s
I20260709 12:25:14.494632 25421 tablet_bootstrap.cc:654] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:14.508517 25145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd0775b429544fcb31e2834c279b159" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
W20260709 12:25:14.510118 25112 leader_election.cc:343] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:14.511934 25263 leader_election.cc:343] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:14.512578 25263 leader_election.cc:304] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:14.514577 25423 raft_consensus.cc:359] T 1bf33e1087ea4e7f98b37dd2c130c635 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:14.515388 25423 raft_consensus.cc:385] T 1bf33e1087ea4e7f98b37dd2c130c635 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:14.514349 25603 raft_consensus.cc:2749] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:14.519424 25423 raft_consensus.cc:740] T 1bf33e1087ea4e7f98b37dd2c130c635 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:14.521448 25423 consensus_queue.cc:260] T 1bf33e1087ea4e7f98b37dd2c130c635 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:14.523283 25632 leader_election.cc:290] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:14.523694 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ecc3ffe78cf4eb091836a5e7d2393cc" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
W20260709 12:25:14.525221 25110 leader_election.cc:343] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:14.525375 25622 raft_consensus.cc:2749] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:14.525812 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ecc3ffe78cf4eb091836a5e7d2393cc" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:14.526611 25298 raft_consensus.cc:3060] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:14.529382 25615 consensus_queue.cc:1048] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:14.543175 25423 ts_tablet_manager.cc:1434] T 1bf33e1087ea4e7f98b37dd2c130c635 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 12:25:14.547160 25423 tablet_bootstrap.cc:492] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:14.544899 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63327743a40345e4b149aca740d0944a" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
W20260709 12:25:14.550112 25188 leader_election.cc:343] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:14.539535 25260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:41903, user_credentials={real_user=slave}} blocked reactor thread for 106736us
I20260709 12:25:14.595788 25298 raft_consensus.cc:2468] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 1.
I20260709 12:25:14.600910 25113 leader_election.cc:304] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:14.602843 25632 raft_consensus.cc:2804] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:14.603915 25610 leader_election.cc:290] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:14.606546 25146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63327743a40345e4b149aca740d0944a" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:14.603623 25632 raft_consensus.cc:697] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:14.606083 25043 catalog_manager.cc:5697] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:14.607354 25146 raft_consensus.cc:2468] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:14.611403 25189 leader_election.cc:304] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:14.614442 25429 raft_consensus.cc:2804] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:14.614859 25429 raft_consensus.cc:493] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.615211 25429 raft_consensus.cc:3060] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:14.608112 25632 consensus_queue.cc:237] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:14.624243 25429 raft_consensus.cc:515] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:14.626942 25621 consensus_queue.cc:1048] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:25:14.651362 25658 raft_consensus.cc:493] T 0190ce7515c34431903f97febee4323e P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.652251 25658 raft_consensus.cc:515] T 0190ce7515c34431903f97febee4323e P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:14.674018 25298 raft_consensus.cc:1275] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:25:14.678774 25419 tablet_bootstrap.cc:492] T ff3d2388e4f54ed59c7760fab0dfc1ec P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:14.679966 25676 consensus_queue.cc:1048] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:14.680423 25418 tablet_bootstrap.cc:492] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:14.680763 25421 tablet_bootstrap.cc:492] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:14.680958 25418 ts_tablet_manager.cc:1403] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.364s	user 0.008s	sys 0.019s
I20260709 12:25:14.681229 25421 ts_tablet_manager.cc:1403] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.294s	user 0.016s	sys 0.004s
I20260709 12:25:14.684513 25423 tablet_bootstrap.cc:654] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:14.687599 25419 ts_tablet_manager.cc:1403] T ff3d2388e4f54ed59c7760fab0dfc1ec P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.464s	user 0.035s	sys 0.021s
I20260709 12:25:14.689658 25418 raft_consensus.cc:359] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:14.690435 25418 raft_consensus.cc:385] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:14.690712 25418 raft_consensus.cc:740] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:14.691037 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0190ce7515c34431903f97febee4323e" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:14.691923 25429 leader_election.cc:290] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:14.693284 25369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63327743a40345e4b149aca740d0944a" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:14.691409 25418 consensus_queue.cc:260] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:14.696178 25418 ts_tablet_manager.cc:1434] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.003s
W20260709 12:25:14.697232 25188 leader_election.cc:343] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:14.703970 25143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63327743a40345e4b149aca740d0944a" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:14.704236 25421 raft_consensus.cc:359] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:14.704751 25143 raft_consensus.cc:3060] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:14.705075 25421 raft_consensus.cc:385] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:14.705638 25421 raft_consensus.cc:740] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:14.706503 25421 consensus_queue.cc:260] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:14.711781 25418 tablet_bootstrap.cc:492] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:14.707931 25419 raft_consensus.cc:359] T ff3d2388e4f54ed59c7760fab0dfc1ec P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:14.712471 25419 raft_consensus.cc:385] T ff3d2388e4f54ed59c7760fab0dfc1ec P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:14.712838 25419 raft_consensus.cc:740] T ff3d2388e4f54ed59c7760fab0dfc1ec P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:14.713721 25419 consensus_queue.cc:260] T ff3d2388e4f54ed59c7760fab0dfc1ec P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:14.716148 25419 ts_tablet_manager.cc:1434] T ff3d2388e4f54ed59c7760fab0dfc1ec P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 12:25:14.716513 25658 leader_election.cc:290] T 0190ce7515c34431903f97febee4323e P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:14.718170 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0190ce7515c34431903f97febee4323e" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:14.719048 25143 raft_consensus.cc:2468] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:14.719425 25421 ts_tablet_manager.cc:1434] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 12:25:14.724499 25338 leader_election.cc:304] T 0190ce7515c34431903f97febee4323e P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:14.725682 25658 raft_consensus.cc:2749] T 0190ce7515c34431903f97febee4323e P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:14.726416 25421 tablet_bootstrap.cc:492] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:14.720283 25419 tablet_bootstrap.cc:492] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:14.750192 25418 tablet_bootstrap.cc:654] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:14.751773 25419 tablet_bootstrap.cc:654] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:14.751929 25621 consensus_queue.cc:1048] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:14.753859 25421 tablet_bootstrap.cc:654] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:14.756405 25189 leader_election.cc:304] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:14.756321 25423 tablet_bootstrap.cc:492] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:14.770800 25423 ts_tablet_manager.cc:1403] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.227s	user 0.017s	sys 0.000s
I20260709 12:25:14.783070 25370 raft_consensus.cc:1275] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:25:14.739871 25632 raft_consensus.cc:493] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.790624 25676 consensus_queue.cc:1048] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:14.788990 25429 raft_consensus.cc:2804] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:14.813035 25429 raft_consensus.cc:697] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:14.813951 25429 consensus_queue.cc:237] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:14.812402 25369 raft_consensus.cc:3060] T 0190ce7515c34431903f97febee4323e P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:14.791044 25632 raft_consensus.cc:515] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
W20260709 12:25:14.824481 25188 consensus_peers.cc:597] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Couldn't send request to peer 0fa8f2c80074488084fea821c4bb293d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:14.828918 25044 catalog_manager.cc:5697] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 1 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:14.832978 25044 catalog_manager.cc:5697] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 1 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:14.841353 25458 raft_consensus.cc:493] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.852049 25418 tablet_bootstrap.cc:492] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:14.852622 25418 ts_tablet_manager.cc:1403] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.141s	user 0.016s	sys 0.017s
I20260709 12:25:14.858256 25418 raft_consensus.cc:359] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:14.859093 25418 raft_consensus.cc:385] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:14.859404 25418 raft_consensus.cc:740] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:14.852427 25458 raft_consensus.cc:515] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:14.850850 25615 consensus_queue.cc:1048] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:25:14.864075 25418 consensus_queue.cc:260] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:14.867646 25418 ts_tablet_manager.cc:1434] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 12:25:14.872025 25418 tablet_bootstrap.cc:492] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:14.882792 25423 raft_consensus.cc:359] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:14.883538 25423 raft_consensus.cc:385] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:14.885031 25632 leader_election.cc:290] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:14.886230 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640ac5b087574063b50e6611b7e8da5b" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:14.887240 25419 tablet_bootstrap.cc:492] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
W20260709 12:25:14.887938 25110 leader_election.cc:343] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:14.890476 25458 leader_election.cc:290] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:14.891520 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640ac5b087574063b50e6611b7e8da5b" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:14.892792 25685 raft_consensus.cc:493] T 1bf33e1087ea4e7f98b37dd2c130c635 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.906215 25685 raft_consensus.cc:515] T 1bf33e1087ea4e7f98b37dd2c130c635 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:14.908782 25685 leader_election.cc:290] T 1bf33e1087ea4e7f98b37dd2c130c635 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:14.909288 25143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3d2388e4f54ed59c7760fab0dfc1ec" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:14.909528 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3d2388e4f54ed59c7760fab0dfc1ec" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:14.910022 25143 raft_consensus.cc:2468] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 0.
I20260709 12:25:14.910458 25218 raft_consensus.cc:2468] T ff3d2388e4f54ed59c7760fab0dfc1ec P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 0.
I20260709 12:25:14.911639 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf33e1087ea4e7f98b37dd2c130c635" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
W20260709 12:25:14.913190 25260 leader_election.cc:343] T 1bf33e1087ea4e7f98b37dd2c130c635 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:14.914498 25335 leader_election.cc:304] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
W20260709 12:25:14.916200 25113 leader_election.cc:343] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:14.916657 25611 raft_consensus.cc:2804] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:14.916712 25113 leader_election.cc:304] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:14.897078 25418 tablet_bootstrap.cc:654] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:14.917852 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf33e1087ea4e7f98b37dd2c130c635" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:14.899556 25419 ts_tablet_manager.cc:1403] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.179s	user 0.016s	sys 0.018s
I20260709 12:25:14.917194 25611 raft_consensus.cc:493] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.883826 25423 raft_consensus.cc:740] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:14.920967 25611 raft_consensus.cc:3060] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:14.928920 25423 consensus_queue.cc:260] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:14.955197 25423 ts_tablet_manager.cc:1434] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.184s	user 0.014s	sys 0.003s
I20260709 12:25:14.919916 25632 raft_consensus.cc:2749] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:14.931921 25421 tablet_bootstrap.cc:492] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:14.957151 25421 ts_tablet_manager.cc:1403] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.232s	user 0.017s	sys 0.037s
I20260709 12:25:14.962891 25423 tablet_bootstrap.cc:492] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
W20260709 12:25:14.919965 25262 leader_election.cc:343] T 1bf33e1087ea4e7f98b37dd2c130c635 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:14.964638 25262 leader_election.cc:304] T 1bf33e1087ea4e7f98b37dd2c130c635 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:14.965538 25685 raft_consensus.cc:2749] T 1bf33e1087ea4e7f98b37dd2c130c635 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:14.965794 25262 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:40887, user_credentials={real_user=slave}} blocked reactor thread for 45867us
I20260709 12:25:14.970814 25421 raft_consensus.cc:359] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:14.972126 25421 raft_consensus.cc:385] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:14.972719 25421 raft_consensus.cc:740] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:14.974915 25419 raft_consensus.cc:359] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:14.976294 25419 raft_consensus.cc:385] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:14.976630 25419 raft_consensus.cc:740] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:14.977684 25419 consensus_queue.cc:260] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
W20260709 12:25:14.991663 25112 consensus_peers.cc:597] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c -> Peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Couldn't send request to peer 0fa8f2c80074488084fea821c4bb293d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:15.001531 25423 tablet_bootstrap.cc:654] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.004855 25677 raft_consensus.cc:493] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.005439 25677 raft_consensus.cc:515] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:15.009579 25418 tablet_bootstrap.cc:492] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:15.010367 25418 ts_tablet_manager.cc:1403] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.139s	user 0.016s	sys 0.006s
I20260709 12:25:15.012928 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc69e13d835645099f9e0e5bea99665a" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
W20260709 12:25:15.014670 25112 leader_election.cc:343] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.014344 25677 leader_election.cc:290] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:15.015235 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc69e13d835645099f9e0e5bea99665a" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:15.016288 25043 catalog_manager.cc:5697] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:15.017076 25110 leader_election.cc:343] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.020409 25110 leader_election.cc:304] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154
W20260709 12:25:15.034101 25092 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:15.035665 25419 ts_tablet_manager.cc:1434] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.115s	user 0.006s	sys 0.002s
I20260709 12:25:15.036731 25419 tablet_bootstrap.cc:492] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:15.035265 25421 consensus_queue.cc:260] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:15.040488 25611 raft_consensus.cc:515] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:15.045328 25419 tablet_bootstrap.cc:654] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.043318 25421 ts_tablet_manager.cc:1434] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.086s	user 0.010s	sys 0.000s
I20260709 12:25:15.047071 25421 tablet_bootstrap.cc:492] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:15.047195 25676 consensus_queue.cc:1048] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:15.024381 25677 raft_consensus.cc:2749] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:15.049844 25418 raft_consensus.cc:359] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:15.050688 25418 raft_consensus.cc:385] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.051229 25418 raft_consensus.cc:740] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.054728 25418 consensus_queue.cc:260] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:15.059597 25143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3d2388e4f54ed59c7760fab0dfc1ec" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:15.060343 25143 raft_consensus.cc:3060] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.062430 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3d2388e4f54ed59c7760fab0dfc1ec" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:15.063112 25218 raft_consensus.cc:3060] T ff3d2388e4f54ed59c7760fab0dfc1ec P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.063548 25423 tablet_bootstrap.cc:492] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:15.064112 25423 ts_tablet_manager.cc:1403] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.108s	user 0.013s	sys 0.000s
I20260709 12:25:15.066954 25423 raft_consensus.cc:359] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:15.067633 25423 raft_consensus.cc:385] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.067945 25423 raft_consensus.cc:740] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.071349 25143 raft_consensus.cc:2468] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 1.
I20260709 12:25:15.072754 25338 leader_election.cc:304] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c; no voters: 
I20260709 12:25:15.073680 25703 raft_consensus.cc:2804] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:15.074169 25703 raft_consensus.cc:697] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d [term 1 LEADER]: Becoming Leader. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Running, Role: LEADER
I20260709 12:25:15.074975 25703 consensus_queue.cc:237] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:15.082334 25423 consensus_queue.cc:260] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:15.086133 25423 ts_tablet_manager.cc:1434] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:25:15.089496 25218 raft_consensus.cc:2468] T ff3d2388e4f54ed59c7760fab0dfc1ec P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 1.
I20260709 12:25:15.092422 25423 tablet_bootstrap.cc:492] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:15.094103 25421 tablet_bootstrap.cc:654] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.082180 25611 leader_election.cc:290] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 election: Requested vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:15.112010 25218 raft_consensus.cc:3060] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.116138 25683 raft_consensus.cc:493] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.116662 25421 tablet_bootstrap.cc:492] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:15.116729 25683 raft_consensus.cc:515] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:15.117940 25423 tablet_bootstrap.cc:654] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.118079 25421 ts_tablet_manager.cc:1403] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.004s
I20260709 12:25:15.122330 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f447960df41a5ade2459879b92b17" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:15.122561 25421 raft_consensus.cc:359] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
W20260709 12:25:15.124212 25262 leader_election.cc:343] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.127692 25143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f447960df41a5ade2459879b92b17" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
W20260709 12:25:15.130465 25263 leader_election.cc:343] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.130954 25263 leader_election.cc:304] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:15.131991 25685 raft_consensus.cc:2749] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:15.128369 25683 leader_election.cc:290] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:15.135190 25418 ts_tablet_manager.cc:1434] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.124s	user 0.005s	sys 0.005s
I20260709 12:25:15.123633 25421 raft_consensus.cc:385] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.136535 25418 tablet_bootstrap.cc:492] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:15.136194 25421 raft_consensus.cc:740] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.137789 25421 consensus_queue.cc:260] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:15.147485 25421 ts_tablet_manager.cc:1434] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 12:25:15.149410 25683 raft_consensus.cc:493] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.150092 25683 raft_consensus.cc:515] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:15.152998 25683 leader_election.cc:290] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:15.154418 25143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3459b31870574ae4aa816cf5ee28162b" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
W20260709 12:25:15.155860 25263 leader_election.cc:343] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.157708 25419 tablet_bootstrap.cc:492] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:15.158371 25419 ts_tablet_manager.cc:1403] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.122s	user 0.020s	sys 0.026s
I20260709 12:25:15.164885 25419 raft_consensus.cc:359] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:15.165616 25419 raft_consensus.cc:385] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.165892 25419 raft_consensus.cc:740] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.168440 25675 consensus_queue.cc:1048] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:15.169552 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3459b31870574ae4aa816cf5ee28162b" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
W20260709 12:25:15.171686 25262 leader_election.cc:343] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.172207 25262 leader_election.cc:304] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:15.173010 25685 raft_consensus.cc:2749] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:15.173597 25421 tablet_bootstrap.cc:492] T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:15.166860 25419 consensus_queue.cc:260] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:15.188302 25419 ts_tablet_manager.cc:1434] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:25:15.189590 25419 tablet_bootstrap.cc:492] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:15.199246 25419 tablet_bootstrap.cc:654] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.207976 25423 tablet_bootstrap.cc:492] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:15.208721 25423 ts_tablet_manager.cc:1403] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.117s	user 0.016s	sys 0.006s
I20260709 12:25:15.212801 25423 raft_consensus.cc:359] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:15.213832 25423 raft_consensus.cc:385] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.216063 25423 raft_consensus.cc:740] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.220238 25423 consensus_queue.cc:260] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:15.221540 25369 raft_consensus.cc:3060] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.235036 25632 consensus_queue.cc:1048] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:25:15.270550 25429 consensus_queue.cc:1048] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:15.278671 25043 catalog_manager.cc:5697] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fa8f2c80074488084fea821c4bb293d (127.16.240.132). New cstate: current_term: 1 leader_uuid: "0fa8f2c80074488084fea821c4bb293d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:15.283260 25418 tablet_bootstrap.cc:654] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.302965 25429 consensus_queue.cc:1048] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:15.223498 25423 ts_tablet_manager.cc:1434] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:25:15.321825 25423 tablet_bootstrap.cc:492] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:15.328931 25421 tablet_bootstrap.cc:700] T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d: Time spent opening tablet: real 0.115s	user 0.002s	sys 0.001s
I20260709 12:25:15.329929 25421 tablet_bootstrap.cc:654] T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.375504 25418 tablet_bootstrap.cc:492] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:15.376123 25418 ts_tablet_manager.cc:1403] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.240s	user 0.013s	sys 0.000s
I20260709 12:25:15.382273 25418 raft_consensus.cc:359] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:15.383134 25418 raft_consensus.cc:385] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.383468 25418 raft_consensus.cc:740] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.388470 25418 consensus_queue.cc:260] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:15.394106 25418 ts_tablet_manager.cc:1434] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 12:25:15.395241 25418 tablet_bootstrap.cc:492] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:15.409503 25676 raft_consensus.cc:493] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.410526 25418 tablet_bootstrap.cc:654] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.410322 25676 raft_consensus.cc:515] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:15.415153 25621 raft_consensus.cc:493] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.416047 25621 raft_consensus.cc:515] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:15.417373 25676 leader_election.cc:290] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:15.418346 25621 leader_election.cc:290] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:15.419183 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd0775b429544fcb31e2834c279b159" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:15.420105 25293 raft_consensus.cc:2468] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
I20260709 12:25:15.420485 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd0775b429544fcb31e2834c279b159" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
W20260709 12:25:15.422115 25112 leader_election.cc:343] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.424198 25143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1f8b45199a40aeaf77fa2e23107375" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:15.424364 25113 leader_election.cc:304] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:15.426175 25677 raft_consensus.cc:2804] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:15.426713 25677 raft_consensus.cc:493] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.427160 25677 raft_consensus.cc:3060] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.427047 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1f8b45199a40aeaf77fa2e23107375" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:15.441672 25338 leader_election.cc:304] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:15.443856 25621 raft_consensus.cc:2749] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:15.455935 25677 raft_consensus.cc:515] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:15.459569 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd0775b429544fcb31e2834c279b159" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:15.460041 25419 tablet_bootstrap.cc:492] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:15.460240 25293 raft_consensus.cc:3060] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.460649 25419 ts_tablet_manager.cc:1403] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.272s	user 0.106s	sys 0.102s
I20260709 12:25:15.463694 25419 raft_consensus.cc:359] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:15.465409 25419 raft_consensus.cc:385] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.465672 25419 raft_consensus.cc:740] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.465982 25683 raft_consensus.cc:493] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.466810 25423 tablet_bootstrap.cc:654] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.466507 25683 raft_consensus.cc:515] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:15.468827 25419 consensus_queue.cc:260] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:15.470871 25683 leader_election.cc:290] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:15.471052 25419 ts_tablet_manager.cc:1434] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:25:15.472427 25421 tablet_bootstrap.cc:492] T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:15.472518 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcc5ac5532e4841a4f0a182a39a1914" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:15.472786 25143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcc5ac5532e4841a4f0a182a39a1914" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:15.473276 25218 raft_consensus.cc:2468] T afcc5ac5532e4841a4f0a182a39a1914 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:15.473543 25143 raft_consensus.cc:2468] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:15.474872 25260 leader_election.cc:304] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:15.476907 25683 raft_consensus.cc:2804] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:15.477293 25683 raft_consensus.cc:493] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.477634 25683 raft_consensus.cc:3060] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:15.479137 25419 tablet_bootstrap.cc:492] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:15.489078 25419 tablet_bootstrap.cc:654] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.489993 25677 leader_election.cc:290] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:15.491938 25293 raft_consensus.cc:2468] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 1.
I20260709 12:25:15.493594 25369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd0775b429544fcb31e2834c279b159" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:15.493862 25113 leader_election.cc:304] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:15.473059 25421 ts_tablet_manager.cc:1403] T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.300s	user 0.029s	sys 0.041s
I20260709 12:25:15.499460 25677 raft_consensus.cc:2804] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:15.500144 25677 raft_consensus.cc:697] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
W20260709 12:25:15.496400 25112 leader_election.cc:343] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.503635 25421 raft_consensus.cc:359] T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:15.504665 25421 raft_consensus.cc:385] T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.516273 25419 tablet_bootstrap.cc:492] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:15.507732 25418 tablet_bootstrap.cc:492] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:15.523694 25419 ts_tablet_manager.cc:1403] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.015s
I20260709 12:25:15.510598 25369 raft_consensus.cc:3060] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.519428 25615 raft_consensus.cc:493] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.524971 25615 raft_consensus.cc:515] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:15.526854 25419 raft_consensus.cc:359] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:15.527628 25419 raft_consensus.cc:385] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.527923 25419 raft_consensus.cc:740] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.528028 25143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640ac5b087574063b50e6611b7e8da5b" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:15.504981 25421 raft_consensus.cc:740] T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.528744 25143 raft_consensus.cc:2468] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:15.528828 25419 consensus_queue.cc:260] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:15.528869 25683 raft_consensus.cc:515] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:15.529280 25421 consensus_queue.cc:260] T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:15.530676 25189 leader_election.cc:304] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:15.531400 25691 raft_consensus.cc:2804] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:15.531793 25691 raft_consensus.cc:493] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.532152 25691 raft_consensus.cc:3060] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.533161 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640ac5b087574063b50e6611b7e8da5b" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
W20260709 12:25:15.534713 25189 leader_election.cc:343] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.535944 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcc5ac5532e4841a4f0a182a39a1914" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:15.536556 25218 raft_consensus.cc:3060] T afcc5ac5532e4841a4f0a182a39a1914 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:15.537360 25419 ts_tablet_manager.cc:1434] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:25:15.538919 25717 raft_consensus.cc:493] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.539812 25421 ts_tablet_manager.cc:1434] T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 12:25:15.539459 25717 raft_consensus.cc:515] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:15.538465 25419 tablet_bootstrap.cc:492] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:15.544489 25421 tablet_bootstrap.cc:492] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:15.541831 25429 raft_consensus.cc:493] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.545244 25429 raft_consensus.cc:515] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:15.523911 25418 ts_tablet_manager.cc:1403] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.129s	user 0.017s	sys 0.008s
I20260709 12:25:15.548185 25429 leader_election.cc:290] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:15.549460 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d39dac4e3e343f2985681aa3c5e5718" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
W20260709 12:25:15.551215 25188 leader_election.cc:343] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.532249 25143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcc5ac5532e4841a4f0a182a39a1914" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:15.552642 25143 raft_consensus.cc:3060] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:15.553020 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d39dac4e3e343f2985681aa3c5e5718" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:15.552915 25418 raft_consensus.cc:359] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:15.553200 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d39dac4e3e343f2985681aa3c5e5718" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:15.553673 25717 leader_election.cc:290] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:15.549741 25419 tablet_bootstrap.cc:654] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.554687 25418 raft_consensus.cc:385] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.554927 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d39dac4e3e343f2985681aa3c5e5718" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:15.554991 25418 raft_consensus.cc:740] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
W20260709 12:25:15.555130 25262 leader_election.cc:343] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.556411 25418 consensus_queue.cc:260] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:15.553846 25220 raft_consensus.cc:2468] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 0.
I20260709 12:25:15.506668 25423 tablet_bootstrap.cc:492] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:15.559542 25423 ts_tablet_manager.cc:1403] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.238s	user 0.011s	sys 0.013s
I20260709 12:25:15.562351 25423 raft_consensus.cc:359] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:15.565538 25423 raft_consensus.cc:385] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.565836 25423 raft_consensus.cc:740] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.566921 25418 ts_tablet_manager.cc:1434] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:25:15.564783 25615 leader_election.cc:290] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:15.567626 25260 leader_election.cc:304] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:15.568073 25418 tablet_bootstrap.cc:492] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:15.569518 25423 consensus_queue.cc:260] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:15.556346 25296 raft_consensus.cc:2468] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:15.532037 25683 leader_election.cc:290] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: Requested vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:15.584262 25189 leader_election.cc:304] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:15.577028 25717 raft_consensus.cc:2804] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:15.589366 25615 raft_consensus.cc:2804] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:15.590039 25717 raft_consensus.cc:493] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.590258 25615 raft_consensus.cc:493] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.590603 25717 raft_consensus.cc:3060] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.590675 25615 raft_consensus.cc:3060] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.599900 25423 ts_tablet_manager.cc:1434] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.001s
I20260709 12:25:15.504966 25677 consensus_queue.cc:237] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:15.607600 25429 raft_consensus.cc:493] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.609393 25429 raft_consensus.cc:515] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:15.609514 25685 raft_consensus.cc:493] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.601130 25423 tablet_bootstrap.cc:492] T bffd5eeaa9c14effb9e1ffc29a23ff01 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:15.612870 25685 raft_consensus.cc:515] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:15.613984 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf33e1087ea4e7f98b37dd2c130c635" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:15.614746 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf33e1087ea4e7f98b37dd2c130c635" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:15.615686 25685 leader_election.cc:290] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:15.616008 25146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a01e9d0014411a83a8edbf3b5504f6" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:15.613265 25429 leader_election.cc:290] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:15.617337 25146 raft_consensus.cc:2468] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 0.
I20260709 12:25:15.618745 25263 leader_election.cc:304] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:15.614691 25293 raft_consensus.cc:2468] T 1bf33e1087ea4e7f98b37dd2c130c635 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:15.609615 25218 raft_consensus.cc:2468] T afcc5ac5532e4841a4f0a182a39a1914 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 2.
I20260709 12:25:15.621363 25685 raft_consensus.cc:2804] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:15.627086 25421 tablet_bootstrap.cc:654] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.627008 25685 raft_consensus.cc:493] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.629961 25685 raft_consensus.cc:3060] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.632037 25189 leader_election.cc:304] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:15.629841 25260 leader_election.cc:304] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:15.615898 25691 raft_consensus.cc:515] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:15.634939 25429 raft_consensus.cc:2804] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:15.635385 25429 raft_consensus.cc:493] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.635682 25691 leader_election.cc:290] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Requested vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:15.637846 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640ac5b087574063b50e6611b7e8da5b" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
W20260709 12:25:15.639429 25189 leader_election.cc:343] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.640340 25146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640ac5b087574063b50e6611b7e8da5b" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:15.640973 25146 raft_consensus.cc:3060] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.617182 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a01e9d0014411a83a8edbf3b5504f6" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:15.635715 25429 raft_consensus.cc:3060] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.652561 25611 raft_consensus.cc:493] T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.680089 25423 tablet_bootstrap.cc:654] T bffd5eeaa9c14effb9e1ffc29a23ff01 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.682848 25630 raft_consensus.cc:493] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.688767 25611 raft_consensus.cc:515] T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:15.689234 25630 raft_consensus.cc:515] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:15.691382 25630 leader_election.cc:290] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:15.697376 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f447960df41a5ade2459879b92b17" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:15.698165 25296 raft_consensus.cc:2468] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
I20260709 12:25:15.672185 25143 raft_consensus.cc:2468] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 2.
I20260709 12:25:15.719551 25418 tablet_bootstrap.cc:654] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.709630 25611 leader_election.cc:290] T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:15.707149 25615 raft_consensus.cc:515] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
W20260709 12:25:15.740480 25260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:41903, user_credentials={real_user=slave}} blocked reactor thread for 106992us
I20260709 12:25:15.747165 25113 leader_election.cc:304] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:15.760226 25717 raft_consensus.cc:515] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:15.750385 25728 raft_consensus.cc:2804] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:15.765087 25045 catalog_manager.cc:5697] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 1 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:15.777643 25419 tablet_bootstrap.cc:492] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:15.786674 25419 ts_tablet_manager.cc:1403] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.248s	user 0.011s	sys 0.013s
I20260709 12:25:15.783152 25429 raft_consensus.cc:515] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:15.793830 25369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d39dac4e3e343f2985681aa3c5e5718" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:15.794421 25429 leader_election.cc:290] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:15.776640 25729 raft_consensus.cc:493] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.795780 25729 raft_consensus.cc:515] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
W20260709 12:25:15.782115 25188 leader_election.cc:343] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.770871 25615 leader_election.cc:290] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:15.774389 25685 raft_consensus.cc:515] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:15.800366 25731 consensus_queue.cc:1048] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:15.800887 25685 leader_election.cc:290] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Requested vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:15.772995 25717 leader_election.cc:290] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:15.802663 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d39dac4e3e343f2985681aa3c5e5718" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:15.803525 25221 raft_consensus.cc:2393] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a28f2edcd70f4eb08f16021ba3e2cf14 in current term 1: Already voted for candidate d3979c425abd4ac7b2ca30e1dec9a154 in this term.
I20260709 12:25:15.781611 25146 raft_consensus.cc:2468] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:15.805001 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf33e1087ea4e7f98b37dd2c130c635" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:15.805605 25298 raft_consensus.cc:3060] T 1bf33e1087ea4e7f98b37dd2c130c635 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.806931 25419 raft_consensus.cc:359] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:15.807660 25419 raft_consensus.cc:385] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.812907 25419 raft_consensus.cc:740] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.820120 25419 consensus_queue.cc:260] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:15.763581 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ea711322544c2999f94b52b35af150" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:15.770555 25630 raft_consensus.cc:2804] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:15.767285 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f447960df41a5ade2459879b92b17" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
W20260709 12:25:15.831142 25262 leader_election.cc:343] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.833277 25421 tablet_bootstrap.cc:492] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:15.834057 25421 ts_tablet_manager.cc:1403] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.290s	user 0.020s	sys 0.013s
I20260709 12:25:15.839480 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d39dac4e3e343f2985681aa3c5e5718" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:15.841077 25372 raft_consensus.cc:3060] T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.827361 25419 ts_tablet_manager.cc:1434] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:25:15.828416 25630 raft_consensus.cc:493] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.862366 25189 leader_election.cc:304] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:15.835729 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d39dac4e3e343f2985681aa3c5e5718" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:15.864506 25419 tablet_bootstrap.cc:492] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:15.866776 25615 raft_consensus.cc:2804] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:15.867380 25615 raft_consensus.cc:697] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
W20260709 12:25:15.870471 25188 leader_election.cc:343] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.870625 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf33e1087ea4e7f98b37dd2c130c635" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:15.871115 25615 consensus_queue.cc:237] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:15.864105 25630 raft_consensus.cc:3060] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.874666 25146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99adf4dd9ed4adbb8f70f7fd8aeaeb8" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:15.876775 25703 consensus_queue.cc:1048] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:15.865367 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ea711322544c2999f94b52b35af150" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:15.878024 25143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a01e9d0014411a83a8edbf3b5504f6" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:15.878659 25143 raft_consensus.cc:3060] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.863633 25729 leader_election.cc:290] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:15.872381 25418 tablet_bootstrap.cc:492] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:15.883090 25418 ts_tablet_manager.cc:1403] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.315s	user 0.013s	sys 0.011s
I20260709 12:25:15.893759 25423 tablet_bootstrap.cc:492] T bffd5eeaa9c14effb9e1ffc29a23ff01 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:15.894227 25423 ts_tablet_manager.cc:1403] T bffd5eeaa9c14effb9e1ffc29a23ff01 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.293s	user 0.018s	sys 0.020s
I20260709 12:25:15.888171 25293 raft_consensus.cc:2393] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d3979c425abd4ac7b2ca30e1dec9a154 in current term 1: Already voted for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in this term.
I20260709 12:25:15.884130 25338 leader_election.cc:304] T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:15.902558 25421 raft_consensus.cc:359] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
W20260709 12:25:15.890653 25112 leader_election.cc:343] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.903394 25421 raft_consensus.cc:385] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.904191 25189 leader_election.cc:304] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14
W20260709 12:25:15.901484 25188 leader_election.cc:343] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.912392 25421 raft_consensus.cc:740] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.907198 25418 raft_consensus.cc:359] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:15.915086 25418 raft_consensus.cc:385] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.915395 25418 raft_consensus.cc:740] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.910477 25423 raft_consensus.cc:359] T bffd5eeaa9c14effb9e1ffc29a23ff01 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:15.916512 25423 raft_consensus.cc:385] T bffd5eeaa9c14effb9e1ffc29a23ff01 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.916962 25423 raft_consensus.cc:740] T bffd5eeaa9c14effb9e1ffc29a23ff01 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.901027 25728 raft_consensus.cc:697] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:15.919993 25418 consensus_queue.cc:260] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:15.921645 25421 consensus_queue.cc:260] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:15.917876 25423 consensus_queue.cc:260] T bffd5eeaa9c14effb9e1ffc29a23ff01 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:15.928285 25421 ts_tablet_manager.cc:1434] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.094s	user 0.004s	sys 0.004s
I20260709 12:25:15.929620 25421 tablet_bootstrap.cc:492] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:15.931707 25418 ts_tablet_manager.cc:1434] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 12:25:15.933070 25418 tablet_bootstrap.cc:492] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:15.920869 25610 raft_consensus.cc:2749] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:15.923863 25630 raft_consensus.cc:515] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:15.939468 25418 tablet_bootstrap.cc:654] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.941308 25630 leader_election.cc:290] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:15.944559 25423 ts_tablet_manager.cc:1434] T bffd5eeaa9c14effb9e1ffc29a23ff01 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.002s
I20260709 12:25:15.946113 25423 tablet_bootstrap.cc:492] T 640ac5b087574063b50e6611b7e8da5b P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
W20260709 12:25:15.926411 25260 leader_election.cc:343] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.963160 25419 tablet_bootstrap.cc:654] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:15.968619 25263 leader_election.cc:343] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.996615 25298 raft_consensus.cc:2468] T 1bf33e1087ea4e7f98b37dd2c130c635 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:15.998383 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f447960df41a5ade2459879b92b17" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:16.003033 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f447960df41a5ade2459879b92b17" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:16.003926 25293 raft_consensus.cc:3060] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.014319 25621 raft_consensus.cc:2749] T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:16.021477 25423 tablet_bootstrap.cc:654] T 640ac5b087574063b50e6611b7e8da5b P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:16.004601 25260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:41903, user_credentials={real_user=slave}} blocked reactor thread for 83939.4us
W20260709 12:25:16.047971 25112 leader_election.cc:343] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.048357 25703 raft_consensus.cc:493] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.050774 25703 raft_consensus.cc:515] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:16.054394 25703 leader_election.cc:290] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:16.056977 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd0775b429544fcb31e2834c279b159" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:16.057909 25298 raft_consensus.cc:2393] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fa8f2c80074488084fea821c4bb293d in current term 1: Already voted for candidate 434d5783f9374eab8f587e0fe6c15b1c in this term.
I20260709 12:25:16.059965 25189 leader_election.cc:304] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:16.060038 25146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd0775b429544fcb31e2834c279b159" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:16.062878 25338 leader_election.cc:304] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:16.060513 25143 raft_consensus.cc:2468] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:16.064482 25615 raft_consensus.cc:2804] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.070427 25615 raft_consensus.cc:697] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:16.071430 25615 consensus_queue.cc:237] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:16.005225 25728 consensus_queue.cc:237] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:16.077021 25731 raft_consensus.cc:3060] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.098340 25418 tablet_bootstrap.cc:492] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:16.098894 25418 ts_tablet_manager.cc:1403] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.166s	user 0.061s	sys 0.030s
I20260709 12:25:16.105358 25717 raft_consensus.cc:493] T bffd5eeaa9c14effb9e1ffc29a23ff01 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.106091 25717 raft_consensus.cc:515] T bffd5eeaa9c14effb9e1ffc29a23ff01 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:16.113183 25418 raft_consensus.cc:359] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:16.114013 25418 raft_consensus.cc:385] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.114301 25418 raft_consensus.cc:740] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.114981 25418 consensus_queue.cc:260] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:16.077440 25260 leader_election.cc:304] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:16.118768 25740 raft_consensus.cc:2749] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:16.118980 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99adf4dd9ed4adbb8f70f7fd8aeaeb8" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:16.120352 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a01e9d0014411a83a8edbf3b5504f6" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
W20260709 12:25:16.122967 25742 log.cc:927] Time spent T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:25:16.128921 25421 tablet_bootstrap.cc:654] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.129467 25263 leader_election.cc:304] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
W20260709 12:25:16.130842 25260 leader_election.cc:343] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.131340 25260 leader_election.cc:304] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:16.132151 25740 raft_consensus.cc:2749] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:16.132186 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffd5eeaa9c14effb9e1ffc29a23ff01" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:16.095149 25293 raft_consensus.cc:2468] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 1.
I20260709 12:25:16.136143 25717 leader_election.cc:290] T bffd5eeaa9c14effb9e1ffc29a23ff01 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:16.136471 25418 ts_tablet_manager.cc:1434] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:25:16.137552 25418 tablet_bootstrap.cc:492] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:16.137876 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffd5eeaa9c14effb9e1ffc29a23ff01" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
W20260709 12:25:16.143922 25262 leader_election.cc:343] T bffd5eeaa9c14effb9e1ffc29a23ff01 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.147109 25418 tablet_bootstrap.cc:654] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.136006 25731 raft_consensus.cc:2749] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:16.148130 25260 leader_election.cc:343] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.156560 25717 raft_consensus.cc:2804] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:25:16.159986 25113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:45473, user_credentials={real_user=slave}} blocked reactor thread for 77067.8us
I20260709 12:25:16.178674 25676 raft_consensus.cc:493] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.179270 25676 raft_consensus.cc:515] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:16.183336 25419 tablet_bootstrap.cc:492] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:16.183929 25419 ts_tablet_manager.cc:1403] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.332s	user 0.026s	sys 0.001s
I20260709 12:25:16.190433 25676 leader_election.cc:290] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:16.174429 25717 raft_consensus.cc:697] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:16.192546 25717 consensus_queue.cc:237] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:16.192548 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99adf4dd9ed4adbb8f70f7fd8aeaeb8" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
W20260709 12:25:16.196275 25110 leader_election.cc:343] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.184024 25045 catalog_manager.cc:5697] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 0 to 2, leader changed from <none> to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.202527 25615 raft_consensus.cc:493] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.203138 25615 raft_consensus.cc:515] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:16.204736 25423 tablet_bootstrap.cc:492] T 640ac5b087574063b50e6611b7e8da5b P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:16.206146 25615 leader_election.cc:290] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:16.206291 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc69e13d835645099f9e0e5bea99665a" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:16.226686 25423 ts_tablet_manager.cc:1403] T 640ac5b087574063b50e6611b7e8da5b P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.281s	user 0.021s	sys 0.001s
I20260709 12:25:16.206975 25419 raft_consensus.cc:359] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:16.227344 25419 raft_consensus.cc:385] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:25:16.207791 25260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:41903, user_credentials={real_user=slave}} blocked reactor thread for 73283.2us
W20260709 12:25:16.229135 25260 leader_election.cc:343] T bffd5eeaa9c14effb9e1ffc29a23ff01 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.229575 25260 leader_election.cc:304] T bffd5eeaa9c14effb9e1ffc29a23ff01 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:16.208058 25146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc69e13d835645099f9e0e5bea99665a" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:16.231312 25146 raft_consensus.cc:2468] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:16.232774 25423 raft_consensus.cc:359] T 640ac5b087574063b50e6611b7e8da5b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:16.233578 25423 raft_consensus.cc:385] T 640ac5b087574063b50e6611b7e8da5b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.233913 25728 raft_consensus.cc:2749] T bffd5eeaa9c14effb9e1ffc29a23ff01 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:16.212836 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99adf4dd9ed4adbb8f70f7fd8aeaeb8" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:16.234972 25294 raft_consensus.cc:2468] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
I20260709 12:25:16.235411 25676 consensus_queue.cc:1048] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:16.227656 25419 raft_consensus.cc:740] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.238127 25419 consensus_queue.cc:260] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:16.215590 25750 raft_consensus.cc:493] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.216517 25113 leader_election.cc:304] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:16.221312 25421 tablet_bootstrap.cc:492] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:16.242825 25419 ts_tablet_manager.cc:1434] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 12:25:16.245359 25421 ts_tablet_manager.cc:1403] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.316s	user 0.014s	sys 0.007s
I20260709 12:25:16.233943 25423 raft_consensus.cc:740] T 640ac5b087574063b50e6611b7e8da5b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
W20260709 12:25:16.241936 25188 leader_election.cc:343] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.250089 25423 consensus_queue.cc:260] T 640ac5b087574063b50e6611b7e8da5b P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:16.250813 25419 tablet_bootstrap.cc:492] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:16.244279 25113 leader_election.cc:304] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:16.252971 25418 tablet_bootstrap.cc:492] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:16.253135 25423 ts_tablet_manager.cc:1434] T 640ac5b087574063b50e6611b7e8da5b P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:25:16.253499 25418 ts_tablet_manager.cc:1403] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.116s	user 0.015s	sys 0.017s
I20260709 12:25:16.244443 25675 raft_consensus.cc:2804] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.254151 25423 tablet_bootstrap.cc:492] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:16.254442 25675 raft_consensus.cc:697] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:16.255427 25675 consensus_queue.cc:237] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:16.240732 25044 catalog_manager.cc:5697] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:16.257364 25677 raft_consensus.cc:2804] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.257817 25677 raft_consensus.cc:493] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.258174 25677 raft_consensus.cc:3060] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.262603 25423 tablet_bootstrap.cc:654] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.264276 25418 raft_consensus.cc:359] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:16.243180 25750 raft_consensus.cc:515] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:16.265161 25418 raft_consensus.cc:385] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.265496 25418 raft_consensus.cc:740] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.266350 25418 consensus_queue.cc:260] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:16.266760 25750 leader_election.cc:290] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:16.269707 25189 leader_election.cc:304] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:16.272395 25615 raft_consensus.cc:2804] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.281020 25615 raft_consensus.cc:493] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.281421 25615 raft_consensus.cc:3060] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.281026 25419 tablet_bootstrap.cc:654] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.294744 25418 ts_tablet_manager.cc:1434] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.003s
I20260709 12:25:16.296422 25418 tablet_bootstrap.cc:492] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:16.298852 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3459b31870574ae4aa816cf5ee28162b" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:16.299657 25294 raft_consensus.cc:2468] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
I20260709 12:25:16.303395 25045 catalog_manager.cc:5697] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 0 to 1, leader changed from <none> to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.308563 25113 leader_election.cc:304] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:16.308410 25676 consensus_queue.cc:1048] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:16.310403 25734 raft_consensus.cc:2804] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.310806 25734 raft_consensus.cc:493] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.311125 25734 raft_consensus.cc:3060] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.319597 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3459b31870574ae4aa816cf5ee28162b" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:16.321627 25615 raft_consensus.cc:515] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:16.323608 25734 raft_consensus.cc:515] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:16.324760 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc69e13d835645099f9e0e5bea99665a" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
W20260709 12:25:16.326234 25188 leader_election.cc:343] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.327775 25615 leader_election.cc:290] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:16.326191 25734 leader_election.cc:290] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:16.330188 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3459b31870574ae4aa816cf5ee28162b" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:16.330895 25296 raft_consensus.cc:3060] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.339390 25041 catalog_manager.cc:5697] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:16.318998 25092 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:16.346432 25421 raft_consensus.cc:359] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:16.347198 25421 raft_consensus.cc:385] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.347451 25421 raft_consensus.cc:740] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.350729 25146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc69e13d835645099f9e0e5bea99665a" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:16.351495 25146 raft_consensus.cc:3060] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.367167 25750 raft_consensus.cc:493] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.368502 25750 raft_consensus.cc:515] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:16.378927 25294 raft_consensus.cc:3060] T 640ac5b087574063b50e6611b7e8da5b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.407474 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f5d4fb33b4421daaf5b63cafcd4f4b" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
W20260709 12:25:16.409920 25110 leader_election.cc:343] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.425778 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3459b31870574ae4aa816cf5ee28162b" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
W20260709 12:25:16.429387 25112 leader_election.cc:343] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.431293 25615 consensus_queue.cc:1048] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:16.431651 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f5d4fb33b4421daaf5b63cafcd4f4b" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:16.437485 25677 raft_consensus.cc:515] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:16.438110 25750 leader_election.cc:290] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:16.442958 25296 raft_consensus.cc:2468] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 1.
I20260709 12:25:16.444756 25421 consensus_queue.cc:260] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:16.444978 25113 leader_election.cc:304] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:16.446489 25421 ts_tablet_manager.cc:1434] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.197s	user 0.001s	sys 0.005s
I20260709 12:25:16.463732 25421 tablet_bootstrap.cc:492] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:16.473170 25676 raft_consensus.cc:2804] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:25:16.482965 25112 leader_election.cc:343] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.489157 25676 raft_consensus.cc:697] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:16.494689 25676 consensus_queue.cc:237] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
W20260709 12:25:16.493661 25112 leader_election.cc:343] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.495968 25112 leader_election.cc:304] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:16.500922 25734 raft_consensus.cc:2749] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:16.491263 25146 raft_consensus.cc:2468] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:16.513751 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99adf4dd9ed4adbb8f70f7fd8aeaeb8" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:16.516327 25419 tablet_bootstrap.cc:492] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:16.516420 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99adf4dd9ed4adbb8f70f7fd8aeaeb8" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:16.517025 25419 ts_tablet_manager.cc:1403] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.267s	user 0.026s	sys 0.032s
W20260709 12:25:16.517257 25110 leader_election.cc:343] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.506296 25621 raft_consensus.cc:493] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.519547 25621 raft_consensus.cc:515] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:16.521798 25621 leader_election.cc:290] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:16.518580 25421 tablet_bootstrap.cc:654] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.510123 25677 leader_election.cc:290] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:16.517190 25296 raft_consensus.cc:3060] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.528460 25423 tablet_bootstrap.cc:492] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:16.529906 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d39dac4e3e343f2985681aa3c5e5718" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:16.535982 25189 leader_election.cc:304] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:16.540586 25423 ts_tablet_manager.cc:1403] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.287s	user 0.061s	sys 0.109s
I20260709 12:25:16.540760 25298 raft_consensus.cc:2393] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fa8f2c80074488084fea821c4bb293d in current term 1: Already voted for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in this term.
I20260709 12:25:16.542338 25610 raft_consensus.cc:2804] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.545396 25610 raft_consensus.cc:697] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:16.546326 25610 consensus_queue.cc:237] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:16.547837 25739 raft_consensus.cc:493] T 640ac5b087574063b50e6611b7e8da5b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.548409 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d39dac4e3e343f2985681aa3c5e5718" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:16.548360 25739 raft_consensus.cc:515] T 640ac5b087574063b50e6611b7e8da5b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:16.549297 25221 raft_consensus.cc:2393] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fa8f2c80074488084fea821c4bb293d in current term 1: Already voted for candidate d3979c425abd4ac7b2ca30e1dec9a154 in this term.
I20260709 12:25:16.550736 25335 leader_election.cc:304] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:16.551765 25296 raft_consensus.cc:2468] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 1.
I20260709 12:25:16.552407 25429 consensus_queue.cc:1048] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:16.553233 25621 raft_consensus.cc:3060] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.555382 25419 raft_consensus.cc:359] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:16.550397 25423 raft_consensus.cc:359] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:16.557709 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640ac5b087574063b50e6611b7e8da5b" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:16.558274 25739 leader_election.cc:290] T 640ac5b087574063b50e6611b7e8da5b P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:16.568674 25419 raft_consensus.cc:385] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.568737 25423 raft_consensus.cc:385] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.569703 25419 raft_consensus.cc:740] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.569788 25423 raft_consensus.cc:740] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.570515 25419 consensus_queue.cc:260] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:16.580572 25145 raft_consensus.cc:1275] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Refusing update from remote peer a28f2edcd70f4eb08f16021ba3e2cf14: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:25:16.583967 25145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640ac5b087574063b50e6611b7e8da5b" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:16.584501 25045 catalog_manager.cc:5697] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 1 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.586454 25739 consensus_queue.cc:1048] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:16.590503 25045 catalog_manager.cc:5697] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 1 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.570894 25423 consensus_queue.cc:260] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:16.586604 25263 leader_election.cc:304] T 640ac5b087574063b50e6611b7e8da5b P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:16.601959 25423 ts_tablet_manager.cc:1434] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.004s
I20260709 12:25:16.606252 25419 ts_tablet_manager.cc:1434] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.001s
I20260709 12:25:16.607904 25418 tablet_bootstrap.cc:654] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.600375 25739 raft_consensus.cc:2749] T 640ac5b087574063b50e6611b7e8da5b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:16.614287 25419 tablet_bootstrap.cc:492] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:16.641613 25423 tablet_bootstrap.cc:492] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:16.619905 25113 leader_election.cc:304] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:16.651667 25615 raft_consensus.cc:493] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.652760 25676 raft_consensus.cc:2804] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.652496 25615 raft_consensus.cc:515] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:16.653298 25676 raft_consensus.cc:697] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
W20260709 12:25:16.664368 25189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:45473, user_credentials={real_user=slave}} blocked reactor thread for 82350.2us
I20260709 12:25:16.628463 25610 consensus_queue.cc:1048] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260709 12:25:16.672003 25676 consensus_queue.cc:237] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
W20260709 12:25:16.700829 25260 consensus_peers.cc:597] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:16.705432 25621 raft_consensus.cc:2749] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:16.707736 25615 leader_election.cc:290] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:16.713526 25419 tablet_bootstrap.cc:654] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.713868 25423 tablet_bootstrap.cc:654] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.713133 25041 catalog_manager.cc:5697] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.714489 25740 raft_consensus.cc:493] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.718920 25740 raft_consensus.cc:515] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:16.718148 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffd5eeaa9c14effb9e1ffc29a23ff01" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:16.728497 25294 raft_consensus.cc:2468] T bffd5eeaa9c14effb9e1ffc29a23ff01 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:16.784364 25418 tablet_bootstrap.cc:492] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:16.791786 25418 ts_tablet_manager.cc:1403] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.496s	user 0.022s	sys 0.008s
I20260709 12:25:16.795025 25421 tablet_bootstrap.cc:492] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:16.795882 25421 ts_tablet_manager.cc:1403] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.332s	user 0.016s	sys 0.007s
I20260709 12:25:16.737517 25739 consensus_queue.cc:1048] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.063s
I20260709 12:25:16.741611 25221 raft_consensus.cc:1275] T afcc5ac5532e4841a4f0a182a39a1914 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Refusing update from remote peer a28f2edcd70f4eb08f16021ba3e2cf14: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 12:25:16.811380 25773 log.cc:927] Time spent T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:25:16.811595 25189 leader_election.cc:304] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:16.812644 25766 raft_consensus.cc:2804] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.813004 25766 raft_consensus.cc:493] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.813320 25766 raft_consensus.cc:3060] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.832727 25615 raft_consensus.cc:493] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.835971 25615 raft_consensus.cc:515] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:16.838094 25419 tablet_bootstrap.cc:492] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:16.838541 25419 ts_tablet_manager.cc:1403] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.225s	user 0.014s	sys 0.006s
I20260709 12:25:16.842971 25418 raft_consensus.cc:359] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:16.843509 25419 raft_consensus.cc:359] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:16.844269 25419 raft_consensus.cc:385] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.844568 25419 raft_consensus.cc:740] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.845795 25419 consensus_queue.cc:260] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:16.846321 25766 raft_consensus.cc:515] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:16.846695 25421 raft_consensus.cc:359] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:16.847445 25421 raft_consensus.cc:385] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.847724 25421 raft_consensus.cc:740] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
W20260709 12:25:16.847880 25112 consensus_peers.cc:597] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c -> Peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Couldn't send request to peer 0fa8f2c80074488084fea821c4bb293d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:16.849274 25419 ts_tablet_manager.cc:1434] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:25:16.859696 25419 tablet_bootstrap.cc:492] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:16.849655 25418 raft_consensus.cc:385] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.848750 25717 consensus_queue.cc:1048] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:25:16.864967 25144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f5d4fb33b4421daaf5b63cafcd4f4b" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:16.866048 25144 raft_consensus.cc:2468] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:16.867924 25189 leader_election.cc:304] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:16.869336 25610 raft_consensus.cc:2804] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.869738 25610 raft_consensus.cc:493] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.870064 25610 raft_consensus.cc:3060] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.848172 25615 leader_election.cc:290] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:16.861400 25418 raft_consensus.cc:740] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.875553 25418 consensus_queue.cc:260] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:16.857887 25421 consensus_queue.cc:260] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:16.894256 25418 ts_tablet_manager.cc:1434] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.102s	user 0.007s	sys 0.000s
I20260709 12:25:16.896409 25418 tablet_bootstrap.cc:492] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
W20260709 12:25:16.899664 25263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:38537, user_credentials={real_user=slave}} blocked reactor thread for 83847.7us
I20260709 12:25:16.910969 25421 ts_tablet_manager.cc:1434] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.115s	user 0.001s	sys 0.006s
I20260709 12:25:16.913792 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffd5eeaa9c14effb9e1ffc29a23ff01" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:16.916307 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f5d4fb33b4421daaf5b63cafcd4f4b" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:16.913718 25421 tablet_bootstrap.cc:492] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:16.898697 25740 leader_election.cc:290] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:16.924059 25144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c46968756c14269bc487ced0f6e74bd" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:16.924299 25766 leader_election.cc:290] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
W20260709 12:25:16.926987 25112 consensus_peers.cc:597] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c -> Peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Couldn't send request to peer 0fa8f2c80074488084fea821c4bb293d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:16.926250 25144 raft_consensus.cc:2468] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 0.
I20260709 12:25:16.898792 25610 raft_consensus.cc:515] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:16.930444 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffd5eeaa9c14effb9e1ffc29a23ff01" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:16.932364 25298 raft_consensus.cc:3060] T bffd5eeaa9c14effb9e1ffc29a23ff01 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:16.861999 25335 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:41903, user_credentials={real_user=slave}} blocked reactor thread for 180954us
I20260709 12:25:16.935669 25263 leader_election.cc:304] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:16.936573 25782 raft_consensus.cc:2804] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.936964 25782 raft_consensus.cc:493] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.937292 25782 raft_consensus.cc:3060] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.944377 25419 tablet_bootstrap.cc:654] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.955153 25782 raft_consensus.cc:515] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:16.946185 25677 consensus_queue.cc:1048] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:16.964761 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffd5eeaa9c14effb9e1ffc29a23ff01" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:16.951563 25042 catalog_manager.cc:5697] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 1 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:16.935499 25188 consensus_peers.cc:597] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Couldn't send request to peer 0fa8f2c80074488084fea821c4bb293d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:16.969693 25145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f5d4fb33b4421daaf5b63cafcd4f4b" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
W20260709 12:25:16.970278 25188 leader_election.cc:343] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.970620 25145 raft_consensus.cc:3060] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.972663 25782 leader_election.cc:290] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
W20260709 12:25:16.974534 25188 leader_election.cc:343] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.975173 25144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c46968756c14269bc487ced0f6e74bd" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
W20260709 12:25:16.975601 25188 leader_election.cc:343] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.975867 25144 raft_consensus.cc:3060] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.952908 25610 leader_election.cc:290] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:16.945310 25298 raft_consensus.cc:2468] T bffd5eeaa9c14effb9e1ffc29a23ff01 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:16.983362 25421 tablet_bootstrap.cc:654] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.985150 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c46968756c14269bc487ced0f6e74bd" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:16.989552 25144 raft_consensus.cc:2468] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:16.990255 25189 leader_election.cc:304] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:16.980115 25423 tablet_bootstrap.cc:492] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:16.992800 25423 ts_tablet_manager.cc:1403] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.352s	user 0.027s	sys 0.017s
I20260709 12:25:16.995018 25610 raft_consensus.cc:2804] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.996713 25610 raft_consensus.cc:697] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:16.997807 25418 tablet_bootstrap.cc:654] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.997634 25610 consensus_queue.cc:237] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:16.999046 25145 raft_consensus.cc:2468] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:17.000491 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f5d4fb33b4421daaf5b63cafcd4f4b" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:17.002050 25263 leader_election.cc:304] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:17.003315 25782 raft_consensus.cc:2804] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:17.004379 25782 raft_consensus.cc:697] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:17.005936 25782 consensus_queue.cc:237] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:17.008837 25189 leader_election.cc:304] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:17.010265 25766 raft_consensus.cc:2804] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:17.013231 25766 raft_consensus.cc:697] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:17.014258 25766 consensus_queue.cc:237] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
W20260709 12:25:17.014938 25188 leader_election.cc:343] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:17.018065 25423 raft_consensus.cc:359] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:17.018986 25423 raft_consensus.cc:385] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.019428 25423 raft_consensus.cc:740] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.020429 25423 consensus_queue.cc:260] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:17.030578 25423 ts_tablet_manager.cc:1434] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:25:17.032223 25423 tablet_bootstrap.cc:492] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:17.021958 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c46968756c14269bc487ced0f6e74bd" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
W20260709 12:25:17.039925 25262 leader_election.cc:343] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:17.089255 25262 leader_election.cc:343] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:17.096081 25740 raft_consensus.cc:493] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.096705 25740 raft_consensus.cc:515] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:17.103233 25418 tablet_bootstrap.cc:492] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:17.105638 25144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d072f6ab35314a9ebd29bbfe4d0eb1f0" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:17.104759 25418 ts_tablet_manager.cc:1403] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.209s	user 0.018s	sys 0.016s
I20260709 12:25:17.109972 25423 tablet_bootstrap.cc:654] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:17.111193 25418 raft_consensus.cc:359] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
W20260709 12:25:17.106315 25188 consensus_peers.cc:597] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Couldn't send request to peer 0fa8f2c80074488084fea821c4bb293d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:17.112071 25418 raft_consensus.cc:385] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.112524 25418 raft_consensus.cc:740] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.113351 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d072f6ab35314a9ebd29bbfe4d0eb1f0" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:17.113382 25418 consensus_queue.cc:260] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
W20260709 12:25:17.114795 25263 leader_election.cc:343] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:17.116178 25260 leader_election.cc:343] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:17.116652 25260 leader_election.cc:304] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:17.116863 25418 ts_tablet_manager.cc:1434] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:17.117491 25782 raft_consensus.cc:2749] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:17.117560 25740 leader_election.cc:290] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:17.118093 25418 tablet_bootstrap.cc:492] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:17.106467 25676 consensus_queue.cc:1048] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:25:17.134301 25418 tablet_bootstrap.cc:654] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:17.143960 25421 tablet_bootstrap.cc:492] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:17.144733 25421 ts_tablet_manager.cc:1403] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.231s	user 0.024s	sys 0.009s
I20260709 12:25:17.146901 25041 catalog_manager.cc:5697] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 0 to 1, leader changed from <none> to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.162113 25421 raft_consensus.cc:359] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:17.162992 25421 raft_consensus.cc:385] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.163273 25421 raft_consensus.cc:740] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.164407 25421 consensus_queue.cc:260] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:17.166849 25732 consensus_queue.cc:1048] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:17.167497 25423 tablet_bootstrap.cc:492] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:17.184026 25423 ts_tablet_manager.cc:1403] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.152s	user 0.015s	sys 0.004s
I20260709 12:25:17.181233 25044 catalog_manager.cc:5697] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.186498 25044 catalog_manager.cc:5697] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:17.191514 25419 tablet_bootstrap.cc:492] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:17.192139 25419 ts_tablet_manager.cc:1403] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.333s	user 0.020s	sys 0.005s
I20260709 12:25:17.200700 25734 consensus_queue.cc:1048] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:17.201534 25418 tablet_bootstrap.cc:492] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:17.202116 25418 ts_tablet_manager.cc:1403] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.000s
I20260709 12:25:17.205094 25418 raft_consensus.cc:359] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:17.205801 25418 raft_consensus.cc:385] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.206069 25418 raft_consensus.cc:740] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.206740 25418 consensus_queue.cc:260] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:17.211712 25423 raft_consensus.cc:359] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:17.212672 25423 raft_consensus.cc:385] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.213321 25423 raft_consensus.cc:740] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.214080 25418 ts_tablet_manager.cc:1434] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:25:17.215009 25734 raft_consensus.cc:493] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.220060 25734 raft_consensus.cc:515] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:17.220139 25423 consensus_queue.cc:260] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:17.222350 25734 leader_election.cc:290] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:17.223551 25423 ts_tablet_manager.cc:1434] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:25:17.225049 25221 raft_consensus.cc:3060] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.225540 25423 tablet_bootstrap.cc:492] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:17.226297 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4d589309f24d3e955fb45b2c6fe3af" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
W20260709 12:25:17.227720 25110 leader_election.cc:343] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:17.225767 25418 tablet_bootstrap.cc:492] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:17.235669 25418 tablet_bootstrap.cc:654] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:17.236423 25734 consensus_queue.cc:1048] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:17.239068 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4d589309f24d3e955fb45b2c6fe3af" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:17.240132 25423 tablet_bootstrap.cc:654] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:17.243371 25112 leader_election.cc:343] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:17.244138 25112 leader_election.cc:304] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:17.244484 25370 raft_consensus.cc:3060] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.245203 25734 raft_consensus.cc:2749] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:17.253234 25423 tablet_bootstrap.cc:492] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:17.254117 25423 ts_tablet_manager.cc:1403] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.007s
I20260709 12:25:17.257603 25423 raft_consensus.cc:359] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:17.258401 25423 raft_consensus.cc:385] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.258754 25423 raft_consensus.cc:740] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.259498 25423 consensus_queue.cc:260] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:17.262072 25423 ts_tablet_manager.cc:1434] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:25:17.262733 25782 raft_consensus.cc:493] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.263262 25782 raft_consensus.cc:515] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:17.265511 25418 tablet_bootstrap.cc:492] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:17.265758 25782 leader_election.cc:290] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:17.224982 25419 raft_consensus.cc:359] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:17.266579 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa2c58c6d37474c908e6f924b95db30" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:17.267203 25419 raft_consensus.cc:385] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.267520 25419 raft_consensus.cc:740] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.267640 25423 tablet_bootstrap.cc:492] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
W20260709 12:25:17.268332 25260 leader_election.cc:343] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:17.268312 25419 consensus_queue.cc:260] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:17.266134 25418 ts_tablet_manager.cc:1403] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.006s
I20260709 12:25:17.269658 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa2c58c6d37474c908e6f924b95db30" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:17.271174 25419 ts_tablet_manager.cc:1434] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.000s
I20260709 12:25:17.272123 25734 raft_consensus.cc:493] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.272644 25418 raft_consensus.cc:359] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:17.272738 25734 raft_consensus.cc:515] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:17.274153 25419 tablet_bootstrap.cc:492] T 46a01e9d0014411a83a8edbf3b5504f6 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:17.275761 25734 leader_election.cc:290] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
W20260709 12:25:17.275813 25262 leader_election.cc:343] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:17.276458 25418 raft_consensus.cc:385] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.276791 25418 raft_consensus.cc:740] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.277573 25418 consensus_queue.cc:260] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:17.278383 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d072f6ab35314a9ebd29bbfe4d0eb1f0" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:17.276459 25262 leader_election.cc:304] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:17.280102 25418 ts_tablet_manager.cc:1434] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
W20260709 12:25:17.280586 25110 leader_election.cc:343] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:17.281109 25782 raft_consensus.cc:2749] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:17.281507 25418 tablet_bootstrap.cc:492] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:17.284042 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d072f6ab35314a9ebd29bbfe4d0eb1f0" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:17.285125 25298 raft_consensus.cc:2468] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
I20260709 12:25:17.286422 25113 leader_election.cc:304] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:17.288201 25734 raft_consensus.cc:2804] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:17.288594 25734 raft_consensus.cc:493] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.288950 25734 raft_consensus.cc:3060] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.293013 25418 tablet_bootstrap.cc:654] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:17.295246 25421 ts_tablet_manager.cc:1434] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.150s	user 0.005s	sys 0.006s
I20260709 12:25:17.297853 25734 raft_consensus.cc:515] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:17.305552 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d072f6ab35314a9ebd29bbfe4d0eb1f0" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
W20260709 12:25:17.307641 25110 leader_election.cc:343] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:17.307857 25419 tablet_bootstrap.cc:654] T 46a01e9d0014411a83a8edbf3b5504f6 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:17.309674 25734 leader_election.cc:290] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:17.309966 25421 tablet_bootstrap.cc:492] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:17.311580 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d072f6ab35314a9ebd29bbfe4d0eb1f0" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:17.312225 25298 raft_consensus.cc:3060] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.321714 25372 raft_consensus.cc:3060] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.336575 25418 tablet_bootstrap.cc:492] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:17.338979 25418 ts_tablet_manager.cc:1403] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.004s
I20260709 12:25:17.343577 25421 tablet_bootstrap.cc:654] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:17.347648 25418 raft_consensus.cc:359] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:17.348901 25418 raft_consensus.cc:385] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.349155 25418 raft_consensus.cc:740] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.349802 25418 consensus_queue.cc:260] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:17.358680 25298 raft_consensus.cc:2468] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 1.
I20260709 12:25:17.360373 25113 leader_election.cc:304] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:17.361790 25421 tablet_bootstrap.cc:492] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:17.362401 25421 ts_tablet_manager.cc:1403] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.010s
I20260709 12:25:17.362672 25632 raft_consensus.cc:2804] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:17.363286 25632 raft_consensus.cc:697] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:17.364158 25632 consensus_queue.cc:237] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:17.368764 25423 tablet_bootstrap.cc:654] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:17.374342 25418 ts_tablet_manager.cc:1434] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.003s
I20260709 12:25:17.374691 25419 tablet_bootstrap.cc:492] T 46a01e9d0014411a83a8edbf3b5504f6 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:17.375168 25419 ts_tablet_manager.cc:1403] T 46a01e9d0014411a83a8edbf3b5504f6 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.101s	user 0.021s	sys 0.011s
I20260709 12:25:17.375439 25418 tablet_bootstrap.cc:492] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:17.378032 25419 raft_consensus.cc:359] T 46a01e9d0014411a83a8edbf3b5504f6 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:17.381227 25419 raft_consensus.cc:385] T 46a01e9d0014411a83a8edbf3b5504f6 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.381603 25419 raft_consensus.cc:740] T 46a01e9d0014411a83a8edbf3b5504f6 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.382723 25419 consensus_queue.cc:260] T 46a01e9d0014411a83a8edbf3b5504f6 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:17.385953 25421 raft_consensus.cc:359] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:17.388175 25421 raft_consensus.cc:385] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.389017 25421 raft_consensus.cc:740] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.390005 25421 consensus_queue.cc:260] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:17.394433 25419 ts_tablet_manager.cc:1434] T 46a01e9d0014411a83a8edbf3b5504f6 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 12:25:17.398468 25419 tablet_bootstrap.cc:492] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:17.397370 25418 tablet_bootstrap.cc:654] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:17.403664 25042 catalog_manager.cc:5697] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 1 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.405627 25421 ts_tablet_manager.cc:1434] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.003s
I20260709 12:25:17.406860 25421 tablet_bootstrap.cc:492] T 1bf33e1087ea4e7f98b37dd2c130c635 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:17.419775 25423 tablet_bootstrap.cc:492] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:17.420397 25423 ts_tablet_manager.cc:1403] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.153s	user 0.013s	sys 0.000s
I20260709 12:25:17.425644 25419 tablet_bootstrap.cc:654] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:17.445255 25423 raft_consensus.cc:359] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:17.446029 25423 raft_consensus.cc:385] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.446308 25423 raft_consensus.cc:740] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.446951 25423 consensus_queue.cc:260] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:17.447463 25418 tablet_bootstrap.cc:492] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:17.448173 25418 ts_tablet_manager.cc:1403] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.073s	user 0.016s	sys 0.001s
I20260709 12:25:17.454123 25421 tablet_bootstrap.cc:654] T 1bf33e1087ea4e7f98b37dd2c130c635 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:17.458945 25423 ts_tablet_manager.cc:1434] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 12:25:17.459981 25423 tablet_bootstrap.cc:492] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:17.464051 25418 raft_consensus.cc:359] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:17.465149 25418 raft_consensus.cc:385] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.465606 25418 raft_consensus.cc:740] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.472885 25728 raft_consensus.cc:493] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.474989 25728 raft_consensus.cc:515] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:17.475302 25418 consensus_queue.cc:260] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:17.477020 25421 tablet_bootstrap.cc:492] T 1bf33e1087ea4e7f98b37dd2c130c635 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:17.477245 25728 leader_election.cc:290] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:17.477532 25421 ts_tablet_manager.cc:1403] T 1bf33e1087ea4e7f98b37dd2c130c635 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.071s	user 0.005s	sys 0.005s
I20260709 12:25:17.479002 25418 ts_tablet_manager.cc:1434] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.002s
W20260709 12:25:17.474191 25262 consensus_peers.cc:597] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Couldn't send request to peer 0fa8f2c80074488084fea821c4bb293d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:17.479161 25144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b324fb11adf4924bd497717bc12ff4c" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
W20260709 12:25:17.480041 25092 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:17.481462 25418 tablet_bootstrap.cc:492] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
W20260709 12:25:17.481909 25263 leader_election.cc:343] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:17.483031 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b324fb11adf4924bd497717bc12ff4c" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
W20260709 12:25:17.484923 25262 leader_election.cc:343] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:17.485680 25262 leader_election.cc:304] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:17.486294 25766 consensus_queue.cc:1048] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:17.486737 25728 raft_consensus.cc:2749] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:17.489182 25429 raft_consensus.cc:493] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.489351 25418 tablet_bootstrap.cc:654] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:17.489835 25419 tablet_bootstrap.cc:492] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:17.489737 25429 raft_consensus.cc:515] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:17.490362 25419 ts_tablet_manager.cc:1403] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.092s	user 0.005s	sys 0.010s
I20260709 12:25:17.490660 25421 raft_consensus.cc:359] T 1bf33e1087ea4e7f98b37dd2c130c635 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:17.491415 25421 raft_consensus.cc:385] T 1bf33e1087ea4e7f98b37dd2c130c635 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.491739 25421 raft_consensus.cc:740] T 1bf33e1087ea4e7f98b37dd2c130c635 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.492642 25421 consensus_queue.cc:260] T 1bf33e1087ea4e7f98b37dd2c130c635 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:17.495075 25421 ts_tablet_manager.cc:1434] T 1bf33e1087ea4e7f98b37dd2c130c635 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:25:17.499527 25421 tablet_bootstrap.cc:492] T bffd5eeaa9c14effb9e1ffc29a23ff01 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:17.503655 25429 leader_election.cc:290] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:17.505484 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2bfe7ad58c42f1aff0feb1c9880d9b" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:17.507340 25423 tablet_bootstrap.cc:654] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:17.507499 25188 leader_election.cc:343] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:17.507344 25421 tablet_bootstrap.cc:654] T bffd5eeaa9c14effb9e1ffc29a23ff01 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:17.509050 25677 raft_consensus.cc:493] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.510157 25677 raft_consensus.cc:515] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:17.510946 25292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2bfe7ad58c42f1aff0feb1c9880d9b" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
W20260709 12:25:17.514986 25189 leader_election.cc:343] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:17.515456 25189 leader_election.cc:304] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:17.516359 25610 raft_consensus.cc:2749] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:17.517498 25188 consensus_peers.cc:597] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Couldn't send request to peer 0fa8f2c80074488084fea821c4bb293d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:17.518744 25677 leader_election.cc:290] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:17.520143 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574e4322900441a18f11a2568ab6fd64" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:17.520238 25728 raft_consensus.cc:493] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.521497 25419 raft_consensus.cc:359] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:17.522248 25419 raft_consensus.cc:385] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.522529 25419 raft_consensus.cc:740] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.521057 25728 raft_consensus.cc:515] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:17.523680 25419 consensus_queue.cc:260] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:17.525923 25419 ts_tablet_manager.cc:1434] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.001s
I20260709 12:25:17.526454 25144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574e4322900441a18f11a2568ab6fd64" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:17.526952 25728 leader_election.cc:290] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:17.527163 25144 raft_consensus.cc:2468] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 0.
I20260709 12:25:17.527832 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574e4322900441a18f11a2568ab6fd64" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:17.529273 25677 raft_consensus.cc:493] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:17.529748 25110 leader_election.cc:343] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:17.530030 25677 raft_consensus.cc:515] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:17.532462 25419 tablet_bootstrap.cc:492] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:17.532814 25677 leader_election.cc:290] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:17.534866 25298 raft_consensus.cc:2468] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
I20260709 12:25:17.535169 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58caedf294044506b135b8990d49e180" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
W20260709 12:25:17.537006 25112 leader_election.cc:343] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:17.538700 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574e4322900441a18f11a2568ab6fd64" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:17.539237 25419 tablet_bootstrap.cc:654] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:17.540642 25260 leader_election.cc:343] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:17.540961 25113 leader_election.cc:304] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:17.542303 25677 raft_consensus.cc:2804] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:17.545035 25677 raft_consensus.cc:493] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.545464 25677 raft_consensus.cc:3060] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.549062 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58caedf294044506b135b8990d49e180" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:17.550158 25263 leader_election.cc:304] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:17.551255 25728 raft_consensus.cc:2804] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:17.551645 25728 raft_consensus.cc:493] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.552042 25728 raft_consensus.cc:3060] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.560473 25728 raft_consensus.cc:515] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:17.562605 25728 leader_election.cc:290] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Requested vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:17.565867 25421 tablet_bootstrap.cc:492] T bffd5eeaa9c14effb9e1ffc29a23ff01 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:17.566468 25421 ts_tablet_manager.cc:1403] T bffd5eeaa9c14effb9e1ffc29a23ff01 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.000s
I20260709 12:25:17.567523 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574e4322900441a18f11a2568ab6fd64" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
W20260709 12:25:17.569866 25188 consensus_peers.cc:597] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Couldn't send request to peer 0fa8f2c80074488084fea821c4bb293d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:17.570278 25260 leader_election.cc:343] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:17.573565 25677 raft_consensus.cc:515] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:17.579092 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574e4322900441a18f11a2568ab6fd64" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:17.581369 25423 tablet_bootstrap.cc:492] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:17.582088 25423 ts_tablet_manager.cc:1403] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.122s	user 0.016s	sys 0.007s
I20260709 12:25:17.570206 25421 raft_consensus.cc:359] T bffd5eeaa9c14effb9e1ffc29a23ff01 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:17.582679 25421 raft_consensus.cc:385] T bffd5eeaa9c14effb9e1ffc29a23ff01 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.583050 25421 raft_consensus.cc:740] T bffd5eeaa9c14effb9e1ffc29a23ff01 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.584532 25677 leader_election.cc:290] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:17.585443 25421 consensus_queue.cc:260] T bffd5eeaa9c14effb9e1ffc29a23ff01 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:17.585844 25423 raft_consensus.cc:359] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:17.587510 25423 raft_consensus.cc:385] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.589218 25423 raft_consensus.cc:740] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.590348 25421 ts_tablet_manager.cc:1434] T bffd5eeaa9c14effb9e1ffc29a23ff01 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.001s
I20260709 12:25:17.592067 25421 tablet_bootstrap.cc:492] T eb4d589309f24d3e955fb45b2c6fe3af P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:17.592969 25423 consensus_queue.cc:260] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:17.594928 25419 tablet_bootstrap.cc:492] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:17.595568 25419 ts_tablet_manager.cc:1403] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.005s
I20260709 12:25:17.596580 25423 ts_tablet_manager.cc:1434] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:25:17.597594 25423 tablet_bootstrap.cc:492] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:17.597685 25418 tablet_bootstrap.cc:492] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:17.650978 25418 ts_tablet_manager.cc:1403] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.170s	user 0.031s	sys 0.063s
W20260709 12:25:17.653380 25110 leader_election.cc:343] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:17.658743 25421 tablet_bootstrap.cc:654] T eb4d589309f24d3e955fb45b2c6fe3af P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:17.658241 25419 raft_consensus.cc:359] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
W20260709 12:25:17.660543 25113 leader_election.cc:343] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:17.672076 25113 leader_election.cc:304] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:17.666806 25144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574e4322900441a18f11a2568ab6fd64" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:17.677695 25728 raft_consensus.cc:493] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.688566 25144 raft_consensus.cc:2393] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a28f2edcd70f4eb08f16021ba3e2cf14 in current term 1: Already voted for candidate 434d5783f9374eab8f587e0fe6c15b1c in this term.
I20260709 12:25:17.673252 25419 raft_consensus.cc:385] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.678989 25728 raft_consensus.cc:515] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:17.695899 25731 raft_consensus.cc:493] T 1bf33e1087ea4e7f98b37dd2c130c635 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.691844 25419 raft_consensus.cc:740] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.697427 25731 raft_consensus.cc:515] T 1bf33e1087ea4e7f98b37dd2c130c635 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:17.699009 25419 consensus_queue.cc:260] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:17.700914 25676 raft_consensus.cc:2749] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:17.702236 25771 raft_consensus.cc:493] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.702863 25771 raft_consensus.cc:515] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:17.705812 25372 raft_consensus.cc:3060] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.708914 25370 raft_consensus.cc:3060] T 1bf33e1087ea4e7f98b37dd2c130c635 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.712222 25728 leader_election.cc:290] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:17.719563 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58caedf294044506b135b8990d49e180" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:17.720319 25731 leader_election.cc:290] T 1bf33e1087ea4e7f98b37dd2c130c635 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:17.723057 25419 ts_tablet_manager.cc:1434] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.127s	user 0.002s	sys 0.008s
I20260709 12:25:17.725911 25766 raft_consensus.cc:493] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.726233 25419 tablet_bootstrap.cc:492] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:17.726984 25766 raft_consensus.cc:515] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:17.709587 25418 raft_consensus.cc:359] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:17.733494 25418 raft_consensus.cc:385] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.733776 25418 raft_consensus.cc:740] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.739445 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf33e1087ea4e7f98b37dd2c130c635" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:17.746738 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574e4322900441a18f11a2568ab6fd64" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:17.748270 25298 raft_consensus.cc:2393] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 434d5783f9374eab8f587e0fe6c15b1c in current term 1: Already voted for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in this term.
I20260709 12:25:17.747141 25421 tablet_bootstrap.cc:492] T eb4d589309f24d3e955fb45b2c6fe3af P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:17.750231 25421 ts_tablet_manager.cc:1403] T eb4d589309f24d3e955fb45b2c6fe3af P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.159s	user 0.020s	sys 0.004s
I20260709 12:25:17.766731 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf33e1087ea4e7f98b37dd2c130c635" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:17.768864 25615 consensus_queue.cc:1048] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:25:17.769938 25262 leader_election.cc:343] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:17.779062 25263 leader_election.cc:304] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:17.787954 25766 leader_election.cc:290] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:17.800925 25740 raft_consensus.cc:2749] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:17.801777 25782 consensus_queue.cc:1048] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:25:17.782955 25418 consensus_queue.cc:260] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:17.816051 25423 tablet_bootstrap.cc:654] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:17.816576 25144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef05435bfb3044ffb451ca8373c097c7" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:17.817378 25144 raft_consensus.cc:2468] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:17.818142 25145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58caedf294044506b135b8990d49e180" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:17.818938 25145 raft_consensus.cc:2468] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 0.
I20260709 12:25:17.828550 25771 leader_election.cc:290] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:17.849802 25263 leader_election.cc:304] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:17.783603 25421 raft_consensus.cc:359] T eb4d589309f24d3e955fb45b2c6fe3af P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:17.856448 25421 raft_consensus.cc:385] T eb4d589309f24d3e955fb45b2c6fe3af P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.856886 25421 raft_consensus.cc:740] T eb4d589309f24d3e955fb45b2c6fe3af P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.860930 25113 leader_election.cc:304] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:17.863183 25418 ts_tablet_manager.cc:1434] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.211s	user 0.010s	sys 0.004s
I20260709 12:25:17.872254 25677 raft_consensus.cc:2749] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:17.887019 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4d589309f24d3e955fb45b2c6fe3af" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:17.888281 25145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4d589309f24d3e955fb45b2c6fe3af" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:17.889138 25145 raft_consensus.cc:2468] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:17.895126 25615 raft_consensus.cc:493] T 46a01e9d0014411a83a8edbf3b5504f6 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.896157 25615 raft_consensus.cc:515] T 46a01e9d0014411a83a8edbf3b5504f6 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:17.898706 25418 tablet_bootstrap.cc:492] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:17.899916 25421 consensus_queue.cc:260] T eb4d589309f24d3e955fb45b2c6fe3af P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:17.901494 25366 raft_consensus.cc:2468] T eb4d589309f24d3e955fb45b2c6fe3af P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:17.855669 25728 raft_consensus.cc:2804] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:17.904302 25728 raft_consensus.cc:493] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:17.904385 25113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:45473, user_credentials={real_user=slave}} blocked reactor thread for 48053.2us
I20260709 12:25:17.904875 25728 raft_consensus.cc:3060] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.899509 25615 leader_election.cc:290] T 46a01e9d0014411a83a8edbf3b5504f6 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:17.904345 25367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef05435bfb3044ffb451ca8373c097c7" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:17.901856 25421 ts_tablet_manager.cc:1434] T eb4d589309f24d3e955fb45b2c6fe3af P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.151s	user 0.005s	sys 0.005s
I20260709 12:25:17.913487 25188 leader_election.cc:304] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:17.964135 25676 raft_consensus.cc:493] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.972726 25421 tablet_bootstrap.cc:492] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:17.961779 25221 raft_consensus.cc:3060] T 46a01e9d0014411a83a8edbf3b5504f6 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.977612 25419 tablet_bootstrap.cc:654] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:17.973511 25676 raft_consensus.cc:515] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
W20260709 12:25:17.983026 25188 leader_election.cc:343] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:17.963618 25338 leader_election.cc:304] T 1bf33e1087ea4e7f98b37dd2c130c635 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:17.968334 25822 raft_consensus.cc:493] T bffd5eeaa9c14effb9e1ffc29a23ff01 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.000269 25822 raft_consensus.cc:515] T bffd5eeaa9c14effb9e1ffc29a23ff01 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:18.001454 25676 leader_election.cc:290] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:18.002171 25770 raft_consensus.cc:2804] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:18.002619 25770 raft_consensus.cc:493] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.003633 25770 raft_consensus.cc:3060] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:18.002821 25822 leader_election.cc:290] T bffd5eeaa9c14effb9e1ffc29a23ff01 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:18.022557 25421 tablet_bootstrap.cc:654] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:18.016572 25369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01f82f06bdb4424b0d871882d6c8c3b" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
W20260709 12:25:18.019663 25338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:45473, user_credentials={real_user=slave}} blocked reactor thread for 73337.7us
I20260709 12:25:18.023825 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01f82f06bdb4424b0d871882d6c8c3b" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
W20260709 12:25:18.024269 25112 leader_election.cc:343] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:18.026105 25731 raft_consensus.cc:2749] T 1bf33e1087ea4e7f98b37dd2c130c635 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:18.028369 25630 consensus_queue.cc:1048] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:25:18.043118 25418 tablet_bootstrap.cc:654] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:18.013396 25367 raft_consensus.cc:3060] T bffd5eeaa9c14effb9e1ffc29a23ff01 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:18.051331 25189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:45473, user_credentials={real_user=slave}} blocked reactor thread for 85145.1us
W20260709 12:25:18.072356 25262 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:40887, user_credentials={real_user=slave}} blocked reactor thread for 44237.7us
W20260709 12:25:18.072252 25110 consensus_peers.cc:597] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:18.078946 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffd5eeaa9c14effb9e1ffc29a23ff01" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
W20260709 12:25:18.076689 25110 leader_election.cc:343] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:18.077363 25189 leader_election.cc:304] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:18.084148 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffd5eeaa9c14effb9e1ffc29a23ff01" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:18.081477 25110 leader_election.cc:304] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:18.093235 25423 tablet_bootstrap.cc:492] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:18.098160 25632 raft_consensus.cc:2749] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:18.095657 25771 raft_consensus.cc:2804] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:18.102779 25771 raft_consensus.cc:493] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.103240 25771 raft_consensus.cc:3060] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:18.112711 25732 raft_consensus.cc:493] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.113579 25732 raft_consensus.cc:515] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:18.148082 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a01e9d0014411a83a8edbf3b5504f6" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:18.149711 25423 ts_tablet_manager.cc:1403] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.552s	user 0.043s	sys 0.065s
I20260709 12:25:18.142437 25770 raft_consensus.cc:515] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:18.171149 25335 leader_election.cc:304] T bffd5eeaa9c14effb9e1ffc29a23ff01 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:18.171622 25732 leader_election.cc:290] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:18.207929 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d39dac4e3e343f2985681aa3c5e5718" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:18.209414 25297 raft_consensus.cc:2468] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:18.211498 25142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a01e9d0014411a83a8edbf3b5504f6" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:18.174970 25728 raft_consensus.cc:515] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:18.226440 25728 leader_election.cc:290] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:18.188629 25423 raft_consensus.cc:359] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:18.234851 25423 raft_consensus.cc:385] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:18.235167 25423 raft_consensus.cc:740] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:18.139029 25771 raft_consensus.cc:515] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:18.254771 25189 leader_election.cc:304] T 46a01e9d0014411a83a8edbf3b5504f6 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:18.241917 25770 leader_election.cc:290] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:18.269032 25189 leader_election.cc:304] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:18.267426 25423 consensus_queue.cc:260] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:18.276085 25421 tablet_bootstrap.cc:492] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:18.276692 25421 ts_tablet_manager.cc:1403] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.304s	user 0.014s	sys 0.018s
I20260709 12:25:18.279543 25766 raft_consensus.cc:2804] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:18.280329 25421 raft_consensus.cc:359] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:18.283968 25421 raft_consensus.cc:385] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:18.284435 25421 raft_consensus.cc:740] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
W20260709 12:25:18.261314 25260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:41903, user_credentials={real_user=slave}} blocked reactor thread for 90699.6us
I20260709 12:25:18.279681 25142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4d589309f24d3e955fb45b2c6fe3af" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:18.287803 25766 raft_consensus.cc:493] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.303500 25418 tablet_bootstrap.cc:492] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:18.306810 25418 ts_tablet_manager.cc:1403] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.408s	user 0.019s	sys 0.015s
I20260709 12:25:18.303212 25421 consensus_queue.cc:260] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:18.310156 25423 ts_tablet_manager.cc:1434] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.160s	user 0.009s	sys 0.000s
I20260709 12:25:18.311607 25423 tablet_bootstrap.cc:492] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:18.308616 25766 raft_consensus.cc:3060] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:18.307240 25142 raft_consensus.cc:3060] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:18.332376 25833 raft_consensus.cc:2749] T 46a01e9d0014411a83a8edbf3b5504f6 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:18.337411 25419 tablet_bootstrap.cc:492] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:18.337416 25147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58caedf294044506b135b8990d49e180" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:18.359588 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d39dac4e3e343f2985681aa3c5e5718" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:18.360450 25370 raft_consensus.cc:2468] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:18.362422 25147 raft_consensus.cc:3060] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:18.340543 25423 tablet_bootstrap.cc:654] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:18.343581 25421 ts_tablet_manager.cc:1434] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.000s
I20260709 12:25:18.350670 25419 ts_tablet_manager.cc:1403] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.625s	user 0.010s	sys 0.033s
I20260709 12:25:18.354437 25418 raft_consensus.cc:359] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:18.371996 25418 raft_consensus.cc:385] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:18.372430 25418 raft_consensus.cc:740] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:18.396023 25418 consensus_queue.cc:260] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:18.396937 25142 raft_consensus.cc:2468] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:18.397934 25418 ts_tablet_manager.cc:1434] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.001s
I20260709 12:25:18.401013 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4d589309f24d3e955fb45b2c6fe3af" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:18.401737 25366 raft_consensus.cc:3060] T eb4d589309f24d3e955fb45b2c6fe3af P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:18.403280 25419 raft_consensus.cc:359] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:18.407560 25419 raft_consensus.cc:385] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:18.407908 25419 raft_consensus.cc:740] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:18.427335 25419 consensus_queue.cc:260] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:18.443456 25418 tablet_bootstrap.cc:492] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:18.451344 25419 ts_tablet_manager.cc:1434] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 12:25:18.452638 25419 tablet_bootstrap.cc:492] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:18.454033 25366 raft_consensus.cc:2468] T eb4d589309f24d3e955fb45b2c6fe3af P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:18.460732 25820 raft_consensus.cc:2749] T bffd5eeaa9c14effb9e1ffc29a23ff01 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:18.407028 25766 raft_consensus.cc:515] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:18.473986 25418 tablet_bootstrap.cc:654] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:18.474257 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58caedf294044506b135b8990d49e180" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:18.478363 25421 tablet_bootstrap.cc:492] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
W20260709 12:25:18.480929 25262 leader_election.cc:343] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:18.487056 25771 leader_election.cc:290] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
W20260709 12:25:18.490227 25189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:38537, user_credentials={real_user=slave}} blocked reactor thread for 175227us
I20260709 12:25:18.492394 25419 tablet_bootstrap.cc:654] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:18.530140 25766 leader_election.cc:290] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:18.530725 25145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef05435bfb3044ffb451ca8373c097c7" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:18.531476 25145 raft_consensus.cc:3060] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:18.552166 25188 leader_election.cc:304] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:18.554339 25829 raft_consensus.cc:2804] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:18.554883 25829 raft_consensus.cc:697] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:18.555905 25829 consensus_queue.cc:237] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:18.557257 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef05435bfb3044ffb451ca8373c097c7" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:18.557670 25421 tablet_bootstrap.cc:654] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:18.558849 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d39dac4e3e343f2985681aa3c5e5718" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:18.559474 25371 raft_consensus.cc:3060] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:18.570739 25423 tablet_bootstrap.cc:492] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:18.571357 25423 ts_tablet_manager.cc:1403] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.260s	user 0.015s	sys 0.011s
W20260709 12:25:18.571221 25189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:38537, user_credentials={real_user=slave}} blocked reactor thread for 46409.9us
I20260709 12:25:18.581730 25835 raft_consensus.cc:493] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.582346 25835 raft_consensus.cc:515] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:18.589479 25371 raft_consensus.cc:2468] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 2.
I20260709 12:25:18.594586 25423 raft_consensus.cc:359] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:18.599714 25423 raft_consensus.cc:385] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:18.600152 25423 raft_consensus.cc:740] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:18.577044 25147 raft_consensus.cc:2468] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:18.602013 25263 leader_election.cc:304] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:18.603168 25145 raft_consensus.cc:2468] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:18.603828 25836 raft_consensus.cc:2804] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:18.604598 25836 raft_consensus.cc:697] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:18.606418 25836 consensus_queue.cc:237] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:18.609203 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2bfe7ad58c42f1aff0feb1c9880d9b" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:18.610195 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d39dac4e3e343f2985681aa3c5e5718" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:18.610867 25293 raft_consensus.cc:3060] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:18.602056 25835 leader_election.cc:290] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
W20260709 12:25:18.598971 25188 leader_election.cc:343] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:18.615209 25188 leader_election.cc:304] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:18.617300 25854 raft_consensus.cc:2804] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:18.619740 25854 raft_consensus.cc:697] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:18.620986 25854 consensus_queue.cc:237] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
W20260709 12:25:18.626452 25262 leader_election.cc:343] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:18.638121 25423 consensus_queue.cc:260] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:18.642766 25423 ts_tablet_manager.cc:1434] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.071s	user 0.004s	sys 0.005s
I20260709 12:25:18.637214 25293 raft_consensus.cc:2468] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 2.
W20260709 12:25:18.649135 25092 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:18.652770 25734 raft_consensus.cc:493] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.653967 25734 raft_consensus.cc:515] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:18.655462 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2bfe7ad58c42f1aff0feb1c9880d9b" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:18.655862 25189 leader_election.cc:304] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:18.656320 25220 raft_consensus.cc:2468] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 0.
I20260709 12:25:18.657708 25853 raft_consensus.cc:2804] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:18.658293 25853 raft_consensus.cc:697] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:18.659044 25423 tablet_bootstrap.cc:492] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:18.659204 25853 consensus_queue.cc:237] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:18.657594 25260 leader_election.cc:304] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:18.681281 25836 raft_consensus.cc:2804] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:18.681732 25836 raft_consensus.cc:493] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.682058 25836 raft_consensus.cc:3060] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:18.682572 25371 raft_consensus.cc:3060] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:18.717011 25418 tablet_bootstrap.cc:492] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:18.717624 25418 ts_tablet_manager.cc:1403] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.284s	user 0.053s	sys 0.018s
I20260709 12:25:18.724282 25418 raft_consensus.cc:359] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:18.725109 25418 raft_consensus.cc:385] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:18.725382 25418 raft_consensus.cc:740] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:18.726311 25419 tablet_bootstrap.cc:492] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:18.726284 25418 consensus_queue.cc:260] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:18.727072 25419 ts_tablet_manager.cc:1403] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.275s	user 0.018s	sys 0.003s
I20260709 12:25:18.729161 25418 ts_tablet_manager.cc:1434] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:25:18.730667 25418 tablet_bootstrap.cc:492] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:18.731986 25836 raft_consensus.cc:515] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:18.733599 25734 leader_election.cc:290] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:18.734408 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b324fb11adf4924bd497717bc12ff4c" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:18.735402 25293 raft_consensus.cc:2468] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
W20260709 12:25:18.718575 25260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:41903, user_credentials={real_user=slave}} blocked reactor thread for 61072.6us
I20260709 12:25:18.736999 25113 leader_election.cc:304] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:18.738111 25838 raft_consensus.cc:2804] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:18.738502 25838 raft_consensus.cc:493] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.738823 25838 raft_consensus.cc:3060] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:18.741762 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b324fb11adf4924bd497717bc12ff4c" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
W20260709 12:25:18.744140 25112 leader_election.cc:343] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:18.731293 25419 raft_consensus.cc:359] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:18.746598 25419 raft_consensus.cc:385] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:18.747047 25419 raft_consensus.cc:740] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:18.745641 25734 raft_consensus.cc:493] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.752234 25418 tablet_bootstrap.cc:654] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:18.754261 25734 raft_consensus.cc:515] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:18.754927 25836 leader_election.cc:290] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:18.758909 25423 tablet_bootstrap.cc:654] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:18.758729 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2bfe7ad58c42f1aff0feb1c9880d9b" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:18.760517 25734 leader_election.cc:290] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
W20260709 12:25:18.761070 25262 leader_election.cc:343] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:18.755627 25041 catalog_manager.cc:5697] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 0 to 1, leader changed from <none> to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:18.762326 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4c35aae32446d4895fa10bcdc4d1eb" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:18.762480 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4c35aae32446d4895fa10bcdc4d1eb" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:18.762352 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2bfe7ad58c42f1aff0feb1c9880d9b" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:18.763334 25293 raft_consensus.cc:2468] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
I20260709 12:25:18.763521 25220 raft_consensus.cc:3060] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:18.757692 25419 consensus_queue.cc:260] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:18.765789 25419 ts_tablet_manager.cc:1434] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 12:25:18.766969 25419 tablet_bootstrap.cc:492] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
W20260709 12:25:18.768630 25110 leader_election.cc:343] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:18.769816 25113 leader_election.cc:304] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:18.772177 25676 raft_consensus.cc:2804] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:18.772569 25676 raft_consensus.cc:493] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.772915 25676 raft_consensus.cc:3060] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:18.789238 25220 raft_consensus.cc:2468] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:18.792845 25260 leader_election.cc:304] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:18.793812 25728 raft_consensus.cc:2804] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:18.794317 25728 raft_consensus.cc:697] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:18.798569 25728 consensus_queue.cc:237] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:18.800273 25838 raft_consensus.cc:515] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:18.804725 25421 tablet_bootstrap.cc:492] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:18.806170 25838 leader_election.cc:290] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:18.807968 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b324fb11adf4924bd497717bc12ff4c" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
W20260709 12:25:18.810114 25112 leader_election.cc:343] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:18.806638 25676 raft_consensus.cc:515] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:18.812283 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b324fb11adf4924bd497717bc12ff4c" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:18.814851 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4c35aae32446d4895fa10bcdc4d1eb" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:18.815207 25293 raft_consensus.cc:3060] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:18.815583 25297 raft_consensus.cc:3060] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:18.815472 25676 leader_election.cc:290] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:18.814455 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4c35aae32446d4895fa10bcdc4d1eb" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
W20260709 12:25:18.821048 25110 leader_election.cc:343] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:18.805470 25421 ts_tablet_manager.cc:1403] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.327s	user 0.036s	sys 0.037s
I20260709 12:25:18.835455 25419 tablet_bootstrap.cc:654] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:18.825078 25421 raft_consensus.cc:359] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:18.851845 25421 raft_consensus.cc:385] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:18.852305 25421 raft_consensus.cc:740] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:18.848693 25297 raft_consensus.cc:2468] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 1.
I20260709 12:25:18.855904 25853 raft_consensus.cc:493] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.856871 25853 raft_consensus.cc:515] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:18.859161 25853 leader_election.cc:290] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:18.863291 25418 tablet_bootstrap.cc:492] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:18.863927 25418 ts_tablet_manager.cc:1403] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.133s	user 0.016s	sys 0.014s
I20260709 12:25:18.864238 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01f82f06bdb4424b0d871882d6c8c3b" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:18.865319 25145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01f82f06bdb4424b0d871882d6c8c3b" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:18.866505 25113 leader_election.cc:304] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:18.868047 25293 raft_consensus.cc:2468] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 1.
W20260709 12:25:18.868412 25188 leader_election.cc:343] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:18.868886 25838 raft_consensus.cc:2804] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:18.869431 25838 raft_consensus.cc:697] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:18.870373 25113 leader_election.cc:304] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:18.872891 25421 consensus_queue.cc:260] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:18.873411 25734 raft_consensus.cc:2804] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:18.870066 25145 raft_consensus.cc:2468] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:18.878073 25045 catalog_manager.cc:5697] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:18.881958 25419 tablet_bootstrap.cc:492] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:18.882614 25419 ts_tablet_manager.cc:1403] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.116s	user 0.009s	sys 0.005s
I20260709 12:25:18.882035 25734 raft_consensus.cc:697] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:18.881837 25838 consensus_queue.cc:237] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:18.884796 25734 consensus_queue.cc:237] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:18.885704 25189 leader_election.cc:304] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:18.887395 25853 raft_consensus.cc:2804] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:18.887791 25853 raft_consensus.cc:493] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.888164 25853 raft_consensus.cc:3060] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:18.889340 25421 ts_tablet_manager.cc:1434] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.067s	user 0.009s	sys 0.000s
I20260709 12:25:18.889719 25423 tablet_bootstrap.cc:492] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:18.890287 25423 ts_tablet_manager.cc:1403] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.232s	user 0.008s	sys 0.014s
I20260709 12:25:18.890518 25421 tablet_bootstrap.cc:492] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:18.882179 25045 catalog_manager.cc:5697] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:18.896351 25821 raft_consensus.cc:493] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3979c425abd4ac7b2ca30e1dec9a154)
I20260709 12:25:18.897306 25821 raft_consensus.cc:515] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:18.897558 25045 catalog_manager.cc:5697] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 0 to 2, leader changed from <none> to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:18.899693 25418 raft_consensus.cc:359] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:18.900446 25418 raft_consensus.cc:385] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:18.900732 25418 raft_consensus.cc:740] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:18.901558 25418 consensus_queue.cc:260] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:18.904208 25423 raft_consensus.cc:359] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:18.905110 25423 raft_consensus.cc:385] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:18.907689 25419 raft_consensus.cc:359] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:18.915426 25418 ts_tablet_manager.cc:1434] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:25:18.916858 25418 tablet_bootstrap.cc:492] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:18.908484 25419 raft_consensus.cc:385] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:18.919945 25419 raft_consensus.cc:740] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:18.920747 25419 consensus_queue.cc:260] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:18.912810 25421 tablet_bootstrap.cc:654] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:18.923533 25419 ts_tablet_manager.cc:1434] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:25:18.924888 25419 tablet_bootstrap.cc:492] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:18.937943 25770 raft_consensus.cc:493] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.938681 25770 raft_consensus.cc:515] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:18.944260 25145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574e4322900441a18f11a2568ab6fd64" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:18.905465 25423 raft_consensus.cc:740] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:18.944860 25770 leader_election.cc:290] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:18.945571 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574e4322900441a18f11a2568ab6fd64" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:18.945116 25145 raft_consensus.cc:2393] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3979c425abd4ac7b2ca30e1dec9a154 in current term 1: Already voted for candidate 434d5783f9374eab8f587e0fe6c15b1c in this term.
I20260709 12:25:18.932639 25418 tablet_bootstrap.cc:654] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:18.953816 25294 raft_consensus.cc:2393] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3979c425abd4ac7b2ca30e1dec9a154 in current term 1: Already voted for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in this term.
I20260709 12:25:18.947340 25147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f5d4fb33b4421daaf5b63cafcd4f4b" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:18.956815 25423 consensus_queue.cc:260] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:18.958062 25731 raft_consensus.cc:493] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.958611 25731 raft_consensus.cc:515] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:18.959730 25423 ts_tablet_manager.cc:1434] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.001s
I20260709 12:25:18.960817 25189 leader_election.cc:304] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:18.965915 25423 tablet_bootstrap.cc:492] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14: Bootstrap starting.
I20260709 12:25:18.962442 25770 raft_consensus.cc:3060] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:18.963992 25821 leader_election.cc:290] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:18.968538 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c46968756c14269bc487ced0f6e74bd" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:18.969221 25731 leader_election.cc:290] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:18.971386 25853 raft_consensus.cc:515] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:18.974645 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01f82f06bdb4424b0d871882d6c8c3b" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:18.976148 25147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c46968756c14269bc487ced0f6e74bd" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
W20260709 12:25:18.976300 25188 leader_election.cc:343] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:18.978152 25421 tablet_bootstrap.cc:492] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:18.978704 25421 ts_tablet_manager.cc:1403] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.002s
I20260709 12:25:18.970674 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f5d4fb33b4421daaf5b63cafcd4f4b" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:18.981036 25335 leader_election.cc:304] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:18.981756 25421 raft_consensus.cc:359] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:18.982513 25421 raft_consensus.cc:385] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:18.982771 25421 raft_consensus.cc:740] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:18.983464 25421 consensus_queue.cc:260] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:18.984814 25419 tablet_bootstrap.cc:654] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:18.985399 25853 leader_election.cc:290] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:18.984819 25371 raft_consensus.cc:3060] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:18.991254 25731 raft_consensus.cc:2749] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:18.991722 25770 raft_consensus.cc:2749] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:18.992803 25338 leader_election.cc:304] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:18.995244 25145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01f82f06bdb4424b0d871882d6c8c3b" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:18.995926 25145 raft_consensus.cc:3060] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:18.989241 25423 tablet_bootstrap.cc:654] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:19.002987 25853 consensus_queue.cc:1048] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:19.007797 25421 ts_tablet_manager.cc:1434] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 12:25:19.018615 25145 raft_consensus.cc:2468] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:19.020009 25189 leader_election.cc:304] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:19.022567 25853 raft_consensus.cc:2804] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:19.027508 25853 raft_consensus.cc:697] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:19.031453 25421 tablet_bootstrap.cc:492] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:19.030337 25853 consensus_queue.cc:237] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:19.037725 25366 raft_consensus.cc:1275] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Refusing update from remote peer d3979c425abd4ac7b2ca30e1dec9a154: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:25:19.039413 25294 raft_consensus.cc:1275] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Refusing update from remote peer d3979c425abd4ac7b2ca30e1dec9a154: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:25:19.041139 25770 consensus_queue.cc:1048] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:19.041157 25423 tablet_bootstrap.cc:492] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14: No bootstrap required, opened a new log
I20260709 12:25:19.041889 25854 consensus_queue.cc:1048] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:19.042339 25423 ts_tablet_manager.cc:1403] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.001s
I20260709 12:25:19.049957 25418 tablet_bootstrap.cc:492] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c: No bootstrap required, opened a new log
I20260709 12:25:19.050714 25418 ts_tablet_manager.cc:1403] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.134s	user 0.015s	sys 0.004s
I20260709 12:25:19.055145 25418 raft_consensus.cc:359] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:19.041818 25419 tablet_bootstrap.cc:492] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:19.057128 25419 ts_tablet_manager.cc:1403] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.133s	user 0.018s	sys 0.007s
I20260709 12:25:19.061736 25419 raft_consensus.cc:359] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:19.062966 25419 raft_consensus.cc:385] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:19.064268 25419 raft_consensus.cc:740] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:19.066463 25419 consensus_queue.cc:260] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:19.065013 25423 raft_consensus.cc:359] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:19.067669 25423 raft_consensus.cc:385] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:19.068028 25423 raft_consensus.cc:740] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Initialized, Role: FOLLOWER
I20260709 12:25:19.072083 25423 consensus_queue.cc:260] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:19.063879 25418 raft_consensus.cc:385] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:19.076164 25418 raft_consensus.cc:740] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:19.077021 25418 consensus_queue.cc:260] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:19.079248 25418 ts_tablet_manager.cc:1434] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.002s
W20260709 12:25:19.082455 25262 consensus_peers.cc:597] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Couldn't send request to peer 0fa8f2c80074488084fea821c4bb293d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.083098 25820 raft_consensus.cc:2749] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:19.085089 25423 ts_tablet_manager.cc:1434] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 12:25:19.091941 25419 ts_tablet_manager.cc:1434] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.001s
I20260709 12:25:19.097601 25419 tablet_bootstrap.cc:492] T 969efca8af254e2e885d546c22e637aa P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:19.105732 25419 tablet_bootstrap.cc:654] T 969efca8af254e2e885d546c22e637aa P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:19.120740 25188 consensus_peers.cc:597] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Couldn't send request to peer 0fa8f2c80074488084fea821c4bb293d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.123987 25045 catalog_manager.cc:5697] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 0 to 1, leader changed from <none> to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:19.140115 25610 consensus_queue.cc:1048] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:19.143802 25421 tablet_bootstrap.cc:654] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:19.157234 25829 consensus_queue.cc:1048] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:19.158993 25419 tablet_bootstrap.cc:492] T 969efca8af254e2e885d546c22e637aa P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:19.159611 25419 ts_tablet_manager.cc:1403] T 969efca8af254e2e885d546c22e637aa P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.007s
I20260709 12:25:19.162537 25419 raft_consensus.cc:359] T 969efca8af254e2e885d546c22e637aa P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:19.163252 25419 raft_consensus.cc:385] T 969efca8af254e2e885d546c22e637aa P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:19.163525 25419 raft_consensus.cc:740] T 969efca8af254e2e885d546c22e637aa P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:19.167649 25419 consensus_queue.cc:260] T 969efca8af254e2e885d546c22e637aa P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:19.169464 25766 raft_consensus.cc:493] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.169963 25766 raft_consensus.cc:515] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:19.171039 25419 ts_tablet_manager.cc:1434] T 969efca8af254e2e885d546c22e637aa P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:25:19.172645 25766 leader_election.cc:290] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:19.173856 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa2c58c6d37474c908e6f924b95db30" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:19.175256 25419 tablet_bootstrap.cc:492] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
W20260709 12:25:19.175294 25188 leader_election.cc:343] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:19.182524 25419 tablet_bootstrap.cc:654] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:19.173924 25042 catalog_manager.cc:5697] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.188943 25836 consensus_queue.cc:1048] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:19.192564 25421 tablet_bootstrap.cc:492] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:19.193243 25421 ts_tablet_manager.cc:1403] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.169s	user 0.014s	sys 0.009s
I20260709 12:25:19.196125 25421 raft_consensus.cc:359] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:19.196929 25421 raft_consensus.cc:385] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:19.197269 25421 raft_consensus.cc:740] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:19.198026 25421 consensus_queue.cc:260] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:19.200205 25219 raft_consensus.cc:3060] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:19.200884 25045 catalog_manager.cc:5697] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 1 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:19.202692 25045 catalog_manager.cc:5697] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 1 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.215993 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa2c58c6d37474c908e6f924b95db30" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:19.216769 25297 raft_consensus.cc:2468] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:19.200205 25421 ts_tablet_manager.cc:1434] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:19.222723 25421 tablet_bootstrap.cc:492] T ef05435bfb3044ffb451ca8373c097c7 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:19.251893 25421 tablet_bootstrap.cc:654] T ef05435bfb3044ffb451ca8373c097c7 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:19.264159 25846 raft_consensus.cc:493] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.264485 25734 raft_consensus.cc:493] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.265029 25846 raft_consensus.cc:515] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:19.265353 25734 raft_consensus.cc:515] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:19.274511 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969efca8af254e2e885d546c22e637aa" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
W20260709 12:25:19.281886 25262 leader_election.cc:343] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:19.282088 25630 raft_consensus.cc:493] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.282665 25630 raft_consensus.cc:515] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:19.284962 25630 leader_election.cc:290] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:19.289266 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd48573282443f78bd7580dcd9c4bc2" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
W20260709 12:25:19.296257 25110 leader_election.cc:343] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:19.286652 25846 leader_election.cc:290] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:19.297204 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd48573282443f78bd7580dcd9c4bc2" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:19.317021 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b8c7cdce0c46fdb50c370f6f53001e" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:19.317773 25294 raft_consensus.cc:2468] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 0.
I20260709 12:25:19.320874 25113 leader_election.cc:304] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:19.326205 25734 leader_election.cc:290] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:19.327790 25676 raft_consensus.cc:2804] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:19.335017 25676 raft_consensus.cc:493] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.335307 25419 tablet_bootstrap.cc:492] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:19.336215 25419 ts_tablet_manager.cc:1403] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.161s	user 0.048s	sys 0.040s
I20260709 12:25:19.340282 25419 raft_consensus.cc:359] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:19.341300 25419 raft_consensus.cc:385] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:19.341648 25419 raft_consensus.cc:740] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:19.342623 25419 consensus_queue.cc:260] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:19.335346 25421 tablet_bootstrap.cc:492] T ef05435bfb3044ffb451ca8373c097c7 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:19.345177 25421 ts_tablet_manager.cc:1403] T ef05435bfb3044ffb451ca8373c097c7 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.123s	user 0.011s	sys 0.065s
I20260709 12:25:19.335398 25676 raft_consensus.cc:3060] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:19.357093 25189 leader_election.cc:304] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:19.358394 25421 raft_consensus.cc:359] T ef05435bfb3044ffb451ca8373c097c7 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:19.359426 25421 raft_consensus.cc:385] T ef05435bfb3044ffb451ca8373c097c7 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:19.359818 25421 raft_consensus.cc:740] T ef05435bfb3044ffb451ca8373c097c7 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:19.359867 25419 ts_tablet_manager.cc:1434] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:25:19.345062 25846 raft_consensus.cc:493] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.362113 25829 raft_consensus.cc:2804] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:19.366048 25829 raft_consensus.cc:493] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.366000 25846 raft_consensus.cc:515] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:19.366583 25829 raft_consensus.cc:3060] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:19.365362 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969efca8af254e2e885d546c22e637aa" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:19.362442 25368 raft_consensus.cc:3060] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:19.372452 25223 raft_consensus.cc:2468] T 969efca8af254e2e885d546c22e637aa P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 0.
I20260709 12:25:19.374109 25846 leader_election.cc:290] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:19.374243 25260 leader_election.cc:304] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
W20260709 12:25:19.378813 25113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:45473, user_credentials={real_user=slave}} blocked reactor thread for 54214.2us
I20260709 12:25:19.361824 25421 consensus_queue.cc:260] T ef05435bfb3044ffb451ca8373c097c7 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
W20260709 12:25:19.382828 25112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:40887, user_credentials={real_user=slave}} blocked reactor thread for 59887us
I20260709 12:25:19.379473 25846 raft_consensus.cc:2804] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:19.388171 25421 ts_tablet_manager.cc:1434] T ef05435bfb3044ffb451ca8373c097c7 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.002s
W20260709 12:25:19.392151 25112 leader_election.cc:343] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:19.385854 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574e4322900441a18f11a2568ab6fd64" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:19.394682 25223 raft_consensus.cc:2468] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:19.394728 25145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574e4322900441a18f11a2568ab6fd64" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:19.395421 25145 raft_consensus.cc:2468] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:19.385208 25677 consensus_queue.cc:1048] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:25:19.392894 25112 leader_election.cc:304] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:19.403522 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b8c7cdce0c46fdb50c370f6f53001e" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
W20260709 12:25:19.405735 25894 log.cc:927] Time spent T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:25:19.392513 25846 raft_consensus.cc:493] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.408769 25846 raft_consensus.cc:3060] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:19.403613 25260 leader_election.cc:304] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:19.402657 25677 raft_consensus.cc:2749] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:19.412025 25836 raft_consensus.cc:2804] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:19.412164 25821 raft_consensus.cc:493] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.412499 25836 raft_consensus.cc:493] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.412895 25836 raft_consensus.cc:3060] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:19.412799 25821 raft_consensus.cc:515] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
W20260709 12:25:19.412147 25112 leader_election.cc:343] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:19.414945 25676 raft_consensus.cc:515] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
W20260709 12:25:19.419039 25188 consensus_peers.cc:597] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Couldn't send request to peer 0fa8f2c80074488084fea821c4bb293d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.430159 25829 raft_consensus.cc:515] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:19.431131 25728 consensus_queue.cc:1048] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:19.439893 25677 consensus_queue.cc:1048] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:19.442586 25829 leader_election.cc:290] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:19.433660 25676 leader_election.cc:290] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:19.455850 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2bfe7ad58c42f1aff0feb1c9880d9b" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:19.457762 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b8c7cdce0c46fdb50c370f6f53001e" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:19.436767 25836 raft_consensus.cc:515] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:19.432073 25421 tablet_bootstrap.cc:492] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:19.445356 25822 raft_consensus.cc:493] T ef05435bfb3044ffb451ca8373c097c7 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.448027 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa2c58c6d37474c908e6f924b95db30" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:19.464583 25371 raft_consensus.cc:3060] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:19.474354 25371 raft_consensus.cc:2468] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:19.477217 25853 raft_consensus.cc:493] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.477838 25853 raft_consensus.cc:515] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:19.479956 25853 leader_election.cc:290] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:19.481467 25188 leader_election.cc:304] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:19.482393 25854 raft_consensus.cc:2804] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:19.482887 25854 raft_consensus.cc:697] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:19.483860 25854 consensus_queue.cc:237] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:19.489775 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574e4322900441a18f11a2568ab6fd64" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:19.490549 25220 raft_consensus.cc:3060] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:19.492493 25223 raft_consensus.cc:3060] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:19.493067 25846 raft_consensus.cc:515] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:19.452051 25419 tablet_bootstrap.cc:492] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154: Bootstrap starting.
I20260709 12:25:19.452540 25821 leader_election.cc:290] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:19.448441 25728 consensus_queue.cc:1048] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:25:19.460753 25822 raft_consensus.cc:515] T ef05435bfb3044ffb451ca8373c097c7 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:19.462349 25836 leader_election.cc:290] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: Requested vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:19.463132 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2bfe7ad58c42f1aff0feb1c9880d9b" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:19.497520 25219 raft_consensus.cc:2468] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 1.
I20260709 12:25:19.498834 25335 leader_election.cc:304] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: a28f2edcd70f4eb08f16021ba3e2cf14
W20260709 12:25:19.499509 25112 leader_election.cc:343] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:19.500161 25142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef05435bfb3044ffb451ca8373c097c7" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:19.500907 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef05435bfb3044ffb451ca8373c097c7" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:19.502509 25335 leader_election.cc:304] T ef05435bfb3044ffb451ca8373c097c7 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:19.498829 25822 leader_election.cc:290] T ef05435bfb3044ffb451ca8373c097c7 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:19.503875 25821 raft_consensus.cc:2749] T ef05435bfb3044ffb451ca8373c097c7 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:19.507918 25820 raft_consensus.cc:2804] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:25:19.509413 25112 consensus_peers.cc:597] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c -> Peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Couldn't send request to peer 0fa8f2c80074488084fea821c4bb293d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.509509 25820 raft_consensus.cc:493] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a28f2edcd70f4eb08f16021ba3e2cf14)
I20260709 12:25:19.510115 25820 raft_consensus.cc:3060] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:19.513239 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969efca8af254e2e885d546c22e637aa" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
W20260709 12:25:19.515061 25262 leader_election.cc:343] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:19.515789 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969efca8af254e2e885d546c22e637aa" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:19.516731 25219 raft_consensus.cc:3060] T 969efca8af254e2e885d546c22e637aa P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:19.526059 25145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4c35aae32446d4895fa10bcdc4d1eb" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:19.518299 25421 tablet_bootstrap.cc:654] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:19.538857 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa2c58c6d37474c908e6f924b95db30" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:19.539533 25297 raft_consensus.cc:3060] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:19.504730 25220 raft_consensus.cc:2468] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 2.
I20260709 12:25:19.522390 25419 tablet_bootstrap.cc:654] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:19.547237 25903 log.cc:927] Time spent T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:25:19.522712 25846 leader_election.cc:290] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:19.553817 25260 leader_election.cc:304] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:19.554822 25846 raft_consensus.cc:2804] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:19.555367 25846 raft_consensus.cc:697] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:19.556366 25846 consensus_queue.cc:237] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:19.559648 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4c35aae32446d4895fa10bcdc4d1eb" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:19.549706 25854 consensus_queue.cc:1048] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:25:19.563426 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b8c7cdce0c46fdb50c370f6f53001e" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:19.564216 25296 raft_consensus.cc:3060] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:19.567157 25297 raft_consensus.cc:2468] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:19.569501 25676 consensus_queue.cc:1048] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:25:19.584738 25296 raft_consensus.cc:2468] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 1.
I20260709 12:25:19.597766 25042 catalog_manager.cc:5697] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:19.604758 25219 raft_consensus.cc:2468] T 969efca8af254e2e885d546c22e637aa P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:19.607151 25820 raft_consensus.cc:515] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:19.608938 25371 raft_consensus.cc:1240] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Rejecting Update request from peer a28f2edcd70f4eb08f16021ba3e2cf14 for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:19.609321 25260 leader_election.cc:304] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:19.626518 25902 raft_consensus.cc:2804] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:19.627228 25902 raft_consensus.cc:697] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:19.634797 25113 leader_election.cc:304] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:19.639047 25189 leader_election.cc:304] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:19.640136 25419 tablet_bootstrap.cc:492] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154: No bootstrap required, opened a new log
I20260709 12:25:19.640815 25419 ts_tablet_manager.cc:1403] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent bootstrapping tablet: real 0.189s	user 0.019s	sys 0.003s
I20260709 12:25:19.651070 25421 tablet_bootstrap.cc:492] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:19.651868 25421 ts_tablet_manager.cc:1403] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.250s	user 0.015s	sys 0.004s
I20260709 12:25:19.628517 25902 consensus_queue.cc:237] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:19.662822 25421 raft_consensus.cc:359] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:19.672052 25421 raft_consensus.cc:385] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:19.672397 25421 raft_consensus.cc:740] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:19.648720 25630 raft_consensus.cc:2804] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:19.656297 25610 raft_consensus.cc:2749] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:19.679385 25421 consensus_queue.cc:260] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:19.685256 25419 raft_consensus.cc:359] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:19.685624 25630 raft_consensus.cc:697] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:19.687503 25630 consensus_queue.cc:237] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:19.698251 25371 raft_consensus.cc:3060] T ef05435bfb3044ffb451ca8373c097c7 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:19.706475 25143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574e4322900441a18f11a2568ab6fd64" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:19.707247 25143 raft_consensus.cc:3060] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:19.707779 25820 leader_election.cc:290] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:19.721181 25421 ts_tablet_manager.cc:1434] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.000s
I20260709 12:25:19.735018 25421 tablet_bootstrap.cc:492] T 58caedf294044506b135b8990d49e180 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:19.686223 25419 raft_consensus.cc:385] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:25:19.748404 25263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:38537, user_credentials={real_user=slave}} blocked reactor thread for 110641us
I20260709 12:25:19.749435 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2bfe7ad58c42f1aff0feb1c9880d9b" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:19.751271 25728 consensus_queue.cc:1059] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:19.752877 25728 raft_consensus.cc:3055] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:19.753320 25728 raft_consensus.cc:740] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:19.753877 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2bfe7ad58c42f1aff0feb1c9880d9b" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:19.754246 25728 consensus_queue.cc:260] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:19.756321 25728 raft_consensus.cc:3060] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:19.773483 25419 raft_consensus.cc:740] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Initialized, Role: FOLLOWER
I20260709 12:25:19.774325 25419 consensus_queue.cc:260] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:19.782307 25419 ts_tablet_manager.cc:1434] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154: Time spent starting tablet: real 0.141s	user 0.007s	sys 0.001s
I20260709 12:25:19.786752 25338 leader_election.cc:304] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:19.787770 25820 raft_consensus.cc:2749] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:25:19.779507 25421 tablet_bootstrap.cc:654] T 58caedf294044506b135b8990d49e180 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:19.794590 25042 catalog_manager.cc:5697] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 0 to 2, leader changed from <none> to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.804960 25143 raft_consensus.cc:2468] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 2.
I20260709 12:25:19.837165 25045 catalog_manager.cc:5697] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 1 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.843704 25421 tablet_bootstrap.cc:492] T 58caedf294044506b135b8990d49e180 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:19.844605 25421 ts_tablet_manager.cc:1403] T 58caedf294044506b135b8990d49e180 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.122s	user 0.021s	sys 0.003s
I20260709 12:25:19.848325 25421 raft_consensus.cc:359] T 58caedf294044506b135b8990d49e180 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:19.849071 25421 raft_consensus.cc:385] T 58caedf294044506b135b8990d49e180 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:19.849340 25421 raft_consensus.cc:740] T 58caedf294044506b135b8990d49e180 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:19.854698 25421 consensus_queue.cc:260] T 58caedf294044506b135b8990d49e180 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:19.863330 25421 ts_tablet_manager.cc:1434] T 58caedf294044506b135b8990d49e180 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:25:19.870477 25042 catalog_manager.cc:5697] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 0 to 1, leader changed from <none> to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:19.872119 25092 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:19.873152 25421 tablet_bootstrap.cc:492] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:19.881063 25421 tablet_bootstrap.cc:654] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:19.893338 25421 tablet_bootstrap.cc:492] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:19.894922 25421 ts_tablet_manager.cc:1403] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.005s
I20260709 12:25:19.898249 25421 raft_consensus.cc:359] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:19.899084 25421 raft_consensus.cc:385] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:19.899385 25421 raft_consensus.cc:740] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:19.900257 25421 consensus_queue.cc:260] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:19.902415 25421 ts_tablet_manager.cc:1434] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:19.904024 25421 tablet_bootstrap.cc:492] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:19.909670 25421 tablet_bootstrap.cc:654] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:19.911177 25371 raft_consensus.cc:3060] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:19.914373 25821 raft_consensus.cc:493] T 58caedf294044506b135b8990d49e180 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.915218 25421 tablet_bootstrap.cc:492] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:19.914921 25821 raft_consensus.cc:515] T 58caedf294044506b135b8990d49e180 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:19.915769 25421 ts_tablet_manager.cc:1403] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:25:19.917099 25821 leader_election.cc:290] T 58caedf294044506b135b8990d49e180 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:19.919006 25421 raft_consensus.cc:359] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:19.919696 25421 raft_consensus.cc:385] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:19.919987 25421 raft_consensus.cc:740] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:19.920495 25821 raft_consensus.cc:493] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.920609 25421 consensus_queue.cc:260] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:19.921106 25821 raft_consensus.cc:515] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:19.922111 25366 raft_consensus.cc:3060] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:19.923254 25421 ts_tablet_manager.cc:1434] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:19.924595 25142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01f82f06bdb4424b0d871882d6c8c3b" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:19.924958 25421 tablet_bootstrap.cc:492] T 8fd48573282443f78bd7580dcd9c4bc2 P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:19.926108 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01f82f06bdb4424b0d871882d6c8c3b" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:19.926209 25143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58caedf294044506b135b8990d49e180" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:19.929255 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58caedf294044506b135b8990d49e180" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:19.929926 25338 leader_election.cc:304] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:19.932145 25421 tablet_bootstrap.cc:654] T 8fd48573282443f78bd7580dcd9c4bc2 P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:19.933569 25338 leader_election.cc:304] T 58caedf294044506b135b8990d49e180 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:19.935062 25820 raft_consensus.cc:2749] T 58caedf294044506b135b8990d49e180 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:19.936648 25821 leader_election.cc:290] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:19.947054 25615 consensus_queue.cc:1048] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:19.950702 25421 tablet_bootstrap.cc:492] T 8fd48573282443f78bd7580dcd9c4bc2 P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:19.951567 25421 ts_tablet_manager.cc:1403] T 8fd48573282443f78bd7580dcd9c4bc2 P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.004s
I20260709 12:25:19.955530 25421 raft_consensus.cc:359] T 8fd48573282443f78bd7580dcd9c4bc2 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:19.956557 25421 raft_consensus.cc:385] T 8fd48573282443f78bd7580dcd9c4bc2 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:19.956918 25421 raft_consensus.cc:740] T 8fd48573282443f78bd7580dcd9c4bc2 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:19.958009 25421 consensus_queue.cc:260] T 8fd48573282443f78bd7580dcd9c4bc2 P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:19.962571 25421 ts_tablet_manager.cc:1434] T 8fd48573282443f78bd7580dcd9c4bc2 P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:25:19.964198 25421 tablet_bootstrap.cc:492] T 969efca8af254e2e885d546c22e637aa P 0fa8f2c80074488084fea821c4bb293d: Bootstrap starting.
I20260709 12:25:19.972167 25822 raft_consensus.cc:2749] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:19.973999 25421 tablet_bootstrap.cc:654] T 969efca8af254e2e885d546c22e637aa P 0fa8f2c80074488084fea821c4bb293d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:19.985476 25771 consensus_queue.cc:1048] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:20.005640 25366 raft_consensus.cc:3060] T 58caedf294044506b135b8990d49e180 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:20.009255 25421 tablet_bootstrap.cc:492] T 969efca8af254e2e885d546c22e637aa P 0fa8f2c80074488084fea821c4bb293d: No bootstrap required, opened a new log
I20260709 12:25:20.010987 25421 ts_tablet_manager.cc:1403] T 969efca8af254e2e885d546c22e637aa P 0fa8f2c80074488084fea821c4bb293d: Time spent bootstrapping tablet: real 0.047s	user 0.025s	sys 0.009s
I20260709 12:25:20.013899 25421 raft_consensus.cc:359] T 969efca8af254e2e885d546c22e637aa P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:20.014598 25421 raft_consensus.cc:385] T 969efca8af254e2e885d546c22e637aa P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:20.014850 25421 raft_consensus.cc:740] T 969efca8af254e2e885d546c22e637aa P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Initialized, Role: FOLLOWER
I20260709 12:25:20.015486 25421 consensus_queue.cc:260] T 969efca8af254e2e885d546c22e637aa P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:20.023339 25421 ts_tablet_manager.cc:1434] T 969efca8af254e2e885d546c22e637aa P 0fa8f2c80074488084fea821c4bb293d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:25:20.029707 25219 raft_consensus.cc:1275] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Refusing update from remote peer a28f2edcd70f4eb08f16021ba3e2cf14: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:25:20.031406 25902 consensus_queue.cc:1048] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:20.043566 25143 raft_consensus.cc:1275] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Refusing update from remote peer a28f2edcd70f4eb08f16021ba3e2cf14: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:25:20.045871 25728 consensus_queue.cc:1048] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:20.098631 25630 consensus_queue.cc:1048] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:20.109738 25366 raft_consensus.cc:3060] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:20.118256 25822 raft_consensus.cc:493] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.118793 25822 raft_consensus.cc:515] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:20.120409 25676 consensus_queue.cc:1048] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:20.124922 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b8c7cdce0c46fdb50c370f6f53001e" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:20.127777 25822 leader_election.cc:290] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:20.133325 25143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b8c7cdce0c46fdb50c370f6f53001e" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:20.136653 25338 leader_election.cc:304] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:20.137765 25822 raft_consensus.cc:2749] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:20.147104 25370 raft_consensus.cc:3060] T 969efca8af254e2e885d546c22e637aa P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:20.155676 25846 consensus_queue.cc:1048] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:20.175047 25728 consensus_queue.cc:1048] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:20.263026 25615 raft_consensus.cc:493] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.263671 25615 raft_consensus.cc:515] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:20.266557 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd48573282443f78bd7580dcd9c4bc2" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:20.266620 25615 leader_election.cc:290] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:20.267316 25370 raft_consensus.cc:2468] T 8fd48573282443f78bd7580dcd9c4bc2 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:20.267623 25143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd48573282443f78bd7580dcd9c4bc2" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:20.268421 25143 raft_consensus.cc:2468] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 0.
I20260709 12:25:20.268922 25188 leader_election.cc:304] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:20.269747 25615 raft_consensus.cc:2804] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:20.270396 25615 raft_consensus.cc:493] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.270740 25615 raft_consensus.cc:3060] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:20.277406 25615 raft_consensus.cc:515] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:20.279160 25615 leader_election.cc:290] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:20.280325 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd48573282443f78bd7580dcd9c4bc2" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:20.280689 25143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd48573282443f78bd7580dcd9c4bc2" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:20.281162 25370 raft_consensus.cc:3060] T 8fd48573282443f78bd7580dcd9c4bc2 P 0fa8f2c80074488084fea821c4bb293d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:20.281407 25143 raft_consensus.cc:3060] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:20.288036 25143 raft_consensus.cc:2468] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:20.288970 25189 leader_election.cc:304] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:20.289638 25615 raft_consensus.cc:2804] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:20.290112 25615 raft_consensus.cc:697] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:20.290846 25615 consensus_queue.cc:237] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:20.291643 25370 raft_consensus.cc:2468] T 8fd48573282443f78bd7580dcd9c4bc2 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:20.312798 25043 catalog_manager.cc:5697] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:20.675792 25615 consensus_queue.cc:1048] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:20.698705 17346 tablet_server.cc:179] TabletServer@127.16.240.129:0 shutting down...
W20260709 12:25:20.702247 25189 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 125 similar messages]
W20260709 12:25:20.731247 25189 consensus_peers.cc:597] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:20.735322 25263 consensus_peers.cc:597] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:20.758631 25338 consensus_peers.cc:597] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:20.774483 25263 consensus_peers.cc:597] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:20.775014 25338 consensus_peers.cc:597] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:20.780893 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:20.782302 17346 tablet_replica.cc:333] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.783035 17346 raft_consensus.cc:2243] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.783493 17346 raft_consensus.cc:2272] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.785630 17346 tablet_replica.cc:333] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.786254 17346 raft_consensus.cc:2243] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.787029 17346 raft_consensus.cc:2272] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.789227 17346 tablet_replica.cc:333] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.789911 17346 raft_consensus.cc:2243] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.790333 17346 raft_consensus.cc:2272] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.792910 17346 tablet_replica.cc:333] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.793658 17346 raft_consensus.cc:2243] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.794183 17346 raft_consensus.cc:2272] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.796942 17346 tablet_replica.cc:333] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.797793 17346 raft_consensus.cc:2243] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.798357 17346 raft_consensus.cc:2272] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.801056 17346 tablet_replica.cc:333] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.801795 17346 raft_consensus.cc:2243] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.802371 17346 raft_consensus.cc:2272] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.805167 17346 tablet_replica.cc:333] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
W20260709 12:25:20.805400 25189 consensus_peers.cc:597] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:20.806020 17346 raft_consensus.cc:2243] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.806910 17346 raft_consensus.cc:2272] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.810232 17346 tablet_replica.cc:333] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.811535 17346 raft_consensus.cc:2243] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.812563 17346 raft_consensus.cc:2272] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.815387 17346 tablet_replica.cc:333] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
W20260709 12:25:20.815619 25263 consensus_peers.cc:597] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:20.816357 17346 raft_consensus.cc:2243] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:25:20.816672 25189 consensus_peers.cc:597] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:20.817395 17346 raft_consensus.cc:2272] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.820019 17346 tablet_replica.cc:333] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.820762 17346 raft_consensus.cc:2243] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.821612 17346 raft_consensus.cc:2272] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.823930 17346 tablet_replica.cc:333] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.824513 17346 raft_consensus.cc:2243] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.825016 17346 raft_consensus.cc:2272] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.827318 17346 tablet_replica.cc:333] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.828608 17346 raft_consensus.cc:2243] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.829366 17346 raft_consensus.cc:2272] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.832103 17346 tablet_replica.cc:333] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.832782 17346 raft_consensus.cc:2243] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.833866 17346 raft_consensus.cc:2272] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.836432 17346 tablet_replica.cc:333] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.837126 17346 raft_consensus.cc:2243] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.837673 17346 raft_consensus.cc:2272] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.840391 17346 tablet_replica.cc:333] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.841136 17346 raft_consensus.cc:2243] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.841681 17346 raft_consensus.cc:2272] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:20.842358 25263 consensus_peers.cc:597] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:20.843266 25263 consensus_peers.cc:597] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:20.844578 17346 tablet_replica.cc:333] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.845551 17346 raft_consensus.cc:2243] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.846836 17346 raft_consensus.cc:2272] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.850344 17346 tablet_replica.cc:333] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
W20260709 12:25:20.850885 25263 consensus_peers.cc:597] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:20.851378 17346 raft_consensus.cc:2243] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.852530 17346 raft_consensus.cc:2272] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:20.853655 25189 consensus_peers.cc:597] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:20.855764 17346 tablet_replica.cc:333] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.856855 17346 raft_consensus.cc:2243] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:25:20.857259 25189 consensus_peers.cc:597] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:20.857977 17346 raft_consensus.cc:2272] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.860997 17346 tablet_replica.cc:333] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.861799 17346 raft_consensus.cc:2243] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.862330 17346 raft_consensus.cc:2272] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.864960 17346 tablet_replica.cc:333] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.865588 17346 raft_consensus.cc:2243] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.866133 17346 raft_consensus.cc:2272] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.869458 17346 tablet_replica.cc:333] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.870389 17346 raft_consensus.cc:2243] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.870955 17346 raft_consensus.cc:2272] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.873894 17346 tablet_replica.cc:333] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.874732 17346 raft_consensus.cc:2243] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.875290 17346 raft_consensus.cc:2272] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.878225 17346 tablet_replica.cc:333] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.879014 17346 raft_consensus.cc:2243] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.879555 17346 raft_consensus.cc:2272] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.882347 17346 tablet_replica.cc:333] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.883222 17346 raft_consensus.cc:2243] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.884451 17346 raft_consensus.cc:2272] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.887106 17346 tablet_replica.cc:333] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.887981 17346 raft_consensus.cc:2243] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.889564 17346 raft_consensus.cc:2272] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.892882 17346 tablet_replica.cc:333] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.893739 17346 raft_consensus.cc:2243] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.894870 17346 raft_consensus.cc:2272] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.897462 17346 tablet_replica.cc:333] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.898123 17346 raft_consensus.cc:2243] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.899080 17346 raft_consensus.cc:2272] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.901444 17346 tablet_replica.cc:333] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.902066 17346 raft_consensus.cc:2243] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.902912 17346 raft_consensus.cc:2272] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.905794 17346 tablet_replica.cc:333] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.906657 17346 raft_consensus.cc:2243] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.907263 17346 raft_consensus.cc:2272] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.910382 17346 tablet_replica.cc:333] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.911150 17346 raft_consensus.cc:2243] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.911682 17346 raft_consensus.cc:2272] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.914623 17346 tablet_replica.cc:333] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.915407 17346 raft_consensus.cc:2243] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:25:20.916378 25338 consensus_peers.cc:597] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:20.916472 17346 raft_consensus.cc:2272] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.919793 17346 tablet_replica.cc:333] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.920670 17346 raft_consensus.cc:2243] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.921185 17346 raft_consensus.cc:2272] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.923840 17346 tablet_replica.cc:333] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.924511 17346 raft_consensus.cc:2243] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.925078 17346 raft_consensus.cc:2272] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.928386 17346 tablet_replica.cc:333] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.929523 17346 raft_consensus.cc:2243] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:20.930065 25338 consensus_peers.cc:597] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:20.930209 17346 raft_consensus.cc:2272] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.934053 17346 tablet_replica.cc:333] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.934909 17346 raft_consensus.cc:2243] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.935968 17346 raft_consensus.cc:2272] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.938803 17346 tablet_replica.cc:333] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.939582 17346 raft_consensus.cc:2243] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.940176 17346 raft_consensus.cc:2272] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.942656 17346 tablet_replica.cc:333] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.943277 17346 raft_consensus.cc:2243] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.944600 17346 raft_consensus.cc:2272] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.948073 17346 tablet_replica.cc:333] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.948910 17346 raft_consensus.cc:2243] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.949440 17346 raft_consensus.cc:2272] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.952536 17346 tablet_replica.cc:333] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.953339 17346 raft_consensus.cc:2243] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.954056 17346 raft_consensus.cc:2272] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:20.954648 25263 consensus_peers.cc:597] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:20.955111 25189 consensus_peers.cc:597] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:20.956192 25189 consensus_peers.cc:597] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:20.956776 17346 tablet_replica.cc:333] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.957408 17346 raft_consensus.cc:2243] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.957866 17346 raft_consensus.cc:2272] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.960500 17346 tablet_replica.cc:333] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.961184 17346 raft_consensus.cc:2243] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.962311 17346 raft_consensus.cc:2272] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.964720 17346 tablet_replica.cc:333] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.965279 17346 raft_consensus.cc:2243] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.966071 17346 raft_consensus.cc:2272] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.968427 17346 tablet_replica.cc:333] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.969159 17346 raft_consensus.cc:2243] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.969632 17346 raft_consensus.cc:2272] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.971999 17346 tablet_replica.cc:333] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.972553 17346 raft_consensus.cc:2243] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.973338 17346 raft_consensus.cc:2272] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.975906 17346 tablet_replica.cc:333] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c: stopping tablet replica
I20260709 12:25:20.976521 17346 raft_consensus.cc:2243] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.977041 17346 raft_consensus.cc:2272] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:21.027297 25338 consensus_peers.cc:597] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:21.057443 17346 tablet_server.cc:196] TabletServer@127.16.240.129:0 shutdown complete.
W20260709 12:25:21.082597 25189 consensus_peers.cc:597] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:21.089619 25263 consensus_peers.cc:597] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:21.106637 25771 raft_consensus.cc:493] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a28f2edcd70f4eb08f16021ba3e2cf14)
I20260709 12:25:21.107555 25771 raft_consensus.cc:515] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:21.111456 25771 leader_election.cc:290] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:21.112012 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2bfe7ad58c42f1aff0feb1c9880d9b" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:21.112504 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2bfe7ad58c42f1aff0feb1c9880d9b" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:21.113090 25366 raft_consensus.cc:2393] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3979c425abd4ac7b2ca30e1dec9a154 in current term 2: Already voted for candidate 0fa8f2c80074488084fea821c4bb293d in this term.
I20260709 12:25:21.113440 25293 raft_consensus.cc:2468] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 2.
I20260709 12:25:21.114929 25189 leader_election.cc:304] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:21.116461 25771 raft_consensus.cc:2804] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:21.117019 25771 raft_consensus.cc:493] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a28f2edcd70f4eb08f16021ba3e2cf14)
I20260709 12:25:21.117594 25771 raft_consensus.cc:3060] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:21.141997 25771 raft_consensus.cc:515] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
W20260709 12:25:21.142575 25189 consensus_peers.cc:597] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:21.144450 25263 consensus_peers.cc:597] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:21.157121 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2bfe7ad58c42f1aff0feb1c9880d9b" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:21.158022 25366 raft_consensus.cc:2393] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d3979c425abd4ac7b2ca30e1dec9a154 in current term 2: Already voted for candidate 0fa8f2c80074488084fea821c4bb293d in this term.
I20260709 12:25:21.160982 25771 leader_election.cc:290] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:21.164117 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2bfe7ad58c42f1aff0feb1c9880d9b" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
W20260709 12:25:21.166879 25189 consensus_peers.cc:597] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:21.170042 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:21.170727 25189 consensus_peers.cc:597] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:21.172307 25293 raft_consensus.cc:2468] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 2.
I20260709 12:25:21.173931 25189 leader_election.cc:304] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:21.174731 25771 raft_consensus.cc:2804] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:21.175402 25771 raft_consensus.cc:697] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:21.176493 25771 consensus_queue.cc:237] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
W20260709 12:25:21.187369 25189 consensus_peers.cc:597] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:21.220422 25043 catalog_manager.cc:5697] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 1 to 2, leader changed from a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131) to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:21.227141 25952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:21.232342 25189 consensus_peers.cc:597] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:21.235381 25953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:21.277318 17346 server_base.cc:1061] running on GCE node
W20260709 12:25:21.278345 25958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:21.279644 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:21.280086 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:21.280337 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599921280321 us; error 0 us; skew 500 ppm
I20260709 12:25:21.281087 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:21.288008 17346 webserver.cc:533] Webserver started at http://127.16.240.129:36317/ using document root <none> and password file <none>
I20260709 12:25:21.288542 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:21.288722 17346 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:25:21.292718 17346 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 12:25:21.301600 25964 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:21.302575 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 12:25:21.302984 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-0-root
uuid: "434d5783f9374eab8f587e0fe6c15b1c"
format_stamp: "Formatted at 2026-07-09 12:25:07 on dist-test-slave-7xpw"
I20260709 12:25:21.303373 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599638884573-17346-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:21.336274 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:21.338054 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:21.340454 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:21.371294 25972 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 12:25:21.568082 25366 raft_consensus.cc:1275] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Refusing update from remote peer d3979c425abd4ac7b2ca30e1dec9a154: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:21.569442 25970 consensus_queue.cc:1048] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:21.591676 25297 raft_consensus.cc:1275] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Refusing update from remote peer d3979c425abd4ac7b2ca30e1dec9a154: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:21.593808 25771 consensus_queue.cc:1048] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:21.697532 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:25:21.697914 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.328s	user 0.011s	sys 0.000s
I20260709 12:25:21.698280 17346 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:25:21.705444 25972 tablet_bootstrap.cc:492] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:21.722143 25972 tablet_bootstrap.cc:492] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:21.723121 25972 tablet_bootstrap.cc:492] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:21.723731 25972 ts_tablet_manager.cc:1403] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 12:25:21.726182 25972 raft_consensus.cc:359] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:21.726902 25972 raft_consensus.cc:740] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:21.727680 25972 consensus_queue.cc:260] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:21.731307 25972 ts_tablet_manager.cc:1434] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:21.732648 25972 tablet_bootstrap.cc:492] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:21.748756 25972 tablet_bootstrap.cc:492] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:21.750036 25972 tablet_bootstrap.cc:492] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:21.750770 25972 ts_tablet_manager.cc:1403] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:25:21.755935 25972 raft_consensus.cc:359] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:21.756727 25972 raft_consensus.cc:740] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:21.757495 25972 consensus_queue.cc:260] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:21.759159 25972 ts_tablet_manager.cc:1434] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:25:21.759913 25972 tablet_bootstrap.cc:492] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:21.772022 25972 tablet_bootstrap.cc:492] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:21.772907 25972 tablet_bootstrap.cc:492] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:21.773579 25972 ts_tablet_manager.cc:1403] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:25:21.776279 25972 raft_consensus.cc:359] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:21.777004 25972 raft_consensus.cc:740] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:21.777714 25972 consensus_queue.cc:260] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:21.779857 25972 ts_tablet_manager.cc:1434] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:25:21.780535 25972 tablet_bootstrap.cc:492] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:21.795694 25972 tablet_bootstrap.cc:492] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:21.796749 25972 tablet_bootstrap.cc:492] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:21.797415 25972 ts_tablet_manager.cc:1403] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 12:25:21.799923 25972 raft_consensus.cc:359] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:21.801115 25972 raft_consensus.cc:740] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:21.801784 25972 consensus_queue.cc:260] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:21.803725 25972 ts_tablet_manager.cc:1434] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:21.804545 25972 tablet_bootstrap.cc:492] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:21.805485 25904 raft_consensus.cc:493] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:21.806066 25904 raft_consensus.cc:515] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:21.814214 25904 leader_election.cc:290] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:21.816540 25820 raft_consensus.cc:493] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:21.817162 25820 raft_consensus.cc:515] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:21.816529 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd0775b429544fcb31e2834c279b159" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:21.819231 25820 leader_election.cc:290] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:21.820210 25949 raft_consensus.cc:493] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:21.820732 25949 raft_consensus.cc:515] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:21.821848 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b324fb11adf4924bd497717bc12ff4c" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:21.822856 25949 leader_election.cc:290] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:21.823458 25949 raft_consensus.cc:493] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:21.829612 25949 raft_consensus.cc:515] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:21.831568 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1f8b45199a40aeaf77fa2e23107375" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
W20260709 12:25:21.837302 25263 leader_election.cc:336] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:21.837834 25263 leader_election.cc:304] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:21.839886 25846 raft_consensus.cc:2749] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:21.836611 25949 leader_election.cc:290] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:21.839710 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb84b6ee4f14cdc9a40ffd59ca4f42c" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
W20260709 12:25:21.842049 25338 leader_election.cc:336] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:21.843182 25338 leader_election.cc:304] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
W20260709 12:25:21.844144 25338 leader_election.cc:336] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:21.844561 25338 leader_election.cc:304] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:21.845830 25945 raft_consensus.cc:2749] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:21.846467 25945 raft_consensus.cc:2749] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:21.848558 25338 leader_election.cc:336] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:21.849118 25338 leader_election.cc:304] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:21.849866 25945 raft_consensus.cc:2749] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:21.851552 25972 tablet_bootstrap.cc:492] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:21.852450 25972 tablet_bootstrap.cc:492] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:21.853382 25972 ts_tablet_manager.cc:1403] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.028s
I20260709 12:25:21.855806 25972 raft_consensus.cc:359] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:21.856506 25972 raft_consensus.cc:740] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:21.857236 25972 consensus_queue.cc:260] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:21.859212 25972 ts_tablet_manager.cc:1434] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:25:21.860119 25972 tablet_bootstrap.cc:492] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:21.868467 25945 raft_consensus.cc:493] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:21.869910 25945 raft_consensus.cc:515] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:21.872605 25945 leader_election.cc:290] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:21.874233 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb0eab5dcee4f95b7c284dea379c795" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
W20260709 12:25:21.880033 25338 leader_election.cc:336] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:21.882519 25338 leader_election.cc:304] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:21.874635 25972 tablet_bootstrap.cc:492] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:21.883648 25945 raft_consensus.cc:2749] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:21.884320 25972 tablet_bootstrap.cc:492] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:21.885097 25972 ts_tablet_manager.cc:1403] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.000s
I20260709 12:25:21.887056 25972 raft_consensus.cc:359] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:21.887569 25972 raft_consensus.cc:740] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:21.888154 25972 consensus_queue.cc:260] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:21.889580 25972 ts_tablet_manager.cc:1434] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:25:21.890251 25972 tablet_bootstrap.cc:492] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:21.894147 25846 raft_consensus.cc:493] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:21.894753 25846 raft_consensus.cc:515] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:21.896920 25846 leader_election.cc:290] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:21.897753 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1f8b45199a40aeaf77fa2e23107375" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:21.898414 25366 raft_consensus.cc:2468] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:21.900161 25262 leader_election.cc:304] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:21.901022 25771 raft_consensus.cc:493] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:21.901569 25771 raft_consensus.cc:515] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:21.901899 25846 raft_consensus.cc:2804] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:21.902540 25846 raft_consensus.cc:493] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:21.903023 25846 raft_consensus.cc:3060] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:21.903584 25771 leader_election.cc:290] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
W20260709 12:25:21.907912 25263 leader_election.cc:336] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:21.913944 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b6c4b190bf487a9d40c062b4195403" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
W20260709 12:25:21.926390 25189 leader_election.cc:336] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:21.926972 25189 leader_election.cc:304] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:21.927981 25771 raft_consensus.cc:2749] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:21.932478 25846 raft_consensus.cc:515] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:21.936517 25972 tablet_bootstrap.cc:492] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:21.936792 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1f8b45199a40aeaf77fa2e23107375" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:21.937361 25366 raft_consensus.cc:3060] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:21.937551 25972 tablet_bootstrap.cc:492] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:21.938268 25972 ts_tablet_manager.cc:1403] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.036s
I20260709 12:25:21.940905 25972 raft_consensus.cc:359] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:21.941255 25904 raft_consensus.cc:493] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:21.941596 25972 raft_consensus.cc:740] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:21.941772 25904 raft_consensus.cc:515] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:21.942432 25972 consensus_queue.cc:260] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:21.944422 25904 leader_election.cc:290] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:21.944710 25972 ts_tablet_manager.cc:1434] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:25:21.947489 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b6c4b190bf487a9d40c062b4195403" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:21.948942 25223 raft_consensus.cc:2468] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:21.950210 25366 raft_consensus.cc:2468] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 2.
I20260709 12:25:21.951329 25846 leader_election.cc:290] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:21.951493 25260 leader_election.cc:304] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:21.952507 25728 raft_consensus.cc:2804] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:21.952853 25728 raft_consensus.cc:493] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:21.953159 25728 raft_consensus.cc:3060] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:21.961792 25728 raft_consensus.cc:515] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
W20260709 12:25:21.963963 25263 leader_election.cc:336] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
W20260709 12:25:21.964536 25263 leader_election.cc:336] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:21.965107 25262 leader_election.cc:304] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:21.966609 25846 raft_consensus.cc:2804] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:21.966924 25904 raft_consensus.cc:493] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:21.967772 25904 raft_consensus.cc:515] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:21.973001 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3459b31870574ae4aa816cf5ee28162b" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:21.973722 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b6c4b190bf487a9d40c062b4195403" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:21.974448 25223 raft_consensus.cc:3060] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:21.978011 25263 leader_election.cc:336] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:21.973829 25771 raft_consensus.cc:493] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:21.980067 25771 raft_consensus.cc:515] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:21.981920 25904 leader_election.cc:290] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:21.982329 25771 leader_election.cc:290] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:21.983634 25728 leader_election.cc:290] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: Requested vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:21.984329 25846 raft_consensus.cc:697] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:21.985183 25223 raft_consensus.cc:2468] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 2.
I20260709 12:25:21.987707 25260 leader_election.cc:304] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:21.988677 25986 raft_consensus.cc:2804] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:21.950440 25972 tablet_bootstrap.cc:492] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:21.989176 25986 raft_consensus.cc:697] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:21.997260 25986 consensus_queue.cc:237] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
W20260709 12:25:21.999092 25189 leader_election.cc:336] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.002512 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ecc3ffe78cf4eb091836a5e7d2393cc" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:22.004690 25904 raft_consensus.cc:493] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:21.985332 25846 consensus_queue.cc:237] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.005297 25904 raft_consensus.cc:515] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:22.008571 25904 leader_election.cc:290] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:22.024611 25615 raft_consensus.cc:493] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.025377 25615 raft_consensus.cc:515] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:22.027377 25615 leader_election.cc:290] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:22.036757 25904 raft_consensus.cc:493] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.037352 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30586f82b3764222905aebbb6896d886" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:22.037545 25904 raft_consensus.cc:515] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.038058 25223 raft_consensus.cc:2468] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:22.040511 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b8c7cdce0c46fdb50c370f6f53001e" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:22.042309 25988 raft_consensus.cc:493] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.046491 25904 leader_election.cc:290] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
W20260709 12:25:22.047375 25263 leader_election.cc:336] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.047910 25263 leader_election.cc:304] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:22.047252 25988 raft_consensus.cc:515] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:22.051687 25904 raft_consensus.cc:2749] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:22.052403 17346 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:25:22.053117 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.355s	user 0.286s	sys 0.003s
I20260709 12:25:22.058815 25189 leader_election.cc:304] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:22.056891 25988 leader_election.cc:290] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:22.062390 25615 raft_consensus.cc:2749] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:22.063894 25986 raft_consensus.cc:493] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.064426 25260 leader_election.cc:304] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:22.064500 25986 raft_consensus.cc:515] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:22.065491 25988 raft_consensus.cc:2804] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:22.066073 25988 raft_consensus.cc:493] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.066656 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30586f82b3764222905aebbb6896d886" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:22.067951 25986 leader_election.cc:290] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
W20260709 12:25:22.069142 25263 leader_election.cc:336] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.078938 25988 raft_consensus.cc:3060] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.070374 25846 raft_consensus.cc:493] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.077373 25045 catalog_manager.cc:5697] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 1 to 2, leader changed from 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129) to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.079715 25846 raft_consensus.cc:515] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.083333 25846 leader_election.cc:290] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.087142 25945 raft_consensus.cc:493] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
W20260709 12:25:22.087495 25263 leader_election.cc:336] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.087821 25945 raft_consensus.cc:515] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:22.090093 25945 leader_election.cc:290] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
W20260709 12:25:22.092041 25263 leader_election.cc:336] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
W20260709 12:25:22.092720 25263 leader_election.cc:336] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.097445 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e2e1ecd7474df9add48f60c06a4a0f" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:22.095813 25988 raft_consensus.cc:515] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:22.099579 25293 raft_consensus.cc:2393] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3979c425abd4ac7b2ca30e1dec9a154 in current term 2: Already voted for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in this term.
I20260709 12:25:22.083982 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b324fb11adf4924bd497717bc12ff4c" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
W20260709 12:25:22.100541 25263 leader_election.cc:336] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.100629 25366 raft_consensus.cc:2468] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:22.101187 25263 leader_election.cc:304] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:22.101910 25986 raft_consensus.cc:2749] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:22.102349 25262 leader_election.cc:304] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:22.103477 25986 raft_consensus.cc:2804] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:22.103886 25986 raft_consensus.cc:493] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.104292 25986 raft_consensus.cc:3060] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.106547 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d072f6ab35314a9ebd29bbfe4d0eb1f0" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:22.108421 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99adf4dd9ed4adbb8f70f7fd8aeaeb8" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:22.108950 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30586f82b3764222905aebbb6896d886" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:22.109624 25221 raft_consensus.cc:3060] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:22.108966 25263 leader_election.cc:336] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
W20260709 12:25:22.113474 25338 leader_election.cc:336] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.113950 25338 leader_election.cc:304] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:22.114595 25986 raft_consensus.cc:515] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.104149 25988 leader_election.cc:290] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: Requested vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:22.116753 25949 raft_consensus.cc:493] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.117312 25949 raft_consensus.cc:515] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.117707 25986 leader_election.cc:290] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.119760 25945 raft_consensus.cc:2749] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:22.120227 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b324fb11adf4924bd497717bc12ff4c" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:22.121083 25371 raft_consensus.cc:3060] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.121457 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd0775b429544fcb31e2834c279b159" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:22.122071 25293 raft_consensus.cc:2468] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 1.
W20260709 12:25:22.125046 25263 leader_election.cc:336] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.125248 25949 leader_election.cc:290] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.125886 25338 leader_election.cc:304] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:22.126766 25820 raft_consensus.cc:2804] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:22.127274 25820 raft_consensus.cc:493] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.127848 25820 raft_consensus.cc:3060] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.127465 25972 tablet_bootstrap.cc:492] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:22.129845 25972 tablet_bootstrap.cc:492] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:22.130659 25972 ts_tablet_manager.cc:1403] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.180s	user 0.021s	sys 0.003s
I20260709 12:25:22.133451 25972 raft_consensus.cc:359] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:22.134150 25972 raft_consensus.cc:740] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.126184 25949 raft_consensus.cc:493] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
W20260709 12:25:22.135815 25338 leader_election.cc:336] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.139901 25949 raft_consensus.cc:515] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.145395 25945 raft_consensus.cc:493] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.146318 25615 raft_consensus.cc:493] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.146529 25945 raft_consensus.cc:515] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.147089 25615 raft_consensus.cc:515] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:22.150569 25945 leader_election.cc:290] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.153136 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f447960df41a5ade2459879b92b17" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:22.154139 25771 raft_consensus.cc:493] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.156437 25945 raft_consensus.cc:493] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.157258 25945 raft_consensus.cc:515] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:22.161041 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b8c7cdce0c46fdb50c370f6f53001e" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:22.154971 25771 raft_consensus.cc:515] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:22.161792 25293 raft_consensus.cc:2468] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 1.
I20260709 12:25:22.164111 25615 leader_election.cc:290] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:22.168877 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354e6422b7944df78b231965e1774820" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:22.169966 25366 raft_consensus.cc:2468] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:22.173039 25188 leader_election.cc:304] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:22.173926 25970 raft_consensus.cc:2804] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:22.174310 25970 raft_consensus.cc:493] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.174705 25970 raft_consensus.cc:3060] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.145386 25949 leader_election.cc:290] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.170450 25986 raft_consensus.cc:493] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.186856 25615 raft_consensus.cc:493] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.187633 25615 raft_consensus.cc:515] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:22.190620 25615 leader_election.cc:290] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:22.192061 25986 raft_consensus.cc:515] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.196842 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "192689638be442acb52df50f2137f664" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:22.185890 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354e6422b7944df78b231965e1774820" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:22.198279 25338 leader_election.cc:304] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:22.199903 25615 raft_consensus.cc:493] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.200644 25615 raft_consensus.cc:515] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:22.196929 25945 leader_election.cc:290] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:22.204919 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d13683d814408081fbbece9be522ed" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:22.171440 25771 leader_election.cc:290] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.208465 25371 raft_consensus.cc:2468] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 2.
I20260709 12:25:22.209197 25615 leader_election.cc:290] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.231986 25615 raft_consensus.cc:493] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.209316 25771 raft_consensus.cc:493] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.232451 25615 raft_consensus.cc:515] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:22.233091 25771 raft_consensus.cc:515] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:22.235167 25771 leader_election.cc:290] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:22.235947 25615 leader_election.cc:290] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.235234 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e2e1ecd7474df9add48f60c06a4a0f" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:22.204303 25945 raft_consensus.cc:493] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.237293 25945 raft_consensus.cc:515] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:22.215648 25260 leader_election.cc:304] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:22.215871 25986 leader_election.cc:290] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.216425 25949 raft_consensus.cc:2804] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:22.218765 25820 raft_consensus.cc:515] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.240957 25949 raft_consensus.cc:493] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.241462 25949 raft_consensus.cc:3060] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.242475 25820 leader_election.cc:290] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.242677 25904 raft_consensus.cc:2749] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:22.134853 25972 consensus_queue.cc:260] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:22.243222 25260 leader_election.cc:304] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
W20260709 12:25:22.227217 25338 leader_election.cc:336] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.244055 25338 leader_election.cc:304] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:22.244792 25972 ts_tablet_manager.cc:1434] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.114s	user 0.008s	sys 0.000s
I20260709 12:25:22.227784 25970 raft_consensus.cc:515] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:22.229641 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4c35aae32446d4895fa10bcdc4d1eb" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:22.245767 25972 tablet_bootstrap.cc:492] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:22.246133 25988 raft_consensus.cc:493] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.246578 25368 raft_consensus.cc:2468] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:22.246711 25988 raft_consensus.cc:515] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.247222 25945 leader_election.cc:290] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:22.247824 25945 raft_consensus.cc:2749] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:22.245275 25338 leader_election.cc:336] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.248845 25188 leader_election.cc:304] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:22.238021 25366 raft_consensus.cc:2468] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:22.214730 25221 raft_consensus.cc:2468] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 2.
I20260709 12:25:22.244884 25728 raft_consensus.cc:2749] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:22.248966 25988 leader_election.cc:290] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.239854 25262 leader_election.cc:304] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:22.250500 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d13683d814408081fbbece9be522ed" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:22.251202 25223 raft_consensus.cc:2468] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 1.
I20260709 12:25:22.251439 25945 raft_consensus.cc:493] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.252270 25970 leader_election.cc:290] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.252018 25728 raft_consensus.cc:2804] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:22.252005 25945 raft_consensus.cc:515] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.252936 25728 raft_consensus.cc:697] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
W20260709 12:25:22.253479 25263 leader_election.cc:336] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.254066 25263 leader_election.cc:304] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:22.254396 25945 leader_election.cc:290] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.255115 25335 leader_election.cc:304] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:22.253466 25218 raft_consensus.cc:2393] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fa8f2c80074488084fea821c4bb293d in current term 2: Already voted for candidate d3979c425abd4ac7b2ca30e1dec9a154 in this term.
I20260709 12:25:22.256702 25904 raft_consensus.cc:2749] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:22.253769 25728 consensus_queue.cc:237] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.257128 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd0775b429544fcb31e2834c279b159" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:22.257704 25298 raft_consensus.cc:3060] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.259080 25820 raft_consensus.cc:2804] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:22.259657 25820 raft_consensus.cc:493] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.260253 25820 raft_consensus.cc:3060] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:22.262734 25263 leader_election.cc:336] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.265484 25188 leader_election.cc:304] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:22.260267 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f447960df41a5ade2459879b92b17" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:22.266489 25366 raft_consensus.cc:2468] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:22.268384 25615 raft_consensus.cc:2804] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:22.265713 25298 raft_consensus.cc:2468] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 2.
I20260709 12:25:22.267189 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "354e6422b7944df78b231965e1774820" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:22.268800 25615 raft_consensus.cc:493] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.269765 25615 raft_consensus.cc:3060] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:22.267248 25338 leader_election.cc:336] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.270501 25262 leader_election.cc:304] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:22.270964 25338 leader_election.cc:304] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:22.267978 25998 raft_consensus.cc:2804] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:22.271812 25986 raft_consensus.cc:2804] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:22.271965 25998 raft_consensus.cc:493] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.272307 25986 raft_consensus.cc:493] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.272388 25998 raft_consensus.cc:3060] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.272722 25986 raft_consensus.cc:3060] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.267695 25988 raft_consensus.cc:493] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.274098 25988 raft_consensus.cc:515] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.269276 25368 raft_consensus.cc:3060] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.277551 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb0eab5dcee4f95b7c284dea379c795" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:22.278192 25366 raft_consensus.cc:2468] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:22.279294 25262 leader_election.cc:304] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:22.280202 25904 raft_consensus.cc:2804] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:22.280624 25904 raft_consensus.cc:493] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.281028 25904 raft_consensus.cc:3060] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.294175 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "192689638be442acb52df50f2137f664" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
W20260709 12:25:22.294569 25189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:45473, user_credentials={real_user=slave}} blocked reactor thread for 54469.5us
I20260709 12:25:22.295096 25298 raft_consensus.cc:2468] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 1.
I20260709 12:25:22.298771 25615 raft_consensus.cc:515] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:22.299618 25368 raft_consensus.cc:2468] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 2.
I20260709 12:25:22.301815 25998 raft_consensus.cc:515] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:22.331773 25188 leader_election.cc:304] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:22.309317 25988 leader_election.cc:290] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.336127 25998 leader_election.cc:290] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.336118 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e2e1ecd7474df9add48f60c06a4a0f" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
W20260709 12:25:22.336647 25263 leader_election.cc:336] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.337968 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d13683d814408081fbbece9be522ed" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:22.338124 25997 raft_consensus.cc:2749] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:22.338599 25771 raft_consensus.cc:2804] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:22.339895 25045 catalog_manager.cc:5697] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 1 to 2, leader changed from 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129) to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:22.341308 25771 raft_consensus.cc:697] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:22.342244 25771 consensus_queue.cc:237] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:22.342257 25045 catalog_manager.cc:5697] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 1 to 2, leader changed from 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129) to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.338696 25368 raft_consensus.cc:3060] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:22.347236 25338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:45473, user_credentials={real_user=slave}} blocked reactor thread for 49848.5us
I20260709 12:25:22.352008 25338 leader_election.cc:304] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:22.353044 25338 leader_election.cc:304] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:22.354074 25972 tablet_bootstrap.cc:492] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:22.353358 25945 raft_consensus.cc:2804] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:22.355937 25945 raft_consensus.cc:697] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [term 2 LEADER]: Becoming Leader. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Running, Role: LEADER
I20260709 12:25:22.356879 25945 consensus_queue.cc:237] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.362291 25972 tablet_bootstrap.cc:492] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:22.363772 25615 leader_election.cc:290] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.362947 25988 raft_consensus.cc:493] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.354364 25997 raft_consensus.cc:2804] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:22.365276 25997 raft_consensus.cc:493] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.364984 25988 raft_consensus.cc:515] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:22.365661 25997 raft_consensus.cc:3060] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.366012 25728 raft_consensus.cc:493] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.366657 25728 raft_consensus.cc:515] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.367340 25988 leader_election.cc:290] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:22.369197 25728 leader_election.cc:290] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.364593 25972 ts_tablet_manager.cc:1403] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.119s	user 0.027s	sys 0.004s
W20260709 12:25:22.354104 25338 leader_election.cc:336] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.375597 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb84b6ee4f14cdc9a40ffd59ca4f42c" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:22.376355 25366 raft_consensus.cc:2468] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 2.
I20260709 12:25:22.343540 25904 raft_consensus.cc:515] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
W20260709 12:25:22.390888 25263 leader_election.cc:336] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
W20260709 12:25:22.391934 25263 leader_election.cc:336] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.392951 25045 catalog_manager.cc:5697] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 1 to 2, leader changed from 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129) to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:22.396338 25728 raft_consensus.cc:493] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.396924 25728 raft_consensus.cc:515] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:22.396770 25972 raft_consensus.cc:359] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:22.397900 25972 raft_consensus.cc:740] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.398046 25949 raft_consensus.cc:515] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.399189 25728 leader_election.cc:290] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:22.402024 25986 raft_consensus.cc:515] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
W20260709 12:25:22.406106 25263 leader_election.cc:336] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.406539 26004 raft_consensus.cc:493] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.409399 25904 leader_election.cc:290] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.412621 25949 leader_election.cc:290] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.414469 25972 consensus_queue.cc:260] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:22.407413 26004 raft_consensus.cc:515] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
W20260709 12:25:22.423089 25263 leader_election.cc:336] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
W20260709 12:25:22.423735 25263 consensus_peers.cc:597] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:22.424911 26004 leader_election.cc:290] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.427250 25986 leader_election.cc:290] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.432297 25972 ts_tablet_manager.cc:1434] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.001s
W20260709 12:25:22.434087 25335 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:41903, user_credentials={real_user=slave}} blocked reactor thread for 56584.6us
I20260709 12:25:22.435550 25262 leader_election.cc:304] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:22.436574 25728 raft_consensus.cc:2804] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:22.437007 25728 raft_consensus.cc:493] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.437387 25728 raft_consensus.cc:3060] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:25:22.439729 25189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:45473, user_credentials={real_user=slave}} blocked reactor thread for 141737us
I20260709 12:25:22.442214 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99adf4dd9ed4adbb8f70f7fd8aeaeb8" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:22.442839 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f447960df41a5ade2459879b92b17" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:22.443643 25366 raft_consensus.cc:3060] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.442857 25298 raft_consensus.cc:2468] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
W20260709 12:25:22.452591 25189 leader_election.cc:336] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.453207 25189 leader_election.cc:304] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:22.453962 25771 raft_consensus.cc:2749] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:22.457104 25972 tablet_bootstrap.cc:492] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:22.457890 25260 leader_election.cc:304] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:22.457713 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d072f6ab35314a9ebd29bbfe4d0eb1f0" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:22.461941 25728 raft_consensus.cc:515] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.467376 25986 raft_consensus.cc:2804] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:22.467991 25366 raft_consensus.cc:2468] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 2.
I20260709 12:25:22.468137 25986 raft_consensus.cc:697] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:22.469367 25986 consensus_queue.cc:237] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:22.459229 25293 raft_consensus.cc:2468] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:22.476673 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb0eab5dcee4f95b7c284dea379c795" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:22.479635 25728 leader_election.cc:290] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 3 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.477559 25366 raft_consensus.cc:3060] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.481865 25368 raft_consensus.cc:2468] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 2.
I20260709 12:25:22.488897 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ecc3ffe78cf4eb091836a5e7d2393cc" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:22.489916 25221 raft_consensus.cc:2468] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:22.491499 25262 leader_election.cc:304] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:22.492261 25997 raft_consensus.cc:515] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.494383 25997 leader_election.cc:290] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.494613 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4c35aae32446d4895fa10bcdc4d1eb" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:22.495383 25220 raft_consensus.cc:2468] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 1.
I20260709 12:25:22.498522 25367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb84b6ee4f14cdc9a40ffd59ca4f42c" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:22.498723 25904 raft_consensus.cc:2804] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:22.499176 25367 raft_consensus.cc:3060] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:22.499294 25904 raft_consensus.cc:697] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
W20260709 12:25:22.495852 25189 leader_election.cc:336] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.500507 25904 consensus_queue.cc:237] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.501107 25189 leader_election.cc:304] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:22.501798 25999 raft_consensus.cc:2749] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:22.502696 25189 leader_election.cc:336] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
W20260709 12:25:22.503400 25189 leader_election.cc:336] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
W20260709 12:25:22.503947 25189 leader_election.cc:336] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.436810 25820 raft_consensus.cc:515] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:22.507738 25820 leader_election.cc:290] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: Requested vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:22.507860 25371 raft_consensus.cc:2393] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d3979c425abd4ac7b2ca30e1dec9a154 in current term 2: Already voted for candidate 0fa8f2c80074488084fea821c4bb293d in this term.
I20260709 12:25:22.497898 25219 raft_consensus.cc:1275] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Refusing update from remote peer a28f2edcd70f4eb08f16021ba3e2cf14: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:25:22.510998 25263 leader_election.cc:336] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
W20260709 12:25:22.512086 25263 leader_election.cc:336] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.512589 25367 raft_consensus.cc:2468] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 3.
I20260709 12:25:22.515400 25262 leader_election.cc:304] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:22.516803 25188 leader_election.cc:304] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:22.517323 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d13683d814408081fbbece9be522ed" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:22.518095 25219 raft_consensus.cc:2393] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0fa8f2c80074488084fea821c4bb293d in current term 2: Already voted for candidate d3979c425abd4ac7b2ca30e1dec9a154 in this term.
I20260709 12:25:22.518376 25771 raft_consensus.cc:2804] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:22.518690 25366 raft_consensus.cc:2468] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 2.
I20260709 12:25:22.516492 25728 raft_consensus.cc:2804] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:22.518903 25771 raft_consensus.cc:697] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:22.519985 25728 raft_consensus.cc:697] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:22.523485 25262 leader_election.cc:304] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:22.524257 25771 consensus_queue.cc:237] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:22.524729 25846 raft_consensus.cc:2804] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:22.525388 25846 raft_consensus.cc:697] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:22.526495 25846 consensus_queue.cc:237] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
W20260709 12:25:22.523219 25338 leader_election.cc:336] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.539582 25728 consensus_queue.cc:237] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.541172 25045 catalog_manager.cc:5697] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d reported cstate change: term changed from 1 to 2, leader changed from 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129) to 0fa8f2c80074488084fea821c4bb293d (127.16.240.132). New cstate: current_term: 2 leader_uuid: "0fa8f2c80074488084fea821c4bb293d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.551121 25189 leader_election.cc:304] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:22.555923 25189 leader_election.cc:304] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:22.556209 25970 raft_consensus.cc:2804] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:22.565479 25970 raft_consensus.cc:493] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.565876 25970 raft_consensus.cc:3060] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.570402 25043 catalog_manager.cc:5697] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 1 to 2, leader changed from 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129) to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:22.581787 25263 consensus_peers.cc:597] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:22.581674 25998 raft_consensus.cc:2804] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:22.583838 25998 raft_consensus.cc:493] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.584286 25998 raft_consensus.cc:3060] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:22.590687 25338 leader_election.cc:336] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
W20260709 12:25:22.591084 25189 leader_election.cc:336] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
W20260709 12:25:22.596692 25189 leader_election.cc:336] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
W20260709 12:25:22.598594 25189 leader_election.cc:336] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.598776 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b8c7cdce0c46fdb50c370f6f53001e" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:22.599608 25298 raft_consensus.cc:3060] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:22.599586 25189 leader_election.cc:336] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.600494 25189 leader_election.cc:304] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3979c425abd4ac7b2ca30e1dec9a154; no voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:22.602522 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3459b31870574ae4aa816cf5ee28162b" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:22.602957 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "192689638be442acb52df50f2137f664" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:22.603371 25297 raft_consensus.cc:2468] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 1.
I20260709 12:25:22.603695 25294 raft_consensus.cc:3060] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:22.606206 25338 leader_election.cc:336] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
W20260709 12:25:22.607111 25338 leader_election.cc:336] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.607504 25338 leader_election.cc:304] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:22.600706 25260 leader_election.cc:304] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:22.608568 25366 raft_consensus.cc:1275] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Refusing update from remote peer a28f2edcd70f4eb08f16021ba3e2cf14: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:22.609761 25615 raft_consensus.cc:2749] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:25:22.614027 25945 raft_consensus.cc:2749] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:25:22.615520 25189 leader_election.cc:336] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.622906 26015 raft_consensus.cc:2804] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:22.623471 26015 raft_consensus.cc:493] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.623934 26015 raft_consensus.cc:3060] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:22.632601 25338 leader_election.cc:336] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
W20260709 12:25:22.633261 25338 leader_election.cc:336] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.635457 25338 leader_election.cc:304] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:22.639477 25298 raft_consensus.cc:2468] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 2.
I20260709 12:25:22.638042 25820 raft_consensus.cc:2804] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:22.649825 25820 raft_consensus.cc:493] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.650249 25820 raft_consensus.cc:3060] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.652573 25998 raft_consensus.cc:515] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:22.655005 25998 leader_election.cc:290] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 election: Requested vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:22.656252 25294 raft_consensus.cc:2468] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 2.
I20260709 12:25:22.656397 25043 catalog_manager.cc:5697] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 1 to 2, leader changed from 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129) to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:22.660018 26015 raft_consensus.cc:515] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:22.662096 25260 leader_election.cc:304] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:22.673565 25988 raft_consensus.cc:2804] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:22.674997 25988 raft_consensus.cc:493] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:22.675472 25988 raft_consensus.cc:3060] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.677537 25972 tablet_bootstrap.cc:492] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:22.678555 25972 tablet_bootstrap.cc:492] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:22.679243 25972 ts_tablet_manager.cc:1403] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.222s	user 0.016s	sys 0.001s
I20260709 12:25:22.679929 25986 consensus_queue.cc:1048] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:22.670351 25970 raft_consensus.cc:515] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:22.690660 25970 leader_election.cc:290] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 election: Requested vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:22.690836 25988 raft_consensus.cc:515] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:22.693238 25988 leader_election.cc:290] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: Requested vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:22.696611 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d072f6ab35314a9ebd29bbfe4d0eb1f0" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:22.697255 25294 raft_consensus.cc:3060] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.698787 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e99adf4dd9ed4adbb8f70f7fd8aeaeb8" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
W20260709 12:25:22.699172 25263 leader_election.cc:336] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.699466 25293 raft_consensus.cc:3060] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.702026 25820 raft_consensus.cc:515] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.703400 25972 raft_consensus.cc:359] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:22.704172 25972 raft_consensus.cc:740] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.704964 26015 leader_election.cc:290] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: Requested vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:22.706892 25293 raft_consensus.cc:2468] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 2.
I20260709 12:25:22.706950 25294 raft_consensus.cc:2468] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 2.
I20260709 12:25:22.708719 25972 consensus_queue.cc:260] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
W20260709 12:25:22.710727 25263 leader_election.cc:336] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.712471 25972 ts_tablet_manager.cc:1434] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 12:25:22.713505 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4c35aae32446d4895fa10bcdc4d1eb" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:22.713883 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ecc3ffe78cf4eb091836a5e7d2393cc" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:22.714212 25220 raft_consensus.cc:3060] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.714524 25223 raft_consensus.cc:3060] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:22.717512 25338 leader_election.cc:336] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.718832 25820 leader_election.cc:290] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:22.722627 25223 raft_consensus.cc:2468] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 2.
I20260709 12:25:22.724613 25189 leader_election.cc:304] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:22.726332 25998 raft_consensus.cc:2804] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:22.726981 25998 raft_consensus.cc:697] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:22.728262 25998 consensus_queue.cc:237] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:22.729370 25972 tablet_bootstrap.cc:492] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
W20260709 12:25:22.729008 25262 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:40887, user_credentials={real_user=slave}} blocked reactor thread for 108387us
I20260709 12:25:22.730260 25728 consensus_queue.cc:1048] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:22.729067 25220 raft_consensus.cc:2468] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 2.
I20260709 12:25:22.734282 25338 leader_election.cc:304] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:22.735414 25820 raft_consensus.cc:2804] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:22.736281 25820 raft_consensus.cc:697] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 2 LEADER]: Becoming Leader. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Running, Role: LEADER
I20260709 12:25:22.737223 25820 consensus_queue.cc:237] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.738075 25189 leader_election.cc:304] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:22.738919 25970 raft_consensus.cc:2804] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:22.739426 25970 raft_consensus.cc:697] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:22.741302 25970 consensus_queue.cc:237] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:22.747378 25338 leader_election.cc:304] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:22.748683 26009 raft_consensus.cc:2804] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:22.749040 25260 leader_election.cc:304] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:22.750278 25260 leader_election.cc:304] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:22.752235 25728 raft_consensus.cc:2804] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:22.752893 25988 raft_consensus.cc:2804] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:22.753552 25988 raft_consensus.cc:697] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:22.754717 25988 consensus_queue.cc:237] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
W20260709 12:25:22.755914 25189 leader_election.cc:336] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.756372 25728 raft_consensus.cc:697] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
W20260709 12:25:22.756981 25189 leader_election.cc:336] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:22.757464 25728 consensus_queue.cc:237] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:22.749215 26009 raft_consensus.cc:697] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [term 2 LEADER]: Becoming Leader. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Running, Role: LEADER
I20260709 12:25:22.759209 26009 consensus_queue.cc:237] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.775442 25366 raft_consensus.cc:1275] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Refusing update from remote peer d3979c425abd4ac7b2ca30e1dec9a154: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:22.775992 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3459b31870574ae4aa816cf5ee28162b" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:22.776829 25294 raft_consensus.cc:3060] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.777696 26003 consensus_queue.cc:1048] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:22.782873 25368 raft_consensus.cc:1275] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Refusing update from remote peer a28f2edcd70f4eb08f16021ba3e2cf14: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:22.787881 26014 consensus_queue.cc:1048] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:22.814038 25263 consensus_peers.cc:597] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:22.817934 25294 raft_consensus.cc:2468] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 2.
I20260709 12:25:22.827510 25045 catalog_manager.cc:5697] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 1 to 2, leader changed from 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129) to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.829604 25045 catalog_manager.cc:5697] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 1 to 2, leader changed from 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129) to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.815320 25043 catalog_manager.cc:5697] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d reported cstate change: term changed from 1 to 2, leader changed from 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129) to 0fa8f2c80074488084fea821c4bb293d (127.16.240.132). New cstate: current_term: 2 leader_uuid: "0fa8f2c80074488084fea821c4bb293d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.834378 25338 leader_election.cc:304] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:22.836503 25820 raft_consensus.cc:2804] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:22.838600 25294 raft_consensus.cc:1275] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Refusing update from remote peer 0fa8f2c80074488084fea821c4bb293d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:22.838798 25820 raft_consensus.cc:697] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [term 2 LEADER]: Becoming Leader. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Running, Role: LEADER
I20260709 12:25:22.840106 25820 consensus_queue.cc:237] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:22.855271 26004 consensus_queue.cc:1048] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
W20260709 12:25:22.890509 25189 consensus_peers.cc:597] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:22.935027 25043 catalog_manager.cc:5697] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 1 to 2, leader changed from 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129) to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.941756 25979 raft_consensus.cc:493] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.942395 25979 raft_consensus.cc:515] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:22.946134 25367 raft_consensus.cc:1275] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Refusing update from remote peer a28f2edcd70f4eb08f16021ba3e2cf14: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:22.947245 25979 leader_election.cc:290] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:22.950133 25904 consensus_queue.cc:1048] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:25:22.956393 25338 consensus_peers.cc:597] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:22.974102 25043 catalog_manager.cc:5697] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 2 to 3, leader changed from 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129) to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 3 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.978621 25972 tablet_bootstrap.cc:492] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:22.979660 25972 tablet_bootstrap.cc:492] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:22.980386 25972 ts_tablet_manager.cc:1403] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.251s	user 0.018s	sys 0.001s
I20260709 12:25:22.987038 25043 catalog_manager.cc:5697] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 1 to 2, leader changed from 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129) to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:22.996205 25043 catalog_manager.cc:5697] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 1 to 2, leader changed from 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129) to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:23.004606 25043 catalog_manager.cc:5697] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 1 to 2, leader changed from 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129) to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:22.982982 25972 raft_consensus.cc:359] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:23.006896 25972 raft_consensus.cc:740] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.009604 25972 consensus_queue.cc:260] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
W20260709 12:25:23.010762 25263 consensus_peers.cc:597] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:23.011471 25263 consensus_peers.cc:597] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:23.011991 25263 consensus_peers.cc:597] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:23.013213 25972 ts_tablet_manager.cc:1434] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:25:23.019783 25972 tablet_bootstrap.cc:492] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:23.046725 25371 raft_consensus.cc:1275] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Refusing update from remote peer a28f2edcd70f4eb08f16021ba3e2cf14: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:23.057353 25972 tablet_bootstrap.cc:492] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:23.059144 25988 consensus_queue.cc:1048] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:23.066054 25972 tablet_bootstrap.cc:492] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:23.066936 25972 ts_tablet_manager.cc:1403] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.011s
I20260709 12:25:23.069809 25972 raft_consensus.cc:359] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:23.070580 25972 raft_consensus.cc:740] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.071341 25972 consensus_queue.cc:260] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
W20260709 12:25:23.076702 25263 consensus_peers.cc:597] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:23.081271 25972 ts_tablet_manager.cc:1434] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:25:23.082322 25972 tablet_bootstrap.cc:492] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:23.090020 25367 raft_consensus.cc:1275] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Refusing update from remote peer a28f2edcd70f4eb08f16021ba3e2cf14: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:23.091883 26026 consensus_queue.cc:1048] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:23.119716 25263 consensus_peers.cc:597] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:23.123869 25189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:38537, user_credentials={real_user=slave}} blocked reactor thread for 80154.6us
I20260709 12:25:23.127290 25043 catalog_manager.cc:5697] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d reported cstate change: term changed from 1 to 2, leader changed from 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129) to 0fa8f2c80074488084fea821c4bb293d (127.16.240.132). New cstate: current_term: 2 leader_uuid: "0fa8f2c80074488084fea821c4bb293d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:23.141539 25043 catalog_manager.cc:5697] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d reported cstate change: term changed from 1 to 2, leader changed from 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129) to 0fa8f2c80074488084fea821c4bb293d (127.16.240.132). New cstate: current_term: 2 leader_uuid: "0fa8f2c80074488084fea821c4bb293d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:23.136137 25366 raft_consensus.cc:1275] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Refusing update from remote peer d3979c425abd4ac7b2ca30e1dec9a154: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:23.138207 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6be441f38874ae7bb28069feed26b69" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:23.143790 25972 tablet_bootstrap.cc:492] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:23.149392 25972 tablet_bootstrap.cc:492] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:23.151666 25972 ts_tablet_manager.cc:1403] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.070s	user 0.017s	sys 0.004s
W20260709 12:25:23.153071 25338 consensus_peers.cc:597] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:23.155939 25972 raft_consensus.cc:359] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:23.145829 25998 consensus_queue.cc:1048] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:25:23.156781 25972 raft_consensus.cc:740] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.157975 25972 consensus_queue.cc:260] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:23.161073 25293 raft_consensus.cc:1275] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Refusing update from remote peer d3979c425abd4ac7b2ca30e1dec9a154: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:23.163407 25972 ts_tablet_manager.cc:1434] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:25:23.168473 25972 tablet_bootstrap.cc:492] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
W20260709 12:25:23.170481 25189 consensus_peers.cc:597] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:23.173578 25338 consensus_peers.cc:597] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:23.176110 25979 raft_consensus.cc:493] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:23.176934 25263 consensus_peers.cc:597] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:23.176786 25979 raft_consensus.cc:515] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:23.184036 25979 leader_election.cc:290] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:23.185817 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1f8b45199a40aeaf77fa2e23107375" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:23.216231 25220 raft_consensus.cc:1275] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Refusing update from remote peer a28f2edcd70f4eb08f16021ba3e2cf14: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:23.224865 25219 raft_consensus.cc:1275] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Refusing update from remote peer a28f2edcd70f4eb08f16021ba3e2cf14: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:23.230154 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6be441f38874ae7bb28069feed26b69" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:23.231772 25965 leader_election.cc:304] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:23.233029 25979 raft_consensus.cc:2749] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:23.236166 25293 raft_consensus.cc:1275] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Refusing update from remote peer 0fa8f2c80074488084fea821c4bb293d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:23.239975 26004 consensus_queue.cc:1048] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:23.240314 26026 consensus_queue.cc:1048] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:23.245905 25338 consensus_peers.cc:597] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:23.248886 26026 consensus_queue.cc:1048] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:25:23.251365 25338 consensus_peers.cc:597] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:23.267069 25999 consensus_queue.cc:1048] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:23.276505 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1f8b45199a40aeaf77fa2e23107375" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:23.278424 25967 leader_election.cc:304] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:23.279297 25979 raft_consensus.cc:2749] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:23.283989 25263 consensus_peers.cc:597] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:23.286496 25189 consensus_peers.cc:597] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:23.287042 25189 consensus_peers.cc:597] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:23.293879 25189 consensus_peers.cc:597] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:23.299291 25979 raft_consensus.cc:493] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.300050 25979 raft_consensus.cc:515] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:23.302773 25979 leader_election.cc:290] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:23.303663 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a616947e81bf446584593e882f8bdeaa" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:23.305156 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a616947e81bf446584593e882f8bdeaa" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:23.308116 25965 leader_election.cc:304] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:23.309479 25972 tablet_bootstrap.cc:492] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:23.310653 25972 tablet_bootstrap.cc:492] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:23.315642 25972 ts_tablet_manager.cc:1403] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.147s	user 0.021s	sys 0.001s
I20260709 12:25:23.316841 25293 raft_consensus.cc:1275] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Refusing update from remote peer d3979c425abd4ac7b2ca30e1dec9a154: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:23.321031 25979 raft_consensus.cc:2749] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:23.323020 25293 raft_consensus.cc:1275] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Refusing update from remote peer 0fa8f2c80074488084fea821c4bb293d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:23.326253 26009 consensus_queue.cc:1048] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:23.328872 25999 consensus_queue.cc:1048] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:23.332908 25972 raft_consensus.cc:359] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:23.338536 25972 raft_consensus.cc:740] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.339479 25972 consensus_queue.cc:260] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:23.342377 25972 ts_tablet_manager.cc:1434] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
W20260709 12:25:23.344460 25263 consensus_peers.cc:597] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:23.346367 25972 tablet_bootstrap.cc:492] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:23.347785 25219 raft_consensus.cc:1275] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Refusing update from remote peer a28f2edcd70f4eb08f16021ba3e2cf14: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:23.364377 25293 raft_consensus.cc:1275] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Refusing update from remote peer 0fa8f2c80074488084fea821c4bb293d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:25:23.364943 25263 consensus_peers.cc:597] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:23.366961 26009 consensus_queue.cc:1048] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:23.347883 25189 consensus_peers.cc:597] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:23.377939 26026 consensus_queue.cc:1048] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:25:23.382829 25338 consensus_peers.cc:597] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:23.387686 25979 raft_consensus.cc:493] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.388319 25979 raft_consensus.cc:515] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:23.391420 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4269cf1528545fd94e1d53fcf6cf48d" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:23.392011 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4269cf1528545fd94e1d53fcf6cf48d" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:23.397329 25968 leader_election.cc:304] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:23.394690 25979 leader_election.cc:290] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
W20260709 12:25:23.415320 25189 consensus_peers.cc:597] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:23.411029 25979 raft_consensus.cc:2749] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:23.420637 25263 consensus_peers.cc:597] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:23.432173 25972 tablet_bootstrap.cc:492] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:23.433174 25972 tablet_bootstrap.cc:492] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:23.433984 25972 ts_tablet_manager.cc:1403] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.088s	user 0.020s	sys 0.004s
W20260709 12:25:23.436045 25338 consensus_peers.cc:597] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:23.438482 25972 raft_consensus.cc:359] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:23.439262 25972 raft_consensus.cc:740] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.439986 25972 consensus_queue.cc:260] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:23.457073 25972 ts_tablet_manager.cc:1434] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:25:23.458005 25972 tablet_bootstrap.cc:492] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:23.458863 25979 raft_consensus.cc:493] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.459445 25979 raft_consensus.cc:515] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:23.461580 25979 leader_election.cc:290] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:23.462750 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d072f6ab35314a9ebd29bbfe4d0eb1f0" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:23.463032 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d072f6ab35314a9ebd29bbfe4d0eb1f0" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:23.465221 25968 leader_election.cc:304] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:23.466441 25979 raft_consensus.cc:2749] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:23.504487 25189 consensus_peers.cc:597] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:23.514925 25972 tablet_bootstrap.cc:492] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:25:23.516081 25263 consensus_peers.cc:597] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:23.517053 25972 tablet_bootstrap.cc:492] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:23.518257 25972 ts_tablet_manager.cc:1403] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.007s
I20260709 12:25:23.521467 25972 raft_consensus.cc:359] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:23.522168 25972 raft_consensus.cc:740] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.522900 25972 consensus_queue.cc:260] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:23.525009 25972 ts_tablet_manager.cc:1434] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:23.525859 25972 tablet_bootstrap.cc:492] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:23.533406 25979 raft_consensus.cc:493] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:23.534216 25263 consensus_peers.cc:597] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:23.534212 25979 raft_consensus.cc:515] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:23.535578 26083 raft_consensus.cc:493] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.538069 26083 raft_consensus.cc:515] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:23.538884 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c46968756c14269bc487ced0f6e74bd" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:23.540480 26083 leader_election.cc:290] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
W20260709 12:25:23.541499 25338 consensus_peers.cc:597] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:23.541659 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f5d4fb33b4421daaf5b63cafcd4f4b" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:23.546130 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f5d4fb33b4421daaf5b63cafcd4f4b" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:23.546864 25979 leader_election.cc:290] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:23.549629 25967 leader_election.cc:304] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:23.550124 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c46968756c14269bc487ced0f6e74bd" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:23.553117 25979 raft_consensus.cc:2749] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:23.621148 25338 consensus_peers.cc:597] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:23.664119 25979 raft_consensus.cc:493] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.664963 25979 raft_consensus.cc:515] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
W20260709 12:25:23.751819 25967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.132:40887, user_credentials={real_user=slave}} blocked reactor thread for 202274us
I20260709 12:25:23.753000 25967 leader_election.cc:304] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:23.753840 26083 raft_consensus.cc:2749] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:23.754781 25220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcc5ac5532e4841a4f0a182a39a1914" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:23.755957 25972 tablet_bootstrap.cc:492] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:23.757184 25972 tablet_bootstrap.cc:492] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:23.757076 25979 leader_election.cc:290] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:23.758585 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcc5ac5532e4841a4f0a182a39a1914" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:23.760144 25972 ts_tablet_manager.cc:1403] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.235s	user 0.038s	sys 0.083s
I20260709 12:25:23.762888 25972 raft_consensus.cc:359] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:23.763598 25972 raft_consensus.cc:740] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.764382 25972 consensus_queue.cc:260] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:23.766544 25972 ts_tablet_manager.cc:1434] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 12:25:23.767343 25972 tablet_bootstrap.cc:492] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:23.784188 25965 leader_election.cc:304] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:23.785548 25979 raft_consensus.cc:2749] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:25:23.795244 25189 consensus_peers.cc:597] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:23.796121 25189 consensus_peers.cc:597] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:23.796782 25972 tablet_bootstrap.cc:492] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:23.797791 25972 tablet_bootstrap.cc:492] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:23.798454 25972 ts_tablet_manager.cc:1403] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.010s
I20260709 12:25:23.801192 25972 raft_consensus.cc:359] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:23.801851 25972 raft_consensus.cc:740] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.802541 25972 consensus_queue.cc:260] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:23.805152 25972 ts_tablet_manager.cc:1434] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:25:23.806028 25972 tablet_bootstrap.cc:492] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
W20260709 12:25:23.809051 25189 consensus_peers.cc:597] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:23.809638 25189 consensus_peers.cc:597] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:23.815481 25189 consensus_peers.cc:597] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:23.827382 25263 consensus_peers.cc:597] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:23.828344 25263 consensus_peers.cc:597] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:23.829324 25972 tablet_bootstrap.cc:492] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:23.830946 25972 tablet_bootstrap.cc:492] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:23.831862 25972 ts_tablet_manager.cc:1403] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.006s
I20260709 12:25:23.835439 25972 raft_consensus.cc:359] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:23.836633 25972 raft_consensus.cc:740] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
W20260709 12:25:23.837666 25263 consensus_peers.cc:597] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:23.837577 25972 consensus_queue.cc:260] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:23.839991 25972 ts_tablet_manager.cc:1434] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:23.841145 25972 tablet_bootstrap.cc:492] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
W20260709 12:25:23.856419 25189 consensus_peers.cc:597] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:23.867841 25972 tablet_bootstrap.cc:492] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:23.869115 25972 tablet_bootstrap.cc:492] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:23.869953 25972 ts_tablet_manager.cc:1403] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.003s
I20260709 12:25:23.873507 25972 raft_consensus.cc:359] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:23.873979 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.129:38537
I20260709 12:25:23.874073 26121 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.129:38537 every 8 connection(s)
I20260709 12:25:23.874356 25972 raft_consensus.cc:740] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.875284 25972 consensus_queue.cc:260] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:23.877796 25972 ts_tablet_manager.cc:1434] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:23.880156 25972 tablet_bootstrap.cc:492] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:23.911644 25972 tablet_bootstrap.cc:492] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:23.912679 25972 tablet_bootstrap.cc:492] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:23.913362 25972 ts_tablet_manager.cc:1403] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.002s
I20260709 12:25:23.916646 25972 raft_consensus.cc:359] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:23.917570 25972 raft_consensus.cc:740] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.918414 25972 consensus_queue.cc:260] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:23.920619 25972 ts_tablet_manager.cc:1434] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:23.922251 25972 tablet_bootstrap.cc:492] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:23.927984 26122 heartbeater.cc:344] Connected to a master server at 127.16.240.190:37775
I20260709 12:25:23.928494 26122 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:23.929515 26122 heartbeater.cc:507] Master 127.16.240.190:37775 requested a full tablet report, sending...
I20260709 12:25:23.941687 25972 tablet_bootstrap.cc:492] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:23.942766 25972 tablet_bootstrap.cc:492] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:23.943507 25972 ts_tablet_manager.cc:1403] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.000s
I20260709 12:25:23.946257 25972 raft_consensus.cc:359] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:23.947026 25972 raft_consensus.cc:740] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.947628 25972 consensus_queue.cc:260] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:23.948868 25042 ts_manager.cc:194] Re-registered known tserver with Master: 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:23.949561 25972 ts_tablet_manager.cc:1434] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:23.950708 25972 tablet_bootstrap.cc:492] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
W20260709 12:25:23.969306 25189 consensus_peers.cc:597] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:23.979387 25979 raft_consensus.cc:493] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.979992 25979 raft_consensus.cc:515] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:23.982249 25979 leader_election.cc:290] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:23.984323 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e2e1ecd7474df9add48f60c06a4a0f" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:23.984774 25367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e2e1ecd7474df9add48f60c06a4a0f" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:23.986294 25967 leader_election.cc:304] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:23.987515 25979 raft_consensus.cc:2749] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:23.990916 25972 tablet_bootstrap.cc:492] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:23.992337 25972 tablet_bootstrap.cc:492] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:23.993067 25972 ts_tablet_manager.cc:1403] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.043s	user 0.028s	sys 0.008s
I20260709 12:25:23.995268 26092 raft_consensus.cc:3060] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.995977 25972 raft_consensus.cc:359] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:23.996727 25972 raft_consensus.cc:740] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.997467 25972 consensus_queue.cc:260] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:24.003832 25972 ts_tablet_manager.cc:1434] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:25:24.004732 25972 tablet_bootstrap.cc:492] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:24.008842 25042 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35206
I20260709 12:25:24.030755 26093 raft_consensus.cc:3060] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.036252 26122 heartbeater.cc:499] Master 127.16.240.190:37775 was elected leader, sending a full tablet report...
I20260709 12:25:24.071808 25972 tablet_bootstrap.cc:492] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:24.072814 25972 tablet_bootstrap.cc:492] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:24.073380 25972 ts_tablet_manager.cc:1403] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.069s	user 0.024s	sys 0.033s
I20260709 12:25:24.075906 25972 raft_consensus.cc:359] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:24.076653 25972 raft_consensus.cc:740] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.077332 25972 consensus_queue.cc:260] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:24.080642 25972 ts_tablet_manager.cc:1434] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:25:24.081578 25972 tablet_bootstrap.cc:492] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:24.094962 25972 tablet_bootstrap.cc:492] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:24.095975 25972 tablet_bootstrap.cc:492] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:24.096669 25972 ts_tablet_manager.cc:1403] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:25:24.099061 25972 raft_consensus.cc:359] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:24.099812 25972 raft_consensus.cc:740] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.100502 25972 consensus_queue.cc:260] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:24.102958 25972 ts_tablet_manager.cc:1434] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:25:24.106176 25972 tablet_bootstrap.cc:492] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:24.123229 25972 tablet_bootstrap.cc:492] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:24.124293 25972 tablet_bootstrap.cc:492] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:24.124897 25972 ts_tablet_manager.cc:1403] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:25:24.127142 25972 raft_consensus.cc:359] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:24.127851 25972 raft_consensus.cc:740] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.128593 25972 consensus_queue.cc:260] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:24.130792 25972 ts_tablet_manager.cc:1434] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:25:24.131994 25972 tablet_bootstrap.cc:492] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:24.143220 26092 raft_consensus.cc:3060] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.153249 25972 tablet_bootstrap.cc:492] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:24.154522 25972 tablet_bootstrap.cc:492] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:24.155187 25972 ts_tablet_manager.cc:1403] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.011s
I20260709 12:25:24.158257 25972 raft_consensus.cc:359] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:24.158891 25972 raft_consensus.cc:740] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.160342 25972 consensus_queue.cc:260] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:24.161739 25972 ts_tablet_manager.cc:1434] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:24.162443 25972 tablet_bootstrap.cc:492] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:24.163276 25979 raft_consensus.cc:493] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.164016 25979 raft_consensus.cc:515] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:24.168277 26093 raft_consensus.cc:3060] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.168898 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc69e13d835645099f9e0e5bea99665a" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" is_pre_election: true
I20260709 12:25:24.171098 25979 leader_election.cc:290] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:24.179251 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc69e13d835645099f9e0e5bea99665a" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:24.186513 25967 leader_election.cc:304] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:24.187891 25979 raft_consensus.cc:2749] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:24.195597 25972 tablet_bootstrap.cc:492] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:24.196950 25972 tablet_bootstrap.cc:492] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:24.197746 25972 ts_tablet_manager.cc:1403] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.013s
I20260709 12:25:24.200198 25972 raft_consensus.cc:359] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:24.200726 25972 raft_consensus.cc:740] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.201314 25972 consensus_queue.cc:260] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:24.202914 25972 ts_tablet_manager.cc:1434] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:25:24.203624 25972 tablet_bootstrap.cc:492] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:24.216845 25972 tablet_bootstrap.cc:492] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:24.217864 25972 tablet_bootstrap.cc:492] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:24.218544 25972 ts_tablet_manager.cc:1403] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.003s
I20260709 12:25:24.221033 25972 raft_consensus.cc:359] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:24.221731 25972 raft_consensus.cc:740] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.222424 25972 consensus_queue.cc:260] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:24.224486 25972 ts_tablet_manager.cc:1434] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:25:24.225718 25972 tablet_bootstrap.cc:492] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:24.226320 25979 raft_consensus.cc:493] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.227124 25979 raft_consensus.cc:515] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:24.229211 25979 leader_election.cc:290] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:24.230103 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b324fb11adf4924bd497717bc12ff4c" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" is_pre_election: true
I20260709 12:25:24.232862 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b324fb11adf4924bd497717bc12ff4c" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:24.234689 25967 leader_election.cc:304] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c; no voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:24.236395 25979 raft_consensus.cc:2749] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:24.244707 25972 tablet_bootstrap.cc:492] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:24.245781 25972 tablet_bootstrap.cc:492] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:24.246467 25972 ts_tablet_manager.cc:1403] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.011s
I20260709 12:25:24.249125 25972 raft_consensus.cc:359] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:24.249712 25972 raft_consensus.cc:740] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.250505 25972 consensus_queue.cc:260] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:24.252606 25972 ts_tablet_manager.cc:1434] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:25:24.259146 25972 tablet_bootstrap.cc:492] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:24.262072 25771 raft_consensus.cc:493] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.262704 25771 raft_consensus.cc:515] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:24.264962 25771 leader_election.cc:290] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:24.270957 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d13683d814408081fbbece9be522ed" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:24.271553 25371 raft_consensus.cc:2468] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 2.
I20260709 12:25:24.272550 25188 leader_election.cc:304] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:24.274186 25998 raft_consensus.cc:2804] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:24.274595 25998 raft_consensus.cc:493] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.274673 26093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d13683d814408081fbbece9be522ed" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c" is_pre_election: true
I20260709 12:25:24.275002 25998 raft_consensus.cc:3060] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:24.280434 26091 raft_consensus.cc:3060] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.285226 26093 raft_consensus.cc:2468] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 1.
I20260709 12:25:24.295172 25998 raft_consensus.cc:515] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:24.298094 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d13683d814408081fbbece9be522ed" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:24.298676 25371 raft_consensus.cc:3060] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:24.308243 25371 raft_consensus.cc:2468] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 3.
I20260709 12:25:24.309075 25972 tablet_bootstrap.cc:492] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:24.309511 25188 leader_election.cc:304] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:24.309847 25972 tablet_bootstrap.cc:492] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:24.310397 26003 raft_consensus.cc:2804] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:24.310525 25972 ts_tablet_manager.cc:1403] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.052s	user 0.026s	sys 0.021s
I20260709 12:25:24.310830 25998 leader_election.cc:290] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [CANDIDATE]: Term 3 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:24.310909 26003 raft_consensus.cc:697] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 3 LEADER]: Becoming Leader. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:24.312127 26003 consensus_queue.cc:237] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:24.314230 26091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d13683d814408081fbbece9be522ed" candidate_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
I20260709 12:25:24.314941 26091 raft_consensus.cc:3060] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:25:24.328727 25972 raft_consensus.cc:359] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:24.330525 25972 raft_consensus.cc:740] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.331490 25972 consensus_queue.cc:260] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:24.338229 25972 ts_tablet_manager.cc:1434] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 12:25:24.339116 25972 tablet_bootstrap.cc:492] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:24.345407 26092 raft_consensus.cc:3060] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.356328 26093 raft_consensus.cc:3060] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.416090 26091 raft_consensus.cc:2468] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3979c425abd4ac7b2ca30e1dec9a154 in term 3.
I20260709 12:25:24.446705 26091 raft_consensus.cc:3060] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.454728 25042 catalog_manager.cc:5697] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 reported cstate change: term changed from 1 to 3, leader changed from 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129) to d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130). New cstate: current_term: 3 leader_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:24.477654 25972 tablet_bootstrap.cc:492] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:24.478823 25972 tablet_bootstrap.cc:492] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:24.479516 25972 ts_tablet_manager.cc:1403] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.141s	user 0.030s	sys 0.000s
W20260709 12:25:24.514066 25260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:41903, user_credentials={real_user=slave}} blocked reactor thread for 88872.4us
I20260709 12:25:24.518020 25972 raft_consensus.cc:359] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:24.518806 25972 raft_consensus.cc:740] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.519596 25972 consensus_queue.cc:260] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:24.531558 25972 ts_tablet_manager.cc:1434] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:25:24.532743 25972 tablet_bootstrap.cc:492] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:24.598249 26092 raft_consensus.cc:3060] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.608438 26089 raft_consensus.cc:3060] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:24.632452 25262 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:40887, user_credentials={real_user=slave}} blocked reactor thread for 68321.5us
I20260709 12:25:24.671685 25972 tablet_bootstrap.cc:492] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:24.677153 25972 tablet_bootstrap.cc:492] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:24.677855 25972 ts_tablet_manager.cc:1403] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.145s	user 0.022s	sys 0.008s
I20260709 12:25:24.680377 25972 raft_consensus.cc:359] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:24.681067 25972 raft_consensus.cc:740] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.699967 25972 consensus_queue.cc:260] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:24.702358 25972 ts_tablet_manager.cc:1434] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:25:24.703222 25972 tablet_bootstrap.cc:492] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:24.725941 25972 tablet_bootstrap.cc:492] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:24.727424 25972 tablet_bootstrap.cc:492] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:24.728299 25972 ts_tablet_manager.cc:1403] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.000s
I20260709 12:25:24.729944 26092 raft_consensus.cc:1275] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Refusing update from remote peer d3979c425abd4ac7b2ca30e1dec9a154: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:24.731174 25972 raft_consensus.cc:359] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:24.731916 25972 raft_consensus.cc:740] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.732110 26003 consensus_queue.cc:1048] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:24.732761 25972 consensus_queue.cc:260] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:24.737599 25972 ts_tablet_manager.cc:1434] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:25:24.738547 25972 tablet_bootstrap.cc:492] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:24.746495 25371 raft_consensus.cc:1275] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Refusing update from remote peer d3979c425abd4ac7b2ca30e1dec9a154: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:24.748610 25970 consensus_queue.cc:1048] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:24.755183 25972 tablet_bootstrap.cc:492] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:24.756570 25972 tablet_bootstrap.cc:492] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:24.757375 25972 ts_tablet_manager.cc:1403] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:25:24.760492 25972 raft_consensus.cc:359] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:24.761292 25972 raft_consensus.cc:740] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.762158 25972 consensus_queue.cc:260] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:24.765108 25972 ts_tablet_manager.cc:1434] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:24.766321 25972 tablet_bootstrap.cc:492] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:24.786800 26089 raft_consensus.cc:3060] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.839016 25972 tablet_bootstrap.cc:492] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:24.840150 25972 tablet_bootstrap.cc:492] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:24.840876 25972 ts_tablet_manager.cc:1403] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.075s	user 0.040s	sys 0.005s
I20260709 12:25:24.845378 25972 raft_consensus.cc:359] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:24.846213 25972 raft_consensus.cc:740] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.847010 25972 consensus_queue.cc:260] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:24.849479 25972 ts_tablet_manager.cc:1434] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:24.850469 25972 tablet_bootstrap.cc:492] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:24.867287 25972 tablet_bootstrap.cc:492] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:24.868338 25972 tablet_bootstrap.cc:492] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:24.869328 25972 ts_tablet_manager.cc:1403] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.001s
I20260709 12:25:24.871573 25972 raft_consensus.cc:359] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:24.872278 25972 raft_consensus.cc:740] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.872892 25972 consensus_queue.cc:260] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:24.875131 25972 ts_tablet_manager.cc:1434] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:24.875975 25972 tablet_bootstrap.cc:492] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:24.896620 25972 tablet_bootstrap.cc:492] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:24.897593 25972 tablet_bootstrap.cc:492] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:24.905056 25972 ts_tablet_manager.cc:1403] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.003s
I20260709 12:25:24.907578 25972 raft_consensus.cc:359] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:24.908828 25972 raft_consensus.cc:740] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.909469 25972 consensus_queue.cc:260] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:24.911495 25972 ts_tablet_manager.cc:1434] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:24.912683 25972 tablet_bootstrap.cc:492] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:24.940479 25972 tablet_bootstrap.cc:492] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:24.941435 25972 tablet_bootstrap.cc:492] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:24.942111 25972 ts_tablet_manager.cc:1403] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.016s
I20260709 12:25:24.944516 25972 raft_consensus.cc:359] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:24.945201 25972 raft_consensus.cc:740] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.945773 25972 consensus_queue.cc:260] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:24.947644 25972 ts_tablet_manager.cc:1434] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:24.948925 25972 tablet_bootstrap.cc:492] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:24.965873 25972 tablet_bootstrap.cc:492] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:24.966845 25972 tablet_bootstrap.cc:492] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:24.967519 25972 ts_tablet_manager.cc:1403] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.004s
I20260709 12:25:24.970052 25972 raft_consensus.cc:359] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:24.970849 25972 raft_consensus.cc:740] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.973513 25972 consensus_queue.cc:260] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:24.993095 25972 ts_tablet_manager.cc:1434] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:25:24.994014 25972 tablet_bootstrap.cc:492] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:25.007512 25972 tablet_bootstrap.cc:492] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:25.008662 25972 tablet_bootstrap.cc:492] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:25.009845 25972 ts_tablet_manager.cc:1403] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 12:25:25.012614 25972 raft_consensus.cc:359] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:25.013365 25972 raft_consensus.cc:740] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.014091 25972 consensus_queue.cc:260] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:25.015969 25972 ts_tablet_manager.cc:1434] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:25:25.017334 25972 tablet_bootstrap.cc:492] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:25.031397 25972 tablet_bootstrap.cc:492] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:25.032388 25972 tablet_bootstrap.cc:492] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:25.033102 25972 ts_tablet_manager.cc:1403] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:25:25.035674 25972 raft_consensus.cc:359] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:25.036384 25972 raft_consensus.cc:740] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.037002 25972 consensus_queue.cc:260] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:25.038872 25972 ts_tablet_manager.cc:1434] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:25.040468 25972 tablet_bootstrap.cc:492] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:25.062044 25972 tablet_bootstrap.cc:492] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:25.062824 25972 tablet_bootstrap.cc:492] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:25.063400 25972 ts_tablet_manager.cc:1403] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.001s
I20260709 12:25:25.065765 25972 raft_consensus.cc:359] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:25.066753 25972 raft_consensus.cc:740] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.067478 25972 consensus_queue.cc:260] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:25.069119 25972 ts_tablet_manager.cc:1434] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.002s
I20260709 12:25:25.070262 25972 tablet_bootstrap.cc:492] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:25.083228 25972 tablet_bootstrap.cc:492] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:25.084088 25972 tablet_bootstrap.cc:492] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:25.084746 25972 ts_tablet_manager.cc:1403] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.007s
I20260709 12:25:25.086762 25972 raft_consensus.cc:359] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:25.087298 25972 raft_consensus.cc:740] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.087946 25972 consensus_queue.cc:260] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:25.089282 25972 ts_tablet_manager.cc:1434] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:25:25.090390 25972 tablet_bootstrap.cc:492] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap starting.
I20260709 12:25:25.108776 25972 tablet_bootstrap.cc:492] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:25.109812 25972 tablet_bootstrap.cc:492] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c: Bootstrap complete.
I20260709 12:25:25.110512 25972 ts_tablet_manager.cc:1403] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.003s
I20260709 12:25:25.112505 25972 raft_consensus.cc:359] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:25.112968 25972 raft_consensus.cc:740] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.113451 25972 consensus_queue.cc:260] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:25.115340 25972 ts_tablet_manager.cc:1434] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:25.142247 26092 raft_consensus.cc:3060] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:25.162734 26092 raft_consensus.cc:3060] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:25.192003 26092 raft_consensus.cc:3060] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:25.229764 26092 raft_consensus.cc:3060] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:25.289526 26092 raft_consensus.cc:3060] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:25.370846 26089 raft_consensus.cc:3060] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:26.154826 25189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:38537, user_credentials={real_user=slave}} blocked reactor thread for 375805us
W20260709 12:25:26.285969 25263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.003s	sys 0.010s
W20260709 12:25:26.286334 25263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.005s	sys 0.011s
W20260709 12:25:26.396881 25260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:41903, user_credentials={real_user=slave}} blocked reactor thread for 48673.2us
W20260709 12:25:26.431794 25263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:38537, user_credentials={real_user=slave}} blocked reactor thread for 61764.1us
W20260709 12:25:26.819235 25244 debug-util.cc:398] Leaking SignalData structure 0x7b080026c4c0 after lost signal to thread 17349
W20260709 12:25:26.822744 25244 debug-util.cc:398] Leaking SignalData structure 0x7b08002b60a0 after lost signal to thread 25079
W20260709 12:25:26.824158 25244 debug-util.cc:398] Leaking SignalData structure 0x7b0800051fe0 after lost signal to thread 25247
W20260709 12:25:26.825418 25244 debug-util.cc:398] Leaking SignalData structure 0x7b08001edce0 after lost signal to thread 25322
W20260709 12:25:26.827654 25244 debug-util.cc:398] Leaking SignalData structure 0x7b0800210fa0 after lost signal to thread 25396
W20260709 12:25:26.829002 25244 debug-util.cc:398] Leaking SignalData structure 0x7b08001dee60 after lost signal to thread 26121
W20260709 12:25:28.031208 25260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:41903, user_credentials={real_user=slave}} blocked reactor thread for 43764us
W20260709 12:25:30.953794 25260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:41903, user_credentials={real_user=slave}} blocked reactor thread for 83129.4us
W20260709 12:25:31.670360 25319 debug-util.cc:398] Leaking SignalData structure 0x7b0800295480 after lost signal to thread 17349
W20260709 12:25:31.671887 25319 debug-util.cc:398] Leaking SignalData structure 0x7b08000ef0a0 after lost signal to thread 25079
W20260709 12:25:31.673535 25319 debug-util.cc:398] Leaking SignalData structure 0x7b080021ac60 after lost signal to thread 25247
W20260709 12:25:31.674978 25319 debug-util.cc:398] Leaking SignalData structure 0x7b080010cbc0 after lost signal to thread 25322
W20260709 12:25:31.676344 25319 debug-util.cc:398] Leaking SignalData structure 0x7b0800301b20 after lost signal to thread 25396
W20260709 12:25:31.677757 25319 debug-util.cc:398] Leaking SignalData structure 0x7b08002d1480 after lost signal to thread 26121
W20260709 12:25:32.429983 25338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:38537, user_credentials={real_user=slave}} blocked reactor thread for 90048.3us
W20260709 12:25:33.448299 25393 debug-util.cc:398] Leaking SignalData structure 0x7b08003cdd00 after lost signal to thread 17349
W20260709 12:25:33.449826 25393 debug-util.cc:398] Leaking SignalData structure 0x7b08001eeb20 after lost signal to thread 25079
W20260709 12:25:33.451515 25393 debug-util.cc:398] Leaking SignalData structure 0x7b0800365580 after lost signal to thread 25247
W20260709 12:25:33.453049 25393 debug-util.cc:398] Leaking SignalData structure 0x7b080011dec0 after lost signal to thread 25322
W20260709 12:25:33.454520 25393 debug-util.cc:398] Leaking SignalData structure 0x7b08000c9420 after lost signal to thread 25396
W20260709 12:25:33.456393 25393 debug-util.cc:398] Leaking SignalData structure 0x7b08002e3e80 after lost signal to thread 26121
W20260709 12:25:33.846997 25262 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:40887, user_credentials={real_user=slave}} blocked reactor thread for 46883.1us
I20260709 12:25:34.145025 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:34.574654 25260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:41903, user_credentials={real_user=slave}} blocked reactor thread for 72084.9us
W20260709 12:25:34.659657 25263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:38537, user_credentials={real_user=slave}} blocked reactor thread for 58019us
W20260709 12:25:34.668262 25189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:38537, user_credentials={real_user=slave}} blocked reactor thread for 57330.8us
I20260709 12:25:34.749912 25292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d0304837699431197f7e780344f1093"
dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
mode: GRACEFUL
new_leader_uuid: "0fa8f2c80074488084fea821c4bb293d"
 from {username='slave'} at 127.0.0.1:43412
I20260709 12:25:34.751296 25292 raft_consensus.cc:606] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Received request to transfer leadership to TS 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:34.761713 25294 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ecc3ffe78cf4eb091836a5e7d2393cc"
dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
mode: GRACEFUL
new_leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:43412
I20260709 12:25:34.762341 25294 raft_consensus.cc:606] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Received request to transfer leadership to TS 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:34.775853 25294 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "574e4322900441a18f11a2568ab6fd64"
dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
mode: GRACEFUL
new_leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:43412
I20260709 12:25:34.776539 25294 raft_consensus.cc:606] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Received request to transfer leadership to TS 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:34.790037 25294 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91840ed520ab444d9bd1acb13b5b6b89"
dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
mode: GRACEFUL
new_leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:43412
I20260709 12:25:34.790834 25294 raft_consensus.cc:606] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Received request to transfer leadership to TS 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:34.794028 25294 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb9f447960df41a5ade2459879b92b17"
dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
mode: GRACEFUL
new_leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:43412
I20260709 12:25:34.794752 25294 raft_consensus.cc:606] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Received request to transfer leadership to TS 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:34.815719 25219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffa2c58c6d37474c908e6f924b95db30"
dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
mode: GRACEFUL
new_leader_uuid: "0fa8f2c80074488084fea821c4bb293d"
 from {username='slave'} at 127.0.0.1:58634
I20260709 12:25:34.816447 25219 raft_consensus.cc:606] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Received request to transfer leadership to TS 0fa8f2c80074488084fea821c4bb293d
I20260709 12:25:34.818071 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:25:34.820166 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:34.821339 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:34.999291 26248 raft_consensus.cc:993] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154: : Instructing follower 0fa8f2c80074488084fea821c4bb293d to start an election
I20260709 12:25:35.001673 26240 raft_consensus.cc:993] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14: : Instructing follower 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:35.003937 26233 raft_consensus.cc:1081] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Signalling peer 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:34.999963 26243 raft_consensus.cc:1081] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Signalling peer 0fa8f2c80074488084fea821c4bb293d to start an election
I20260709 12:25:35.007647 26087 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ecc3ffe78cf4eb091836a5e7d2393cc"
dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:44684
I20260709 12:25:35.008352 25366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffa2c58c6d37474c908e6f924b95db30"
dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
 from {username='slave'} at 127.0.0.1:49948
I20260709 12:25:35.008448 26087 raft_consensus.cc:493] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:35.009210 25366 raft_consensus.cc:493] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:35.009241 26087 raft_consensus.cc:3060] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.010093 25366 raft_consensus.cc:3060] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:35.020315 26240 raft_consensus.cc:993] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14: : Instructing follower 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:35.020896 26240 raft_consensus.cc:1081] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Signalling peer 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:35.023135 26092 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "574e4322900441a18f11a2568ab6fd64"
dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:44684
I20260709 12:25:35.023711 26092 raft_consensus.cc:493] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:35.024047 26092 raft_consensus.cc:3060] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.040161 25366 raft_consensus.cc:515] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:35.044184 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa2c58c6d37474c908e6f924b95db30" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:35.044993 25219 raft_consensus.cc:3055] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:35.045305 25219 raft_consensus.cc:740] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:35.046133 25219 consensus_queue.cc:260] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:35.047305 25219 raft_consensus.cc:3060] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:35.052217 26087 raft_consensus.cc:515] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:35.055101 26087 leader_election.cc:290] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 3 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:35.051240 26092 raft_consensus.cc:515] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:35.056438 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ecc3ffe78cf4eb091836a5e7d2393cc" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:35.057014 25294 raft_consensus.cc:3055] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:35.057302 25294 raft_consensus.cc:740] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:35.058099 25294 consensus_queue.cc:260] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:35.058624 26092 leader_election.cc:290] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 3 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:35.059476 25294 raft_consensus.cc:3060] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.061312 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ecc3ffe78cf4eb091836a5e7d2393cc" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:35.064117 25223 raft_consensus.cc:3060] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.070084 25219 raft_consensus.cc:2468] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 2.
I20260709 12:25:35.062772 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574e4322900441a18f11a2568ab6fd64" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:35.062288 25292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574e4322900441a18f11a2568ab6fd64" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:35.072202 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa2c58c6d37474c908e6f924b95db30" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:35.082706 25221 raft_consensus.cc:3060] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.082933 25293 raft_consensus.cc:3060] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:35.084028 25223 raft_consensus.cc:2468] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 3.
I20260709 12:25:35.088639 25965 leader_election.cc:304] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:35.093812 25221 raft_consensus.cc:2468] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 3.
I20260709 12:25:35.098393 25293 raft_consensus.cc:2468] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 2.
I20260709 12:25:35.082849 25292 raft_consensus.cc:3055] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:35.099953 25292 raft_consensus.cc:740] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:35.100319 25335 leader_election.cc:304] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:35.081790 25294 raft_consensus.cc:2468] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 3.
I20260709 12:25:35.082162 25366 leader_election.cc:290] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:35.136497 26246 raft_consensus.cc:2804] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:35.101234 26254 raft_consensus.cc:2804] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:35.137054 26246 raft_consensus.cc:697] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d [term 2 LEADER]: Becoming Leader. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Running, Role: LEADER
I20260709 12:25:35.127219 25965 leader_election.cc:304] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:35.100971 25292 consensus_queue.cc:260] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:35.138072 26246 consensus_queue.cc:237] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:35.138864 25292 raft_consensus.cc:3060] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.130211 26233 raft_consensus.cc:993] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14: : Instructing follower 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:35.142359 26233 raft_consensus.cc:1081] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Signalling peer 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:35.143435 26233 raft_consensus.cc:993] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14: : Instructing follower 0fa8f2c80074488084fea821c4bb293d to start an election
I20260709 12:25:35.145599 26087 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91840ed520ab444d9bd1acb13b5b6b89"
dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:44684
I20260709 12:25:35.146598 26087 raft_consensus.cc:493] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:35.147079 26087 raft_consensus.cc:3060] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:35.151981 25292 raft_consensus.cc:2468] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 3.
I20260709 12:25:35.200242 26233 raft_consensus.cc:1081] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Signalling peer 0fa8f2c80074488084fea821c4bb293d to start an election
I20260709 12:25:35.202407 25370 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d0304837699431197f7e780344f1093"
dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
 from {username='slave'} at 127.0.0.1:49946
I20260709 12:25:35.203066 25370 raft_consensus.cc:493] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:35.203708 25370 raft_consensus.cc:3060] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:35.220121 25370 raft_consensus.cc:515] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:35.237196 25370 leader_election.cc:290] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:35.246434 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0304837699431197f7e780344f1093" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:35.247087 25294 raft_consensus.cc:3055] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:35.247380 25294 raft_consensus.cc:740] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:35.248322 25294 consensus_queue.cc:260] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:35.249450 25294 raft_consensus.cc:3060] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:35.252939 26228 raft_consensus.cc:993] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14: : Instructing follower 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:35.253571 26228 raft_consensus.cc:1081] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Signalling peer 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:35.258127 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0304837699431197f7e780344f1093" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:35.258852 25219 raft_consensus.cc:3060] T 0d0304837699431197f7e780344f1093 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:35.272675 25294 raft_consensus.cc:2468] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 2.
I20260709 12:25:35.273069 25219 raft_consensus.cc:2468] T 0d0304837699431197f7e780344f1093 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 2.
I20260709 12:25:35.275432 26092 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb9f447960df41a5ade2459879b92b17"
dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:44684
I20260709 12:25:35.305190 26092 raft_consensus.cc:493] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:35.305864 26092 raft_consensus.cc:3060] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:25:35.311038 25338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:45473, user_credentials={real_user=slave}} blocked reactor thread for 64974.3us
W20260709 12:25:35.333824 25335 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:41903, user_credentials={real_user=slave}} blocked reactor thread for 68938.2us
I20260709 12:25:35.338361 25335 leader_election.cc:304] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:35.339437 26245 raft_consensus.cc:2804] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:35.340301 26245 raft_consensus.cc:697] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d [term 2 LEADER]: Becoming Leader. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Running, Role: LEADER
I20260709 12:25:35.341620 26245 consensus_queue.cc:237] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:35.287030 26087 raft_consensus.cc:515] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:35.372555 26092 raft_consensus.cc:515] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
W20260709 12:25:35.376965 25338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:45473, user_credentials={real_user=slave}} blocked reactor thread for 52832.1us
I20260709 12:25:35.378908 26092 leader_election.cc:290] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 3 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:35.403275 25366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f447960df41a5ade2459879b92b17" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:35.403697 26255 raft_consensus.cc:2804] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:35.404479 25366 raft_consensus.cc:3060] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.404516 26255 raft_consensus.cc:697] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 3 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:35.405992 26255 consensus_queue.cc:237] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:35.390967 26254 raft_consensus.cc:697] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 3 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:35.417225 26254 consensus_queue.cc:237] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:35.430377 25366 raft_consensus.cc:2468] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 3.
I20260709 12:25:35.434190 25045 catalog_manager.cc:5697] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d reported cstate change: term changed from 1 to 2, leader changed from d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130) to 0fa8f2c80074488084fea821c4bb293d (127.16.240.132). New cstate: current_term: 2 leader_uuid: "0fa8f2c80074488084fea821c4bb293d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:35.436991 26087 leader_election.cc:290] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
W20260709 12:25:35.444238 25260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:41903, user_credentials={real_user=slave}} blocked reactor thread for 61363.1us
I20260709 12:25:35.448982 25967 leader_election.cc:304] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c; no voters: 
I20260709 12:25:35.450595 26256 raft_consensus.cc:2804] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:35.465858 26256 raft_consensus.cc:697] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 3 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:35.467208 26256 consensus_queue.cc:237] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:35.485121 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f447960df41a5ade2459879b92b17" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:35.485857 25296 raft_consensus.cc:3055] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:35.486209 25296 raft_consensus.cc:740] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:35.487001 25296 consensus_queue.cc:260] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:35.489171 25292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91840ed520ab444d9bd1acb13b5b6b89" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:35.489794 25292 raft_consensus.cc:3055] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:35.490118 25292 raft_consensus.cc:740] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:35.490978 25292 consensus_queue.cc:260] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:35.492913 25292 raft_consensus.cc:3060] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:35.496618 25296 raft_consensus.cc:3060] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.501295 25292 raft_consensus.cc:2468] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 2.
I20260709 12:25:35.504591 25968 leader_election.cc:304] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:35.509501 26255 raft_consensus.cc:2804] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:35.516131 26255 raft_consensus.cc:697] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:35.517587 26255 consensus_queue.cc:237] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:35.510059 25296 raft_consensus.cc:2468] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 3.
W20260709 12:25:35.522318 25965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:41903, user_credentials={real_user=slave}} blocked reactor thread for 395166us
I20260709 12:25:35.524299 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91840ed520ab444d9bd1acb13b5b6b89" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:35.524959 25219 raft_consensus.cc:3060] T 91840ed520ab444d9bd1acb13b5b6b89 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:35.527490 25041 catalog_manager.cc:5697] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 2 to 3, leader changed from a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131) to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 3 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:35.534055 25219 raft_consensus.cc:2468] T 91840ed520ab444d9bd1acb13b5b6b89 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 2.
I20260709 12:25:35.647517 25045 catalog_manager.cc:5697] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d reported cstate change: term changed from 1 to 2, leader changed from a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131) to 0fa8f2c80074488084fea821c4bb293d (127.16.240.132). New cstate: current_term: 2 leader_uuid: "0fa8f2c80074488084fea821c4bb293d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:35.649036 25041 catalog_manager.cc:5697] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 2 to 3, leader changed from a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131) to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 3 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:35.651527 25041 catalog_manager.cc:5697] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 2 to 3, leader changed from a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131) to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 3 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:35.653641 25041 catalog_manager.cc:5697] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 1 to 2, leader changed from a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131) to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 2 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:35.665841 25219 raft_consensus.cc:1275] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Refusing update from remote peer 0fa8f2c80074488084fea821c4bb293d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:35.667881 26268 consensus_queue.cc:1048] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:35.717659 25296 raft_consensus.cc:1275] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Refusing update from remote peer 0fa8f2c80074488084fea821c4bb293d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:35.720050 26260 consensus_queue.cc:1048] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:35.736449 25294 raft_consensus.cc:1275] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Refusing update from remote peer 0fa8f2c80074488084fea821c4bb293d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:35.741541 26245 consensus_queue.cc:1048] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:35.899428 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:35.919461 25296 raft_consensus.cc:1275] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:35.921495 25219 raft_consensus.cc:1275] T 0d0304837699431197f7e780344f1093 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Refusing update from remote peer 0fa8f2c80074488084fea821c4bb293d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:35.928354 26261 consensus_queue.cc:1048] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:35.945864 26255 consensus_queue.cc:1048] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:35.951987 25223 raft_consensus.cc:1275] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154 [term 3 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:35.954774 26255 consensus_queue.cc:1048] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:25:35.980876 25189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:45473, user_credentials={real_user=slave}} blocked reactor thread for 115769us
I20260709 12:25:36.038412 25296 raft_consensus.cc:1275] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:25:36.044718 25188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:40887, user_credentials={real_user=slave}} blocked reactor thread for 112865us
I20260709 12:25:36.045934 26255 consensus_queue.cc:1048] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:25:36.161294 25188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:40887, user_credentials={real_user=slave}} blocked reactor thread for 48515us
I20260709 12:25:36.164929 25366 raft_consensus.cc:1275] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:25:36.162298 26288 log.cc:927] Time spent T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14: Append to log took a long time: real 0.111s	user 0.002s	sys 0.000s
I20260709 12:25:36.229166 25221 raft_consensus.cc:1275] T 91840ed520ab444d9bd1acb13b5b6b89 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:36.231109 25223 raft_consensus.cc:1275] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154 [term 3 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:36.254268 26292 consensus_queue.cc:1048] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:36.255187 26294 consensus_queue.cc:1048] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:25:36.315433 26293 log.cc:927] Time spent T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 12:25:36.356076 25967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:40887, user_credentials={real_user=slave}} blocked reactor thread for 188889us
I20260709 12:25:36.376279 26294 consensus_queue.cc:1048] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:25:36.404806 25189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:38537, user_credentials={real_user=slave}} blocked reactor thread for 343256us
W20260709 12:25:36.416200 25335 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:41903, user_credentials={real_user=slave}} blocked reactor thread for 281389us
W20260709 12:25:36.498785 25263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:38537, user_credentials={real_user=slave}} blocked reactor thread for 49958.2us
W20260709 12:25:36.501251 25189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:45473, user_credentials={real_user=slave}} blocked reactor thread for 77110.1us
I20260709 12:25:36.516399 25221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63327743a40345e4b149aca740d0944a"
dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
mode: GRACEFUL
new_leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:58634
I20260709 12:25:36.517020 25221 raft_consensus.cc:606] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Received request to transfer leadership to TS 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:36.685263 25294 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "752795059ef543b9a98b6dba09b04230"
dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
mode: GRACEFUL
new_leader_uuid: "0fa8f2c80074488084fea821c4bb293d"
 from {username='slave'} at 127.0.0.1:43412
I20260709 12:25:36.686049 25294 raft_consensus.cc:606] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Received request to transfer leadership to TS 0fa8f2c80074488084fea821c4bb293d
W20260709 12:25:36.724911 25335 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:41903, user_credentials={real_user=slave}} blocked reactor thread for 222100us
I20260709 12:25:36.741607 25294 raft_consensus.cc:1275] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:36.745604 25293 raft_consensus.cc:1275] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:36.760257 25221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1ea711322544c2999f94b52b35af150"
dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
mode: GRACEFUL
new_leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
 from {username='slave'} at 127.0.0.1:58634
I20260709 12:25:36.760958 25221 raft_consensus.cc:606] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Received request to transfer leadership to TS a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:36.756778 26292 consensus_queue.cc:1048] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:25:36.794169 26295 consensus_queue.cc:1048] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
W20260709 12:25:36.789649 26322 log.cc:927] Time spent T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c: Append to log took a long time: real 0.057s	user 0.003s	sys 0.000s
W20260709 12:25:36.819175 25338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:45473, user_credentials={real_user=slave}} blocked reactor thread for 66939.9us
I20260709 12:25:36.860858 26320 raft_consensus.cc:993] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14: : Instructing follower 0fa8f2c80074488084fea821c4bb293d to start an election
I20260709 12:25:36.861426 26320 raft_consensus.cc:1081] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Signalling peer 0fa8f2c80074488084fea821c4bb293d to start an election
W20260709 12:25:36.867038 26323 log.cc:927] Time spent T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c: Append to log took a long time: real 0.133s	user 0.004s	sys 0.000s
I20260709 12:25:36.886989 25372 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "752795059ef543b9a98b6dba09b04230"
dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
 from {username='slave'} at 127.0.0.1:49946
I20260709 12:25:36.887778 25372 raft_consensus.cc:493] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:36.888228 25372 raft_consensus.cc:3060] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:36.897192 25293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbb0eab5dcee4f95b7c284dea379c795"
dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
mode: GRACEFUL
new_leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:43412
I20260709 12:25:36.897817 25293 raft_consensus.cc:606] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Received request to transfer leadership to TS 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:36.902942 26302 raft_consensus.cc:993] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154: : Instructing follower a28f2edcd70f4eb08f16021ba3e2cf14 to start an election
I20260709 12:25:36.903469 26302 raft_consensus.cc:1081] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Signalling peer a28f2edcd70f4eb08f16021ba3e2cf14 to start an election
I20260709 12:25:36.942142 25215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e01f82f06bdb4424b0d871882d6c8c3b"
dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
mode: GRACEFUL
new_leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:58634
I20260709 12:25:36.942992 25215 raft_consensus.cc:606] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Received request to transfer leadership to TS 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:36.945302 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:36.947144 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:36.948002 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:36.953480 25372 raft_consensus.cc:515] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:36.958216 26244 raft_consensus.cc:993] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154: : Instructing follower 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:36.961351 26244 raft_consensus.cc:1081] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Signalling peer 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:36.975440 26091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63327743a40345e4b149aca740d0944a"
dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:44694
I20260709 12:25:36.976238 26091 raft_consensus.cc:493] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:36.976673 26091 raft_consensus.cc:3060] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:36.958335 26330 log.cc:927] Time spent T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:25:36.994006 25298 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1ea711322544c2999f94b52b35af150"
dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
 from {username='slave'} at 127.0.0.1:49520
I20260709 12:25:36.995561 25298 raft_consensus.cc:493] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:36.996018 25298 raft_consensus.cc:3060] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.006335 25372 leader_election.cc:290] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:37.007542 25368 raft_consensus.cc:1240] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Rejecting Update request from peer a28f2edcd70f4eb08f16021ba3e2cf14 for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:37.008610 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752795059ef543b9a98b6dba09b04230" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:37.009227 25293 raft_consensus.cc:3055] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:37.009522 25293 raft_consensus.cc:740] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:37.010370 25293 consensus_queue.cc:260] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:37.011724 25293 raft_consensus.cc:3060] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.013245 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752795059ef543b9a98b6dba09b04230" candidate_uuid: "0fa8f2c80074488084fea821c4bb293d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:37.028112 25215 raft_consensus.cc:3060] T 752795059ef543b9a98b6dba09b04230 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.052940 26233 raft_consensus.cc:993] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14: : Instructing follower 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:37.053731 26320 raft_consensus.cc:1081] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Signalling peer 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:37.051952 25298 raft_consensus.cc:515] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:37.058354 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ea711322544c2999f94b52b35af150" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:37.059175 25221 raft_consensus.cc:3055] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:37.059532 25221 raft_consensus.cc:740] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:37.060585 25221 consensus_queue.cc:260] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:37.060326 25293 raft_consensus.cc:2468] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 2.
I20260709 12:25:37.060870 26091 raft_consensus.cc:515] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:37.062848 25338 leader_election.cc:304] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:37.063915 26267 raft_consensus.cc:2804] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:37.064440 26267 raft_consensus.cc:697] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [term 2 LEADER]: Becoming Leader. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Running, Role: LEADER
I20260709 12:25:37.065424 26267 consensus_queue.cc:237] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:37.066226 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ea711322544c2999f94b52b35af150" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:37.067324 26091 leader_election.cc:290] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:37.071275 25221 raft_consensus.cc:3060] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.066927 25372 raft_consensus.cc:3060] T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.069916 25368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63327743a40345e4b149aca740d0944a" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:37.076735 25368 raft_consensus.cc:3060] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.068509 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63327743a40345e4b149aca740d0944a" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:37.080093 25214 raft_consensus.cc:3055] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:37.080511 25214 raft_consensus.cc:740] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:37.081559 25214 consensus_queue.cc:260] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:37.083099 25214 raft_consensus.cc:3060] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.084656 26093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbb0eab5dcee4f95b7c284dea379c795"
dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:44684
I20260709 12:25:37.085438 26093 raft_consensus.cc:493] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:37.085875 26093 raft_consensus.cc:3060] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:37.098037 25298 leader_election.cc:290] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:37.119009 25215 raft_consensus.cc:2468] T 752795059ef543b9a98b6dba09b04230 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fa8f2c80074488084fea821c4bb293d in term 2.
I20260709 12:25:37.125865 26093 raft_consensus.cc:515] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:37.144555 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb0eab5dcee4f95b7c284dea379c795" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:37.146608 25042 catalog_manager.cc:5697] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d reported cstate change: term changed from 1 to 2, leader changed from a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131) to 0fa8f2c80074488084fea821c4bb293d (127.16.240.132). New cstate: current_term: 2 leader_uuid: "0fa8f2c80074488084fea821c4bb293d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:37.129848 25214 raft_consensus.cc:2468] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 2.
I20260709 12:25:37.169636 25965 leader_election.cc:304] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:37.170644 26316 raft_consensus.cc:2804] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:37.171217 26316 raft_consensus.cc:697] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [term 2 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:37.163074 26093 leader_election.cc:290] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 3 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:37.172360 25298 raft_consensus.cc:3055] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:37.172171 26316 consensus_queue.cc:237] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:37.172801 25298 raft_consensus.cc:740] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:37.174387 25298 consensus_queue.cc:260] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:37.163759 25365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb0eab5dcee4f95b7c284dea379c795" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:37.176976 25365 raft_consensus.cc:3060] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:37.175549 25298 raft_consensus.cc:3060] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:37.211957 25368 raft_consensus.cc:2468] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 2.
I20260709 12:25:37.224859 25365 raft_consensus.cc:2468] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 3.
I20260709 12:25:37.226495 25967 leader_election.cc:304] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c; no voters: 
I20260709 12:25:37.227499 26316 raft_consensus.cc:2804] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:37.228250 26316 raft_consensus.cc:697] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 3 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:37.229161 26316 consensus_queue.cc:237] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:37.211892 25372 raft_consensus.cc:2468] T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 2.
I20260709 12:25:37.252554 25221 raft_consensus.cc:2468] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 2.
I20260709 12:25:37.257910 25262 leader_election.cc:304] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:37.281672 25298 raft_consensus.cc:2468] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 3.
I20260709 12:25:37.275161 26298 raft_consensus.cc:2804] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:37.296821 26298 raft_consensus.cc:697] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:37.307044 25043 catalog_manager.cc:5697] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 1 to 2, leader changed from d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130) to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 2 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.314221 26303 raft_consensus.cc:993] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154: : Instructing follower 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:37.315008 26298 consensus_queue.cc:237] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:37.321282 26287 raft_consensus.cc:1081] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Signalling peer 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:37.327870 26093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e01f82f06bdb4424b0d871882d6c8c3b"
dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:44694
I20260709 12:25:37.329077 26093 raft_consensus.cc:493] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:37.329506 26093 raft_consensus.cc:3060] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.349099 25041 catalog_manager.cc:5697] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14 reported cstate change: term changed from 1 to 2, leader changed from d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130) to a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.365053 26093 raft_consensus.cc:515] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:37.370656 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01f82f06bdb4424b0d871882d6c8c3b" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:37.371871 25372 raft_consensus.cc:3060] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.377214 26093 leader_election.cc:290] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:37.378862 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01f82f06bdb4424b0d871882d6c8c3b" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:37.379523 25221 raft_consensus.cc:3055] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:37.379849 25221 raft_consensus.cc:740] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:37.380625 25221 consensus_queue.cc:260] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:37.381807 25221 raft_consensus.cc:3060] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.385102 25372 raft_consensus.cc:2468] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 2.
I20260709 12:25:37.387107 25967 leader_election.cc:304] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c; no voters: 
I20260709 12:25:37.388103 26255 raft_consensus.cc:2804] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:37.388621 26255 raft_consensus.cc:697] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [term 2 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:37.389546 26255 consensus_queue.cc:237] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:37.412585 25221 raft_consensus.cc:2468] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 2.
I20260709 12:25:37.436420 25042 catalog_manager.cc:5697] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 2 to 3, leader changed from a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131) to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 3 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:37.440589 25042 catalog_manager.cc:5697] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 1 to 2, leader changed from d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130) to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 2 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.473970 25294 raft_consensus.cc:1275] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Refusing update from remote peer 0fa8f2c80074488084fea821c4bb293d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:37.481279 26267 consensus_queue.cc:1048] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:37.577016 25221 raft_consensus.cc:1275] T 752795059ef543b9a98b6dba09b04230 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Refusing update from remote peer 0fa8f2c80074488084fea821c4bb293d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:37.586432 26345 consensus_queue.cc:1048] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:37.608173 25372 raft_consensus.cc:1275] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:37.616320 26255 consensus_queue.cc:1048] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:37.652799 25293 raft_consensus.cc:1275] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:37.654910 26292 consensus_queue.cc:1048] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:37.703426 25372 raft_consensus.cc:1275] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:37.705281 25214 raft_consensus.cc:1275] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:37.718360 26295 consensus_queue.cc:1048] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:37.740561 26255 consensus_queue.cc:1048] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:25:37.832504 25263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:38537, user_credentials={real_user=slave}} blocked reactor thread for 56630.2us
I20260709 12:25:37.838569 25223 raft_consensus.cc:1275] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Refusing update from remote peer a28f2edcd70f4eb08f16021ba3e2cf14: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:37.874388 26251 consensus_queue.cc:1048] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:37.880944 25365 raft_consensus.cc:1275] T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Refusing update from remote peer a28f2edcd70f4eb08f16021ba3e2cf14: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:37.883924 26304 consensus_queue.cc:1048] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:38.054910 25221 raft_consensus.cc:1275] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:38.077891 25372 raft_consensus.cc:1275] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:38.082617 26316 consensus_queue.cc:1048] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:25:38.115489 26295 consensus_queue.cc:1048] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:38.162737 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:38.241060 25338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:38537, user_credentials={real_user=slave}} blocked reactor thread for 81155.2us
I20260709 12:25:38.507700 25372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05b8c7cdce0c46fdb50c370f6f53001e"
dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
mode: GRACEFUL
new_leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:45242
I20260709 12:25:38.508574 25372 raft_consensus.cc:606] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 2 LEADER]: Received request to transfer leadership to TS 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:38.512343 25221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c47c723f1bb4cd7b3ca0e8376ebb5e8"
dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
mode: GRACEFUL
new_leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:58634
I20260709 12:25:38.513031 25221 raft_consensus.cc:606] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Received request to transfer leadership to TS 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:38.517246 25294 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c46968756c14269bc487ced0f6e74bd"
dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
mode: GRACEFUL
new_leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:43412
I20260709 12:25:38.517925 25294 raft_consensus.cc:606] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Received request to transfer leadership to TS 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:38.522925 25221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc69e13d835645099f9e0e5bea99665a"
dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
mode: GRACEFUL
new_leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:58634
I20260709 12:25:38.523622 25221 raft_consensus.cc:606] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Received request to transfer leadership to TS 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:38.532874 25221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d072f6ab35314a9ebd29bbfe4d0eb1f0"
dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
mode: GRACEFUL
new_leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:58634
I20260709 12:25:38.533895 25221 raft_consensus.cc:606] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 LEADER]: Received request to transfer leadership to TS 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:38.535570 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:38.539079 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:38.540222 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:38.586470 26360 raft_consensus.cc:993] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14: : Instructing follower 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:38.587199 26360 raft_consensus.cc:1081] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Signalling peer 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:38.590476 26085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c46968756c14269bc487ced0f6e74bd"
dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:44684
I20260709 12:25:38.591192 26085 raft_consensus.cc:493] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:38.591645 26085 raft_consensus.cc:3060] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.618104 26085 raft_consensus.cc:515] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:38.635375 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c46968756c14269bc487ced0f6e74bd" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:38.636185 25293 raft_consensus.cc:3055] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:38.636518 25293 raft_consensus.cc:740] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:38.637413 25293 consensus_queue.cc:260] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:38.638717 25293 raft_consensus.cc:3060] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.663215 26085 leader_election.cc:290] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:38.666460 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c46968756c14269bc487ced0f6e74bd" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:38.667156 25372 raft_consensus.cc:3060] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.677062 25293 raft_consensus.cc:2468] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 2.
I20260709 12:25:38.679837 25968 leader_election.cc:304] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:38.681036 26255 raft_consensus.cc:2804] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:38.682703 26255 raft_consensus.cc:697] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [term 2 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:38.683681 26255 consensus_queue.cc:237] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:38.684454 25372 raft_consensus.cc:2468] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 2.
I20260709 12:25:38.705950 25041 catalog_manager.cc:5697] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 1 to 2, leader changed from a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131) to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 2 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:38.747103 26325 raft_consensus.cc:993] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d: : Instructing follower 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:38.747851 26345 raft_consensus.cc:1081] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 2 LEADER]: Signalling peer 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:38.750638 26287 raft_consensus.cc:993] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154: : Instructing follower 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:38.751257 26287 raft_consensus.cc:1081] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Signalling peer 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:38.754180 26091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05b8c7cdce0c46fdb50c370f6f53001e"
dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:44704
I20260709 12:25:38.754797 26091 raft_consensus.cc:493] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:38.755194 26091 raft_consensus.cc:3060] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:38.760269 26085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc69e13d835645099f9e0e5bea99665a"
dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:44694
I20260709 12:25:38.761008 26085 raft_consensus.cc:493] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:38.761404 26085 raft_consensus.cc:3060] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.810549 26085 raft_consensus.cc:515] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:38.816605 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc69e13d835645099f9e0e5bea99665a" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:38.817368 25372 raft_consensus.cc:3060] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.824308 26085 leader_election.cc:290] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:38.826431 25372 raft_consensus.cc:2468] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 2.
I20260709 12:25:38.829893 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc69e13d835645099f9e0e5bea99665a" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:38.830804 25221 raft_consensus.cc:3055] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:38.831197 25221 raft_consensus.cc:740] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:38.834178 25221 consensus_queue.cc:260] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:38.812618 26091 raft_consensus.cc:515] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:38.838945 25967 leader_election.cc:304] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, 434d5783f9374eab8f587e0fe6c15b1c; no voters: 
I20260709 12:25:38.839269 26091 leader_election.cc:290] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 3 election: Requested vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887)
I20260709 12:25:38.840682 25221 raft_consensus.cc:3060] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.848985 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b8c7cdce0c46fdb50c370f6f53001e" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:38.852214 25372 raft_consensus.cc:3055] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:38.852946 25372 raft_consensus.cc:740] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0fa8f2c80074488084fea821c4bb293d, State: Running, Role: LEADER
I20260709 12:25:38.844991 26255 raft_consensus.cc:2804] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:38.856444 26255 raft_consensus.cc:697] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 2 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:38.857514 26255 consensus_queue.cc:237] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:38.866680 25221 raft_consensus.cc:2468] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 2.
I20260709 12:25:38.871534 25372 consensus_queue.cc:260] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:38.874637 25372 raft_consensus.cc:3060] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:38.881145 25293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b8c7cdce0c46fdb50c370f6f53001e" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:38.883000 25293 raft_consensus.cc:3060] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:25:38.884516 25189 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:38537, user_credentials={real_user=slave}} blocked reactor thread for 57616.4us
I20260709 12:25:38.901544 25293 raft_consensus.cc:2468] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 3.
I20260709 12:25:38.903319 25968 leader_election.cc:304] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:38.904536 25372 raft_consensus.cc:2468] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 3.
I20260709 12:25:38.904496 26316 raft_consensus.cc:2804] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:38.908681 26316 raft_consensus.cc:697] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 3 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:38.913008 26375 raft_consensus.cc:993] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154: : Instructing follower 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:38.913683 26303 raft_consensus.cc:1081] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Signalling peer 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:38.909874 26316 consensus_queue.cc:237] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
W20260709 12:25:38.923465 25188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.132:40887, user_credentials={real_user=slave}} blocked reactor thread for 71296.3us
I20260709 12:25:38.924180 26091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c47c723f1bb4cd7b3ca0e8376ebb5e8"
dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:44694
I20260709 12:25:38.924782 26091 raft_consensus.cc:493] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:38.925076 26091 raft_consensus.cc:3060] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.935523 25041 catalog_manager.cc:5697] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 1 to 2, leader changed from d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130) to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 2 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:38.943427 26091 raft_consensus.cc:515] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:38.946444 25365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c47c723f1bb4cd7b3ca0e8376ebb5e8" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:38.946852 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c47c723f1bb4cd7b3ca0e8376ebb5e8" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:38.947285 25365 raft_consensus.cc:3060] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.947603 25221 raft_consensus.cc:3055] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:38.948066 25221 raft_consensus.cc:740] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:38.949527 25221 consensus_queue.cc:260] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:38.946278 26091 leader_election.cc:290] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:38.951606 25221 raft_consensus.cc:3060] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:39.033252 25221 raft_consensus.cc:2468] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 2.
I20260709 12:25:39.034650 25965 leader_election.cc:304] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:39.035951 26377 raft_consensus.cc:2804] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:39.036654 26377 raft_consensus.cc:697] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:39.040261 26374 raft_consensus.cc:993] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154: : Instructing follower 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:39.042402 26374 raft_consensus.cc:1081] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 LEADER]: Signalling peer 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:39.045843 26091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d072f6ab35314a9ebd29bbfe4d0eb1f0"
dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:44694
I20260709 12:25:39.046449 26091 raft_consensus.cc:493] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:39.046859 26091 raft_consensus.cc:3060] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:39.045562 26377 consensus_queue.cc:237] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:39.031608 25365 raft_consensus.cc:2468] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 2.
I20260709 12:25:39.055239 26091 raft_consensus.cc:515] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:39.061439 26091 leader_election.cc:290] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 3 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:39.063273 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d072f6ab35314a9ebd29bbfe4d0eb1f0" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:39.064059 25294 raft_consensus.cc:3060] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:39.067329 25041 catalog_manager.cc:5697] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 2 to 3, leader changed from 0fa8f2c80074488084fea821c4bb293d (127.16.240.132) to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 3 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:39.073160 25294 raft_consensus.cc:2468] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 3.
I20260709 12:25:39.077171 25968 leader_election.cc:304] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:39.078056 26316 raft_consensus.cc:2804] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:39.078543 26316 raft_consensus.cc:697] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 3 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:39.079494 26316 consensus_queue.cc:237] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:39.090637 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d072f6ab35314a9ebd29bbfe4d0eb1f0" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:39.091347 25219 raft_consensus.cc:3055] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:39.091655 25219 raft_consensus.cc:740] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:39.090710 25365 raft_consensus.cc:1275] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:39.095836 25219 consensus_queue.cc:260] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:39.097307 25219 raft_consensus.cc:3060] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:39.102880 26377 consensus_queue.cc:1048] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:39.108098 25219 raft_consensus.cc:2468] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 3.
I20260709 12:25:39.109618 25294 raft_consensus.cc:1275] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:39.114538 26316 consensus_queue.cc:1048] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:39.154726 25041 catalog_manager.cc:5697] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 1 to 2, leader changed from d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130) to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 2 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:39.159274 25041 catalog_manager.cc:5697] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 2 to 3, leader changed from d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130) to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 3 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:39.305828 25370 raft_consensus.cc:1275] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:39.312156 26316 consensus_queue.cc:1048] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:39.321264 25294 raft_consensus.cc:1275] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:39.323781 26316 consensus_queue.cc:1048] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:39.384642 25221 raft_consensus.cc:1275] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:39.387488 26255 consensus_queue.cc:1048] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:39.435159 25370 raft_consensus.cc:1275] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:39.436755 26255 consensus_queue.cc:1048] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:39.607259 25293 raft_consensus.cc:1275] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:39.611274 25221 raft_consensus.cc:1275] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:39.614980 26316 consensus_queue.cc:1048] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:39.615257 26295 consensus_queue.cc:1048] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:39.662700 25219 raft_consensus.cc:1275] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 3 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:39.665383 26377 consensus_queue.cc:1048] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:39.671947 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:39.708961 25372 raft_consensus.cc:1275] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:39.743855 26255 consensus_queue.cc:1048] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:39.828665 25221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "640ac5b087574063b50e6611b7e8da5b"
dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
mode: GRACEFUL
new_leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:58634
I20260709 12:25:39.829306 25221 raft_consensus.cc:606] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Received request to transfer leadership to TS 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:39.832544 25221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4269cf1528545fd94e1d53fcf6cf48d"
dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
mode: GRACEFUL
new_leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:58634
I20260709 12:25:39.833125 25221 raft_consensus.cc:606] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Received request to transfer leadership to TS 434d5783f9374eab8f587e0fe6c15b1c
I20260709 12:25:39.834594 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:39.836621 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:39.837899 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:39.951543 26287 raft_consensus.cc:993] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154: : Instructing follower 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:39.953447 26287 raft_consensus.cc:1081] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Signalling peer 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:39.955833 26091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4269cf1528545fd94e1d53fcf6cf48d"
dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:44694
I20260709 12:25:39.956483 26091 raft_consensus.cc:493] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:39.956830 26091 raft_consensus.cc:3060] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:39.965989 26091 raft_consensus.cc:515] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:39.969972 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4269cf1528545fd94e1d53fcf6cf48d" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:39.970772 25219 raft_consensus.cc:3055] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:39.971132 25219 raft_consensus.cc:740] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:39.972132 25219 consensus_queue.cc:260] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:39.973436 25219 raft_consensus.cc:3060] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:39.994621 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4269cf1528545fd94e1d53fcf6cf48d" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:39.995412 25294 raft_consensus.cc:3060] T f4269cf1528545fd94e1d53fcf6cf48d P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:39.999449 25219 raft_consensus.cc:2468] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 2.
I20260709 12:25:40.019456 25965 leader_election.cc:304] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154; no voters: 
I20260709 12:25:40.020548 26295 raft_consensus.cc:2804] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:40.021029 26295 raft_consensus.cc:697] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [term 2 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:40.021978 26295 consensus_queue.cc:237] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:40.016769 25294 raft_consensus.cc:2468] T f4269cf1528545fd94e1d53fcf6cf48d P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 2.
I20260709 12:25:40.017078 26091 leader_election.cc:290] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:40.046015 25041 catalog_manager.cc:5697] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 1 to 2, leader changed from d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130) to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 2 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:40.177897 26287 raft_consensus.cc:993] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154: : Instructing follower 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:40.178438 26398 raft_consensus.cc:1081] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Signalling peer 434d5783f9374eab8f587e0fe6c15b1c to start an election
I20260709 12:25:40.185158 26091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "640ac5b087574063b50e6611b7e8da5b"
dest_uuid: "434d5783f9374eab8f587e0fe6c15b1c"
 from {username='slave'} at 127.0.0.1:44694
I20260709 12:25:40.185814 26091 raft_consensus.cc:493] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:40.186219 26091 raft_consensus.cc:3060] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:40.192694 26091 raft_consensus.cc:515] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:40.194866 26091 leader_election.cc:290] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 election: Requested vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:40.196262 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640ac5b087574063b50e6611b7e8da5b" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14"
I20260709 12:25:40.196462 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640ac5b087574063b50e6611b7e8da5b" candidate_uuid: "434d5783f9374eab8f587e0fe6c15b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3979c425abd4ac7b2ca30e1dec9a154"
I20260709 12:25:40.197140 25294 raft_consensus.cc:3060] T 640ac5b087574063b50e6611b7e8da5b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:40.197455 25221 raft_consensus.cc:3055] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:40.197759 25221 raft_consensus.cc:740] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3979c425abd4ac7b2ca30e1dec9a154, State: Running, Role: LEADER
I20260709 12:25:40.198621 25221 consensus_queue.cc:260] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:40.200145 25221 raft_consensus.cc:3060] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:40.206259 25294 raft_consensus.cc:2468] T 640ac5b087574063b50e6611b7e8da5b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 2.
I20260709 12:25:40.207592 25968 leader_election.cc:304] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:40.208999 26255 raft_consensus.cc:2804] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:40.209489 26255 raft_consensus.cc:697] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [term 2 LEADER]: Becoming Leader. State: Replica: 434d5783f9374eab8f587e0fe6c15b1c, State: Running, Role: LEADER
I20260709 12:25:40.210421 26255 consensus_queue.cc:237] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:40.233327 25221 raft_consensus.cc:2468] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434d5783f9374eab8f587e0fe6c15b1c in term 2.
I20260709 12:25:40.259794 25041 catalog_manager.cc:5697] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c reported cstate change: term changed from 1 to 2, leader changed from d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130) to 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129). New cstate: current_term: 2 leader_uuid: "434d5783f9374eab8f587e0fe6c15b1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:40.421875 25221 raft_consensus.cc:1275] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:40.423673 26295 consensus_queue.cc:1048] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:40.492796 25294 raft_consensus.cc:1275] T f4269cf1528545fd94e1d53fcf6cf48d P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:40.502087 26316 consensus_queue.cc:1048] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:40.851192 25293 raft_consensus.cc:1275] T 640ac5b087574063b50e6611b7e8da5b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:40.852330 25221 raft_consensus.cc:1275] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Refusing update from remote peer 434d5783f9374eab8f587e0fe6c15b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:40.855701 26255 consensus_queue.cc:1048] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:40.861558 26255 consensus_queue.cc:1048] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:40.933282 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:40.982708 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:40.984499 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:40.985284 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:41.027554 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:41.092667 17346 tablet_server.cc:179] TabletServer@127.16.240.129:38537 shutting down...
W20260709 12:25:41.113253 25189 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 262 similar messages]
W20260709 12:25:41.120139 25263 consensus_peers.cc:597] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:41.120677 25189 consensus_peers.cc:597] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:41.136072 25263 consensus_peers.cc:597] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:41.158349 25263 consensus_peers.cc:597] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:41.160887 25189 consensus_peers.cc:597] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.173657 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:41.174978 17346 tablet_replica.cc:333] stopping tablet replica
W20260709 12:25:41.176112 25263 consensus_peers.cc:597] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.176400 17346 raft_consensus.cc:2243] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.177081 17346 raft_consensus.cc:2272] T ef05435bfb3044ffb451ca8373c097c7 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.180030 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.180720 17346 raft_consensus.cc:2243] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.181283 17346 raft_consensus.cc:2272] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.185976 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.188333 17346 raft_consensus.cc:2243] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.189064 17346 raft_consensus.cc:2272] T 4ae8b407c5d34cfb85a405355e2befda P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:41.190451 25189 consensus_peers.cc:597] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.192389 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.193460 17346 raft_consensus.cc:2243] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.194087 17346 raft_consensus.cc:2272] T 935b81351905468d8fa751d430f33ef2 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.199218 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.201515 17346 raft_consensus.cc:2243] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.202740 17346 raft_consensus.cc:2272] T 574e4322900441a18f11a2568ab6fd64 P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.207463 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.209554 17346 raft_consensus.cc:2243] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:25:41.209762 25263 consensus_peers.cc:597] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.210831 17346 raft_consensus.cc:2272] T dbb0eab5dcee4f95b7c284dea379c795 P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:41.212495 25338 consensus_peers.cc:597] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.216917 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.218098 17346 raft_consensus.cc:2243] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:41.226859 25263 consensus_peers.cc:597] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.228679 17346 raft_consensus.cc:2272] T 354e6422b7944df78b231965e1774820 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:41.231293 25189 consensus_peers.cc:597] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.232556 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.233750 17346 raft_consensus.cc:2243] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.234325 17346 raft_consensus.cc:2272] T 272d9a9f4ef849db8e59fad827bc81d0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.237916 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.238878 17346 raft_consensus.cc:2243] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.239539 17346 raft_consensus.cc:2272] T 37de5b1c577f426488d8649c7b56a9a0 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:41.240784 25338 consensus_peers.cc:597] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:41.243268 25189 consensus_peers.cc:597] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.243537 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.245591 17346 raft_consensus.cc:2243] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.246138 17346 raft_consensus.cc:2272] T a6ef2af3aa69454aa946797dc87d6e9d P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.249738 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.250705 17346 raft_consensus.cc:2243] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.251276 17346 raft_consensus.cc:2272] T ff3d2388e4f54ed59c7760fab0dfc1ec P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.255272 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.256242 17346 raft_consensus.cc:2243] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.256771 17346 raft_consensus.cc:2272] T 58caedf294044506b135b8990d49e180 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.259678 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.260404 17346 raft_consensus.cc:2243] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.260900 17346 raft_consensus.cc:2272] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.263532 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.264204 17346 raft_consensus.cc:2243] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.264690 17346 raft_consensus.cc:2272] T 30586f82b3764222905aebbb6896d886 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.267964 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.268900 17346 raft_consensus.cc:2243] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.269480 17346 raft_consensus.cc:2272] T 77d13683d814408081fbbece9be522ed P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.272387 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.273094 17346 raft_consensus.cc:2243] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.274163 17346 raft_consensus.cc:2272] T 05b8c7cdce0c46fdb50c370f6f53001e P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.277037 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.277770 17346 raft_consensus.cc:2243] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.278198 17346 raft_consensus.cc:2272] T b349920766b74e3aa849cd67521bf887 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.280613 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.281322 17346 raft_consensus.cc:2243] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.281909 17346 raft_consensus.cc:2272] T 3459b31870574ae4aa816cf5ee28162b P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:41.284821 25263 consensus_peers.cc:597] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.285038 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.286350 17346 raft_consensus.cc:2243] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.287725 17346 raft_consensus.cc:2272] T e01f82f06bdb4424b0d871882d6c8c3b P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.290418 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.291226 17346 raft_consensus.cc:2243] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.291978 17346 raft_consensus.cc:2272] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.295850 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.296730 17346 raft_consensus.cc:2243] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:25:41.296741 25263 consensus_peers.cc:597] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.297969 17346 raft_consensus.cc:2272] T 2ecc3ffe78cf4eb091836a5e7d2393cc P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.301234 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.301972 17346 raft_consensus.cc:2243] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.302596 17346 raft_consensus.cc:2272] T 8fd0775b429544fcb31e2834c279b159 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.305202 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.305967 17346 raft_consensus.cc:2243] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.306449 17346 raft_consensus.cc:2272] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.309067 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.309729 17346 raft_consensus.cc:2243] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.310238 17346 raft_consensus.cc:2272] T 46a01e9d0014411a83a8edbf3b5504f6 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.314304 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.315092 17346 raft_consensus.cc:2243] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.315773 17346 raft_consensus.cc:2272] T 51b6c4b190bf487a9d40c062b4195403 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.318799 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.319540 17346 raft_consensus.cc:2243] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.320245 17346 raft_consensus.cc:2272] T 8fd48573282443f78bd7580dcd9c4bc2 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.323592 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.324517 17346 raft_consensus.cc:2243] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.325173 17346 raft_consensus.cc:2272] T 2b324fb11adf4924bd497717bc12ff4c P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.329937 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.331023 17346 raft_consensus.cc:2243] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.332207 17346 raft_consensus.cc:2272] T f4269cf1528545fd94e1d53fcf6cf48d P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:41.335884 25263 consensus_peers.cc:597] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.336380 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.337459 17346 raft_consensus.cc:2243] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:25:41.337484 25189 consensus_peers.cc:597] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.338642 17346 raft_consensus.cc:2272] T 63327743a40345e4b149aca740d0944a P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.341980 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.342893 17346 raft_consensus.cc:2243] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.343492 17346 raft_consensus.cc:2272] T 3ba86635097441c08a6ca206ab0bfe9a P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.346565 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.347460 17346 raft_consensus.cc:2243] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.348070 17346 raft_consensus.cc:2272] T eb4d589309f24d3e955fb45b2c6fe3af P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.351387 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.352240 17346 raft_consensus.cc:2243] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.353479 17346 raft_consensus.cc:2272] T cb9f447960df41a5ade2459879b92b17 P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:41.354786 25189 consensus_peers.cc:597] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.356706 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.357589 17346 raft_consensus.cc:2243] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.358631 17346 raft_consensus.cc:2272] T 640ac5b087574063b50e6611b7e8da5b P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.362453 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.363324 17346 raft_consensus.cc:2243] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:41.363523 25189 consensus_peers.cc:597] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.364154 17346 raft_consensus.cc:2272] T 6b1f8b45199a40aeaf77fa2e23107375 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.367659 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.368505 17346 raft_consensus.cc:2243] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.369553 17346 raft_consensus.cc:2272] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P 434d5783f9374eab8f587e0fe6c15b1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.372466 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.373206 17346 raft_consensus.cc:2243] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.374614 17346 raft_consensus.cc:2272] T 9c46968756c14269bc487ced0f6e74bd P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.377614 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.378448 17346 raft_consensus.cc:2243] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.379077 17346 raft_consensus.cc:2272] T afcc5ac5532e4841a4f0a182a39a1914 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.381775 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.382591 17346 raft_consensus.cc:2243] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.383184 17346 raft_consensus.cc:2272] T 192689638be442acb52df50f2137f664 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.385804 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.386382 17346 raft_consensus.cc:2243] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.386847 17346 raft_consensus.cc:2272] T f6be441f38874ae7bb28069feed26b69 P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.389021 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.389709 17346 raft_consensus.cc:2243] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.390890 17346 raft_consensus.cc:2272] T 91840ed520ab444d9bd1acb13b5b6b89 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.393873 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.394479 17346 raft_consensus.cc:2243] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.394964 17346 raft_consensus.cc:2272] T 83e2e1ecd7474df9add48f60c06a4a0f P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.397397 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.397977 17346 raft_consensus.cc:2243] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.398890 17346 raft_consensus.cc:2272] T 1b4c35aae32446d4895fa10bcdc4d1eb P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.401547 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.402093 17346 raft_consensus.cc:2243] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.402588 17346 raft_consensus.cc:2272] T a616947e81bf446584593e882f8bdeaa P 434d5783f9374eab8f587e0fe6c15b1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.405025 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.405650 17346 raft_consensus.cc:2243] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.406469 17346 raft_consensus.cc:2272] T cc69e13d835645099f9e0e5bea99665a P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.408870 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:41.409380 17346 raft_consensus.cc:2243] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.410331 17346 raft_consensus.cc:2272] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 434d5783f9374eab8f587e0fe6c15b1c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:41.415213 25338 consensus_peers.cc:597] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:41.427793 25189 consensus_peers.cc:597] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:41.432400 25338 consensus_peers.cc:597] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:41.437076 25263 consensus_peers.cc:597] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:41.450110 25338 consensus_peers.cc:597] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:41.459298 25263 consensus_peers.cc:597] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:41.466881 25189 consensus_peers.cc:597] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:41.481441 25338 consensus_peers.cc:597] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:41.508675 25338 consensus_peers.cc:597] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.513052 17346 tablet_server.cc:196] TabletServer@127.16.240.129:38537 shutdown complete.
W20260709 12:25:41.514381 25189 consensus_peers.cc:597] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.639901 17346 tablet_server.cc:179] TabletServer@127.16.240.130:0 shutting down...
W20260709 12:25:41.657063 25335 consensus_peers.cc:597] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:41.682370 25335 consensus_peers.cc:597] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:41.687084 25263 consensus_peers.cc:597] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:41.727319 25260 consensus_peers.cc:597] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:41.746008 25338 consensus_peers.cc:597] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d -> Peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Couldn't send request to peer 434d5783f9374eab8f587e0fe6c15b1c. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:41.768337 25335 consensus_peers.cc:597] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:41.780985 25260 consensus_peers.cc:597] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:41.788061 25260 consensus_peers.cc:597] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:41.795049 25335 consensus_peers.cc:597] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.818797 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:41.820050 17346 tablet_replica.cc:333] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.821031 17346 raft_consensus.cc:2243] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:25:41.821301 25260 consensus_peers.cc:597] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.822212 17346 raft_consensus.cc:2272] T 8fd48573282443f78bd7580dcd9c4bc2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:41.823024 25335 consensus_peers.cc:597] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.827255 17346 tablet_replica.cc:333] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.828745 17346 raft_consensus.cc:2243] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.829329 17346 raft_consensus.cc:2272] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:41.831681 25260 consensus_peers.cc:597] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.832515 17346 tablet_replica.cc:333] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.833496 17346 raft_consensus.cc:2243] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.834066 17346 raft_consensus.cc:2272] T ffa2c58c6d37474c908e6f924b95db30 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.838075 17346 tablet_replica.cc:333] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.838954 17346 raft_consensus.cc:2243] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.839509 17346 raft_consensus.cc:2272] T e01f82f06bdb4424b0d871882d6c8c3b P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.842069 17346 tablet_replica.cc:333] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.842782 17346 raft_consensus.cc:2243] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.843241 17346 raft_consensus.cc:2272] T 574e4322900441a18f11a2568ab6fd64 P d3979c425abd4ac7b2ca30e1dec9a154 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.845744 17346 tablet_replica.cc:333] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.846479 17346 raft_consensus.cc:2243] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.847503 17346 raft_consensus.cc:2272] T ef05435bfb3044ffb451ca8373c097c7 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.850709 17346 tablet_replica.cc:333] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.851542 17346 raft_consensus.cc:2243] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.853132 17346 raft_consensus.cc:2272] T eb4d589309f24d3e955fb45b2c6fe3af P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.855357 17346 tablet_replica.cc:333] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.856142 17346 raft_consensus.cc:2243] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.857092 17346 raft_consensus.cc:2272] T bf2bfe7ad58c42f1aff0feb1c9880d9b P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.859452 17346 tablet_replica.cc:333] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.860164 17346 raft_consensus.cc:2243] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.861649 17346 raft_consensus.cc:2272] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.864919 17346 tablet_replica.cc:333] T 969efca8af254e2e885d546c22e637aa P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.865868 17346 raft_consensus.cc:2243] T 969efca8af254e2e885d546c22e637aa P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.866430 17346 raft_consensus.cc:2272] T 969efca8af254e2e885d546c22e637aa P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.869088 17346 tablet_replica.cc:333] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.870167 17346 raft_consensus.cc:2243] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.870986 17346 raft_consensus.cc:2272] T cc69e13d835645099f9e0e5bea99665a P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.874358 17346 tablet_replica.cc:333] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.875052 17346 raft_consensus.cc:2243] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.876173 17346 raft_consensus.cc:2272] T 9d39dac4e3e343f2985681aa3c5e5718 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:41.877851 25260 consensus_peers.cc:597] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.879159 17346 tablet_replica.cc:333] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.879936 17346 raft_consensus.cc:2243] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.880404 17346 raft_consensus.cc:2272] T 640ac5b087574063b50e6611b7e8da5b P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.884301 17346 tablet_replica.cc:333] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.885046 17346 raft_consensus.cc:2243] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.886013 17346 raft_consensus.cc:2272] T 2ecc3ffe78cf4eb091836a5e7d2393cc P d3979c425abd4ac7b2ca30e1dec9a154 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.889045 17346 tablet_replica.cc:333] T ff3d2388e4f54ed59c7760fab0dfc1ec P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.889902 17346 raft_consensus.cc:2243] T ff3d2388e4f54ed59c7760fab0dfc1ec P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.890519 17346 raft_consensus.cc:2272] T ff3d2388e4f54ed59c7760fab0dfc1ec P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.893306 17346 tablet_replica.cc:333] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.894335 17346 raft_consensus.cc:2243] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.895071 17346 raft_consensus.cc:2272] T 63327743a40345e4b149aca740d0944a P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.898263 17346 tablet_replica.cc:333] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.899296 17346 raft_consensus.cc:2243] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.899922 17346 raft_consensus.cc:2272] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:41.900076 25335 consensus_peers.cc:597] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.902889 17346 tablet_replica.cc:333] T afcc5ac5532e4841a4f0a182a39a1914 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.903900 17346 raft_consensus.cc:2243] T afcc5ac5532e4841a4f0a182a39a1914 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.904539 17346 raft_consensus.cc:2272] T afcc5ac5532e4841a4f0a182a39a1914 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.907729 17346 tablet_replica.cc:333] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.908725 17346 raft_consensus.cc:2243] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.909336 17346 raft_consensus.cc:2272] T 1b4c35aae32446d4895fa10bcdc4d1eb P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.912184 17346 tablet_replica.cc:333] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.913252 17346 raft_consensus.cc:2243] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:25:41.913273 25335 consensus_peers.cc:597] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.914891 17346 raft_consensus.cc:2272] T a616947e81bf446584593e882f8bdeaa P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.918375 17346 tablet_replica.cc:333] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.919162 17346 raft_consensus.cc:2243] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.919711 17346 raft_consensus.cc:2272] T b1ea711322544c2999f94b52b35af150 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.922466 17346 tablet_replica.cc:333] T 46a01e9d0014411a83a8edbf3b5504f6 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.923085 17346 raft_consensus.cc:2243] T 46a01e9d0014411a83a8edbf3b5504f6 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.923556 17346 raft_consensus.cc:2272] T 46a01e9d0014411a83a8edbf3b5504f6 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.926091 17346 tablet_replica.cc:333] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.926995 17346 raft_consensus.cc:2243] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.928360 17346 raft_consensus.cc:2272] T d4f5d4fb33b4421daaf5b63cafcd4f4b P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.931941 17346 tablet_replica.cc:333] T 0d0304837699431197f7e780344f1093 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.933045 17346 raft_consensus.cc:2243] T 0d0304837699431197f7e780344f1093 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.934255 17346 raft_consensus.cc:2272] T 0d0304837699431197f7e780344f1093 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.937521 17346 tablet_replica.cc:333] T 0190ce7515c34431903f97febee4323e P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.938265 17346 raft_consensus.cc:2243] T 0190ce7515c34431903f97febee4323e P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.938814 17346 raft_consensus.cc:2272] T 0190ce7515c34431903f97febee4323e P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.941246 17346 tablet_replica.cc:333] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.941870 17346 raft_consensus.cc:2243] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.942907 17346 raft_consensus.cc:2272] T 1bf33e1087ea4e7f98b37dd2c130c635 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.945458 17346 tablet_replica.cc:333] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.946081 17346 raft_consensus.cc:2243] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.946552 17346 raft_consensus.cc:2272] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.951089 17346 tablet_replica.cc:333] T dcf5a5e68833468a8206894be4a16f56 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.952473 17346 raft_consensus.cc:2243] T dcf5a5e68833468a8206894be4a16f56 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.953277 17346 raft_consensus.cc:2272] T dcf5a5e68833468a8206894be4a16f56 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:41.954845 25260 consensus_peers.cc:597] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.956408 17346 tablet_replica.cc:333] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.957270 17346 raft_consensus.cc:2243] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.957811 17346 raft_consensus.cc:2272] T f50c1e80871a4f21a31521e37160b99f P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.960264 17346 tablet_replica.cc:333] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.960927 17346 raft_consensus.cc:2243] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.963977 17346 raft_consensus.cc:2272] T f6be441f38874ae7bb28069feed26b69 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.967228 17346 tablet_replica.cc:333] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.968055 17346 raft_consensus.cc:2243] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.968708 17346 raft_consensus.cc:2272] T 8bc47554d5e54ab4826c21fdd6126df0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.972301 17346 tablet_replica.cc:333] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.973083 17346 raft_consensus.cc:2243] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.974175 17346 raft_consensus.cc:2272] T 354e6422b7944df78b231965e1774820 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.977090 17346 tablet_replica.cc:333] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.977880 17346 raft_consensus.cc:2243] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.978952 17346 raft_consensus.cc:2272] T 37de5b1c577f426488d8649c7b56a9a0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.981997 17346 tablet_replica.cc:333] T a6ef2af3aa69454aa946797dc87d6e9d P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.984072 17346 raft_consensus.cc:2243] T a6ef2af3aa69454aa946797dc87d6e9d P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.984666 17346 raft_consensus.cc:2272] T a6ef2af3aa69454aa946797dc87d6e9d P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.988665 17346 tablet_replica.cc:333] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.989468 17346 raft_consensus.cc:2243] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.990600 17346 raft_consensus.cc:2272] T bffd5eeaa9c14effb9e1ffc29a23ff01 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.993415 17346 tablet_replica.cc:333] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.994501 17346 raft_consensus.cc:2243] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:41.995781 17346 raft_consensus.cc:2272] T 77d13683d814408081fbbece9be522ed P d3979c425abd4ac7b2ca30e1dec9a154 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.998657 17346 tablet_replica.cc:333] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:41.999461 17346 raft_consensus.cc:2243] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.999987 17346 raft_consensus.cc:2272] T f4269cf1528545fd94e1d53fcf6cf48d P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.000151 25335 consensus_peers.cc:597] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.002841 17346 tablet_replica.cc:333] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:42.003645 17346 raft_consensus.cc:2243] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.004644 17346 raft_consensus.cc:2272] T 83e2e1ecd7474df9add48f60c06a4a0f P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.007524 17346 tablet_replica.cc:333] T 91840ed520ab444d9bd1acb13b5b6b89 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:42.008330 17346 raft_consensus.cc:2243] T 91840ed520ab444d9bd1acb13b5b6b89 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.008894 17346 raft_consensus.cc:2272] T 91840ed520ab444d9bd1acb13b5b6b89 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.009660 25260 consensus_peers.cc:597] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.011765 17346 tablet_replica.cc:333] T 752795059ef543b9a98b6dba09b04230 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:42.012602 17346 raft_consensus.cc:2243] T 752795059ef543b9a98b6dba09b04230 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.013077 17346 raft_consensus.cc:2272] T 752795059ef543b9a98b6dba09b04230 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.016077 17346 tablet_replica.cc:333] T 272d9a9f4ef849db8e59fad827bc81d0 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:42.016842 17346 raft_consensus.cc:2243] T 272d9a9f4ef849db8e59fad827bc81d0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.017436 17346 raft_consensus.cc:2272] T 272d9a9f4ef849db8e59fad827bc81d0 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.020429 17346 tablet_replica.cc:333] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:42.021090 17346 raft_consensus.cc:2243] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.021632 17346 raft_consensus.cc:2272] T 30586f82b3764222905aebbb6896d886 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.024648 17346 tablet_replica.cc:333] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:42.025348 17346 raft_consensus.cc:2243] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.025902 17346 raft_consensus.cc:2272] T 51b6c4b190bf487a9d40c062b4195403 P d3979c425abd4ac7b2ca30e1dec9a154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.028689 17346 tablet_replica.cc:333] T 935b81351905468d8fa751d430f33ef2 P d3979c425abd4ac7b2ca30e1dec9a154: stopping tablet replica
I20260709 12:25:42.029350 17346 raft_consensus.cc:2243] T 935b81351905468d8fa751d430f33ef2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.029884 17346 raft_consensus.cc:2272] T 935b81351905468d8fa751d430f33ef2 P d3979c425abd4ac7b2ca30e1dec9a154 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.054478 25335 consensus_peers.cc:597] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:42.091969 25260 consensus_peers.cc:597] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:42.108021 25189 connection.cc:466] server connection from 127.0.0.1:34420 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34420 (request call id 637) could send its response
I20260709 12:25:42.166289 17346 tablet_server.cc:196] TabletServer@127.16.240.130:0 shutdown complete.
W20260709 12:25:42.205127 25335 consensus_peers.cc:597] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d -> Peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Couldn't send request to peer d3979c425abd4ac7b2ca30e1dec9a154. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:41903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.280388 17346 tablet_server.cc:179] TabletServer@127.16.240.131:0 shutting down...
W20260709 12:25:42.315711 25338 consensus_peers.cc:597] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d -> Peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Couldn't send request to peer a28f2edcd70f4eb08f16021ba3e2cf14. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.311450 26425 raft_consensus.cc:493] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:42.331447 26425 raft_consensus.cc:515] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
W20260709 12:25:42.342449 25335 leader_election.cc:336] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Network error: Client connection negotiation failed: client connection to 127.16.240.130:41903: connect: Connection refused (error 111)
I20260709 12:25:42.356658 26425 leader_election.cc:290] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
W20260709 12:25:42.358970 25338 consensus_peers.cc:597] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d -> Peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Couldn't send request to peer a28f2edcd70f4eb08f16021ba3e2cf14. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:42.359613 25338 consensus_peers.cc:597] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d -> Peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Couldn't send request to peer a28f2edcd70f4eb08f16021ba3e2cf14. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.360491 26412 raft_consensus.cc:493] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:42.361153 26412 raft_consensus.cc:515] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:42.363590 26412 leader_election.cc:290] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
W20260709 12:25:42.377620 25338 leader_election.cc:336] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:42.378115 25338 leader_election.cc:304] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:42.379216 26412 raft_consensus.cc:2749] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:25:42.387426 25338 leader_election.cc:336] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
W20260709 12:25:42.388357 25338 consensus_peers.cc:597] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d -> Peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Couldn't send request to peer a28f2edcd70f4eb08f16021ba3e2cf14. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:42.404542 25338 consensus_peers.cc:597] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d -> Peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Couldn't send request to peer a28f2edcd70f4eb08f16021ba3e2cf14. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:42.405138 25338 leader_election.cc:336] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:42.405532 25338 leader_election.cc:304] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:42.407627 26425 raft_consensus.cc:2749] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:42.414599 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:42.416080 17346 tablet_replica.cc:333] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.417155 17346 raft_consensus.cc:2243] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.418254 17346 raft_consensus.cc:2272] T 969efca8af254e2e885d546c22e637aa P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.418850 25338 consensus_peers.cc:597] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d -> Peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Couldn't send request to peer a28f2edcd70f4eb08f16021ba3e2cf14. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.421274 17346 tablet_replica.cc:333] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.423102 17346 raft_consensus.cc:2243] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.423837 17346 raft_consensus.cc:2272] T bf2bfe7ad58c42f1aff0feb1c9880d9b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.427383 25338 consensus_peers.cc:597] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d -> Peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Couldn't send request to peer a28f2edcd70f4eb08f16021ba3e2cf14. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.428422 17346 tablet_replica.cc:333] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.429040 26424 raft_consensus.cc:493] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:42.429656 17346 raft_consensus.cc:2243] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.429587 26424 raft_consensus.cc:515] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:42.430994 17346 raft_consensus.cc:2272] T 58caedf294044506b135b8990d49e180 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.434124 26424 leader_election.cc:290] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:42.436602 17346 tablet_replica.cc:333] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
W20260709 12:25:42.437552 25260 leader_election.cc:336] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Network error: Client connection negotiation failed: client connection to 127.16.240.130:41903: connect: Connection refused (error 111)
I20260709 12:25:42.437629 17346 raft_consensus.cc:2243] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.439050 17346 raft_consensus.cc:2272] T 2b324fb11adf4924bd497717bc12ff4c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.439334 25263 leader_election.cc:336] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:42.439853 25263 leader_election.cc:304] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:42.440910 26424 raft_consensus.cc:2749] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:42.441195 26421 raft_consensus.cc:493] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:42.441823 26421 raft_consensus.cc:515] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:42.443431 17346 tablet_replica.cc:333] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.444242 26421 leader_election.cc:290] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:42.444383 17346 raft_consensus.cc:2243] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.445201 17346 raft_consensus.cc:2272] T 574e4322900441a18f11a2568ab6fd64 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.448376 17346 tablet_replica.cc:333] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.449281 17346 raft_consensus.cc:2243] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.449863 17346 raft_consensus.cc:2272] T ffa2c58c6d37474c908e6f924b95db30 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.450881 25338 leader_election.cc:336] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
W20260709 12:25:42.451886 25338 leader_election.cc:336] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:42.452342 17346 tablet_replica.cc:333] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.452313 25338 leader_election.cc:304] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:42.453249 17346 raft_consensus.cc:2243] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.453222 26421 raft_consensus.cc:2749] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:42.454041 17346 raft_consensus.cc:2272] T d072f6ab35314a9ebd29bbfe4d0eb1f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.456228 17346 tablet_replica.cc:333] T bffd5eeaa9c14effb9e1ffc29a23ff01 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.456831 17346 raft_consensus.cc:2243] T bffd5eeaa9c14effb9e1ffc29a23ff01 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.457374 17346 raft_consensus.cc:2272] T bffd5eeaa9c14effb9e1ffc29a23ff01 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.460462 17346 tablet_replica.cc:333] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.461097 17346 raft_consensus.cc:2243] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.461588 17346 raft_consensus.cc:2272] T e99adf4dd9ed4adbb8f70f7fd8aeaeb8 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.461700 25338 consensus_peers.cc:597] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d -> Peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Couldn't send request to peer a28f2edcd70f4eb08f16021ba3e2cf14. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.464073 17346 tablet_replica.cc:333] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.464838 17346 raft_consensus.cc:2243] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.465314 17346 raft_consensus.cc:2272] T 3459b31870574ae4aa816cf5ee28162b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.467623 17346 tablet_replica.cc:333] T 1bf33e1087ea4e7f98b37dd2c130c635 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.468415 17346 raft_consensus.cc:2243] T 1bf33e1087ea4e7f98b37dd2c130c635 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.468891 17346 raft_consensus.cc:2272] T 1bf33e1087ea4e7f98b37dd2c130c635 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.471259 17346 tablet_replica.cc:333] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.472091 17346 raft_consensus.cc:2243] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.473580 17346 raft_consensus.cc:2272] T 1b4c35aae32446d4895fa10bcdc4d1eb P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.476372 17346 tablet_replica.cc:333] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.477233 17346 raft_consensus.cc:2243] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.478313 17346 raft_consensus.cc:2272] T b1ea711322544c2999f94b52b35af150 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.481175 17346 tablet_replica.cc:333] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.481984 17346 raft_consensus.cc:2243] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.482579 17346 raft_consensus.cc:2272] T 9d39dac4e3e343f2985681aa3c5e5718 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.485888 17346 tablet_replica.cc:333] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.486953 17346 raft_consensus.cc:2243] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.487530 17346 raft_consensus.cc:2272] T 9c46968756c14269bc487ced0f6e74bd P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.491532 17346 tablet_replica.cc:333] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.492964 17346 raft_consensus.cc:2243] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.493577 17346 raft_consensus.cc:2272] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.496028 17346 tablet_replica.cc:333] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.496636 17346 raft_consensus.cc:2243] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.497445 17346 raft_consensus.cc:2272] T afcc5ac5532e4841a4f0a182a39a1914 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.499692 17346 tablet_replica.cc:333] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.500324 17346 raft_consensus.cc:2243] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.500862 17346 raft_consensus.cc:2272] T 05b8c7cdce0c46fdb50c370f6f53001e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.503188 17346 tablet_replica.cc:333] T b349920766b74e3aa849cd67521bf887 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.503983 17346 raft_consensus.cc:2243] T b349920766b74e3aa849cd67521bf887 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.504477 17346 raft_consensus.cc:2272] T b349920766b74e3aa849cd67521bf887 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.508103 17346 tablet_replica.cc:333] T dcf5a5e68833468a8206894be4a16f56 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.508713 17346 raft_consensus.cc:2243] T dcf5a5e68833468a8206894be4a16f56 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.509208 17346 raft_consensus.cc:2272] T dcf5a5e68833468a8206894be4a16f56 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.511621 17346 tablet_replica.cc:333] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.512250 17346 raft_consensus.cc:2243] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.512704 17346 raft_consensus.cc:2272] T f50c1e80871a4f21a31521e37160b99f P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.514806 17346 tablet_replica.cc:333] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.515658 17346 raft_consensus.cc:2243] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.516296 17346 raft_consensus.cc:2272] T 4ae8b407c5d34cfb85a405355e2befda P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.519418 17346 tablet_replica.cc:333] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.520303 17346 raft_consensus.cc:2243] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.520910 17346 raft_consensus.cc:2272] T 8bc47554d5e54ab4826c21fdd6126df0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.524358 17346 tablet_replica.cc:333] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.525074 26418 raft_consensus.cc:493] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:42.525533 17346 raft_consensus.cc:2243] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.526124 17346 raft_consensus.cc:2272] T 192689638be442acb52df50f2137f664 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.525826 26418 raft_consensus.cc:515] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } }
I20260709 12:25:42.529086 17346 tablet_replica.cc:333] T f6be441f38874ae7bb28069feed26b69 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.529915 17346 raft_consensus.cc:2243] T f6be441f38874ae7bb28069feed26b69 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.530495 17346 raft_consensus.cc:2272] T f6be441f38874ae7bb28069feed26b69 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.533093 25260 leader_election.cc:336] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Network error: Client connection negotiation failed: client connection to 127.16.240.130:41903: connect: Connection refused (error 111)
I20260709 12:25:42.533403 17346 tablet_replica.cc:333] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.534286 17346 raft_consensus.cc:2243] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.534403 26418 leader_election.cc:290] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:42.535456 17346 raft_consensus.cc:2272] T 46a01e9d0014411a83a8edbf3b5504f6 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.539615 17346 tablet_replica.cc:333] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
W20260709 12:25:42.540207 25263 leader_election.cc:336] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:42.540472 17346 raft_consensus.cc:2243] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.540792 25263 leader_election.cc:304] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:42.541114 17346 raft_consensus.cc:2272] T 8fd0775b429544fcb31e2834c279b159 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.544466 17346 tablet_replica.cc:333] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.545286 17346 raft_consensus.cc:2243] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.545879 17346 raft_consensus.cc:2272] T 0d0304837699431197f7e780344f1093 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.546018 26421 raft_consensus.cc:493] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:42.546686 26421 raft_consensus.cc:515] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:42.547631 26418 raft_consensus.cc:2749] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:42.548935 17346 tablet_replica.cc:333] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.549834 17346 raft_consensus.cc:2243] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:25:42.549998 25338 consensus_peers.cc:597] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d -> Peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Couldn't send request to peer a28f2edcd70f4eb08f16021ba3e2cf14. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.553133 26421 leader_election.cc:290] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:42.556102 17346 raft_consensus.cc:2272] T 0190ce7515c34431903f97febee4323e P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.557699 25338 consensus_peers.cc:597] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d -> Peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Couldn't send request to peer a28f2edcd70f4eb08f16021ba3e2cf14. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.559497 17346 tablet_replica.cc:333] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
W20260709 12:25:42.559811 25338 leader_election.cc:336] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:42.560556 17346 raft_consensus.cc:2243] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.561822 17346 raft_consensus.cc:2272] T 30586f82b3764222905aebbb6896d886 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.565011 17346 tablet_replica.cc:333] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
W20260709 12:25:42.565035 25338 leader_election.cc:336] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:42.565788 17346 raft_consensus.cc:2243] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.565676 25338 leader_election.cc:304] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:42.566543 26421 raft_consensus.cc:2749] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:42.566913 17346 raft_consensus.cc:2272] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.569451 17346 tablet_replica.cc:333] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.570144 17346 raft_consensus.cc:2243] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.570266 26418 raft_consensus.cc:493] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:42.570677 17346 raft_consensus.cc:2272] T 91840ed520ab444d9bd1acb13b5b6b89 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.570915 26418 raft_consensus.cc:515] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:42.573231 17346 tablet_replica.cc:333] T 37de5b1c577f426488d8649c7b56a9a0 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.573894 17346 raft_consensus.cc:2243] T 37de5b1c577f426488d8649c7b56a9a0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.574445 17346 raft_consensus.cc:2272] T 37de5b1c577f426488d8649c7b56a9a0 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.574637 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb0eab5dcee4f95b7c284dea379c795" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d" is_pre_election: true
I20260709 12:25:42.574751 26418 leader_election.cc:290] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:42.575304 25372 raft_consensus.cc:2468] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 3.
I20260709 12:25:42.577369 17346 tablet_replica.cc:333] T f4269cf1528545fd94e1d53fcf6cf48d P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.578063 25262 leader_election.cc:304] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:42.578281 17346 raft_consensus.cc:2243] T f4269cf1528545fd94e1d53fcf6cf48d P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.578869 17346 raft_consensus.cc:2272] T f4269cf1528545fd94e1d53fcf6cf48d P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.579994 26418 raft_consensus.cc:2804] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:42.580531 26418 raft_consensus.cc:493] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:42.581053 26418 raft_consensus.cc:3060] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:42.581697 17346 tablet_replica.cc:333] T 640ac5b087574063b50e6611b7e8da5b P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.582580 17346 raft_consensus.cc:2243] T 640ac5b087574063b50e6611b7e8da5b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.583104 17346 raft_consensus.cc:2272] T 640ac5b087574063b50e6611b7e8da5b P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.583509 25263 leader_election.cc:336] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:42.585956 17346 tablet_replica.cc:333] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.587041 17346 raft_consensus.cc:2243] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.587985 17346 raft_consensus.cc:2272] T cb9f447960df41a5ade2459879b92b17 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.590885 17346 tablet_replica.cc:333] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.591893 17346 raft_consensus.cc:2243] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.593437 17346 raft_consensus.cc:2272] T 6b1f8b45199a40aeaf77fa2e23107375 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.594683 26418 raft_consensus.cc:515] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:42.596592 17346 tablet_replica.cc:333] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.597385 17346 raft_consensus.cc:2243] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.597797 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb0eab5dcee4f95b7c284dea379c795" candidate_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0fa8f2c80074488084fea821c4bb293d"
I20260709 12:25:42.598040 17346 raft_consensus.cc:2272] T 752795059ef543b9a98b6dba09b04230 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.598381 25372 raft_consensus.cc:3060] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:42.601241 17346 tablet_replica.cc:333] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.601655 26418 leader_election.cc:290] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 4 election: Requested vote from peers 0fa8f2c80074488084fea821c4bb293d (127.16.240.132:40887), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:42.602058 17346 raft_consensus.cc:2243] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.603132 17346 raft_consensus.cc:2272] T 3ba86635097441c08a6ca206ab0bfe9a P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.606019 17346 tablet_replica.cc:333] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.606735 17346 raft_consensus.cc:2243] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.607492 17346 raft_consensus.cc:2272] T 2ecc3ffe78cf4eb091836a5e7d2393cc P a28f2edcd70f4eb08f16021ba3e2cf14 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.606042 25372 raft_consensus.cc:2468] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a28f2edcd70f4eb08f16021ba3e2cf14 in term 4.
I20260709 12:25:42.609257 25262 leader_election.cc:304] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d, a28f2edcd70f4eb08f16021ba3e2cf14; no voters: 
I20260709 12:25:42.610040 26418 raft_consensus.cc:2804] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:42.610666 17346 tablet_replica.cc:333] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.611006 26418 raft_consensus.cc:697] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 4 LEADER]: Becoming Leader. State: Replica: a28f2edcd70f4eb08f16021ba3e2cf14, State: Running, Role: LEADER
I20260709 12:25:42.611497 17346 raft_consensus.cc:2243] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.612694 17346 raft_consensus.cc:2272] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.612195 26418 consensus_queue.cc:237] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
W20260709 12:25:42.613474 25263 leader_election.cc:336] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:42.615556 17346 tablet_replica.cc:333] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.616247 17346 raft_consensus.cc:2243] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.617483 17346 raft_consensus.cc:2272] T 935b81351905468d8fa751d430f33ef2 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.619956 17346 tablet_replica.cc:333] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.620479 17346 raft_consensus.cc:2243] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.621307 17346 raft_consensus.cc:2272] T 51b6c4b190bf487a9d40c062b4195403 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.623528 17346 tablet_replica.cc:333] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14: stopping tablet replica
I20260709 12:25:42.624056 17346 raft_consensus.cc:2243] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.624706 17346 pending_rounds.cc:70] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14: Trying to abort 1 pending ops.
I20260709 12:25:42.624943 17346 pending_rounds.cc:77] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14: Aborting op as it isn't in flight: id { term: 4 index: 4 } timestamp: 7305625364951908352 op_type: NO_OP noop_request { }
I20260709 12:25:42.625267 17346 raft_consensus.cc:2889] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:42.625548 17346 raft_consensus.cc:2272] T dbb0eab5dcee4f95b7c284dea379c795 P a28f2edcd70f4eb08f16021ba3e2cf14 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.632575 26421 raft_consensus.cc:493] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:42.633160 26421 raft_consensus.cc:515] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
W20260709 12:25:42.636270 25338 consensus_peers.cc:597] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d -> Peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Couldn't send request to peer a28f2edcd70f4eb08f16021ba3e2cf14. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:42.642043 25338 leader_election.cc:336] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
W20260709 12:25:42.643436 25335 leader_election.cc:336] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Network error: Client connection negotiation failed: client connection to 127.16.240.130:41903: connect: Connection refused (error 111)
I20260709 12:25:42.643975 25335 leader_election.cc:304] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:42.648205 26426 raft_consensus.cc:2749] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:42.650202 26421 leader_election.cc:290] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
W20260709 12:25:42.679854 25338 consensus_peers.cc:597] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d -> Peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Couldn't send request to peer a28f2edcd70f4eb08f16021ba3e2cf14. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.735375 17346 tablet_server.cc:196] TabletServer@127.16.240.131:0 shutdown complete.
I20260709 12:25:42.758366 26421 raft_consensus.cc:493] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:42.759114 26421 raft_consensus.cc:515] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:42.761610 26421 leader_election.cc:290] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
W20260709 12:25:42.770092 25338 leader_election.cc:336] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Network error: Client connection negotiation failed: client connection to 127.16.240.131:45473: connect: Connection refused (error 111)
W20260709 12:25:42.770893 25338 leader_election.cc:336] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:42.771327 25338 leader_election.cc:304] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, a28f2edcd70f4eb08f16021ba3e2cf14
I20260709 12:25:42.772341 26421 raft_consensus.cc:2749] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:42.825282 26421 raft_consensus.cc:493] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:42.825973 26421 raft_consensus.cc:515] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:42.828469 26421 leader_election.cc:290] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
W20260709 12:25:42.834832 25335 leader_election.cc:336] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Network error: Client connection negotiation failed: client connection to 127.16.240.130:41903: connect: Connection refused (error 111)
W20260709 12:25:42.841289 25338 leader_election.cc:336] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:42.841858 25338 leader_election.cc:304] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:42.842604 26421 raft_consensus.cc:2749] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:42.842689 17346 tablet_server.cc:179] TabletServer@127.16.240.132:0 shutting down...
I20260709 12:25:42.871469 26426 raft_consensus.cc:493] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 434d5783f9374eab8f587e0fe6c15b1c)
I20260709 12:25:42.872100 26426 raft_consensus.cc:515] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:42.874331 26426 leader_election.cc:290] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
W20260709 12:25:42.883594 25335 leader_election.cc:336] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Network error: Client connection negotiation failed: client connection to 127.16.240.130:41903: connect: Connection refused (error 111)
W20260709 12:25:42.887719 25338 leader_election.cc:336] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:42.889604 25338 leader_election.cc:304] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:42.892606 26425 raft_consensus.cc:2749] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:42.948312 26421 raft_consensus.cc:493] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d3979c425abd4ac7b2ca30e1dec9a154)
I20260709 12:25:42.948962 26421 raft_consensus.cc:515] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:42.951278 26421 leader_election.cc:290] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
W20260709 12:25:42.956671 25335 leader_election.cc:336] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Network error: Client connection negotiation failed: client connection to 127.16.240.130:41903: connect: Connection refused (error 111)
W20260709 12:25:42.960170 25338 leader_election.cc:336] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Network error: Client connection negotiation failed: client connection to 127.16.240.131:45473: connect: Connection refused (error 111)
I20260709 12:25:42.960565 25338 leader_election.cc:304] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:42.961236 26426 raft_consensus.cc:2749] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:42.967825 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:42.968935 17346 tablet_replica.cc:333] T 8fd48573282443f78bd7580dcd9c4bc2 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:42.969972 17346 raft_consensus.cc:2243] T 8fd48573282443f78bd7580dcd9c4bc2 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.970654 17346 raft_consensus.cc:2272] T 8fd48573282443f78bd7580dcd9c4bc2 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.973861 17346 tablet_replica.cc:333] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:42.974825 17346 raft_consensus.cc:2243] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.975085 26421 raft_consensus.cc:493] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d3979c425abd4ac7b2ca30e1dec9a154)
I20260709 12:25:42.975499 17346 raft_consensus.cc:2272] T 2b324fb11adf4924bd497717bc12ff4c P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.975883 26421 raft_consensus.cc:515] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "a28f2edcd70f4eb08f16021ba3e2cf14" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 45473 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } }
I20260709 12:25:42.979247 17346 tablet_replica.cc:333] T 58caedf294044506b135b8990d49e180 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:42.979535 26421 leader_election.cc:290] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473)
I20260709 12:25:42.980430 17346 raft_consensus.cc:2243] T 58caedf294044506b135b8990d49e180 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.981652 17346 raft_consensus.cc:2272] T 58caedf294044506b135b8990d49e180 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.984429 25335 leader_election.cc:336] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Network error: Client connection negotiation failed: client connection to 127.16.240.130:41903: connect: Connection refused (error 111)
I20260709 12:25:42.984809 17346 tablet_replica.cc:333] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
W20260709 12:25:42.986110 25338 leader_election.cc:336] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a28f2edcd70f4eb08f16021ba3e2cf14 (127.16.240.131:45473): Network error: Client connection negotiation failed: client connection to 127.16.240.131:45473: connect: Connection refused (error 111)
I20260709 12:25:42.986567 25338 leader_election.cc:304] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: a28f2edcd70f4eb08f16021ba3e2cf14, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:42.986678 17346 raft_consensus.cc:2243] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.987353 17346 raft_consensus.cc:2272] T e01f82f06bdb4424b0d871882d6c8c3b P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.987296 26421 raft_consensus.cc:2749] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:42.990175 17346 tablet_replica.cc:333] T ef05435bfb3044ffb451ca8373c097c7 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:42.991062 17346 raft_consensus.cc:2243] T ef05435bfb3044ffb451ca8373c097c7 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.991766 17346 raft_consensus.cc:2272] T ef05435bfb3044ffb451ca8373c097c7 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.994819 17346 tablet_replica.cc:333] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:42.995617 17346 raft_consensus.cc:2243] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.996663 17346 raft_consensus.cc:2272] T ffa2c58c6d37474c908e6f924b95db30 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.000212 17346 tablet_replica.cc:333] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.001116 17346 raft_consensus.cc:2243] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.001698 17346 raft_consensus.cc:2272] T bf2bfe7ad58c42f1aff0feb1c9880d9b P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.002005 26421 raft_consensus.cc:493] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3979c425abd4ac7b2ca30e1dec9a154)
I20260709 12:25:43.002605 26421 raft_consensus.cc:515] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } } peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } }
I20260709 12:25:43.004474 17346 tablet_replica.cc:333] T eb4d589309f24d3e955fb45b2c6fe3af P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.004601 26421 leader_election.cc:290] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537), d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903)
I20260709 12:25:43.005434 17346 raft_consensus.cc:2243] T eb4d589309f24d3e955fb45b2c6fe3af P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.006078 17346 raft_consensus.cc:2272] T eb4d589309f24d3e955fb45b2c6fe3af P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.009071 17346 tablet_replica.cc:333] T 969efca8af254e2e885d546c22e637aa P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.009984 17346 raft_consensus.cc:2243] T 969efca8af254e2e885d546c22e637aa P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:43.010090 25338 leader_election.cc:336] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:43.010669 17346 raft_consensus.cc:2272] T 969efca8af254e2e885d546c22e637aa P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:43.010984 25335 leader_election.cc:336] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Network error: Client connection negotiation failed: client connection to 127.16.240.130:41903: connect: Connection refused (error 111)
I20260709 12:25:43.011512 25335 leader_election.cc:304] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:43.012229 26421 raft_consensus.cc:2749] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:43.013587 17346 tablet_replica.cc:333] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.014364 17346 raft_consensus.cc:2243] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.014779 17346 raft_consensus.cc:2272] T cc69e13d835645099f9e0e5bea99665a P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.016894 17346 tablet_replica.cc:333] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.017463 17346 raft_consensus.cc:2243] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:43.018282 17346 raft_consensus.cc:2272] T 3459b31870574ae4aa816cf5ee28162b P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.020560 17346 tablet_replica.cc:333] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.021279 17346 raft_consensus.cc:2243] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.021754 17346 raft_consensus.cc:2272] T 9d39dac4e3e343f2985681aa3c5e5718 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.023965 17346 tablet_replica.cc:333] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.024560 17346 raft_consensus.cc:2243] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.025024 17346 raft_consensus.cc:2272] T 63327743a40345e4b149aca740d0944a P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.027076 17346 tablet_replica.cc:333] T 1bf33e1087ea4e7f98b37dd2c130c635 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.027621 17346 raft_consensus.cc:2243] T 1bf33e1087ea4e7f98b37dd2c130c635 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.028144 17346 raft_consensus.cc:2272] T 1bf33e1087ea4e7f98b37dd2c130c635 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.030303 17346 tablet_replica.cc:333] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.030906 17346 raft_consensus.cc:2243] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.031342 17346 raft_consensus.cc:2272] T 5c47c723f1bb4cd7b3ca0e8376ebb5e8 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.033336 17346 tablet_replica.cc:333] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.034521 17346 raft_consensus.cc:2243] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:43.035725 17346 raft_consensus.cc:2272] T dcf5a5e68833468a8206894be4a16f56 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.037988 17346 tablet_replica.cc:333] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.038633 17346 raft_consensus.cc:2243] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:43.039451 17346 raft_consensus.cc:2272] T f50c1e80871a4f21a31521e37160b99f P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.041563 17346 tablet_replica.cc:333] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.042128 17346 raft_consensus.cc:2243] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:43.042949 17346 raft_consensus.cc:2272] T 192689638be442acb52df50f2137f664 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.044981 17346 tablet_replica.cc:333] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.045917 17346 raft_consensus.cc:2243] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:43.046970 17346 raft_consensus.cc:2272] T 4ae8b407c5d34cfb85a405355e2befda P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.049413 17346 tablet_replica.cc:333] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.050251 17346 raft_consensus.cc:2243] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:43.051115 17346 raft_consensus.cc:2272] T 8bc47554d5e54ab4826c21fdd6126df0 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.053944 17346 tablet_replica.cc:333] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.054837 17346 raft_consensus.cc:2243] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.055393 17346 raft_consensus.cc:2272] T d4f5d4fb33b4421daaf5b63cafcd4f4b P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.057492 17346 tablet_replica.cc:333] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.058072 17346 raft_consensus.cc:2243] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:43.058871 17346 raft_consensus.cc:2272] T 8fd0775b429544fcb31e2834c279b159 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.060896 17346 tablet_replica.cc:333] T 0190ce7515c34431903f97febee4323e P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.061486 17346 raft_consensus.cc:2243] T 0190ce7515c34431903f97febee4323e P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.061918 17346 raft_consensus.cc:2272] T 0190ce7515c34431903f97febee4323e P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.064154 17346 tablet_replica.cc:333] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.064708 17346 raft_consensus.cc:2243] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:43.065658 17346 raft_consensus.cc:2272] T 0d0304837699431197f7e780344f1093 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.069173 17346 tablet_replica.cc:333] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.069921 17346 raft_consensus.cc:2243] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.070596 17346 raft_consensus.cc:2272] T dbb0eab5dcee4f95b7c284dea379c795 P 0fa8f2c80074488084fea821c4bb293d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.072866 17346 tablet_replica.cc:333] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.074035 17346 raft_consensus.cc:2243] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.074654 17346 raft_consensus.cc:2272] T 354e6422b7944df78b231965e1774820 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.076828 17346 tablet_replica.cc:333] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.077418 17346 raft_consensus.cc:2243] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.077885 17346 raft_consensus.cc:2272] T 2bb84b6ee4f14cdc9a40ffd59ca4f42c P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.079847 17346 tablet_replica.cc:333] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.080425 17346 raft_consensus.cc:2243] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.080899 17346 raft_consensus.cc:2272] T cb9f447960df41a5ade2459879b92b17 P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.082929 17346 tablet_replica.cc:333] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.083472 17346 raft_consensus.cc:2243] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.083968 17346 raft_consensus.cc:2272] T 6b1f8b45199a40aeaf77fa2e23107375 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.086030 17346 tablet_replica.cc:333] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.086617 17346 raft_consensus.cc:2243] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:43.087455 17346 raft_consensus.cc:2272] T 272d9a9f4ef849db8e59fad827bc81d0 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.089946 17346 tablet_replica.cc:333] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.090572 17346 raft_consensus.cc:2243] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.091023 17346 raft_consensus.cc:2272] T 3ba86635097441c08a6ca206ab0bfe9a P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.093142 17346 tablet_replica.cc:333] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.093676 17346 raft_consensus.cc:2243] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:43.094472 17346 raft_consensus.cc:2272] T 752795059ef543b9a98b6dba09b04230 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.096439 17346 tablet_replica.cc:333] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.097074 17346 raft_consensus.cc:2243] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:43.097926 17346 raft_consensus.cc:2272] T a6ef2af3aa69454aa946797dc87d6e9d P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.099949 17346 tablet_replica.cc:333] T bffd5eeaa9c14effb9e1ffc29a23ff01 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.100490 17346 raft_consensus.cc:2243] T bffd5eeaa9c14effb9e1ffc29a23ff01 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.100927 17346 raft_consensus.cc:2272] T bffd5eeaa9c14effb9e1ffc29a23ff01 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.102876 17346 tablet_replica.cc:333] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.103420 17346 raft_consensus.cc:2243] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.103853 17346 raft_consensus.cc:2272] T 77d13683d814408081fbbece9be522ed P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.105865 17346 tablet_replica.cc:333] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.106403 17346 raft_consensus.cc:2243] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.106832 17346 raft_consensus.cc:2272] T 2dc0dd4f13f243639d68c6d9a0e3afd3 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.108814 17346 tablet_replica.cc:333] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.109329 17346 raft_consensus.cc:2243] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.109772 17346 raft_consensus.cc:2272] T 9c46968756c14269bc487ced0f6e74bd P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.111620 17346 tablet_replica.cc:333] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.112195 17346 raft_consensus.cc:2243] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:43.113003 17346 raft_consensus.cc:2272] T fc7a0e6ac8cd4e8eb2e4549b0f9b64f0 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.115142 17346 tablet_replica.cc:333] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.115705 17346 raft_consensus.cc:2243] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.116161 17346 raft_consensus.cc:2272] T 05b8c7cdce0c46fdb50c370f6f53001e P 0fa8f2c80074488084fea821c4bb293d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.118129 17346 tablet_replica.cc:333] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.118674 17346 raft_consensus.cc:2243] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:43.119201 26421 raft_consensus.cc:493] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3979c425abd4ac7b2ca30e1dec9a154)
I20260709 12:25:43.119515 17346 raft_consensus.cc:2272] T b349920766b74e3aa849cd67521bf887 P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.119711 26421 raft_consensus.cc:515] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3979c425abd4ac7b2ca30e1dec9a154" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 41903 } } peers { permanent_uuid: "0fa8f2c80074488084fea821c4bb293d" member_type: VOTER last_known_addr { host: "127.16.240.132" port: 40887 } } peers { permanent_uuid: "434d5783f9374eab8f587e0fe6c15b1c" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 38537 } }
I20260709 12:25:43.121826 26421 leader_election.cc:290] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903), 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537)
I20260709 12:25:43.121950 17346 tablet_replica.cc:333] T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.122824 17346 raft_consensus.cc:2243] T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.123311 17346 raft_consensus.cc:2272] T b1ea711322544c2999f94b52b35af150 P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:43.125844 25335 leader_election.cc:336] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d3979c425abd4ac7b2ca30e1dec9a154 (127.16.240.130:41903): Network error: Client connection negotiation failed: client connection to 127.16.240.130:41903: connect: Connection refused (error 111)
I20260709 12:25:43.126217 17346 tablet_replica.cc:333] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
W20260709 12:25:43.126359 25338 leader_election.cc:336] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 434d5783f9374eab8f587e0fe6c15b1c (127.16.240.129:38537): Network error: Client connection negotiation failed: client connection to 127.16.240.129:38537: connect: Connection refused (error 111)
I20260709 12:25:43.126786 25338 leader_election.cc:304] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fa8f2c80074488084fea821c4bb293d; no voters: 434d5783f9374eab8f587e0fe6c15b1c, d3979c425abd4ac7b2ca30e1dec9a154
I20260709 12:25:43.126895 17346 raft_consensus.cc:2243] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.127398 26421 raft_consensus.cc:2706] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Received pre-election callback for term 2 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:25:43.128049 17346 raft_consensus.cc:2272] T a616947e81bf446584593e882f8bdeaa P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.130899 17346 tablet_replica.cc:333] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.132046 17346 raft_consensus.cc:2243] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:43.133076 17346 raft_consensus.cc:2272] T ff3d2388e4f54ed59c7760fab0dfc1ec P 0fa8f2c80074488084fea821c4bb293d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.135308 17346 tablet_replica.cc:333] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d: stopping tablet replica
I20260709 12:25:43.135885 17346 raft_consensus.cc:2243] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:43.136349 17346 raft_consensus.cc:2272] T 83e2e1ecd7474df9add48f60c06a4a0f P 0fa8f2c80074488084fea821c4bb293d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.237639 17346 tablet_server.cc:196] TabletServer@127.16.240.132:0 shutdown complete.
I20260709 12:25:43.310205 17346 master.cc:562] Master@127.16.240.190:37775 shutting down...
I20260709 12:25:43.341843 17346 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:43.342464 17346 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:43.342819 17346 tablet_replica.cc:333] T 00000000000000000000000000000000 P b145ad0df8d04146b31731e3ff1e189c: stopping tablet replica
I20260709 12:25:43.366279 17346 master.cc:584] Master@127.16.240.190:37775 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (36154 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:25:43.468000 17346 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.240.190:44961
I20260709 12:25:43.469475 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:43.476292 26431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:43.476986 26433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:43.477118 26430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:43.478608 17346 server_base.cc:1061] running on GCE node
I20260709 12:25:43.480320 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:43.480547 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:43.480670 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599943480658 us; error 0 us; skew 500 ppm
I20260709 12:25:43.481178 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:43.483986 17346 webserver.cc:533] Webserver started at http://127.16.240.190:44139/ using document root <none> and password file <none>
I20260709 12:25:43.484496 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:43.484666 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:43.484915 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:43.486121 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/master-0-root/instance:
uuid: "238de6455f2246389d22370102f7128f"
format_stamp: "Formatted at 2026-07-09 12:25:43 on dist-test-slave-7xpw"
I20260709 12:25:43.492568 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:25:43.496385 26438 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:43.497169 17346 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 12:25:43.497434 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/master-0-root
uuid: "238de6455f2246389d22370102f7128f"
format_stamp: "Formatted at 2026-07-09 12:25:43 on dist-test-slave-7xpw"
I20260709 12:25:43.497700 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:43.523187 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:43.524897 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:43.568013 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.190:44961
I20260709 12:25:43.568058 26490 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.190:44961 every 8 connection(s)
I20260709 12:25:43.572713 26491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:43.584637 26491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f: Bootstrap starting.
I20260709 12:25:43.590610 26491 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.595310 26491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f: No bootstrap required, opened a new log
I20260709 12:25:43.597759 26491 raft_consensus.cc:359] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "238de6455f2246389d22370102f7128f" member_type: VOTER }
I20260709 12:25:43.598242 26491 raft_consensus.cc:385] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.598464 26491 raft_consensus.cc:740] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 238de6455f2246389d22370102f7128f, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.599151 26491 consensus_queue.cc:260] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "238de6455f2246389d22370102f7128f" member_type: VOTER }
I20260709 12:25:43.599700 26491 raft_consensus.cc:399] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:43.600009 26491 raft_consensus.cc:493] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:43.600287 26491 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.605980 26491 raft_consensus.cc:515] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "238de6455f2246389d22370102f7128f" member_type: VOTER }
I20260709 12:25:43.606570 26491 leader_election.cc:304] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 238de6455f2246389d22370102f7128f; no voters: 
I20260709 12:25:43.607828 26491 leader_election.cc:290] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:43.608301 26494 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:43.609741 26494 raft_consensus.cc:697] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f [term 1 LEADER]: Becoming Leader. State: Replica: 238de6455f2246389d22370102f7128f, State: Running, Role: LEADER
I20260709 12:25:43.610481 26494 consensus_queue.cc:237] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "238de6455f2246389d22370102f7128f" member_type: VOTER }
I20260709 12:25:43.610939 26491 sys_catalog.cc:565] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:43.615687 26496 sys_catalog.cc:455] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 238de6455f2246389d22370102f7128f. Latest consensus state: current_term: 1 leader_uuid: "238de6455f2246389d22370102f7128f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "238de6455f2246389d22370102f7128f" member_type: VOTER } }
I20260709 12:25:43.616125 26495 sys_catalog.cc:455] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "238de6455f2246389d22370102f7128f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "238de6455f2246389d22370102f7128f" member_type: VOTER } }
I20260709 12:25:43.616762 26496 sys_catalog.cc:458] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:43.616977 26495 sys_catalog.cc:458] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:43.619515 26502 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:43.624612 26502 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:43.628362 17346 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:43.635071 26502 catalog_manager.cc:1383] Generated new cluster ID: d2b73f02fde14018a304712001b313ca
I20260709 12:25:43.635412 26502 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:43.654558 26502 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:43.656023 26502 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:43.672207 26502 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f: Generated new TSK 0
I20260709 12:25:43.672906 26502 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:43.696623 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:43.703908 26512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:43.704809 26513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:43.706993 26515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:43.707046 17346 server_base.cc:1061] running on GCE node
I20260709 12:25:43.708828 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:43.709141 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:43.709360 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599943709325 us; error 0 us; skew 500 ppm
I20260709 12:25:43.710098 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:43.713383 17346 webserver.cc:533] Webserver started at http://127.16.240.129:41773/ using document root <none> and password file <none>
I20260709 12:25:43.713975 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:43.714190 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:43.714466 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:43.715672 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/ts-0-root/instance:
uuid: "0124e3cddc0049cd893bbd46dd123386"
format_stamp: "Formatted at 2026-07-09 12:25:43 on dist-test-slave-7xpw"
I20260709 12:25:43.720418 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:25:43.724464 26520 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:43.725500 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:25:43.726048 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/ts-0-root
uuid: "0124e3cddc0049cd893bbd46dd123386"
format_stamp: "Formatted at 2026-07-09 12:25:43 on dist-test-slave-7xpw"
I20260709 12:25:43.726330 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:43.768076 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:43.769263 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:43.770982 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:43.773628 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:43.773833 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:43.774118 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:43.774312 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:43.824397 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.129:45903
I20260709 12:25:43.824524 26583 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.129:45903 every 8 connection(s)
I20260709 12:25:43.830612 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:43.839210 26589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:43.841583 26588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:43.843331 26591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:43.845260 17346 server_base.cc:1061] running on GCE node
I20260709 12:25:43.846657 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:43.846958 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:43.847183 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599943847160 us; error 0 us; skew 500 ppm
I20260709 12:25:43.848026 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:43.848809 26584 heartbeater.cc:344] Connected to a master server at 127.16.240.190:44961
I20260709 12:25:43.849212 26584 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:43.850123 26584 heartbeater.cc:507] Master 127.16.240.190:44961 requested a full tablet report, sending...
I20260709 12:25:43.851209 17346 webserver.cc:533] Webserver started at http://127.16.240.130:33995/ using document root <none> and password file <none>
I20260709 12:25:43.852131 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:43.852406 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:43.852741 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:43.853297 26455 ts_manager.cc:194] Registered new tserver with Master: 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903)
I20260709 12:25:43.854417 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/ts-1-root/instance:
uuid: "0103ef679011427d9901c6debd71d0ee"
format_stamp: "Formatted at 2026-07-09 12:25:43 on dist-test-slave-7xpw"
I20260709 12:25:43.855948 26455 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33670
I20260709 12:25:43.860339 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:25:43.864341 26596 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:43.865167 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:25:43.865521 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/ts-1-root
uuid: "0103ef679011427d9901c6debd71d0ee"
format_stamp: "Formatted at 2026-07-09 12:25:43 on dist-test-slave-7xpw"
I20260709 12:25:43.865813 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:43.886752 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:43.888103 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:43.889614 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:43.892025 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:43.892251 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:43.892503 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:43.892678 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:43.939734 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.130:44215
I20260709 12:25:43.939977 26658 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.130:44215 every 8 connection(s)
I20260709 12:25:43.944839 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:43.952731 26662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:43.953832 26663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:43.958491 26665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:43.958717 17346 server_base.cc:1061] running on GCE node
I20260709 12:25:43.959684 26659 heartbeater.cc:344] Connected to a master server at 127.16.240.190:44961
I20260709 12:25:43.960143 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:25:43.960273 26659 heartbeater.cc:461] Registering TS with master...
W20260709 12:25:43.960554 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:43.960808 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599943960785 us; error 0 us; skew 500 ppm
I20260709 12:25:43.961395 26659 heartbeater.cc:507] Master 127.16.240.190:44961 requested a full tablet report, sending...
I20260709 12:25:43.961786 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:43.964702 26455 ts_manager.cc:194] Registered new tserver with Master: 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215)
I20260709 12:25:43.965255 17346 webserver.cc:533] Webserver started at http://127.16.240.131:36833/ using document root <none> and password file <none>
I20260709 12:25:43.965986 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:43.966228 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:43.966534 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:43.966666 26455 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33682
I20260709 12:25:43.968104 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/ts-2-root/instance:
uuid: "5756baf49a8d4598ba0a5e87d70af089"
format_stamp: "Formatted at 2026-07-09 12:25:43 on dist-test-slave-7xpw"
I20260709 12:25:43.973695 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:25:43.977398 26670 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:43.978351 17346 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:25:43.978652 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/ts-2-root
uuid: "5756baf49a8d4598ba0a5e87d70af089"
format_stamp: "Formatted at 2026-07-09 12:25:43 on dist-test-slave-7xpw"
I20260709 12:25:43.978936 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:43.999938 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:44.001168 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:44.002457 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:44.004904 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:44.005162 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:44.005465 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:44.005678 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:44.056034 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.131:41747
I20260709 12:25:44.056056 26733 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.131:41747 every 8 connection(s)
I20260709 12:25:44.072875 26734 heartbeater.cc:344] Connected to a master server at 127.16.240.190:44961
I20260709 12:25:44.073468 26734 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:44.074409 26734 heartbeater.cc:507] Master 127.16.240.190:44961 requested a full tablet report, sending...
I20260709 12:25:44.076771 26455 ts_manager.cc:194] Registered new tserver with Master: 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:44.077905 17346 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018233318s
I20260709 12:25:44.078341 26455 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33698
I20260709 12:25:44.107267 26455 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33714:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:44.110345 26455 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:44.190709 26549 tablet_service.cc:1511] Processing CreateTablet for tablet c23edbfdff914fcdbe4fa0cd9267c789 (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:44.192695 26549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c23edbfdff914fcdbe4fa0cd9267c789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.197537 26548 tablet_service.cc:1511] Processing CreateTablet for tablet 8652951dd9794f5ba96237691f61617a (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:44.199452 26548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8652951dd9794f5ba96237691f61617a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.200991 26547 tablet_service.cc:1511] Processing CreateTablet for tablet ec619159fb614124adfd72bc4b8763ce (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:44.202543 26547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec619159fb614124adfd72bc4b8763ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.204169 26624 tablet_service.cc:1511] Processing CreateTablet for tablet c23edbfdff914fcdbe4fa0cd9267c789 (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:44.205605 26622 tablet_service.cc:1511] Processing CreateTablet for tablet ec619159fb614124adfd72bc4b8763ce (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:44.206564 26624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c23edbfdff914fcdbe4fa0cd9267c789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.207945 26623 tablet_service.cc:1511] Processing CreateTablet for tablet 8652951dd9794f5ba96237691f61617a (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:44.208936 26621 tablet_service.cc:1511] Processing CreateTablet for tablet 40f10e687e5d47ab94cff8a28641c03d (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:44.209487 26623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8652951dd9794f5ba96237691f61617a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.210351 26621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f10e687e5d47ab94cff8a28641c03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.212975 26622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec619159fb614124adfd72bc4b8763ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.216252 26620 tablet_service.cc:1511] Processing CreateTablet for tablet 606a6f609e4d4a6da9e2f288bbaaa0f8 (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:44.217883 26620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 606a6f609e4d4a6da9e2f288bbaaa0f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.222254 26619 tablet_service.cc:1511] Processing CreateTablet for tablet dd2b9d6bc39a43d39212393ed0834a8e (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:44.224085 26619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd2b9d6bc39a43d39212393ed0834a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.231527 26618 tablet_service.cc:1511] Processing CreateTablet for tablet 27f734d1b5a04b0abd7ad8eab8b08a39 (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:44.233577 26618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27f734d1b5a04b0abd7ad8eab8b08a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.234514 26699 tablet_service.cc:1511] Processing CreateTablet for tablet c23edbfdff914fcdbe4fa0cd9267c789 (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:44.234558 26546 tablet_service.cc:1511] Processing CreateTablet for tablet 40f10e687e5d47ab94cff8a28641c03d (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:44.236356 26699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c23edbfdff914fcdbe4fa0cd9267c789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.236622 26546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f10e687e5d47ab94cff8a28641c03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.237237 26617 tablet_service.cc:1511] Processing CreateTablet for tablet 4acfec5dd12c4ab8a20a580682d2a42a (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:44.238653 26617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4acfec5dd12c4ab8a20a580682d2a42a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.238483 26544 tablet_service.cc:1511] Processing CreateTablet for tablet dd2b9d6bc39a43d39212393ed0834a8e (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:44.241022 26543 tablet_service.cc:1511] Processing CreateTablet for tablet 27f734d1b5a04b0abd7ad8eab8b08a39 (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:44.243417 26545 tablet_service.cc:1511] Processing CreateTablet for tablet 606a6f609e4d4a6da9e2f288bbaaa0f8 (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:44.245136 26544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd2b9d6bc39a43d39212393ed0834a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.248268 26545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 606a6f609e4d4a6da9e2f288bbaaa0f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.249807 26543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27f734d1b5a04b0abd7ad8eab8b08a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.251967 26542 tablet_service.cc:1511] Processing CreateTablet for tablet 4acfec5dd12c4ab8a20a580682d2a42a (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:44.252200 26698 tablet_service.cc:1511] Processing CreateTablet for tablet 8652951dd9794f5ba96237691f61617a (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:44.254359 26698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8652951dd9794f5ba96237691f61617a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.254519 26542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4acfec5dd12c4ab8a20a580682d2a42a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.258231 26697 tablet_service.cc:1511] Processing CreateTablet for tablet ec619159fb614124adfd72bc4b8763ce (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:44.259856 26697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec619159fb614124adfd72bc4b8763ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.273617 26696 tablet_service.cc:1511] Processing CreateTablet for tablet 40f10e687e5d47ab94cff8a28641c03d (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:44.274621 26616 tablet_service.cc:1511] Processing CreateTablet for tablet dc0e14b9fa7944bcab2242e920f8a51e (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:44.275404 26696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f10e687e5d47ab94cff8a28641c03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.276244 26616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc0e14b9fa7944bcab2242e920f8a51e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.280857 26615 tablet_service.cc:1511] Processing CreateTablet for tablet 985db528c3f741df95fe12330c6f0e1f (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:44.282398 26615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985db528c3f741df95fe12330c6f0e1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.286585 26695 tablet_service.cc:1511] Processing CreateTablet for tablet 606a6f609e4d4a6da9e2f288bbaaa0f8 (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:44.288136 26695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 606a6f609e4d4a6da9e2f288bbaaa0f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.293131 26750 tablet_bootstrap.cc:492] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386: Bootstrap starting.
I20260709 12:25:44.293694 26694 tablet_service.cc:1511] Processing CreateTablet for tablet dd2b9d6bc39a43d39212393ed0834a8e (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:44.295324 26694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd2b9d6bc39a43d39212393ed0834a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.300887 26750 tablet_bootstrap.cc:654] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.309218 26693 tablet_service.cc:1511] Processing CreateTablet for tablet 27f734d1b5a04b0abd7ad8eab8b08a39 (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:44.311058 26693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27f734d1b5a04b0abd7ad8eab8b08a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.358947 26546 tablet_service.cc:1511] Processing CreateTablet for tablet dc0e14b9fa7944bcab2242e920f8a51e (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:44.360443 26546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc0e14b9fa7944bcab2242e920f8a51e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.361877 26692 tablet_service.cc:1511] Processing CreateTablet for tablet 4acfec5dd12c4ab8a20a580682d2a42a (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:44.363276 26692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4acfec5dd12c4ab8a20a580682d2a42a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.371706 26541 tablet_service.cc:1511] Processing CreateTablet for tablet 985db528c3f741df95fe12330c6f0e1f (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:44.373770 26541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985db528c3f741df95fe12330c6f0e1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.377139 26690 tablet_service.cc:1511] Processing CreateTablet for tablet 985db528c3f741df95fe12330c6f0e1f (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:44.379441 26691 tablet_service.cc:1511] Processing CreateTablet for tablet dc0e14b9fa7944bcab2242e920f8a51e (DEFAULT_TABLE table=test-workload [id=3e9849afaec24627906663c3287c8602]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:44.388445 26691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc0e14b9fa7944bcab2242e920f8a51e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.392352 26690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985db528c3f741df95fe12330c6f0e1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.441668 26750 tablet_bootstrap.cc:492] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386: No bootstrap required, opened a new log
I20260709 12:25:44.442287 26750 ts_tablet_manager.cc:1403] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386: Time spent bootstrapping tablet: real 0.150s	user 0.046s	sys 0.070s
I20260709 12:25:44.449637 26750 raft_consensus.cc:359] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.450522 26750 raft_consensus.cc:385] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.450834 26750 raft_consensus.cc:740] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0124e3cddc0049cd893bbd46dd123386, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.470134 26749 tablet_bootstrap.cc:492] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee: Bootstrap starting.
I20260709 12:25:44.485662 26752 tablet_bootstrap.cc:492] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089: Bootstrap starting.
I20260709 12:25:44.492787 26752 tablet_bootstrap.cc:654] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.483230 26750 consensus_queue.cc:260] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.504935 26750 ts_tablet_manager.cc:1434] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.004s
I20260709 12:25:44.506702 26584 heartbeater.cc:499] Master 127.16.240.190:44961 was elected leader, sending a full tablet report...
I20260709 12:25:44.508069 26750 tablet_bootstrap.cc:492] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386: Bootstrap starting.
I20260709 12:25:44.506700 26749 tablet_bootstrap.cc:654] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.515125 26750 tablet_bootstrap.cc:654] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.518020 26752 tablet_bootstrap.cc:492] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089: No bootstrap required, opened a new log
I20260709 12:25:44.518538 26752 ts_tablet_manager.cc:1403] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.011s
I20260709 12:25:44.522073 26752 raft_consensus.cc:359] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.523267 26752 raft_consensus.cc:385] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.523703 26752 raft_consensus.cc:740] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.525072 26752 consensus_queue.cc:260] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.527417 26750 tablet_bootstrap.cc:492] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386: No bootstrap required, opened a new log
I20260709 12:25:44.528128 26750 ts_tablet_manager.cc:1403] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 12:25:44.534350 26749 tablet_bootstrap.cc:492] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee: No bootstrap required, opened a new log
I20260709 12:25:44.534885 26749 ts_tablet_manager.cc:1403] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.010s
I20260709 12:25:44.531330 26750 raft_consensus.cc:359] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } }
I20260709 12:25:44.536329 26750 raft_consensus.cc:385] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.536734 26750 raft_consensus.cc:740] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0124e3cddc0049cd893bbd46dd123386, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.537775 26750 consensus_queue.cc:260] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } }
I20260709 12:25:44.537945 26749 raft_consensus.cc:359] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.538719 26749 raft_consensus.cc:385] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.539040 26749 raft_consensus.cc:740] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.539927 26749 consensus_queue.cc:260] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.540925 26750 ts_tablet_manager.cc:1434] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:25:44.542356 26750 tablet_bootstrap.cc:492] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386: Bootstrap starting.
I20260709 12:25:44.544548 26752 ts_tablet_manager.cc:1434] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089: Time spent starting tablet: real 0.026s	user 0.015s	sys 0.011s
I20260709 12:25:44.545362 26734 heartbeater.cc:499] Master 127.16.240.190:44961 was elected leader, sending a full tablet report...
I20260709 12:25:44.545768 26752 tablet_bootstrap.cc:492] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089: Bootstrap starting.
I20260709 12:25:44.553887 26752 tablet_bootstrap.cc:654] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:44.561488 26735 tablet.cc:2406] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:25:44.563225 26659 heartbeater.cc:499] Master 127.16.240.190:44961 was elected leader, sending a full tablet report...
I20260709 12:25:44.563731 26750 tablet_bootstrap.cc:654] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.564685 26749 ts_tablet_manager.cc:1434] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee: Time spent starting tablet: real 0.030s	user 0.013s	sys 0.009s
I20260709 12:25:44.566536 26749 tablet_bootstrap.cc:492] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee: Bootstrap starting.
I20260709 12:25:44.574615 26749 tablet_bootstrap.cc:654] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.575160 26752 tablet_bootstrap.cc:492] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089: No bootstrap required, opened a new log
I20260709 12:25:44.575867 26752 ts_tablet_manager.cc:1403] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.001s
I20260709 12:25:44.579224 26752 raft_consensus.cc:359] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } }
I20260709 12:25:44.580124 26752 raft_consensus.cc:385] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.580204 26750 tablet_bootstrap.cc:492] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386: No bootstrap required, opened a new log
I20260709 12:25:44.580678 26752 raft_consensus.cc:740] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.580911 26750 ts_tablet_manager.cc:1403] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.008s
I20260709 12:25:44.581713 26752 consensus_queue.cc:260] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } }
I20260709 12:25:44.583259 26749 tablet_bootstrap.cc:492] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee: No bootstrap required, opened a new log
I20260709 12:25:44.583873 26749 ts_tablet_manager.cc:1403] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.002s
I20260709 12:25:44.584575 26752 ts_tablet_manager.cc:1434] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:44.584385 26750 raft_consensus.cc:359] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.585497 26750 raft_consensus.cc:385] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.585896 26750 raft_consensus.cc:740] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0124e3cddc0049cd893bbd46dd123386, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.586563 26752 tablet_bootstrap.cc:492] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 5756baf49a8d4598ba0a5e87d70af089: Bootstrap starting.
I20260709 12:25:44.586862 26750 consensus_queue.cc:260] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.587085 26749 raft_consensus.cc:359] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.588093 26749 raft_consensus.cc:385] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.588435 26749 raft_consensus.cc:740] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.589475 26750 ts_tablet_manager.cc:1434] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:44.589342 26749 consensus_queue.cc:260] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.590682 26750 tablet_bootstrap.cc:492] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386: Bootstrap starting.
I20260709 12:25:44.591929 26749 ts_tablet_manager.cc:1434] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:44.593015 26749 tablet_bootstrap.cc:492] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee: Bootstrap starting.
I20260709 12:25:44.593967 26753 raft_consensus.cc:493] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.594527 26753 raft_consensus.cc:515] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.595556 26752 tablet_bootstrap.cc:654] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 5756baf49a8d4598ba0a5e87d70af089: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.598544 26750 tablet_bootstrap.cc:654] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.600265 26749 tablet_bootstrap.cc:654] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.608011 26753 leader_election.cc:290] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:44.613216 26749 tablet_bootstrap.cc:492] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee: No bootstrap required, opened a new log
I20260709 12:25:44.614001 26749 ts_tablet_manager.cc:1403] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.011s
I20260709 12:25:44.617981 26749 raft_consensus.cc:359] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.618816 26749 raft_consensus.cc:385] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.619113 26749 raft_consensus.cc:740] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.620005 26749 consensus_queue.cc:260] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.622666 26749 ts_tablet_manager.cc:1434] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.005s
W20260709 12:25:44.623689 26504 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:44.623710 26749 tablet_bootstrap.cc:492] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee: Bootstrap starting.
I20260709 12:25:44.632184 26753 raft_consensus.cc:493] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.632922 26753 raft_consensus.cc:515] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } }
I20260709 12:25:44.635349 26753 leader_election.cc:290] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747), 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215)
I20260709 12:25:44.639977 26749 tablet_bootstrap.cc:654] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.654136 26634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f10e687e5d47ab94cff8a28641c03d" candidate_uuid: "0124e3cddc0049cd893bbd46dd123386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0103ef679011427d9901c6debd71d0ee" is_pre_election: true
W20260709 12:25:44.656055 26521 leader_election.cc:343] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:44.657354 26634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23edbfdff914fcdbe4fa0cd9267c789" candidate_uuid: "0124e3cddc0049cd893bbd46dd123386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0103ef679011427d9901c6debd71d0ee" is_pre_election: true
W20260709 12:25:44.658903 26521 leader_election.cc:343] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:44.663303 26750 tablet_bootstrap.cc:492] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386: No bootstrap required, opened a new log
I20260709 12:25:44.663522 26752 tablet_bootstrap.cc:492] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 5756baf49a8d4598ba0a5e87d70af089: No bootstrap required, opened a new log
I20260709 12:25:44.664284 26750 ts_tablet_manager.cc:1403] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386: Time spent bootstrapping tablet: real 0.074s	user 0.026s	sys 0.046s
I20260709 12:25:44.667798 26749 tablet_bootstrap.cc:492] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee: No bootstrap required, opened a new log
I20260709 12:25:44.664322 26752 ts_tablet_manager.cc:1403] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 5756baf49a8d4598ba0a5e87d70af089: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.039s
I20260709 12:25:44.668440 26750 raft_consensus.cc:359] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.669301 26750 raft_consensus.cc:385] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.669625 26750 raft_consensus.cc:740] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0124e3cddc0049cd893bbd46dd123386, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.670424 26750 consensus_queue.cc:260] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.668440 26749 ts_tablet_manager.cc:1403] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.008s
I20260709 12:25:44.672875 26750 ts_tablet_manager.cc:1434] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:44.674015 26750 tablet_bootstrap.cc:492] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386: Bootstrap starting.
I20260709 12:25:44.671543 26752 raft_consensus.cc:359] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.675100 26752 raft_consensus.cc:385] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.675423 26752 raft_consensus.cc:740] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.676548 26709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f10e687e5d47ab94cff8a28641c03d" candidate_uuid: "0124e3cddc0049cd893bbd46dd123386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089" is_pre_election: true
I20260709 12:25:44.677332 26709 raft_consensus.cc:2468] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0124e3cddc0049cd893bbd46dd123386 in term 0.
I20260709 12:25:44.677851 26749 raft_consensus.cc:359] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.678740 26749 raft_consensus.cc:385] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.679041 26749 raft_consensus.cc:740] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.678879 26708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23edbfdff914fcdbe4fa0cd9267c789" candidate_uuid: "0124e3cddc0049cd893bbd46dd123386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089" is_pre_election: true
I20260709 12:25:44.680418 26708 raft_consensus.cc:2468] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0124e3cddc0049cd893bbd46dd123386 in term 0.
I20260709 12:25:44.680361 26749 consensus_queue.cc:260] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.681454 26750 tablet_bootstrap.cc:654] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.682966 26749 ts_tablet_manager.cc:1434] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:25:44.682873 26522 leader_election.cc:304] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0124e3cddc0049cd893bbd46dd123386, 5756baf49a8d4598ba0a5e87d70af089; no voters: 0103ef679011427d9901c6debd71d0ee
I20260709 12:25:44.684022 26753 raft_consensus.cc:2804] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:44.684213 26749 tablet_bootstrap.cc:492] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee: Bootstrap starting.
I20260709 12:25:44.684446 26753 raft_consensus.cc:493] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.684882 26753 raft_consensus.cc:3060] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.691537 26522 leader_election.cc:304] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0124e3cddc0049cd893bbd46dd123386, 5756baf49a8d4598ba0a5e87d70af089; no voters: 0103ef679011427d9901c6debd71d0ee
I20260709 12:25:44.695852 26749 tablet_bootstrap.cc:654] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.701361 26753 raft_consensus.cc:515] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.703326 26753 leader_election.cc:290] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [CANDIDATE]: Term 1 election: Requested vote from peers 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:44.704417 26634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f10e687e5d47ab94cff8a28641c03d" candidate_uuid: "0124e3cddc0049cd893bbd46dd123386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0103ef679011427d9901c6debd71d0ee"
I20260709 12:25:44.705252 26634 raft_consensus.cc:3060] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.676282 26752 consensus_queue.cc:260] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 5756baf49a8d4598ba0a5e87d70af089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.709463 26752 ts_tablet_manager.cc:1434] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 5756baf49a8d4598ba0a5e87d70af089: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 12:25:44.710666 26752 tablet_bootstrap.cc:492] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089: Bootstrap starting.
I20260709 12:25:44.716042 26753 raft_consensus.cc:2804] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:44.716550 26753 raft_consensus.cc:493] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.716892 26753 raft_consensus.cc:3060] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.719167 26634 raft_consensus.cc:2468] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0124e3cddc0049cd893bbd46dd123386 in term 1.
I20260709 12:25:44.719461 26708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f10e687e5d47ab94cff8a28641c03d" candidate_uuid: "0124e3cddc0049cd893bbd46dd123386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
I20260709 12:25:44.720211 26708 raft_consensus.cc:3060] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.723308 26749 tablet_bootstrap.cc:492] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee: No bootstrap required, opened a new log
I20260709 12:25:44.724251 26749 ts_tablet_manager.cc:1403] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.004s
I20260709 12:25:44.725811 26758 raft_consensus.cc:493] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.726401 26758 raft_consensus.cc:515] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.729298 26758 leader_election.cc:290] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:44.729902 26749 raft_consensus.cc:359] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.731202 26749 raft_consensus.cc:385] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.731686 26749 raft_consensus.cc:740] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.732645 26757 raft_consensus.cc:493] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.733525 26757 raft_consensus.cc:515] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.734012 26749 consensus_queue.cc:260] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.736130 26521 leader_election.cc:304] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 0124e3cddc0049cd893bbd46dd123386; no voters: 
I20260709 12:25:44.737317 26769 raft_consensus.cc:2804] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:44.737676 26749 ts_tablet_manager.cc:1434] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:25:44.738106 26750 tablet_bootstrap.cc:492] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386: No bootstrap required, opened a new log
I20260709 12:25:44.738677 26750 ts_tablet_manager.cc:1403] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386: Time spent bootstrapping tablet: real 0.065s	user 0.029s	sys 0.033s
I20260709 12:25:44.738896 26749 tablet_bootstrap.cc:492] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee: Bootstrap starting.
I20260709 12:25:44.741984 26750 raft_consensus.cc:359] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.742857 26752 tablet_bootstrap.cc:654] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.742868 26750 raft_consensus.cc:385] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.743600 26750 raft_consensus.cc:740] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0124e3cddc0049cd893bbd46dd123386, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.744758 26757 leader_election.cc:290] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215)
I20260709 12:25:44.744637 26750 consensus_queue.cc:260] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.739392 26753 raft_consensus.cc:515] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } }
I20260709 12:25:44.750291 26753 leader_election.cc:290] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [CANDIDATE]: Term 1 election: Requested vote from peers 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747), 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215)
I20260709 12:25:44.750428 26749 tablet_bootstrap.cc:654] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.751643 26634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23edbfdff914fcdbe4fa0cd9267c789" candidate_uuid: "0124e3cddc0049cd893bbd46dd123386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0103ef679011427d9901c6debd71d0ee"
W20260709 12:25:44.755498 26521 leader_election.cc:343] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:44.774477 26634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606a6f609e4d4a6da9e2f288bbaaa0f8" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0103ef679011427d9901c6debd71d0ee" is_pre_election: true
W20260709 12:25:44.777113 26671 leader_election.cc:343] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:44.787842 26758 raft_consensus.cc:493] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.788622 26758 raft_consensus.cc:515] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.791384 26758 leader_election.cc:290] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:44.797482 26769 raft_consensus.cc:697] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [term 1 LEADER]: Becoming Leader. State: Replica: 0124e3cddc0049cd893bbd46dd123386, State: Running, Role: LEADER
I20260709 12:25:44.799199 26769 consensus_queue.cc:237] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.806977 26709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23edbfdff914fcdbe4fa0cd9267c789" candidate_uuid: "0124e3cddc0049cd893bbd46dd123386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
I20260709 12:25:44.808035 26709 raft_consensus.cc:3060] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.821527 26708 raft_consensus.cc:2468] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0124e3cddc0049cd893bbd46dd123386 in term 1.
I20260709 12:25:44.829198 26749 tablet_bootstrap.cc:492] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee: No bootstrap required, opened a new log
I20260709 12:25:44.833015 26749 ts_tablet_manager.cc:1403] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee: Time spent bootstrapping tablet: real 0.094s	user 0.017s	sys 0.027s
I20260709 12:25:44.840296 26749 raft_consensus.cc:359] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.834167 26709 raft_consensus.cc:2468] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0124e3cddc0049cd893bbd46dd123386 in term 1.
I20260709 12:25:44.857317 26749 raft_consensus.cc:385] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.857950 26749 raft_consensus.cc:740] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.859203 26749 consensus_queue.cc:260] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.859887 26522 leader_election.cc:304] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0124e3cddc0049cd893bbd46dd123386, 5756baf49a8d4598ba0a5e87d70af089; no voters: 0103ef679011427d9901c6debd71d0ee
I20260709 12:25:44.847507 26559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606a6f609e4d4a6da9e2f288bbaaa0f8" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0124e3cddc0049cd893bbd46dd123386" is_pre_election: true
I20260709 12:25:44.868306 26749 ts_tablet_manager.cc:1434] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 12:25:44.869791 26749 tablet_bootstrap.cc:492] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee: Bootstrap starting.
W20260709 12:25:44.869800 26672 leader_election.cc:343] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:44.870888 26773 raft_consensus.cc:2804] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:44.871114 26672 leader_election.cc:304] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5756baf49a8d4598ba0a5e87d70af089; no voters: 0103ef679011427d9901c6debd71d0ee, 0124e3cddc0049cd893bbd46dd123386
I20260709 12:25:44.871737 26773 raft_consensus.cc:697] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [term 1 LEADER]: Becoming Leader. State: Replica: 0124e3cddc0049cd893bbd46dd123386, State: Running, Role: LEADER
I20260709 12:25:44.873185 26757 raft_consensus.cc:2749] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:44.872959 26773 consensus_queue.cc:237] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } }
I20260709 12:25:44.880371 26709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec619159fb614124adfd72bc4b8763ce" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089" is_pre_election: true
I20260709 12:25:44.888062 26749 tablet_bootstrap.cc:654] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.891870 26709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4acfec5dd12c4ab8a20a580682d2a42a" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089" is_pre_election: true
W20260709 12:25:44.900662 26598 leader_election.cc:343] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:44.901892 26598 leader_election.cc:343] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:44.903568 26749 tablet_bootstrap.cc:492] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee: No bootstrap required, opened a new log
I20260709 12:25:44.904333 26749 ts_tablet_manager.cc:1403] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.006s
I20260709 12:25:44.910410 26750 ts_tablet_manager.cc:1434] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386: Time spent starting tablet: real 0.171s	user 0.055s	sys 0.100s
I20260709 12:25:44.912446 26750 tablet_bootstrap.cc:492] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386: Bootstrap starting.
I20260709 12:25:44.912886 26752 tablet_bootstrap.cc:492] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089: No bootstrap required, opened a new log
I20260709 12:25:44.912956 26749 raft_consensus.cc:359] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.913671 26752 ts_tablet_manager.cc:1403] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089: Time spent bootstrapping tablet: real 0.203s	user 0.091s	sys 0.077s
I20260709 12:25:44.914031 26749 raft_consensus.cc:385] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.914446 26749 raft_consensus.cc:740] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.915467 26749 consensus_queue.cc:260] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
W20260709 12:25:44.917619 26781 log.cc:927] Time spent T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:25:44.917315 26752 raft_consensus.cc:359] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.921156 26752 raft_consensus.cc:385] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.918298 26749 ts_tablet_manager.cc:1434] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:25:44.922582 26750 tablet_bootstrap.cc:654] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.922892 26749 tablet_bootstrap.cc:492] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee: Bootstrap starting.
I20260709 12:25:44.922770 26559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec619159fb614124adfd72bc4b8763ce" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0124e3cddc0049cd893bbd46dd123386" is_pre_election: true
I20260709 12:25:44.924701 26559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4acfec5dd12c4ab8a20a580682d2a42a" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0124e3cddc0049cd893bbd46dd123386" is_pre_election: true
I20260709 12:25:44.925360 26559 raft_consensus.cc:2468] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 0.
I20260709 12:25:44.930070 26455 catalog_manager.cc:5697] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "0124e3cddc0049cd893bbd46dd123386" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:44.921562 26752 raft_consensus.cc:740] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Initialized, Role: FOLLOWER
W20260709 12:25:44.932435 26598 leader_election.cc:343] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:44.933023 26598 leader_election.cc:304] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee; no voters: 0124e3cddc0049cd893bbd46dd123386, 5756baf49a8d4598ba0a5e87d70af089
I20260709 12:25:44.932690 26752 consensus_queue.cc:260] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.933928 26758 raft_consensus.cc:2749] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:44.935603 26598 leader_election.cc:304] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 0124e3cddc0049cd893bbd46dd123386; no voters: 5756baf49a8d4598ba0a5e87d70af089
I20260709 12:25:44.936209 26750 tablet_bootstrap.cc:492] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386: No bootstrap required, opened a new log
I20260709 12:25:44.936448 26758 raft_consensus.cc:2804] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:44.936920 26758 raft_consensus.cc:493] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.937377 26758 raft_consensus.cc:3060] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.938005 26752 ts_tablet_manager.cc:1434] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 12:25:44.939121 26752 tablet_bootstrap.cc:492] T dd2b9d6bc39a43d39212393ed0834a8e P 5756baf49a8d4598ba0a5e87d70af089: Bootstrap starting.
I20260709 12:25:44.936913 26750 ts_tablet_manager.cc:1403] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.000s
I20260709 12:25:44.946188 26749 tablet_bootstrap.cc:654] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.948942 26752 tablet_bootstrap.cc:654] T dd2b9d6bc39a43d39212393ed0834a8e P 5756baf49a8d4598ba0a5e87d70af089: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.951543 26758 raft_consensus.cc:515] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.959190 26559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4acfec5dd12c4ab8a20a580682d2a42a" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0124e3cddc0049cd893bbd46dd123386"
I20260709 12:25:44.960052 26559 raft_consensus.cc:3060] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.955446 26750 raft_consensus.cc:359] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.972834 26750 raft_consensus.cc:385] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.975841 26709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4acfec5dd12c4ab8a20a580682d2a42a" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
W20260709 12:25:44.978184 26598 leader_election.cc:343] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:44.979055 26750 raft_consensus.cc:740] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0124e3cddc0049cd893bbd46dd123386, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.983304 26758 leader_election.cc:290] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:44.980384 26750 consensus_queue.cc:260] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.986366 26750 ts_tablet_manager.cc:1434] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 12:25:44.988116 26559 raft_consensus.cc:2468] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 1.
I20260709 12:25:44.990005 26598 leader_election.cc:304] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 0124e3cddc0049cd893bbd46dd123386; no voters: 5756baf49a8d4598ba0a5e87d70af089
I20260709 12:25:44.991660 26758 raft_consensus.cc:2804] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:44.995406 26758 raft_consensus.cc:697] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Becoming Leader. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Running, Role: LEADER
I20260709 12:25:44.996677 26758 consensus_queue.cc:237] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:44.997568 26749 tablet_bootstrap.cc:492] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee: No bootstrap required, opened a new log
I20260709 12:25:44.998711 26749 ts_tablet_manager.cc:1403] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee: Time spent bootstrapping tablet: real 0.076s	user 0.030s	sys 0.030s
I20260709 12:25:45.000356 26455 catalog_manager.cc:5697] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "0124e3cddc0049cd893bbd46dd123386" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:45.001241 26749 raft_consensus.cc:359] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.001632 26750 tablet_bootstrap.cc:492] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386: Bootstrap starting.
I20260709 12:25:45.001902 26749 raft_consensus.cc:385] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.002276 26749 raft_consensus.cc:740] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.002925 26749 consensus_queue.cc:260] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.004925 26749 ts_tablet_manager.cc:1434] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 12:25:45.006299 26749 tablet_bootstrap.cc:492] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee: Bootstrap starting.
I20260709 12:25:45.009043 26752 tablet_bootstrap.cc:492] T dd2b9d6bc39a43d39212393ed0834a8e P 5756baf49a8d4598ba0a5e87d70af089: No bootstrap required, opened a new log
I20260709 12:25:45.009894 26752 ts_tablet_manager.cc:1403] T dd2b9d6bc39a43d39212393ed0834a8e P 5756baf49a8d4598ba0a5e87d70af089: Time spent bootstrapping tablet: real 0.071s	user 0.033s	sys 0.021s
I20260709 12:25:45.009145 26750 tablet_bootstrap.cc:654] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.014001 26749 tablet_bootstrap.cc:654] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.013757 26752 raft_consensus.cc:359] T dd2b9d6bc39a43d39212393ed0834a8e P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.014575 26752 raft_consensus.cc:385] T dd2b9d6bc39a43d39212393ed0834a8e P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.014952 26752 raft_consensus.cc:740] T dd2b9d6bc39a43d39212393ed0834a8e P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.016084 26752 consensus_queue.cc:260] T dd2b9d6bc39a43d39212393ed0834a8e P 5756baf49a8d4598ba0a5e87d70af089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.018688 26752 ts_tablet_manager.cc:1434] T dd2b9d6bc39a43d39212393ed0834a8e P 5756baf49a8d4598ba0a5e87d70af089: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.003s
I20260709 12:25:45.019955 26752 tablet_bootstrap.cc:492] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089: Bootstrap starting.
I20260709 12:25:45.026480 26752 tablet_bootstrap.cc:654] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.026767 26750 tablet_bootstrap.cc:492] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386: No bootstrap required, opened a new log
I20260709 12:25:45.028012 26758 raft_consensus.cc:493] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.028615 26758 raft_consensus.cc:515] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.032979 26559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652951dd9794f5ba96237691f61617a" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0124e3cddc0049cd893bbd46dd123386" is_pre_election: true
I20260709 12:25:45.033751 26559 raft_consensus.cc:2468] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 0.
I20260709 12:25:45.035580 26598 leader_election.cc:304] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 0124e3cddc0049cd893bbd46dd123386; no voters: 
I20260709 12:25:45.036886 26790 raft_consensus.cc:2804] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:45.037428 26790 raft_consensus.cc:493] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.037850 26790 raft_consensus.cc:3060] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.038743 26709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652951dd9794f5ba96237691f61617a" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089" is_pre_election: true
W20260709 12:25:45.040738 26598 leader_election.cc:343] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.041361 26758 leader_election.cc:290] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:45.042153 26750 ts_tablet_manager.cc:1403] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.005s
I20260709 12:25:45.042603 26752 tablet_bootstrap.cc:492] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089: No bootstrap required, opened a new log
I20260709 12:25:45.043170 26752 ts_tablet_manager.cc:1403] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.006s
I20260709 12:25:45.045524 26750 raft_consensus.cc:359] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.046412 26750 raft_consensus.cc:385] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.046077 26752 raft_consensus.cc:359] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.046746 26750 raft_consensus.cc:740] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0124e3cddc0049cd893bbd46dd123386, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.033849 26455 catalog_manager.cc:5697] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 0103ef679011427d9901c6debd71d0ee (127.16.240.130). New cstate: current_term: 1 leader_uuid: "0103ef679011427d9901c6debd71d0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:45.046837 26752 raft_consensus.cc:385] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.047892 26752 raft_consensus.cc:740] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.047851 26750 consensus_queue.cc:260] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.049015 26752 consensus_queue.cc:260] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.051394 26752 ts_tablet_manager.cc:1434] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:45.052116 26750 ts_tablet_manager.cc:1434] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:25:45.052896 26752 tablet_bootstrap.cc:492] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089: Bootstrap starting.
I20260709 12:25:45.053404 26750 tablet_bootstrap.cc:492] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386: Bootstrap starting.
I20260709 12:25:45.060252 26752 tablet_bootstrap.cc:654] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.060252 26750 tablet_bootstrap.cc:654] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.072041 26790 raft_consensus.cc:515] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.076325 26559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652951dd9794f5ba96237691f61617a" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0124e3cddc0049cd893bbd46dd123386"
I20260709 12:25:45.077211 26559 raft_consensus.cc:3060] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.091439 26758 raft_consensus.cc:493] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.092410 26758 raft_consensus.cc:515] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.095398 26758 leader_election.cc:290] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:45.096904 26558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2b9d6bc39a43d39212393ed0834a8e" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0124e3cddc0049cd893bbd46dd123386" is_pre_election: true
I20260709 12:25:45.099080 26558 raft_consensus.cc:2468] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 0.
I20260709 12:25:45.097743 26709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2b9d6bc39a43d39212393ed0834a8e" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089" is_pre_election: true
I20260709 12:25:45.099869 26709 raft_consensus.cc:2468] T dd2b9d6bc39a43d39212393ed0834a8e P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 0.
I20260709 12:25:45.097308 26750 tablet_bootstrap.cc:492] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386: No bootstrap required, opened a new log
I20260709 12:25:45.100858 26598 leader_election.cc:304] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 0124e3cddc0049cd893bbd46dd123386; no voters: 
I20260709 12:25:45.102829 26758 raft_consensus.cc:2804] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:45.103147 26559 raft_consensus.cc:2468] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 1.
I20260709 12:25:45.103246 26758 raft_consensus.cc:493] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.099081 26752 tablet_bootstrap.cc:492] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089: No bootstrap required, opened a new log
I20260709 12:25:45.103633 26749 tablet_bootstrap.cc:492] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee: No bootstrap required, opened a new log
I20260709 12:25:45.103792 26758 raft_consensus.cc:3060] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.104156 26752 ts_tablet_manager.cc:1403] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.013s
I20260709 12:25:45.104389 26749 ts_tablet_manager.cc:1403] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee: Time spent bootstrapping tablet: real 0.098s	user 0.044s	sys 0.048s
I20260709 12:25:45.106714 26749 raft_consensus.cc:359] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } }
I20260709 12:25:45.107236 26749 raft_consensus.cc:385] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.107779 26749 raft_consensus.cc:740] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.107227 26752 raft_consensus.cc:359] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.108196 26752 raft_consensus.cc:385] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.100879 26750 ts_tablet_manager.cc:1403] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.010s
I20260709 12:25:45.108510 26752 raft_consensus.cc:740] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.108498 26749 consensus_queue.cc:260] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } }
I20260709 12:25:45.109695 26752 consensus_queue.cc:260] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.111301 26750 raft_consensus.cc:359] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.112408 26750 raft_consensus.cc:385] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.112680 26750 raft_consensus.cc:740] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0124e3cddc0049cd893bbd46dd123386, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.113504 26750 consensus_queue.cc:260] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.115623 26750 ts_tablet_manager.cc:1434] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:45.116784 26750 tablet_bootstrap.cc:492] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386: Bootstrap starting.
I20260709 12:25:45.120226 26798 raft_consensus.cc:493] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.120818 26798 raft_consensus.cc:515] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.121266 26752 ts_tablet_manager.cc:1434] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:25:45.122722 26750 tablet_bootstrap.cc:654] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.122742 26752 tablet_bootstrap.cc:492] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089: Bootstrap starting.
I20260709 12:25:45.127106 26558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606a6f609e4d4a6da9e2f288bbaaa0f8" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0124e3cddc0049cd893bbd46dd123386" is_pre_election: true
I20260709 12:25:45.127940 26558 raft_consensus.cc:2468] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 0.
I20260709 12:25:45.129369 26598 leader_election.cc:304] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 0124e3cddc0049cd893bbd46dd123386; no voters: 
I20260709 12:25:45.131274 26752 tablet_bootstrap.cc:654] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.132589 26798 leader_election.cc:290] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:45.132742 26709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606a6f609e4d4a6da9e2f288bbaaa0f8" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089" is_pre_election: true
I20260709 12:25:45.133236 26798 raft_consensus.cc:2804] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:45.133659 26798 raft_consensus.cc:493] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.133522 26709 raft_consensus.cc:2468] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 0.
I20260709 12:25:45.134274 26798 raft_consensus.cc:3060] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.139030 26750 tablet_bootstrap.cc:492] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386: No bootstrap required, opened a new log
I20260709 12:25:45.139618 26750 ts_tablet_manager.cc:1403] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386: Time spent bootstrapping tablet: real 0.023s	user 0.005s	sys 0.011s
I20260709 12:25:45.142444 26750 raft_consensus.cc:359] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.143153 26750 raft_consensus.cc:385] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.143435 26750 raft_consensus.cc:740] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0124e3cddc0049cd893bbd46dd123386, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.144358 26750 consensus_queue.cc:260] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.146948 26758 raft_consensus.cc:515] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.149678 26750 ts_tablet_manager.cc:1434] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:25:45.150766 26750 tablet_bootstrap.cc:492] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386: Bootstrap starting.
I20260709 12:25:45.155325 26752 tablet_bootstrap.cc:492] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089: No bootstrap required, opened a new log
I20260709 12:25:45.157553 26752 ts_tablet_manager.cc:1403] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089: Time spent bootstrapping tablet: real 0.035s	user 0.003s	sys 0.028s
I20260709 12:25:45.161729 26752 raft_consensus.cc:359] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.157191 26798 raft_consensus.cc:515] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.162895 26752 raft_consensus.cc:385] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.163256 26752 raft_consensus.cc:740] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.164196 26752 consensus_queue.cc:260] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.165241 26558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606a6f609e4d4a6da9e2f288bbaaa0f8" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0124e3cddc0049cd893bbd46dd123386"
I20260709 12:25:45.166389 26750 tablet_bootstrap.cc:654] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.166419 26558 raft_consensus.cc:3060] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.169184 26752 ts_tablet_manager.cc:1434] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:25:45.170289 26752 tablet_bootstrap.cc:492] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089: Bootstrap starting.
I20260709 12:25:45.175238 26558 raft_consensus.cc:2468] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 1.
I20260709 12:25:45.176194 26752 tablet_bootstrap.cc:654] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.176642 26598 leader_election.cc:304] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 0124e3cddc0049cd893bbd46dd123386; no voters: 
I20260709 12:25:45.188831 26802 raft_consensus.cc:493] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.188819 26752 tablet_bootstrap.cc:492] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089: No bootstrap required, opened a new log
I20260709 12:25:45.189458 26790 leader_election.cc:290] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:45.189898 26752 ts_tablet_manager.cc:1403] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:25:45.189553 26802 raft_consensus.cc:515] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.190465 26790 raft_consensus.cc:2804] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:45.191105 26790 raft_consensus.cc:697] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Becoming Leader. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Running, Role: LEADER
I20260709 12:25:45.192282 26790 consensus_queue.cc:237] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.193077 26709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652951dd9794f5ba96237691f61617a" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
I20260709 12:25:45.193150 26752 raft_consensus.cc:359] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.194012 26709 raft_consensus.cc:3060] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.194180 26752 raft_consensus.cc:385] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.194619 26752 raft_consensus.cc:740] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.195550 26752 consensus_queue.cc:260] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.196044 26758 leader_election.cc:290] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:45.202180 26709 raft_consensus.cc:2468] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 1.
I20260709 12:25:45.204135 26750 tablet_bootstrap.cc:492] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386: No bootstrap required, opened a new log
I20260709 12:25:45.204423 26559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0e14b9fa7944bcab2242e920f8a51e" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0124e3cddc0049cd893bbd46dd123386" is_pre_election: true
I20260709 12:25:45.204658 26752 ts_tablet_manager.cc:1434] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:25:45.204705 26750 ts_tablet_manager.cc:1403] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386: Time spent bootstrapping tablet: real 0.054s	user 0.024s	sys 0.018s
I20260709 12:25:45.205542 26797 raft_consensus.cc:493] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.205179 26559 raft_consensus.cc:2468] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 0.
I20260709 12:25:45.206048 26752 tablet_bootstrap.cc:492] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089: Bootstrap starting.
I20260709 12:25:45.206172 26797 raft_consensus.cc:515] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } }
I20260709 12:25:45.207405 26598 leader_election.cc:304] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 0124e3cddc0049cd893bbd46dd123386; no voters: 
I20260709 12:25:45.208411 26598 leader_election.cc:304] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 0124e3cddc0049cd893bbd46dd123386; no voters: 
I20260709 12:25:45.210513 26749 ts_tablet_manager.cc:1434] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee: Time spent starting tablet: real 0.106s	user 0.012s	sys 0.025s
I20260709 12:25:45.208771 26797 leader_election.cc:290] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:45.213012 26797 raft_consensus.cc:2804] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:45.213480 26797 raft_consensus.cc:697] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Becoming Leader. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Running, Role: LEADER
I20260709 12:25:45.213652 26752 tablet_bootstrap.cc:654] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.211517 26798 leader_election.cc:290] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:45.214489 26798 raft_consensus.cc:2804] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:45.214352 26797 consensus_queue.cc:237] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.214931 26798 raft_consensus.cc:493] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.215376 26798 raft_consensus.cc:3060] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.217252 26758 raft_consensus.cc:493] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.211644 26750 raft_consensus.cc:359] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.217778 26758 raft_consensus.cc:515] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.218277 26750 raft_consensus.cc:385] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.218596 26750 raft_consensus.cc:740] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0124e3cddc0049cd893bbd46dd123386, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.213721 26749 tablet_bootstrap.cc:492] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee: Bootstrap starting.
I20260709 12:25:45.219484 26750 consensus_queue.cc:260] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.220032 26758 leader_election.cc:290] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:45.225540 26559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2b9d6bc39a43d39212393ed0834a8e" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0124e3cddc0049cd893bbd46dd123386"
I20260709 12:25:45.226418 26559 raft_consensus.cc:3060] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.226776 26752 tablet_bootstrap.cc:492] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089: No bootstrap required, opened a new log
I20260709 12:25:45.226827 26750 ts_tablet_manager.cc:1434] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:25:45.227510 26752 ts_tablet_manager.cc:1403] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.002s
I20260709 12:25:45.230499 26752 raft_consensus.cc:359] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.231402 26752 raft_consensus.cc:385] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.231731 26752 raft_consensus.cc:740] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.232658 26752 consensus_queue.cc:260] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.234488 26559 raft_consensus.cc:2468] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 1.
I20260709 12:25:45.225519 26709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2b9d6bc39a43d39212393ed0834a8e" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
I20260709 12:25:45.238849 26598 leader_election.cc:304] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 0124e3cddc0049cd893bbd46dd123386; no voters: 
I20260709 12:25:45.239058 26708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23edbfdff914fcdbe4fa0cd9267c789" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089" is_pre_election: true
I20260709 12:25:45.240000 26708 raft_consensus.cc:2393] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0103ef679011427d9901c6debd71d0ee in current term 1: Already voted for candidate 0124e3cddc0049cd893bbd46dd123386 in this term.
I20260709 12:25:45.240172 26802 leader_election.cc:290] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:45.240840 26797 raft_consensus.cc:2804] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:45.241093 26707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606a6f609e4d4a6da9e2f288bbaaa0f8" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
I20260709 12:25:45.241626 26797 raft_consensus.cc:697] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Becoming Leader. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Running, Role: LEADER
I20260709 12:25:45.241851 26707 raft_consensus.cc:3060] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.241281 26453 catalog_manager.cc:5697] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 0103ef679011427d9901c6debd71d0ee (127.16.240.130). New cstate: current_term: 1 leader_uuid: "0103ef679011427d9901c6debd71d0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:45.244238 26706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985db528c3f741df95fe12330c6f0e1f" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089" is_pre_election: true
I20260709 12:25:45.244969 26706 raft_consensus.cc:2468] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 0.
I20260709 12:25:45.246133 26749 tablet_bootstrap.cc:654] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.246500 26598 leader_election.cc:304] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 5756baf49a8d4598ba0a5e87d70af089; no voters: 
I20260709 12:25:45.246904 26706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0e14b9fa7944bcab2242e920f8a51e" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089" is_pre_election: true
I20260709 12:25:45.247159 26752 ts_tablet_manager.cc:1434] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:25:45.247488 26802 raft_consensus.cc:2804] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:45.247627 26706 raft_consensus.cc:2468] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 0.
I20260709 12:25:45.248028 26802 raft_consensus.cc:493] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.242339 26797 consensus_queue.cc:237] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.248433 26802 raft_consensus.cc:3060] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.256305 26798 raft_consensus.cc:515] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.258695 26798 leader_election.cc:290] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:45.258802 26802 raft_consensus.cc:515] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.259712 26557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0e14b9fa7944bcab2242e920f8a51e" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0124e3cddc0049cd893bbd46dd123386"
I20260709 12:25:45.260421 26557 raft_consensus.cc:3060] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.260504 26558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23edbfdff914fcdbe4fa0cd9267c789" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0124e3cddc0049cd893bbd46dd123386" is_pre_election: true
I20260709 12:25:45.261201 26802 leader_election.cc:290] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:45.261894 26559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985db528c3f741df95fe12330c6f0e1f" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0124e3cddc0049cd893bbd46dd123386" is_pre_election: true
I20260709 12:25:45.262583 26559 raft_consensus.cc:2468] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 0.
I20260709 12:25:45.264927 26749 tablet_bootstrap.cc:492] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee: No bootstrap required, opened a new log
I20260709 12:25:45.265265 26757 raft_consensus.cc:493] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.265473 26749 ts_tablet_manager.cc:1403] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.004s
I20260709 12:25:45.265782 26757 raft_consensus.cc:515] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.266603 26707 raft_consensus.cc:2468] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 1.
I20260709 12:25:45.236171 26709 raft_consensus.cc:3060] T dd2b9d6bc39a43d39212393ed0834a8e P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.268193 26757 leader_election.cc:290] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215)
I20260709 12:25:45.268623 26749 raft_consensus.cc:359] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.269327 26749 raft_consensus.cc:385] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.269616 26749 raft_consensus.cc:740] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.270008 26706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985db528c3f741df95fe12330c6f0e1f" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
I20260709 12:25:45.270305 26634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec619159fb614124adfd72bc4b8763ce" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0103ef679011427d9901c6debd71d0ee" is_pre_election: true
I20260709 12:25:45.273439 26706 raft_consensus.cc:3060] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.273595 26634 raft_consensus.cc:2468] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 0.
I20260709 12:25:45.274758 26453 catalog_manager.cc:5697] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 0103ef679011427d9901c6debd71d0ee (127.16.240.130). New cstate: current_term: 1 leader_uuid: "0103ef679011427d9901c6debd71d0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:45.277827 26453 catalog_manager.cc:5697] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 0103ef679011427d9901c6debd71d0ee (127.16.240.130). New cstate: current_term: 1 leader_uuid: "0103ef679011427d9901c6debd71d0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:45.270327 26749 consensus_queue.cc:260] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.270780 26598 leader_election.cc:304] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee; no voters: 0124e3cddc0049cd893bbd46dd123386, 5756baf49a8d4598ba0a5e87d70af089
I20260709 12:25:45.275817 26671 leader_election.cc:304] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 5756baf49a8d4598ba0a5e87d70af089; no voters: 
I20260709 12:25:45.279304 26558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec619159fb614124adfd72bc4b8763ce" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0124e3cddc0049cd893bbd46dd123386" is_pre_election: true
I20260709 12:25:45.280491 26634 raft_consensus.cc:3060] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.281703 26558 raft_consensus.cc:2468] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 0.
I20260709 12:25:45.279316 26557 raft_consensus.cc:2468] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 1.
I20260709 12:25:45.280503 26749 ts_tablet_manager.cc:1434] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:25:45.284121 26598 leader_election.cc:304] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 0124e3cddc0049cd893bbd46dd123386; no voters: 
I20260709 12:25:45.284991 26797 raft_consensus.cc:2804] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:45.285482 26797 raft_consensus.cc:697] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Becoming Leader. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Running, Role: LEADER
I20260709 12:25:45.286325 26797 consensus_queue.cc:237] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.270859 26707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0e14b9fa7944bcab2242e920f8a51e" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
I20260709 12:25:45.280092 26757 raft_consensus.cc:2804] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:45.288388 26757 raft_consensus.cc:493] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.288789 26757 raft_consensus.cc:3060] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.289413 26709 raft_consensus.cc:2468] T dd2b9d6bc39a43d39212393ed0834a8e P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 1.
I20260709 12:25:45.280881 26559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985db528c3f741df95fe12330c6f0e1f" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0124e3cddc0049cd893bbd46dd123386"
I20260709 12:25:45.290932 26559 raft_consensus.cc:3060] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.296805 26757 raft_consensus.cc:515] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.297811 26707 raft_consensus.cc:3060] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.300254 26557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec619159fb614124adfd72bc4b8763ce" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0124e3cddc0049cd893bbd46dd123386"
I20260709 12:25:45.303457 26557 raft_consensus.cc:3060] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.299201 26559 raft_consensus.cc:2468] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 1.
I20260709 12:25:45.305850 26802 raft_consensus.cc:2749] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:45.306960 26453 catalog_manager.cc:5697] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 0103ef679011427d9901c6debd71d0ee (127.16.240.130). New cstate: current_term: 1 leader_uuid: "0103ef679011427d9901c6debd71d0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:45.305841 26598 leader_election.cc:304] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 0124e3cddc0049cd893bbd46dd123386; no voters: 
I20260709 12:25:45.309201 26802 raft_consensus.cc:2804] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:45.309474 26706 raft_consensus.cc:2468] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 1.
I20260709 12:25:45.309882 26802 raft_consensus.cc:697] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Becoming Leader. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Running, Role: LEADER
I20260709 12:25:45.310926 26802 consensus_queue.cc:237] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.311868 26773 consensus_queue.cc:1048] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:45.314778 26757 leader_election.cc:290] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 1 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215)
I20260709 12:25:45.316958 26707 raft_consensus.cc:2468] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 1.
I20260709 12:25:45.310947 26557 raft_consensus.cc:2468] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 1.
I20260709 12:25:45.318981 26633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec619159fb614124adfd72bc4b8763ce" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0103ef679011427d9901c6debd71d0ee"
I20260709 12:25:45.319514 26672 leader_election.cc:304] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0124e3cddc0049cd893bbd46dd123386, 5756baf49a8d4598ba0a5e87d70af089; no voters: 
I20260709 12:25:45.319959 26633 raft_consensus.cc:3060] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.320576 26757 raft_consensus.cc:2804] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:45.330026 26757 raft_consensus.cc:697] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [term 1 LEADER]: Becoming Leader. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Running, Role: LEADER
I20260709 12:25:45.331030 26757 consensus_queue.cc:237] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.333885 26777 consensus_queue.cc:1048] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:45.345562 26453 catalog_manager.cc:5697] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 0103ef679011427d9901c6debd71d0ee (127.16.240.130). New cstate: current_term: 1 leader_uuid: "0103ef679011427d9901c6debd71d0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:45.353091 26813 raft_consensus.cc:493] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.353868 26813 raft_consensus.cc:515] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.354604 26753 consensus_queue.cc:1048] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:45.355319 26633 raft_consensus.cc:2468] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 1.
I20260709 12:25:45.360782 26802 raft_consensus.cc:493] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.361413 26802 raft_consensus.cc:515] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.362982 26557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f734d1b5a04b0abd7ad8eab8b08a39" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0124e3cddc0049cd893bbd46dd123386" is_pre_election: true
I20260709 12:25:45.356648 26813 leader_election.cc:290] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215)
I20260709 12:25:45.363735 26557 raft_consensus.cc:2468] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 0.
I20260709 12:25:45.364147 26813 raft_consensus.cc:493] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.364598 26813 raft_consensus.cc:515] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.365813 26672 leader_election.cc:304] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0124e3cddc0049cd893bbd46dd123386, 5756baf49a8d4598ba0a5e87d70af089; no voters: 
I20260709 12:25:45.371544 26757 raft_consensus.cc:2804] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:45.371428 26632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4acfec5dd12c4ab8a20a580682d2a42a" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0103ef679011427d9901c6debd71d0ee" is_pre_election: true
I20260709 12:25:45.371157 26452 catalog_manager.cc:5697] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "5756baf49a8d4598ba0a5e87d70af089" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:45.367070 26709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f734d1b5a04b0abd7ad8eab8b08a39" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089" is_pre_election: true
I20260709 12:25:45.373840 26633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f734d1b5a04b0abd7ad8eab8b08a39" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0103ef679011427d9901c6debd71d0ee" is_pre_election: true
I20260709 12:25:45.374876 26633 raft_consensus.cc:2468] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 0.
I20260709 12:25:45.377684 26773 consensus_queue.cc:1048] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:45.378917 26802 leader_election.cc:290] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:45.372071 26757 raft_consensus.cc:493] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.372825 26559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4acfec5dd12c4ab8a20a580682d2a42a" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0124e3cddc0049cd893bbd46dd123386" is_pre_election: true
I20260709 12:25:45.388082 26559 raft_consensus.cc:2393] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5756baf49a8d4598ba0a5e87d70af089 in current term 1: Already voted for candidate 0103ef679011427d9901c6debd71d0ee in this term.
I20260709 12:25:45.366815 26813 leader_election.cc:290] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215)
I20260709 12:25:45.370095 26557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f734d1b5a04b0abd7ad8eab8b08a39" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0124e3cddc0049cd893bbd46dd123386" is_pre_election: true
I20260709 12:25:45.389693 26557 raft_consensus.cc:2468] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 0.
I20260709 12:25:45.389753 26672 leader_election.cc:304] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5756baf49a8d4598ba0a5e87d70af089; no voters: 0103ef679011427d9901c6debd71d0ee, 0124e3cddc0049cd893bbd46dd123386
I20260709 12:25:45.391230 26757 raft_consensus.cc:3060] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.391326 26813 raft_consensus.cc:3060] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.392972 26598 leader_election.cc:304] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 0124e3cddc0049cd893bbd46dd123386; no voters: 
I20260709 12:25:45.401264 26802 raft_consensus.cc:2804] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:45.401723 26802 raft_consensus.cc:493] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.402073 26802 raft_consensus.cc:3060] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.411677 26802 raft_consensus.cc:515] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.411923 26757 raft_consensus.cc:515] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.415674 26709 raft_consensus.cc:2393] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0103ef679011427d9901c6debd71d0ee in current term 1: Already voted for candidate 5756baf49a8d4598ba0a5e87d70af089 in this term.
I20260709 12:25:45.414803 26813 raft_consensus.cc:2749] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:45.420303 26757 leader_election.cc:290] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 1 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215)
I20260709 12:25:45.420372 26557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f734d1b5a04b0abd7ad8eab8b08a39" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0124e3cddc0049cd893bbd46dd123386"
I20260709 12:25:45.421172 26557 raft_consensus.cc:3060] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.421698 26559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f734d1b5a04b0abd7ad8eab8b08a39" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0124e3cddc0049cd893bbd46dd123386"
I20260709 12:25:45.424700 26632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f734d1b5a04b0abd7ad8eab8b08a39" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0103ef679011427d9901c6debd71d0ee"
I20260709 12:25:45.425539 26632 raft_consensus.cc:2393] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5756baf49a8d4598ba0a5e87d70af089 in current term 1: Already voted for candidate 0103ef679011427d9901c6debd71d0ee in this term.
I20260709 12:25:45.426651 26671 leader_election.cc:304] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5756baf49a8d4598ba0a5e87d70af089; no voters: 0103ef679011427d9901c6debd71d0ee, 0124e3cddc0049cd893bbd46dd123386
I20260709 12:25:45.427922 26757 raft_consensus.cc:2749] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:45.429140 26557 raft_consensus.cc:2468] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 1.
I20260709 12:25:45.430258 26598 leader_election.cc:304] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 0124e3cddc0049cd893bbd46dd123386; no voters: 
I20260709 12:25:45.430981 26797 raft_consensus.cc:2804] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:45.431464 26797 raft_consensus.cc:697] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Becoming Leader. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Running, Role: LEADER
I20260709 12:25:45.431514 26802 leader_election.cc:290] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 1 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:45.432423 26797 consensus_queue.cc:237] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:45.432844 26709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f734d1b5a04b0abd7ad8eab8b08a39" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
I20260709 12:25:45.433629 26709 raft_consensus.cc:2393] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0103ef679011427d9901c6debd71d0ee in current term 1: Already voted for candidate 5756baf49a8d4598ba0a5e87d70af089 in this term.
I20260709 12:25:45.442085 26453 catalog_manager.cc:5697] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 0103ef679011427d9901c6debd71d0ee (127.16.240.130). New cstate: current_term: 1 leader_uuid: "0103ef679011427d9901c6debd71d0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:45.576228 26797 consensus_queue.cc:1048] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:45.578944 17346 ts_manager.cc:295] Set tserver state for 0124e3cddc0049cd893bbd46dd123386 to MAINTENANCE_MODE
I20260709 12:25:45.579847 17346 tablet_server.cc:179] TabletServer@127.16.240.129:0 shutting down...
W20260709 12:25:45.599506 26598 consensus_peers.cc:597] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:45.610440 26598 consensus_peers.cc:597] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:45.611337 26598 consensus_peers.cc:597] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:45.621119 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:45.622174 17346 tablet_replica.cc:333] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386: stopping tablet replica
I20260709 12:25:45.622913 17346 raft_consensus.cc:2243] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:45.623373 17346 raft_consensus.cc:2272] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:45.625037 26504 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:45.625855 17346 tablet_replica.cc:333] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386: stopping tablet replica
I20260709 12:25:45.626482 17346 raft_consensus.cc:2243] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:45.626852 17346 raft_consensus.cc:2272] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:45.628849 17346 tablet_replica.cc:333] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386: stopping tablet replica
I20260709 12:25:45.629453 17346 raft_consensus.cc:2243] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:45.629870 17346 raft_consensus.cc:2272] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:45.631678 17346 tablet_replica.cc:333] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386: stopping tablet replica
I20260709 12:25:45.632351 17346 raft_consensus.cc:2243] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:45.632752 17346 raft_consensus.cc:2272] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:45.634505 17346 tablet_replica.cc:333] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386: stopping tablet replica
I20260709 12:25:45.635066 17346 raft_consensus.cc:2243] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:45.635970 17346 raft_consensus.cc:2272] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:45.638235 17346 tablet_replica.cc:333] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386: stopping tablet replica
I20260709 12:25:45.638839 17346 raft_consensus.cc:2243] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:45.639242 17346 raft_consensus.cc:2272] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:45.641127 17346 tablet_replica.cc:333] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386: stopping tablet replica
I20260709 12:25:45.641670 17346 raft_consensus.cc:2243] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:45.642493 17346 raft_consensus.cc:2272] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:45.645118 17346 tablet_replica.cc:333] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386: stopping tablet replica
I20260709 12:25:45.645689 17346 raft_consensus.cc:2243] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:45.646039 17346 raft_consensus.cc:2272] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:45.646370 26798 consensus_queue.cc:1048] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:45.648000 17346 tablet_replica.cc:333] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386: stopping tablet replica
I20260709 12:25:45.648623 17346 raft_consensus.cc:2243] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:45.649082 17346 raft_consensus.cc:2272] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:45.651522 17346 tablet_replica.cc:333] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386: stopping tablet replica
I20260709 12:25:45.652245 17346 raft_consensus.cc:2243] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:45.652705 17346 raft_consensus.cc:2272] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:45.677122 26798 consensus_queue.cc:1048] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:45.692456 17346 tablet_server.cc:196] TabletServer@127.16.240.129:0 shutdown complete.
I20260709 12:25:45.706724 26798 consensus_queue.cc:1048] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:25:45.722146 26598 consensus_peers.cc:597] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:45.727015 26598 consensus_peers.cc:597] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:45.732223 26672 consensus_peers.cc:597] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:45.764031 26598 consensus_peers.cc:597] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:45.867794 26757 consensus_queue.cc:1048] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:45.882385 26598 consensus_peers.cc:597] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:45.897102 26802 consensus_queue.cc:1048] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:45.940968 26802 consensus_queue.cc:1048] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:45.998632 26802 consensus_queue.cc:1048] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:46.117067 26598 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111) [suppressed 195 similar messages]
W20260709 12:25:46.626089 26504 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:46.843008 26802 raft_consensus.cc:493] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0124e3cddc0049cd893bbd46dd123386)
I20260709 12:25:46.843829 26802 raft_consensus.cc:515] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } }
I20260709 12:25:46.846254 26802 leader_election.cc:290] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:46.847752 26709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23edbfdff914fcdbe4fa0cd9267c789" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089" is_pre_election: true
W20260709 12:25:46.850082 26598 leader_election.cc:336] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111)
I20260709 12:25:46.850503 26598 leader_election.cc:304] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee; no voters: 0124e3cddc0049cd893bbd46dd123386, 5756baf49a8d4598ba0a5e87d70af089
I20260709 12:25:46.851263 26802 raft_consensus.cc:2749] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:46.866832 26818 raft_consensus.cc:493] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0124e3cddc0049cd893bbd46dd123386)
I20260709 12:25:46.867503 26818 raft_consensus.cc:515] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } }
I20260709 12:25:46.868994 26838 raft_consensus.cc:493] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0124e3cddc0049cd893bbd46dd123386)
I20260709 12:25:46.869594 26838 raft_consensus.cc:515] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:46.870604 26818 leader_election.cc:290] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215)
I20260709 12:25:46.871156 26632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23edbfdff914fcdbe4fa0cd9267c789" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0103ef679011427d9901c6debd71d0ee" is_pre_election: true
I20260709 12:25:46.871886 26632 raft_consensus.cc:2468] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 1.
I20260709 12:25:46.871879 26838 leader_election.cc:290] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215)
I20260709 12:25:46.873339 26671 leader_election.cc:304] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 5756baf49a8d4598ba0a5e87d70af089; no voters: 
I20260709 12:25:46.873689 26632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f10e687e5d47ab94cff8a28641c03d" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0103ef679011427d9901c6debd71d0ee" is_pre_election: true
I20260709 12:25:46.874434 26838 raft_consensus.cc:2804] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:46.874789 26838 raft_consensus.cc:493] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0124e3cddc0049cd893bbd46dd123386)
W20260709 12:25:46.874956 26672 leader_election.cc:336] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111)
I20260709 12:25:46.875185 26838 raft_consensus.cc:3060] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:46.878026 26672 leader_election.cc:336] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111)
I20260709 12:25:46.878479 26672 leader_election.cc:304] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5756baf49a8d4598ba0a5e87d70af089; no voters: 0103ef679011427d9901c6debd71d0ee, 0124e3cddc0049cd893bbd46dd123386
I20260709 12:25:46.879127 26818 raft_consensus.cc:2749] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:46.881886 26838 raft_consensus.cc:515] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } }
I20260709 12:25:46.883100 26802 raft_consensus.cc:493] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0124e3cddc0049cd893bbd46dd123386)
I20260709 12:25:46.883646 26802 raft_consensus.cc:515] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:46.884199 26838 leader_election.cc:290] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 2 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215)
I20260709 12:25:46.885483 26632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23edbfdff914fcdbe4fa0cd9267c789" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0103ef679011427d9901c6debd71d0ee"
I20260709 12:25:46.885990 26632 raft_consensus.cc:3060] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.886534 26802 leader_election.cc:290] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:46.889351 26709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f10e687e5d47ab94cff8a28641c03d" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089" is_pre_election: true
W20260709 12:25:46.889467 26672 leader_election.cc:336] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111)
I20260709 12:25:46.890159 26709 raft_consensus.cc:2468] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 1.
W20260709 12:25:46.891367 26598 leader_election.cc:336] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111)
I20260709 12:25:46.892328 26598 leader_election.cc:304] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 5756baf49a8d4598ba0a5e87d70af089; no voters: 0124e3cddc0049cd893bbd46dd123386
I20260709 12:25:46.893131 26802 raft_consensus.cc:2804] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:46.893471 26802 raft_consensus.cc:493] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0124e3cddc0049cd893bbd46dd123386)
I20260709 12:25:46.893579 26632 raft_consensus.cc:2468] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 2.
I20260709 12:25:46.893787 26802 raft_consensus.cc:3060] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.894748 26671 leader_election.cc:304] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 5756baf49a8d4598ba0a5e87d70af089; no voters: 0124e3cddc0049cd893bbd46dd123386
I20260709 12:25:46.895448 26838 raft_consensus.cc:2804] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:46.895990 26838 raft_consensus.cc:697] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [term 2 LEADER]: Becoming Leader. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Running, Role: LEADER
I20260709 12:25:46.896740 26838 consensus_queue.cc:237] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } }
I20260709 12:25:46.899709 26802 raft_consensus.cc:515] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:46.901957 26802 leader_election.cc:290] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 2 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:46.903687 26709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f10e687e5d47ab94cff8a28641c03d" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
I20260709 12:25:46.904397 26709 raft_consensus.cc:3060] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.904902 26452 catalog_manager.cc:5697] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 reported cstate change: term changed from 1 to 2, leader changed from 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129) to 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "5756baf49a8d4598ba0a5e87d70af089" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:46.906749 26598 leader_election.cc:336] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111)
I20260709 12:25:46.912858 26709 raft_consensus.cc:2468] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 2.
I20260709 12:25:46.914196 26598 leader_election.cc:304] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 5756baf49a8d4598ba0a5e87d70af089; no voters: 0124e3cddc0049cd893bbd46dd123386
I20260709 12:25:46.915268 26802 raft_consensus.cc:2804] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:46.915819 26802 raft_consensus.cc:697] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [term 2 LEADER]: Becoming Leader. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Running, Role: LEADER
I20260709 12:25:46.916769 26802 consensus_queue.cc:237] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:46.925601 26452 catalog_manager.cc:5697] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee reported cstate change: term changed from 1 to 2, leader changed from 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129) to 0103ef679011427d9901c6debd71d0ee (127.16.240.130). New cstate: current_term: 2 leader_uuid: "0103ef679011427d9901c6debd71d0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:47.417589 26598 consensus_peers.cc:597] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:47.461447 26672 consensus_peers.cc:597] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:47.482393 26632 raft_consensus.cc:1275] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Refusing update from remote peer 5756baf49a8d4598ba0a5e87d70af089: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:47.483951 26838 consensus_queue.cc:1048] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:47.500659 26709 raft_consensus.cc:1275] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Refusing update from remote peer 0103ef679011427d9901c6debd71d0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:47.502038 26802 consensus_queue.cc:1048] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:47.627136 26504 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:25:47.835220 26672 consensus_peers.cc:597] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:47.892123 26598 consensus_peers.cc:597] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:48.048784 26598 consensus_peers.cc:597] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:48.159341 26598 consensus_peers.cc:597] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:48.160068 26598 consensus_peers.cc:597] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:48.188457 26598 consensus_peers.cc:597] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:48.192766 26598 consensus_peers.cc:597] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:48.415645 26598 consensus_peers.cc:597] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:48.628580 26504 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:25:49.629776 26504 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:25:49.735903 26598 consensus_peers.cc:597] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:50.025883 26672 consensus_peers.cc:597] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:50.416608 26672 consensus_peers.cc:597] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:50.511183 26598 consensus_peers.cc:597] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:50.573319 26598 consensus_peers.cc:597] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:50.631207 26504 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:25:50.708209 26598 consensus_peers.cc:597] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:50.720949 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:50.728173 26598 consensus_peers.cc:597] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:50.729946 26857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:50.731489 26858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:50.739118 17346 server_base.cc:1061] running on GCE node
W20260709 12:25:50.740245 26860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:50.741537 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:50.741756 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:50.741979 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599950741962 us; error 0 us; skew 500 ppm
I20260709 12:25:50.742967 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:50.746975 17346 webserver.cc:533] Webserver started at http://127.16.240.129:41773/ using document root <none> and password file <none>
I20260709 12:25:50.747632 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:50.747893 17346 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:25:50.752468 17346 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:25:50.757754 26865 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:50.758800 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 12:25:50.759109 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/ts-0-root
uuid: "0124e3cddc0049cd893bbd46dd123386"
format_stamp: "Formatted at 2026-07-09 12:25:43 on dist-test-slave-7xpw"
I20260709 12:25:50.759496 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599638884573-17346-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:50.797127 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:50.798493 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:50.800271 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:50.805127 26872 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 12:25:50.853713 26598 consensus_peers.cc:597] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:50.874935 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:25:50.875562 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.072s	user 0.004s	sys 0.000s
I20260709 12:25:50.876114 17346 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:25:50.885098 26872 tablet_bootstrap.cc:492] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386: Bootstrap starting.
W20260709 12:25:50.895634 26598 consensus_peers.cc:597] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:50.903033 26872 tablet_bootstrap.cc:492] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:50.904019 26872 tablet_bootstrap.cc:492] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386: Bootstrap complete.
I20260709 12:25:50.904642 26872 ts_tablet_manager.cc:1403] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 12:25:50.907109 26872 raft_consensus.cc:359] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } }
I20260709 12:25:50.908507 26872 raft_consensus.cc:740] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0124e3cddc0049cd893bbd46dd123386, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.909492 26872 consensus_queue.cc:260] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } }
I20260709 12:25:50.912524 26872 ts_tablet_manager.cc:1434] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:50.913933 26872 tablet_bootstrap.cc:492] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386: Bootstrap starting.
I20260709 12:25:50.928085 26872 tablet_bootstrap.cc:492] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:50.929169 26872 tablet_bootstrap.cc:492] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386: Bootstrap complete.
I20260709 12:25:50.929872 26872 ts_tablet_manager.cc:1403] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.005s
I20260709 12:25:50.931407 17346 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:25:50.931823 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.056s	user 0.055s	sys 0.000s
I20260709 12:25:50.932572 26872 raft_consensus.cc:359] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:50.933418 26872 raft_consensus.cc:740] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0124e3cddc0049cd893bbd46dd123386, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.934203 26872 consensus_queue.cc:260] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:50.936043 26872 ts_tablet_manager.cc:1434] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.006s
I20260709 12:25:50.936794 26872 tablet_bootstrap.cc:492] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386: Bootstrap starting.
I20260709 12:25:50.954468 26872 tablet_bootstrap.cc:492] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:50.955830 26872 tablet_bootstrap.cc:492] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386: Bootstrap complete.
I20260709 12:25:50.956629 26872 ts_tablet_manager.cc:1403] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:25:50.959841 26872 raft_consensus.cc:359] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:50.960695 26872 raft_consensus.cc:740] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0124e3cddc0049cd893bbd46dd123386, State: Initialized, Role: FOLLOWER
W20260709 12:25:50.960873 26598 consensus_peers.cc:597] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:50.961707 26872 consensus_queue.cc:260] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:50.964200 26872 ts_tablet_manager.cc:1434] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:50.965221 26872 tablet_bootstrap.cc:492] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386: Bootstrap starting.
I20260709 12:25:50.981492 26872 tablet_bootstrap.cc:492] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:50.982677 26872 tablet_bootstrap.cc:492] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386: Bootstrap complete.
I20260709 12:25:50.983596 26872 ts_tablet_manager.cc:1403] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.006s
I20260709 12:25:50.986959 26872 raft_consensus.cc:359] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:50.987897 26872 raft_consensus.cc:740] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0124e3cddc0049cd893bbd46dd123386, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.988847 26872 consensus_queue.cc:260] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:50.992326 26872 ts_tablet_manager.cc:1434] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:25:50.993461 26872 tablet_bootstrap.cc:492] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386: Bootstrap starting.
I20260709 12:25:51.004727 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.129:45903
I20260709 12:25:51.004894 26934 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.129:45903 every 8 connection(s)
I20260709 12:25:51.005996 26872 tablet_bootstrap.cc:492] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:51.006774 26872 tablet_bootstrap.cc:492] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386: Bootstrap complete.
I20260709 12:25:51.007368 26872 ts_tablet_manager.cc:1403] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.006s
I20260709 12:25:51.010298 26872 raft_consensus.cc:359] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.011202 26872 raft_consensus.cc:740] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0124e3cddc0049cd893bbd46dd123386, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.011997 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:51.012110 26872 consensus_queue.cc:260] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.015139 26872 ts_tablet_manager.cc:1434] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:25:51.016544 26872 tablet_bootstrap.cc:492] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386: Bootstrap starting.
I20260709 12:25:51.043452 26872 tablet_bootstrap.cc:492] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:51.045006 26872 tablet_bootstrap.cc:492] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386: Bootstrap complete.
I20260709 12:25:51.045850 26872 ts_tablet_manager.cc:1403] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.009s
I20260709 12:25:51.049036 26935 heartbeater.cc:344] Connected to a master server at 127.16.240.190:44961
I20260709 12:25:51.049644 26935 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:51.049353 26872 raft_consensus.cc:359] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.050184 26872 raft_consensus.cc:740] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0124e3cddc0049cd893bbd46dd123386, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.050724 26935 heartbeater.cc:507] Master 127.16.240.190:44961 requested a full tablet report, sending...
I20260709 12:25:51.051232 26872 consensus_queue.cc:260] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.054770 26872 ts_tablet_manager.cc:1434] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:25:51.055935 26872 tablet_bootstrap.cc:492] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386: Bootstrap starting.
I20260709 12:25:51.057279 26632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40f10e687e5d47ab94cff8a28641c03d"
dest_uuid: "0103ef679011427d9901c6debd71d0ee"
mode: GRACEFUL
new_leader_uuid: "5756baf49a8d4598ba0a5e87d70af089"
 from {username='slave'} at 127.0.0.1:42158
I20260709 12:25:51.058148 26632 raft_consensus.cc:606] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [term 2 LEADER]: Received request to transfer leadership to TS 5756baf49a8d4598ba0a5e87d70af089
I20260709 12:25:51.062600 26452 ts_manager.cc:194] Re-registered known tserver with Master: 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903)
I20260709 12:25:51.063345 26632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4acfec5dd12c4ab8a20a580682d2a42a"
dest_uuid: "0103ef679011427d9901c6debd71d0ee"
mode: GRACEFUL
new_leader_uuid: "5756baf49a8d4598ba0a5e87d70af089"
 from {username='slave'} at 127.0.0.1:42158
I20260709 12:25:51.064085 26632 raft_consensus.cc:606] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Received request to transfer leadership to TS 5756baf49a8d4598ba0a5e87d70af089
I20260709 12:25:51.068136 26632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8652951dd9794f5ba96237691f61617a"
dest_uuid: "0103ef679011427d9901c6debd71d0ee"
mode: GRACEFUL
new_leader_uuid: "5756baf49a8d4598ba0a5e87d70af089"
 from {username='slave'} at 127.0.0.1:42158
I20260709 12:25:51.068845 26632 raft_consensus.cc:606] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Received request to transfer leadership to TS 5756baf49a8d4598ba0a5e87d70af089
I20260709 12:25:51.071952 26632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc0e14b9fa7944bcab2242e920f8a51e"
dest_uuid: "0103ef679011427d9901c6debd71d0ee"
mode: GRACEFUL
new_leader_uuid: "5756baf49a8d4598ba0a5e87d70af089"
 from {username='slave'} at 127.0.0.1:42158
I20260709 12:25:51.072607 26632 raft_consensus.cc:606] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Received request to transfer leadership to TS 5756baf49a8d4598ba0a5e87d70af089
I20260709 12:25:51.073069 26872 tablet_bootstrap.cc:492] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:51.074095 26872 tablet_bootstrap.cc:492] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386: Bootstrap complete.
I20260709 12:25:51.074175 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:25:51.074811 26872 ts_tablet_manager.cc:1403] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.009s
I20260709 12:25:51.074980 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:51.076228 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:51.077919 26452 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33730
I20260709 12:25:51.078058 26872 raft_consensus.cc:359] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.078902 26872 raft_consensus.cc:740] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0124e3cddc0049cd893bbd46dd123386, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.079806 26872 consensus_queue.cc:260] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.081523 26935 heartbeater.cc:499] Master 127.16.240.190:44961 was elected leader, sending a full tablet report...
I20260709 12:25:51.081959 26872 ts_tablet_manager.cc:1434] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:25:51.082899 26872 tablet_bootstrap.cc:492] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386: Bootstrap starting.
I20260709 12:25:51.096735 26872 tablet_bootstrap.cc:492] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:51.097474 26872 tablet_bootstrap.cc:492] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386: Bootstrap complete.
I20260709 12:25:51.098058 26872 ts_tablet_manager.cc:1403] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:25:51.100559 26872 raft_consensus.cc:359] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.101270 26872 raft_consensus.cc:740] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0124e3cddc0049cd893bbd46dd123386, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.101975 26872 consensus_queue.cc:260] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.103940 26872 ts_tablet_manager.cc:1434] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 12:25:51.104761 26872 tablet_bootstrap.cc:492] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386: Bootstrap starting.
I20260709 12:25:51.117589 26908 raft_consensus.cc:3060] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.119323 26872 tablet_bootstrap.cc:492] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:51.120182 26872 tablet_bootstrap.cc:492] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386: Bootstrap complete.
I20260709 12:25:51.120755 26872 ts_tablet_manager.cc:1403] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:25:51.122880 26872 raft_consensus.cc:359] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.123391 26872 raft_consensus.cc:740] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0124e3cddc0049cd893bbd46dd123386, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.124035 26872 consensus_queue.cc:260] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.125917 26872 ts_tablet_manager.cc:1434] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:51.126901 26872 tablet_bootstrap.cc:492] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386: Bootstrap starting.
I20260709 12:25:51.130752 26854 raft_consensus.cc:993] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee: : Instructing follower 5756baf49a8d4598ba0a5e87d70af089 to start an election
I20260709 12:25:51.131345 26854 raft_consensus.cc:1081] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Signalling peer 5756baf49a8d4598ba0a5e87d70af089 to start an election
I20260709 12:25:51.134284 26709 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8652951dd9794f5ba96237691f61617a"
dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
 from {username='slave'} at 127.0.0.1:57308
I20260709 12:25:51.135150 26709 raft_consensus.cc:493] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:51.135685 26709 raft_consensus.cc:3060] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.141444 26872 tablet_bootstrap.cc:492] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:51.142263 26872 tablet_bootstrap.cc:492] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386: Bootstrap complete.
I20260709 12:25:51.142856 26872 ts_tablet_manager.cc:1403] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:25:51.143249 26709 raft_consensus.cc:515] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.145517 26872 raft_consensus.cc:359] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.146056 26908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652951dd9794f5ba96237691f61617a" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0124e3cddc0049cd893bbd46dd123386"
I20260709 12:25:51.146322 26632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652951dd9794f5ba96237691f61617a" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0103ef679011427d9901c6debd71d0ee"
I20260709 12:25:51.146462 26872 raft_consensus.cc:740] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0124e3cddc0049cd893bbd46dd123386, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.146880 26908 raft_consensus.cc:3060] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.147053 26632 raft_consensus.cc:3055] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:51.147512 26632 raft_consensus.cc:740] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Running, Role: LEADER
I20260709 12:25:51.147814 26872 consensus_queue.cc:260] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.148903 26632 consensus_queue.cc:260] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.150183 26632 raft_consensus.cc:3060] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.150501 26872 ts_tablet_manager.cc:1434] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:51.146066 26709 leader_election.cc:290] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 2 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215)
I20260709 12:25:51.155632 26908 raft_consensus.cc:2468] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 2.
I20260709 12:25:51.157219 26672 leader_election.cc:304] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0124e3cddc0049cd893bbd46dd123386, 5756baf49a8d4598ba0a5e87d70af089; no voters: 
I20260709 12:25:51.158447 26848 raft_consensus.cc:2804] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:51.159122 26632 raft_consensus.cc:2468] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 2.
I20260709 12:25:51.160002 26848 raft_consensus.cc:697] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [term 2 LEADER]: Becoming Leader. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Running, Role: LEADER
I20260709 12:25:51.161283 26848 consensus_queue.cc:237] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.169783 26452 catalog_manager.cc:5697] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 reported cstate change: term changed from 1 to 2, leader changed from 0103ef679011427d9901c6debd71d0ee (127.16.240.130) to 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "5756baf49a8d4598ba0a5e87d70af089" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:51.182655 26854 raft_consensus.cc:993] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee: : Instructing follower 5756baf49a8d4598ba0a5e87d70af089 to start an election
I20260709 12:25:51.183326 26854 raft_consensus.cc:1081] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [term 2 LEADER]: Signalling peer 5756baf49a8d4598ba0a5e87d70af089 to start an election
I20260709 12:25:51.185775 26709 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40f10e687e5d47ab94cff8a28641c03d"
dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
 from {username='slave'} at 127.0.0.1:57308
I20260709 12:25:51.186230 26709 raft_consensus.cc:493] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:51.186625 26709 raft_consensus.cc:3060] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:51.197482 26908 raft_consensus.cc:3060] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.196388 26709 raft_consensus.cc:515] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.202126 26709 leader_election.cc:290] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 3 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215)
I20260709 12:25:51.202564 26907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f10e687e5d47ab94cff8a28641c03d" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0124e3cddc0049cd893bbd46dd123386"
I20260709 12:25:51.202643 26632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f10e687e5d47ab94cff8a28641c03d" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0103ef679011427d9901c6debd71d0ee"
I20260709 12:25:51.204344 26632 raft_consensus.cc:3055] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:51.204998 26632 raft_consensus.cc:740] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Running, Role: LEADER
I20260709 12:25:51.206010 26632 consensus_queue.cc:260] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.207444 26632 raft_consensus.cc:3060] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:51.215579 26632 raft_consensus.cc:2468] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 3.
I20260709 12:25:51.217051 26671 leader_election.cc:304] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 5756baf49a8d4598ba0a5e87d70af089; no voters: 0124e3cddc0049cd893bbd46dd123386
I20260709 12:25:51.218096 26848 raft_consensus.cc:2804] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:51.218640 26848 raft_consensus.cc:697] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [term 3 LEADER]: Becoming Leader. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Running, Role: LEADER
I20260709 12:25:51.219666 26848 consensus_queue.cc:237] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.228374 26453 catalog_manager.cc:5697] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 reported cstate change: term changed from 2 to 3, leader changed from 0103ef679011427d9901c6debd71d0ee (127.16.240.130) to 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131). New cstate: current_term: 3 leader_uuid: "5756baf49a8d4598ba0a5e87d70af089" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:51.360558 26856 raft_consensus.cc:993] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee: : Instructing follower 5756baf49a8d4598ba0a5e87d70af089 to start an election
I20260709 12:25:51.361346 26854 raft_consensus.cc:1081] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Signalling peer 5756baf49a8d4598ba0a5e87d70af089 to start an election
I20260709 12:25:51.362967 26709 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4acfec5dd12c4ab8a20a580682d2a42a"
dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
 from {username='slave'} at 127.0.0.1:57308
I20260709 12:25:51.363430 26709 raft_consensus.cc:493] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:51.363682 26709 raft_consensus.cc:3060] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.369072 26709 raft_consensus.cc:515] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.371104 26709 leader_election.cc:290] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 2 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215)
I20260709 12:25:51.372561 26632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4acfec5dd12c4ab8a20a580682d2a42a" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0103ef679011427d9901c6debd71d0ee"
I20260709 12:25:51.372561 26908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4acfec5dd12c4ab8a20a580682d2a42a" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0124e3cddc0049cd893bbd46dd123386"
I20260709 12:25:51.373585 26632 raft_consensus.cc:3055] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:51.373591 26908 raft_consensus.cc:3060] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.374162 26632 raft_consensus.cc:740] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Running, Role: LEADER
I20260709 12:25:51.375115 26632 consensus_queue.cc:260] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.376727 26632 raft_consensus.cc:3060] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.382391 26908 raft_consensus.cc:2468] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 2.
I20260709 12:25:51.384215 26672 leader_election.cc:304] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0124e3cddc0049cd893bbd46dd123386, 5756baf49a8d4598ba0a5e87d70af089; no voters: 
I20260709 12:25:51.385145 26848 raft_consensus.cc:2804] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:51.385705 26848 raft_consensus.cc:697] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 2 LEADER]: Becoming Leader. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Running, Role: LEADER
I20260709 12:25:51.385722 26632 raft_consensus.cc:2468] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 2.
I20260709 12:25:51.386873 26848 consensus_queue.cc:237] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.396737 26453 catalog_manager.cc:5697] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 reported cstate change: term changed from 1 to 2, leader changed from 0103ef679011427d9901c6debd71d0ee (127.16.240.130) to 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "5756baf49a8d4598ba0a5e87d70af089" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:51.408499 26856 raft_consensus.cc:993] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee: : Instructing follower 5756baf49a8d4598ba0a5e87d70af089 to start an election
I20260709 12:25:51.409168 26854 raft_consensus.cc:1081] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Signalling peer 5756baf49a8d4598ba0a5e87d70af089 to start an election
I20260709 12:25:51.410912 26709 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc0e14b9fa7944bcab2242e920f8a51e"
dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
 from {username='slave'} at 127.0.0.1:57308
I20260709 12:25:51.411361 26709 raft_consensus.cc:493] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:51.411598 26709 raft_consensus.cc:3060] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.419661 26709 raft_consensus.cc:515] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.421461 26709 leader_election.cc:290] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 2 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215)
I20260709 12:25:51.422464 26908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0e14b9fa7944bcab2242e920f8a51e" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0124e3cddc0049cd893bbd46dd123386"
I20260709 12:25:51.422719 26632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0e14b9fa7944bcab2242e920f8a51e" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0103ef679011427d9901c6debd71d0ee"
I20260709 12:25:51.423202 26908 raft_consensus.cc:3060] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.423287 26632 raft_consensus.cc:3055] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:51.423729 26632 raft_consensus.cc:740] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Running, Role: LEADER
I20260709 12:25:51.424731 26632 consensus_queue.cc:260] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.426450 26632 raft_consensus.cc:3060] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.432821 26908 raft_consensus.cc:2468] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 2.
I20260709 12:25:51.434413 26672 leader_election.cc:304] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0124e3cddc0049cd893bbd46dd123386, 5756baf49a8d4598ba0a5e87d70af089; no voters: 
I20260709 12:25:51.435233 26848 raft_consensus.cc:2804] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:51.435233 26632 raft_consensus.cc:2468] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 2.
I20260709 12:25:51.436169 26848 raft_consensus.cc:697] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 2 LEADER]: Becoming Leader. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Running, Role: LEADER
I20260709 12:25:51.437207 26848 consensus_queue.cc:237] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:51.444244 26453 catalog_manager.cc:5697] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 reported cstate change: term changed from 1 to 2, leader changed from 0103ef679011427d9901c6debd71d0ee (127.16.240.130) to 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "5756baf49a8d4598ba0a5e87d70af089" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:51.551187 26908 raft_consensus.cc:1275] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Refusing update from remote peer 5756baf49a8d4598ba0a5e87d70af089: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.553568 26949 consensus_queue.cc:1048] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:51.575636 26632 raft_consensus.cc:1275] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Refusing update from remote peer 5756baf49a8d4598ba0a5e87d70af089: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.577062 26848 consensus_queue.cc:1048] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:51.632452 26504 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:51.674098 26908 raft_consensus.cc:3060] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:51.680598 26908 raft_consensus.cc:1275] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [term 3 FOLLOWER]: Refusing update from remote peer 5756baf49a8d4598ba0a5e87d70af089: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:51.682474 26848 consensus_queue.cc:1048] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:51.691818 26632 raft_consensus.cc:1275] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [term 3 FOLLOWER]: Refusing update from remote peer 5756baf49a8d4598ba0a5e87d70af089: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:51.693511 26964 consensus_queue.cc:1048] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:51.771303 26632 raft_consensus.cc:1275] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Refusing update from remote peer 5756baf49a8d4598ba0a5e87d70af089: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.772835 26964 consensus_queue.cc:1048] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:51.784427 26908 raft_consensus.cc:1275] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Refusing update from remote peer 5756baf49a8d4598ba0a5e87d70af089: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.786294 26972 consensus_queue.cc:1048] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:51.830899 26907 raft_consensus.cc:1275] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Refusing update from remote peer 5756baf49a8d4598ba0a5e87d70af089: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.832556 26972 consensus_queue.cc:1048] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:51.844146 26632 raft_consensus.cc:1275] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Refusing update from remote peer 5756baf49a8d4598ba0a5e87d70af089: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.845757 26972 consensus_queue.cc:1048] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:52.087981 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:52.106220 26709 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8652951dd9794f5ba96237691f61617a"
dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
mode: GRACEFUL
new_leader_uuid: "0103ef679011427d9901c6debd71d0ee"
 from {username='slave'} at 127.0.0.1:52946
I20260709 12:25:52.106902 26709 raft_consensus.cc:606] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [term 2 LEADER]: Received request to transfer leadership to TS 0103ef679011427d9901c6debd71d0ee
I20260709 12:25:52.109838 26709 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc0e14b9fa7944bcab2242e920f8a51e"
dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
mode: GRACEFUL
new_leader_uuid: "0103ef679011427d9901c6debd71d0ee"
 from {username='slave'} at 127.0.0.1:52946
I20260709 12:25:52.110352 26709 raft_consensus.cc:606] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 2 LEADER]: Received request to transfer leadership to TS 0103ef679011427d9901c6debd71d0ee
I20260709 12:25:52.111488 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:52.112514 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:52.113196 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:52.166155 26972 raft_consensus.cc:993] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089: : Instructing follower 0103ef679011427d9901c6debd71d0ee to start an election
I20260709 12:25:52.166673 26848 raft_consensus.cc:1081] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [term 2 LEADER]: Signalling peer 0103ef679011427d9901c6debd71d0ee to start an election
I20260709 12:25:52.168637 26632 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8652951dd9794f5ba96237691f61617a"
dest_uuid: "0103ef679011427d9901c6debd71d0ee"
 from {username='slave'} at 127.0.0.1:42156
I20260709 12:25:52.169149 26632 raft_consensus.cc:493] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:52.169492 26632 raft_consensus.cc:3060] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:52.175534 26632 raft_consensus.cc:515] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:52.177209 26632 leader_election.cc:290] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 3 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:52.178175 26908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652951dd9794f5ba96237691f61617a" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0124e3cddc0049cd893bbd46dd123386"
I20260709 12:25:52.178357 26709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652951dd9794f5ba96237691f61617a" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
I20260709 12:25:52.178831 26908 raft_consensus.cc:3060] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:52.179026 26709 raft_consensus.cc:3055] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:52.179416 26709 raft_consensus.cc:740] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Running, Role: LEADER
I20260709 12:25:52.180262 26709 consensus_queue.cc:260] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:52.181318 26709 raft_consensus.cc:3060] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:52.184792 26908 raft_consensus.cc:2468] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 3.
I20260709 12:25:52.186053 26598 leader_election.cc:304] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 0124e3cddc0049cd893bbd46dd123386; no voters: 
I20260709 12:25:52.186095 26709 raft_consensus.cc:2468] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 3.
I20260709 12:25:52.186966 26854 raft_consensus.cc:2804] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:52.187558 26854 raft_consensus.cc:697] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 3 LEADER]: Becoming Leader. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Running, Role: LEADER
I20260709 12:25:52.188519 26854 consensus_queue.cc:237] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:52.196485 26453 catalog_manager.cc:5697] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee reported cstate change: term changed from 2 to 3, leader changed from 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131) to 0103ef679011427d9901c6debd71d0ee (127.16.240.130). New cstate: current_term: 3 leader_uuid: "0103ef679011427d9901c6debd71d0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:52.409196 26972 raft_consensus.cc:993] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089: : Instructing follower 0103ef679011427d9901c6debd71d0ee to start an election
I20260709 12:25:52.409754 26972 raft_consensus.cc:1081] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 2 LEADER]: Signalling peer 0103ef679011427d9901c6debd71d0ee to start an election
I20260709 12:25:52.411545 26632 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc0e14b9fa7944bcab2242e920f8a51e"
dest_uuid: "0103ef679011427d9901c6debd71d0ee"
 from {username='slave'} at 127.0.0.1:42156
I20260709 12:25:52.412180 26632 raft_consensus.cc:493] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:52.412602 26632 raft_consensus.cc:3060] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:52.417821 26632 raft_consensus.cc:515] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:52.419525 26632 leader_election.cc:290] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 3 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:52.420483 26908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0e14b9fa7944bcab2242e920f8a51e" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0124e3cddc0049cd893bbd46dd123386"
I20260709 12:25:52.420922 26709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0e14b9fa7944bcab2242e920f8a51e" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
I20260709 12:25:52.421135 26908 raft_consensus.cc:3060] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:52.421504 26709 raft_consensus.cc:3055] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:52.421810 26709 raft_consensus.cc:740] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Running, Role: LEADER
I20260709 12:25:52.422585 26709 consensus_queue.cc:260] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:52.423978 26709 raft_consensus.cc:3060] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:52.429550 26908 raft_consensus.cc:2468] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 3.
I20260709 12:25:52.431079 26598 leader_election.cc:304] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 0124e3cddc0049cd893bbd46dd123386; no voters: 
I20260709 12:25:52.431589 26709 raft_consensus.cc:2468] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 3.
I20260709 12:25:52.432127 26854 raft_consensus.cc:2804] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:52.432672 26854 raft_consensus.cc:697] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 3 LEADER]: Becoming Leader. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Running, Role: LEADER
I20260709 12:25:52.433518 26854 consensus_queue.cc:237] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:52.439988 26453 catalog_manager.cc:5697] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee reported cstate change: term changed from 2 to 3, leader changed from 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131) to 0103ef679011427d9901c6debd71d0ee (127.16.240.130). New cstate: current_term: 3 leader_uuid: "0103ef679011427d9901c6debd71d0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:52.633806 26504 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:52.762858 26709 raft_consensus.cc:1275] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [term 3 FOLLOWER]: Refusing update from remote peer 0103ef679011427d9901c6debd71d0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:52.762858 26908 raft_consensus.cc:1275] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386 [term 3 FOLLOWER]: Refusing update from remote peer 0103ef679011427d9901c6debd71d0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:52.764760 26856 consensus_queue.cc:1048] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:52.765616 26854 consensus_queue.cc:1048] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:52.918746 26709 raft_consensus.cc:1275] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 3 FOLLOWER]: Refusing update from remote peer 0103ef679011427d9901c6debd71d0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:52.920288 26986 consensus_queue.cc:1048] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:52.931234 26908 raft_consensus.cc:1275] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [term 3 FOLLOWER]: Refusing update from remote peer 0103ef679011427d9901c6debd71d0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:52.933508 26854 consensus_queue.cc:1048] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:53.120600 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:53.128583 26632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27f734d1b5a04b0abd7ad8eab8b08a39"
dest_uuid: "0103ef679011427d9901c6debd71d0ee"
mode: GRACEFUL
new_leader_uuid: "5756baf49a8d4598ba0a5e87d70af089"
 from {username='slave'} at 127.0.0.1:42158
I20260709 12:25:53.129554 26632 raft_consensus.cc:606] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Received request to transfer leadership to TS 5756baf49a8d4598ba0a5e87d70af089
I20260709 12:25:53.133198 26632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "985db528c3f741df95fe12330c6f0e1f"
dest_uuid: "0103ef679011427d9901c6debd71d0ee"
mode: GRACEFUL
new_leader_uuid: "5756baf49a8d4598ba0a5e87d70af089"
 from {username='slave'} at 127.0.0.1:42158
I20260709 12:25:53.133874 26632 raft_consensus.cc:606] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Received request to transfer leadership to TS 5756baf49a8d4598ba0a5e87d70af089
I20260709 12:25:53.135170 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:53.135845 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:53.136610 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:53.251852 26856 raft_consensus.cc:993] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee: : Instructing follower 5756baf49a8d4598ba0a5e87d70af089 to start an election
I20260709 12:25:53.252378 26854 raft_consensus.cc:1081] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Signalling peer 5756baf49a8d4598ba0a5e87d70af089 to start an election
I20260709 12:25:53.253986 26709 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "985db528c3f741df95fe12330c6f0e1f"
dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
 from {username='slave'} at 127.0.0.1:57308
I20260709 12:25:53.254521 26709 raft_consensus.cc:493] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:53.254957 26709 raft_consensus.cc:3060] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:53.260419 26709 raft_consensus.cc:515] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:53.262250 26709 leader_election.cc:290] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 2 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215)
I20260709 12:25:53.263206 26908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985db528c3f741df95fe12330c6f0e1f" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0124e3cddc0049cd893bbd46dd123386"
I20260709 12:25:53.263428 26632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985db528c3f741df95fe12330c6f0e1f" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0103ef679011427d9901c6debd71d0ee"
I20260709 12:25:53.263938 26908 raft_consensus.cc:3060] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:53.264092 26632 raft_consensus.cc:3055] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:53.264825 26632 raft_consensus.cc:740] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Running, Role: LEADER
I20260709 12:25:53.265736 26632 consensus_queue.cc:260] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:53.266829 26632 raft_consensus.cc:3060] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:53.270494 26908 raft_consensus.cc:2468] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 2.
I20260709 12:25:53.271901 26672 leader_election.cc:304] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0124e3cddc0049cd893bbd46dd123386, 5756baf49a8d4598ba0a5e87d70af089; no voters: 
I20260709 12:25:53.272671 26972 raft_consensus.cc:2804] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:53.272632 26632 raft_consensus.cc:2468] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 2.
I20260709 12:25:53.274626 26972 raft_consensus.cc:697] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089 [term 2 LEADER]: Becoming Leader. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Running, Role: LEADER
I20260709 12:25:53.275686 26972 consensus_queue.cc:237] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:53.283665 26452 catalog_manager.cc:5697] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089 reported cstate change: term changed from 1 to 2, leader changed from 0103ef679011427d9901c6debd71d0ee (127.16.240.130) to 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "5756baf49a8d4598ba0a5e87d70af089" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:53.294792 26856 raft_consensus.cc:993] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee: : Instructing follower 5756baf49a8d4598ba0a5e87d70af089 to start an election
I20260709 12:25:53.295346 26856 raft_consensus.cc:1081] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Signalling peer 5756baf49a8d4598ba0a5e87d70af089 to start an election
I20260709 12:25:53.297124 26709 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27f734d1b5a04b0abd7ad8eab8b08a39"
dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
 from {username='slave'} at 127.0.0.1:57308
I20260709 12:25:53.297693 26709 raft_consensus.cc:493] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:53.298045 26709 raft_consensus.cc:3060] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:53.304623 26709 raft_consensus.cc:515] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:53.307022 26709 leader_election.cc:290] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 2 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215)
I20260709 12:25:53.308036 26908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f734d1b5a04b0abd7ad8eab8b08a39" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0124e3cddc0049cd893bbd46dd123386"
I20260709 12:25:53.308476 26632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f734d1b5a04b0abd7ad8eab8b08a39" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0103ef679011427d9901c6debd71d0ee"
I20260709 12:25:53.308732 26908 raft_consensus.cc:3060] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:53.309046 26632 raft_consensus.cc:3055] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:53.309340 26632 raft_consensus.cc:740] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Running, Role: LEADER
I20260709 12:25:53.310341 26632 consensus_queue.cc:260] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:53.311708 26632 raft_consensus.cc:3060] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:53.317435 26908 raft_consensus.cc:2468] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 2.
I20260709 12:25:53.318758 26672 leader_election.cc:304] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0124e3cddc0049cd893bbd46dd123386, 5756baf49a8d4598ba0a5e87d70af089; no voters: 
I20260709 12:25:53.318976 26632 raft_consensus.cc:2468] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 2.
I20260709 12:25:53.319823 26972 raft_consensus.cc:2804] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:53.320421 26972 raft_consensus.cc:697] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [term 2 LEADER]: Becoming Leader. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Running, Role: LEADER
I20260709 12:25:53.321293 26972 consensus_queue.cc:237] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:53.329473 26452 catalog_manager.cc:5697] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 reported cstate change: term changed from 1 to 2, leader changed from 0103ef679011427d9901c6debd71d0ee (127.16.240.130) to 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "5756baf49a8d4598ba0a5e87d70af089" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:53.634888 26504 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:53.786293 26632 raft_consensus.cc:1275] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Refusing update from remote peer 5756baf49a8d4598ba0a5e87d70af089: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:53.788080 26972 consensus_queue.cc:1048] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:53.794943 26908 raft_consensus.cc:1275] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Refusing update from remote peer 5756baf49a8d4598ba0a5e87d70af089: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:53.797433 26998 consensus_queue.cc:1048] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:53.824867 26908 raft_consensus.cc:1275] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Refusing update from remote peer 5756baf49a8d4598ba0a5e87d70af089: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:53.826169 26991 consensus_queue.cc:1048] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:53.837209 26632 raft_consensus.cc:1275] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Refusing update from remote peer 5756baf49a8d4598ba0a5e87d70af089: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:53.838721 26998 consensus_queue.cc:1048] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:54.143931 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:54.152240 26709 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4acfec5dd12c4ab8a20a580682d2a42a"
dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
mode: GRACEFUL
new_leader_uuid: "0103ef679011427d9901c6debd71d0ee"
 from {username='slave'} at 127.0.0.1:52946
I20260709 12:25:54.152949 26709 raft_consensus.cc:606] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 2 LEADER]: Received request to transfer leadership to TS 0103ef679011427d9901c6debd71d0ee
I20260709 12:25:54.156008 26709 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec619159fb614124adfd72bc4b8763ce"
dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
mode: GRACEFUL
new_leader_uuid: "0103ef679011427d9901c6debd71d0ee"
 from {username='slave'} at 127.0.0.1:52946
I20260709 12:25:54.156728 26709 raft_consensus.cc:606] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [term 1 LEADER]: Received request to transfer leadership to TS 0103ef679011427d9901c6debd71d0ee
I20260709 12:25:54.157990 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:54.158604 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:54.159360 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:54.266402 26991 raft_consensus.cc:993] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089: : Instructing follower 0103ef679011427d9901c6debd71d0ee to start an election
I20260709 12:25:54.266916 26998 raft_consensus.cc:1081] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [term 1 LEADER]: Signalling peer 0103ef679011427d9901c6debd71d0ee to start an election
I20260709 12:25:54.268507 26633 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec619159fb614124adfd72bc4b8763ce"
dest_uuid: "0103ef679011427d9901c6debd71d0ee"
 from {username='slave'} at 127.0.0.1:42156
I20260709 12:25:54.269157 26633 raft_consensus.cc:493] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:54.269490 26633 raft_consensus.cc:3060] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.275887 26633 raft_consensus.cc:515] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:54.277621 26633 leader_election.cc:290] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 2 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:54.278666 26908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec619159fb614124adfd72bc4b8763ce" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0124e3cddc0049cd893bbd46dd123386"
I20260709 12:25:54.278900 26709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec619159fb614124adfd72bc4b8763ce" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
I20260709 12:25:54.279237 26908 raft_consensus.cc:3060] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.279532 26709 raft_consensus.cc:3055] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:54.279851 26709 raft_consensus.cc:740] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Running, Role: LEADER
I20260709 12:25:54.280642 26709 consensus_queue.cc:260] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:54.281826 26709 raft_consensus.cc:3060] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.284667 26991 raft_consensus.cc:993] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089: : Instructing follower 0103ef679011427d9901c6debd71d0ee to start an election
I20260709 12:25:54.285280 26998 raft_consensus.cc:1081] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 2 LEADER]: Signalling peer 0103ef679011427d9901c6debd71d0ee to start an election
I20260709 12:25:54.286353 26908 raft_consensus.cc:2468] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 2.
I20260709 12:25:54.287140 26633 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4acfec5dd12c4ab8a20a580682d2a42a"
dest_uuid: "0103ef679011427d9901c6debd71d0ee"
 from {username='slave'} at 127.0.0.1:42156
I20260709 12:25:54.287611 26598 leader_election.cc:304] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 0124e3cddc0049cd893bbd46dd123386; no voters: 
I20260709 12:25:54.287793 26633 raft_consensus.cc:493] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:54.288281 26633 raft_consensus.cc:3060] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:54.288511 26709 raft_consensus.cc:2468] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 2.
I20260709 12:25:54.288499 26986 raft_consensus.cc:2804] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:54.292341 26986 raft_consensus.cc:697] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [term 2 LEADER]: Becoming Leader. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Running, Role: LEADER
I20260709 12:25:54.293589 26986 consensus_queue.cc:237] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:54.295835 26633 raft_consensus.cc:515] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:54.298468 26633 leader_election.cc:290] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 3 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131:41747)
I20260709 12:25:54.299260 26908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4acfec5dd12c4ab8a20a580682d2a42a" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0124e3cddc0049cd893bbd46dd123386"
I20260709 12:25:54.300042 26908 raft_consensus.cc:3060] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:54.300751 26709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4acfec5dd12c4ab8a20a580682d2a42a" candidate_uuid: "0103ef679011427d9901c6debd71d0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
I20260709 12:25:54.301391 26709 raft_consensus.cc:3055] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:54.301813 26709 raft_consensus.cc:740] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Running, Role: LEADER
I20260709 12:25:54.302636 26709 consensus_queue.cc:260] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:54.302423 26452 catalog_manager.cc:5697] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee reported cstate change: term changed from 1 to 2, leader changed from 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131) to 0103ef679011427d9901c6debd71d0ee (127.16.240.130). New cstate: current_term: 2 leader_uuid: "0103ef679011427d9901c6debd71d0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.303998 26709 raft_consensus.cc:3060] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:54.306404 26908 raft_consensus.cc:2468] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 3.
I20260709 12:25:54.307632 26598 leader_election.cc:304] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0103ef679011427d9901c6debd71d0ee, 0124e3cddc0049cd893bbd46dd123386; no voters: 
I20260709 12:25:54.308462 26986 raft_consensus.cc:2804] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:54.309069 26986 raft_consensus.cc:697] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 3 LEADER]: Becoming Leader. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Running, Role: LEADER
I20260709 12:25:54.309903 26986 consensus_queue.cc:237] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:54.310942 26709 raft_consensus.cc:2468] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103ef679011427d9901c6debd71d0ee in term 3.
I20260709 12:25:54.323537 26452 catalog_manager.cc:5697] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee reported cstate change: term changed from 2 to 3, leader changed from 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131) to 0103ef679011427d9901c6debd71d0ee (127.16.240.130). New cstate: current_term: 3 leader_uuid: "0103ef679011427d9901c6debd71d0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:54.636281 26504 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:54.695047 26908 raft_consensus.cc:1275] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Refusing update from remote peer 0103ef679011427d9901c6debd71d0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:54.696923 27006 consensus_queue.cc:1048] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:54.708437 26709 raft_consensus.cc:1275] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Refusing update from remote peer 0103ef679011427d9901c6debd71d0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:54.711166 26986 consensus_queue.cc:1048] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:54.750746 26908 raft_consensus.cc:1275] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [term 3 FOLLOWER]: Refusing update from remote peer 0103ef679011427d9901c6debd71d0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:54.752507 26986 consensus_queue.cc:1048] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:54.763206 26709 raft_consensus.cc:1275] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 3 FOLLOWER]: Refusing update from remote peer 0103ef679011427d9901c6debd71d0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:54.765259 26856 consensus_queue.cc:1048] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:55.166497 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:55.174764 26633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4acfec5dd12c4ab8a20a580682d2a42a"
dest_uuid: "0103ef679011427d9901c6debd71d0ee"
mode: GRACEFUL
new_leader_uuid: "5756baf49a8d4598ba0a5e87d70af089"
 from {username='slave'} at 127.0.0.1:42158
I20260709 12:25:55.175333 26633 raft_consensus.cc:606] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 3 LEADER]: Received request to transfer leadership to TS 5756baf49a8d4598ba0a5e87d70af089
I20260709 12:25:55.178217 26633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc0e14b9fa7944bcab2242e920f8a51e"
dest_uuid: "0103ef679011427d9901c6debd71d0ee"
mode: GRACEFUL
new_leader_uuid: "5756baf49a8d4598ba0a5e87d70af089"
 from {username='slave'} at 127.0.0.1:42158
I20260709 12:25:55.178951 26633 raft_consensus.cc:606] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 3 LEADER]: Received request to transfer leadership to TS 5756baf49a8d4598ba0a5e87d70af089
I20260709 12:25:55.180157 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:55.180882 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:55.181707 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:55.254062 26856 raft_consensus.cc:993] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee: : Instructing follower 5756baf49a8d4598ba0a5e87d70af089 to start an election
I20260709 12:25:55.254566 26986 raft_consensus.cc:1081] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 3 LEADER]: Signalling peer 5756baf49a8d4598ba0a5e87d70af089 to start an election
I20260709 12:25:55.256402 26709 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4acfec5dd12c4ab8a20a580682d2a42a"
dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
 from {username='slave'} at 127.0.0.1:57308
I20260709 12:25:55.256995 26709 raft_consensus.cc:493] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:55.257372 26709 raft_consensus.cc:3060] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:55.263947 26709 raft_consensus.cc:515] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:55.265625 26709 leader_election.cc:290] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 4 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215)
I20260709 12:25:55.267096 26908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4acfec5dd12c4ab8a20a580682d2a42a" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0124e3cddc0049cd893bbd46dd123386"
I20260709 12:25:55.267143 26633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4acfec5dd12c4ab8a20a580682d2a42a" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0103ef679011427d9901c6debd71d0ee"
I20260709 12:25:55.267983 26908 raft_consensus.cc:3060] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:55.268119 26633 raft_consensus.cc:3055] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:55.268606 26633 raft_consensus.cc:740] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Running, Role: LEADER
I20260709 12:25:55.269407 26633 consensus_queue.cc:260] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:55.270776 26633 raft_consensus.cc:3060] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:55.274843 26908 raft_consensus.cc:2468] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 4.
I20260709 12:25:55.276048 26672 leader_election.cc:304] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0124e3cddc0049cd893bbd46dd123386, 5756baf49a8d4598ba0a5e87d70af089; no voters: 
I20260709 12:25:55.276758 26991 raft_consensus.cc:2804] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:55.277240 26991 raft_consensus.cc:697] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 4 LEADER]: Becoming Leader. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Running, Role: LEADER
I20260709 12:25:55.278182 26991 consensus_queue.cc:237] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:55.278712 26633 raft_consensus.cc:2468] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 4.
I20260709 12:25:55.285128 26452 catalog_manager.cc:5697] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 reported cstate change: term changed from 3 to 4, leader changed from 0103ef679011427d9901c6debd71d0ee (127.16.240.130) to 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131). New cstate: current_term: 4 leader_uuid: "5756baf49a8d4598ba0a5e87d70af089" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:55.567793 26856 raft_consensus.cc:993] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee: : Instructing follower 5756baf49a8d4598ba0a5e87d70af089 to start an election
I20260709 12:25:55.568284 26986 raft_consensus.cc:1081] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 3 LEADER]: Signalling peer 5756baf49a8d4598ba0a5e87d70af089 to start an election
I20260709 12:25:55.570108 26709 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc0e14b9fa7944bcab2242e920f8a51e"
dest_uuid: "5756baf49a8d4598ba0a5e87d70af089"
 from {username='slave'} at 127.0.0.1:57308
I20260709 12:25:55.570585 26709 raft_consensus.cc:493] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:55.570868 26709 raft_consensus.cc:3060] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:55.576450 26709 raft_consensus.cc:515] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:55.578613 26709 leader_election.cc:290] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 4 election: Requested vote from peers 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903), 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215)
I20260709 12:25:55.579523 26908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0e14b9fa7944bcab2242e920f8a51e" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0124e3cddc0049cd893bbd46dd123386"
I20260709 12:25:55.579838 26633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0e14b9fa7944bcab2242e920f8a51e" candidate_uuid: "5756baf49a8d4598ba0a5e87d70af089" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0103ef679011427d9901c6debd71d0ee"
I20260709 12:25:55.580216 26908 raft_consensus.cc:3060] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:55.580554 26633 raft_consensus.cc:3055] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:55.580982 26633 raft_consensus.cc:740] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0103ef679011427d9901c6debd71d0ee, State: Running, Role: LEADER
I20260709 12:25:55.581753 26633 consensus_queue.cc:260] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:55.582779 26633 raft_consensus.cc:3060] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:55.587586 26908 raft_consensus.cc:2468] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 4.
I20260709 12:25:55.588959 26672 leader_election.cc:304] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0124e3cddc0049cd893bbd46dd123386, 5756baf49a8d4598ba0a5e87d70af089; no voters: 
I20260709 12:25:55.589046 26633 raft_consensus.cc:2468] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5756baf49a8d4598ba0a5e87d70af089 in term 4.
I20260709 12:25:55.589730 26991 raft_consensus.cc:2804] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:55.590221 26991 raft_consensus.cc:697] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 4 LEADER]: Becoming Leader. State: Replica: 5756baf49a8d4598ba0a5e87d70af089, State: Running, Role: LEADER
I20260709 12:25:55.590975 26991 consensus_queue.cc:237] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } }
I20260709 12:25:55.598322 26452 catalog_manager.cc:5697] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 reported cstate change: term changed from 3 to 4, leader changed from 0103ef679011427d9901c6debd71d0ee (127.16.240.130) to 5756baf49a8d4598ba0a5e87d70af089 (127.16.240.131). New cstate: current_term: 4 leader_uuid: "5756baf49a8d4598ba0a5e87d70af089" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5756baf49a8d4598ba0a5e87d70af089" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 41747 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:55.637672 26504 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:55.681238 26633 raft_consensus.cc:1275] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 4 FOLLOWER]: Refusing update from remote peer 5756baf49a8d4598ba0a5e87d70af089: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:55.682719 26991 consensus_queue.cc:1048] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:55.694183 26908 raft_consensus.cc:1275] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [term 4 FOLLOWER]: Refusing update from remote peer 5756baf49a8d4598ba0a5e87d70af089: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:55.695554 26991 consensus_queue.cc:1048] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:56.003872 26908 raft_consensus.cc:1275] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [term 4 FOLLOWER]: Refusing update from remote peer 5756baf49a8d4598ba0a5e87d70af089: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:56.005420 26991 consensus_queue.cc:1048] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0124e3cddc0049cd893bbd46dd123386" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 45903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:56.015652 26633 raft_consensus.cc:1275] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 4 FOLLOWER]: Refusing update from remote peer 5756baf49a8d4598ba0a5e87d70af089: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:56.023962 27029 consensus_queue.cc:1048] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0103ef679011427d9901c6debd71d0ee" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:56.188634 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:56.215806 17346 tablet_server.cc:179] TabletServer@127.16.240.129:45903 shutting down...
I20260709 12:25:56.242908 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:56.243579 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:56.244297 17346 raft_consensus.cc:2243] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:56.244750 17346 raft_consensus.cc:2272] T ec619159fb614124adfd72bc4b8763ce P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.246891 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:56.247454 17346 raft_consensus.cc:2243] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:56.248410 17346 raft_consensus.cc:2272] T dc0e14b9fa7944bcab2242e920f8a51e P 0124e3cddc0049cd893bbd46dd123386 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.251392 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:56.252295 17346 raft_consensus.cc:2243] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:56.252786 17346 raft_consensus.cc:2272] T 4acfec5dd12c4ab8a20a580682d2a42a P 0124e3cddc0049cd893bbd46dd123386 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.255947 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:56.256544 17346 raft_consensus.cc:2243] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:56.256965 17346 raft_consensus.cc:2272] T 40f10e687e5d47ab94cff8a28641c03d P 0124e3cddc0049cd893bbd46dd123386 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.258862 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:56.259364 17346 raft_consensus.cc:2243] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:56.260036 17346 raft_consensus.cc:2272] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.262053 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:56.262566 17346 raft_consensus.cc:2243] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:56.262992 17346 raft_consensus.cc:2272] T 8652951dd9794f5ba96237691f61617a P 0124e3cddc0049cd893bbd46dd123386 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.265250 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:56.265754 17346 raft_consensus.cc:2243] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:56.266225 17346 raft_consensus.cc:2272] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.269045 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:56.269637 17346 raft_consensus.cc:2243] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:56.270093 17346 raft_consensus.cc:2272] T dd2b9d6bc39a43d39212393ed0834a8e P 0124e3cddc0049cd893bbd46dd123386 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.272809 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:56.273527 17346 raft_consensus.cc:2243] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:56.274195 17346 raft_consensus.cc:2272] T 985db528c3f741df95fe12330c6f0e1f P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.276396 17346 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:56.276856 17346 raft_consensus.cc:2243] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:56.277225 17346 raft_consensus.cc:2272] T c23edbfdff914fcdbe4fa0cd9267c789 P 0124e3cddc0049cd893bbd46dd123386 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:56.292146 26598 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 100 similar messages]
W20260709 12:25:56.294998 26598 consensus_peers.cc:597] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:56.309144 17346 tablet_server.cc:196] TabletServer@127.16.240.129:45903 shutdown complete.
W20260709 12:25:56.320125 26672 consensus_peers.cc:597] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:56.330216 26672 consensus_peers.cc:597] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:56.333802 17346 tablet_server.cc:179] TabletServer@127.16.240.130:0 shutting down...
W20260709 12:25:56.344085 26671 consensus_peers.cc:597] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 -> Peer 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215): Couldn't send request to peer 0103ef679011427d9901c6debd71d0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:56.360543 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:56.361346 17346 tablet_replica.cc:333] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee: stopping tablet replica
I20260709 12:25:56.362242 17346 raft_consensus.cc:2243] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:56.362864 17346 raft_consensus.cc:2272] T c23edbfdff914fcdbe4fa0cd9267c789 P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.365296 17346 tablet_replica.cc:333] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee: stopping tablet replica
I20260709 12:25:56.365978 17346 raft_consensus.cc:2243] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:56.366449 17346 raft_consensus.cc:2272] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.368903 17346 tablet_replica.cc:333] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee: stopping tablet replica
I20260709 12:25:56.369951 17346 raft_consensus.cc:2243] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:56.371239 17346 raft_consensus.cc:2272] T dd2b9d6bc39a43d39212393ed0834a8e P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:56.375053 26672 consensus_peers.cc:597] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 -> Peer 0124e3cddc0049cd893bbd46dd123386 (127.16.240.129:45903): Couldn't send request to peer 0124e3cddc0049cd893bbd46dd123386. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:45903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:56.375396 17346 tablet_replica.cc:333] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee: stopping tablet replica
I20260709 12:25:56.376209 17346 raft_consensus.cc:2243] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:56.377321 17346 raft_consensus.cc:2272] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 0103ef679011427d9901c6debd71d0ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.380743 17346 tablet_replica.cc:333] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee: stopping tablet replica
I20260709 12:25:56.381916 17346 raft_consensus.cc:2243] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:56.382592 17346 raft_consensus.cc:2272] T dc0e14b9fa7944bcab2242e920f8a51e P 0103ef679011427d9901c6debd71d0ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.385643 17346 tablet_replica.cc:333] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee: stopping tablet replica
I20260709 12:25:56.386204 17346 raft_consensus.cc:2243] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:56.386742 17346 raft_consensus.cc:2272] T 985db528c3f741df95fe12330c6f0e1f P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.390003 17346 tablet_replica.cc:333] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee: stopping tablet replica
I20260709 12:25:56.390743 17346 raft_consensus.cc:2243] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:56.391541 17346 raft_consensus.cc:2272] T 4acfec5dd12c4ab8a20a580682d2a42a P 0103ef679011427d9901c6debd71d0ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.394522 17346 tablet_replica.cc:333] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee: stopping tablet replica
I20260709 12:25:56.395082 17346 raft_consensus.cc:2243] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:56.395524 17346 raft_consensus.cc:2272] T 40f10e687e5d47ab94cff8a28641c03d P 0103ef679011427d9901c6debd71d0ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.397594 17346 tablet_replica.cc:333] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee: stopping tablet replica
I20260709 12:25:56.398051 17346 raft_consensus.cc:2243] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:56.398833 17346 raft_consensus.cc:2272] T 8652951dd9794f5ba96237691f61617a P 0103ef679011427d9901c6debd71d0ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.401477 17346 tablet_replica.cc:333] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee: stopping tablet replica
I20260709 12:25:56.402065 17346 raft_consensus.cc:2243] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:56.402891 17346 raft_consensus.cc:2272] T ec619159fb614124adfd72bc4b8763ce P 0103ef679011427d9901c6debd71d0ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.439190 17346 tablet_server.cc:196] TabletServer@127.16.240.130:0 shutdown complete.
W20260709 12:25:56.460307 26671 consensus_peers.cc:597] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 -> Peer 0103ef679011427d9901c6debd71d0ee (127.16.240.130:44215): Couldn't send request to peer 0103ef679011427d9901c6debd71d0ee. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:44215: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:56.471287 17346 tablet_server.cc:179] TabletServer@127.16.240.131:0 shutting down...
I20260709 12:25:56.500425 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:56.501096 17346 tablet_replica.cc:333] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089: stopping tablet replica
I20260709 12:25:56.501899 17346 raft_consensus.cc:2243] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:56.502812 17346 raft_consensus.cc:2272] T 985db528c3f741df95fe12330c6f0e1f P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.505205 17346 tablet_replica.cc:333] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089: stopping tablet replica
I20260709 12:25:56.505870 17346 raft_consensus.cc:2243] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:56.506767 17346 raft_consensus.cc:2272] T dc0e14b9fa7944bcab2242e920f8a51e P 5756baf49a8d4598ba0a5e87d70af089 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.509490 17346 tablet_replica.cc:333] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089: stopping tablet replica
I20260709 12:25:56.510171 17346 raft_consensus.cc:2243] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:56.510637 17346 raft_consensus.cc:2272] T ec619159fb614124adfd72bc4b8763ce P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.512945 17346 tablet_replica.cc:333] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089: stopping tablet replica
I20260709 12:25:56.513552 17346 raft_consensus.cc:2243] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:56.514012 17346 raft_consensus.cc:2272] T 8652951dd9794f5ba96237691f61617a P 5756baf49a8d4598ba0a5e87d70af089 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.516234 17346 tablet_replica.cc:333] T dd2b9d6bc39a43d39212393ed0834a8e P 5756baf49a8d4598ba0a5e87d70af089: stopping tablet replica
I20260709 12:25:56.516825 17346 raft_consensus.cc:2243] T dd2b9d6bc39a43d39212393ed0834a8e P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:56.517309 17346 raft_consensus.cc:2272] T dd2b9d6bc39a43d39212393ed0834a8e P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.519465 17346 tablet_replica.cc:333] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089: stopping tablet replica
I20260709 12:25:56.520117 17346 raft_consensus.cc:2243] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:56.520934 17346 raft_consensus.cc:2272] T 27f734d1b5a04b0abd7ad8eab8b08a39 P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.523226 17346 tablet_replica.cc:333] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 5756baf49a8d4598ba0a5e87d70af089: stopping tablet replica
I20260709 12:25:56.523849 17346 raft_consensus.cc:2243] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:56.524322 17346 raft_consensus.cc:2272] T 606a6f609e4d4a6da9e2f288bbaaa0f8 P 5756baf49a8d4598ba0a5e87d70af089 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.526407 17346 tablet_replica.cc:333] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089: stopping tablet replica
I20260709 12:25:56.526974 17346 raft_consensus.cc:2243] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:56.527864 17346 raft_consensus.cc:2272] T c23edbfdff914fcdbe4fa0cd9267c789 P 5756baf49a8d4598ba0a5e87d70af089 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.529954 17346 tablet_replica.cc:333] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089: stopping tablet replica
I20260709 12:25:56.530512 17346 raft_consensus.cc:2243] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:56.531358 17346 raft_consensus.cc:2272] T 4acfec5dd12c4ab8a20a580682d2a42a P 5756baf49a8d4598ba0a5e87d70af089 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.534617 17346 tablet_replica.cc:333] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089: stopping tablet replica
I20260709 12:25:56.535207 17346 raft_consensus.cc:2243] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:56.536247 17346 raft_consensus.cc:2272] T 40f10e687e5d47ab94cff8a28641c03d P 5756baf49a8d4598ba0a5e87d70af089 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.575227 17346 tablet_server.cc:196] TabletServer@127.16.240.131:0 shutdown complete.
I20260709 12:25:56.603690 17346 master.cc:562] Master@127.16.240.190:44961 shutting down...
I20260709 12:25:56.633533 17346 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:56.634080 17346 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:56.634380 17346 tablet_replica.cc:333] T 00000000000000000000000000000000 P 238de6455f2246389d22370102f7128f: stopping tablet replica
I20260709 12:25:56.656204 17346 master.cc:584] Master@127.16.240.190:44961 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13236 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:25:56.704341 17346 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.240.190:41523
I20260709 12:25:56.705598 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:56.712266 27037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:56.712280 27036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:56.712507 27039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:56.713899 17346 server_base.cc:1061] running on GCE node
I20260709 12:25:56.714918 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:56.715106 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:56.715305 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599956715290 us; error 0 us; skew 500 ppm
I20260709 12:25:56.716811 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:56.719305 17346 webserver.cc:533] Webserver started at http://127.16.240.190:37341/ using document root <none> and password file <none>
I20260709 12:25:56.719914 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:56.720115 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:56.720423 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:56.721602 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599638884573-17346-0/minicluster-data/master-0-root/instance:
uuid: "a37bae6cfea44ee396a61714c7590f9f"
format_stamp: "Formatted at 2026-07-09 12:25:56 on dist-test-slave-7xpw"
I20260709 12:25:56.726217 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:25:56.730041 27044 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:56.731036 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:25:56.731312 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599638884573-17346-0/minicluster-data/master-0-root
uuid: "a37bae6cfea44ee396a61714c7590f9f"
format_stamp: "Formatted at 2026-07-09 12:25:56 on dist-test-slave-7xpw"
I20260709 12:25:56.731599 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599638884573-17346-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599638884573-17346-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599638884573-17346-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:56.757078 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:56.758239 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:56.800949 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.190:41523
I20260709 12:25:56.801067 27095 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.190:41523 every 8 connection(s)
I20260709 12:25:56.805029 27096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.817209 27096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f: Bootstrap starting.
I20260709 12:25:56.822248 27096 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.827396 27096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f: No bootstrap required, opened a new log
I20260709 12:25:56.830534 27096 raft_consensus.cc:359] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a37bae6cfea44ee396a61714c7590f9f" member_type: VOTER }
I20260709 12:25:56.831372 27096 raft_consensus.cc:385] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.831651 27096 raft_consensus.cc:740] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a37bae6cfea44ee396a61714c7590f9f, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.832464 27096 consensus_queue.cc:260] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a37bae6cfea44ee396a61714c7590f9f" member_type: VOTER }
I20260709 12:25:56.833007 27096 raft_consensus.cc:399] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:56.833259 27096 raft_consensus.cc:493] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:56.833549 27096 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.838886 27096 raft_consensus.cc:515] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a37bae6cfea44ee396a61714c7590f9f" member_type: VOTER }
I20260709 12:25:56.839496 27096 leader_election.cc:304] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a37bae6cfea44ee396a61714c7590f9f; no voters: 
I20260709 12:25:56.840725 27096 leader_election.cc:290] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:56.841143 27100 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:56.842598 27100 raft_consensus.cc:697] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f [term 1 LEADER]: Becoming Leader. State: Replica: a37bae6cfea44ee396a61714c7590f9f, State: Running, Role: LEADER
I20260709 12:25:56.843295 27100 consensus_queue.cc:237] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a37bae6cfea44ee396a61714c7590f9f" member_type: VOTER }
I20260709 12:25:56.844113 27096 sys_catalog.cc:565] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:56.850644 27102 sys_catalog.cc:455] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a37bae6cfea44ee396a61714c7590f9f. Latest consensus state: current_term: 1 leader_uuid: "a37bae6cfea44ee396a61714c7590f9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a37bae6cfea44ee396a61714c7590f9f" member_type: VOTER } }
I20260709 12:25:56.851094 27101 sys_catalog.cc:455] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a37bae6cfea44ee396a61714c7590f9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a37bae6cfea44ee396a61714c7590f9f" member_type: VOTER } }
I20260709 12:25:56.851717 27102 sys_catalog.cc:458] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:56.852084 27101 sys_catalog.cc:458] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:56.854753 27107 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:56.863147 27107 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:56.864296 17346 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:56.872641 27107 catalog_manager.cc:1383] Generated new cluster ID: 1dbfb8ed2335405eb1e81d208fb7d53f
I20260709 12:25:56.872982 27107 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:56.887739 27107 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:56.889420 27107 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:56.914693 27107 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f: Generated new TSK 0
I20260709 12:25:56.915390 27107 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:56.932691 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:56.940897 27118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:56.942561 27119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:56.944562 17346 server_base.cc:1061] running on GCE node
W20260709 12:25:56.944638 27121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:56.946306 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:56.946511 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:56.946733 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599956946695 us; error 0 us; skew 500 ppm
I20260709 12:25:56.947312 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:56.950629 17346 webserver.cc:533] Webserver started at http://127.16.240.129:34955/ using document root <none> and password file <none>
I20260709 12:25:56.951179 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:56.951363 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:56.951664 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:56.952934 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599638884573-17346-0/minicluster-data/ts-0-root/instance:
uuid: "6003e8384ae843f58b9dff24c59e87aa"
format_stamp: "Formatted at 2026-07-09 12:25:56 on dist-test-slave-7xpw"
I20260709 12:25:56.957798 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:25:56.961541 27127 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:56.962357 17346 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:25:56.962697 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599638884573-17346-0/minicluster-data/ts-0-root
uuid: "6003e8384ae843f58b9dff24c59e87aa"
format_stamp: "Formatted at 2026-07-09 12:25:56 on dist-test-slave-7xpw"
I20260709 12:25:56.963017 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599638884573-17346-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599638884573-17346-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599638884573-17346-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:56.981755 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:56.983107 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:56.985308 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:56.988436 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:56.988636 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:56.988910 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:56.989077 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:57.035869 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.129:37067
I20260709 12:25:57.036149 27189 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.129:37067 every 8 connection(s)
I20260709 12:25:57.041039 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:57.049271 27194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:57.050874 27195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:57.053191 17346 server_base.cc:1061] running on GCE node
W20260709 12:25:57.054080 27198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:57.055343 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:57.055600 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:57.055835 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599957055814 us; error 0 us; skew 500 ppm
I20260709 12:25:57.056461 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:57.056828 27190 heartbeater.cc:344] Connected to a master server at 127.16.240.190:41523
I20260709 12:25:57.057264 27190 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:57.058167 27190 heartbeater.cc:507] Master 127.16.240.190:41523 requested a full tablet report, sending...
I20260709 12:25:57.059508 17346 webserver.cc:533] Webserver started at http://127.16.240.130:40119/ using document root <none> and password file <none>
I20260709 12:25:57.060184 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:57.060400 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:57.060696 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:57.061136 27061 ts_manager.cc:194] Registered new tserver with Master: 6003e8384ae843f58b9dff24c59e87aa (127.16.240.129:37067)
I20260709 12:25:57.061952 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599638884573-17346-0/minicluster-data/ts-1-root/instance:
uuid: "4e3bc1f809a947df942a4bad3a2ff46a"
format_stamp: "Formatted at 2026-07-09 12:25:57 on dist-test-slave-7xpw"
I20260709 12:25:57.063150 27061 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36260
I20260709 12:25:57.067132 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.002s
I20260709 12:25:57.070940 27203 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:57.071805 17346 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:25:57.072136 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599638884573-17346-0/minicluster-data/ts-1-root
uuid: "4e3bc1f809a947df942a4bad3a2ff46a"
format_stamp: "Formatted at 2026-07-09 12:25:57 on dist-test-slave-7xpw"
I20260709 12:25:57.072467 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599638884573-17346-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599638884573-17346-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599638884573-17346-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:57.090265 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:57.091596 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:57.093166 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:57.095434 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:57.095691 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:57.096007 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:57.096197 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:57.142726 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.130:37301
I20260709 12:25:57.142853 27265 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.130:37301 every 8 connection(s)
I20260709 12:25:57.148808 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:57.158849 27270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:57.160181 27269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:57.161453 27273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:57.162251 17346 server_base.cc:1061] running on GCE node
I20260709 12:25:57.163462 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:57.163798 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:57.164022 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599957164004 us; error 0 us; skew 500 ppm
I20260709 12:25:57.164759 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:57.164757 27266 heartbeater.cc:344] Connected to a master server at 127.16.240.190:41523
I20260709 12:25:57.165447 27266 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:57.166435 27266 heartbeater.cc:507] Master 127.16.240.190:41523 requested a full tablet report, sending...
I20260709 12:25:57.167701 17346 webserver.cc:533] Webserver started at http://127.16.240.131:40835/ using document root <none> and password file <none>
I20260709 12:25:57.168476 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:57.168707 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:57.168991 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:57.168977 27061 ts_manager.cc:194] Registered new tserver with Master: 4e3bc1f809a947df942a4bad3a2ff46a (127.16.240.130:37301)
I20260709 12:25:57.170606 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599638884573-17346-0/minicluster-data/ts-2-root/instance:
uuid: "cc9eb4205b3745a4bf66eb2357e4f308"
format_stamp: "Formatted at 2026-07-09 12:25:57 on dist-test-slave-7xpw"
I20260709 12:25:57.170661 27061 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36276
I20260709 12:25:57.176033 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 12:25:57.180207 27278 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:57.181172 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 12:25:57.181452 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599638884573-17346-0/minicluster-data/ts-2-root
uuid: "cc9eb4205b3745a4bf66eb2357e4f308"
format_stamp: "Formatted at 2026-07-09 12:25:57 on dist-test-slave-7xpw"
I20260709 12:25:57.181703 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599638884573-17346-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599638884573-17346-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599638884573-17346-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:57.203068 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:57.204385 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:57.205848 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:57.208525 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:57.208814 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:57.209210 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:57.209473 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:57.256093 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.131:43109
I20260709 12:25:57.256290 27340 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.131:43109 every 8 connection(s)
I20260709 12:25:57.272643 27341 heartbeater.cc:344] Connected to a master server at 127.16.240.190:41523
I20260709 12:25:57.273159 27341 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:57.273986 27341 heartbeater.cc:507] Master 127.16.240.190:41523 requested a full tablet report, sending...
I20260709 12:25:57.276225 27061 ts_manager.cc:194] Registered new tserver with Master: cc9eb4205b3745a4bf66eb2357e4f308 (127.16.240.131:43109)
I20260709 12:25:57.277245 17346 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017539291s
I20260709 12:25:57.277693 27061 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36290
I20260709 12:25:57.305647 27061 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36306:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:57.307986 27061 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:57.360509 27155 tablet_service.cc:1511] Processing CreateTablet for tablet 70926a90f10b41209eabbbd6321a6629 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53a44aa277d3405a8b3161b6d811890f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:57.362149 27155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70926a90f10b41209eabbbd6321a6629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.362821 27306 tablet_service.cc:1511] Processing CreateTablet for tablet 70926a90f10b41209eabbbd6321a6629 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53a44aa277d3405a8b3161b6d811890f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:57.362958 27305 tablet_service.cc:1511] Processing CreateTablet for tablet ce1aa011649f44d2b04ced407e5784eb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53a44aa277d3405a8b3161b6d811890f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:57.363962 27306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70926a90f10b41209eabbbd6321a6629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.360509 27154 tablet_service.cc:1511] Processing CreateTablet for tablet ce1aa011649f44d2b04ced407e5784eb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53a44aa277d3405a8b3161b6d811890f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:57.365239 27154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce1aa011649f44d2b04ced407e5784eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.367148 27305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce1aa011649f44d2b04ced407e5784eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.368541 27230 tablet_service.cc:1511] Processing CreateTablet for tablet ce1aa011649f44d2b04ced407e5784eb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53a44aa277d3405a8b3161b6d811890f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:57.370816 27230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce1aa011649f44d2b04ced407e5784eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.367204 27231 tablet_service.cc:1511] Processing CreateTablet for tablet 70926a90f10b41209eabbbd6321a6629 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53a44aa277d3405a8b3161b6d811890f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:57.373558 27231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70926a90f10b41209eabbbd6321a6629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.406701 27357 tablet_bootstrap.cc:492] T ce1aa011649f44d2b04ced407e5784eb P 6003e8384ae843f58b9dff24c59e87aa: Bootstrap starting.
I20260709 12:25:57.408773 27356 tablet_bootstrap.cc:492] T 70926a90f10b41209eabbbd6321a6629 P cc9eb4205b3745a4bf66eb2357e4f308: Bootstrap starting.
I20260709 12:25:57.411545 27358 tablet_bootstrap.cc:492] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a: Bootstrap starting.
I20260709 12:25:57.415243 27356 tablet_bootstrap.cc:654] T 70926a90f10b41209eabbbd6321a6629 P cc9eb4205b3745a4bf66eb2357e4f308: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.417515 27357 tablet_bootstrap.cc:654] T ce1aa011649f44d2b04ced407e5784eb P 6003e8384ae843f58b9dff24c59e87aa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.419306 27358 tablet_bootstrap.cc:654] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.420738 27356 tablet_bootstrap.cc:492] T 70926a90f10b41209eabbbd6321a6629 P cc9eb4205b3745a4bf66eb2357e4f308: No bootstrap required, opened a new log
I20260709 12:25:57.421314 27356 ts_tablet_manager.cc:1403] T 70926a90f10b41209eabbbd6321a6629 P cc9eb4205b3745a4bf66eb2357e4f308: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.006s
I20260709 12:25:57.424263 27356 raft_consensus.cc:359] T 70926a90f10b41209eabbbd6321a6629 P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.425133 27356 raft_consensus.cc:385] T 70926a90f10b41209eabbbd6321a6629 P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.425469 27356 raft_consensus.cc:740] T 70926a90f10b41209eabbbd6321a6629 P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9eb4205b3745a4bf66eb2357e4f308, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.426218 27356 consensus_queue.cc:260] T 70926a90f10b41209eabbbd6321a6629 P cc9eb4205b3745a4bf66eb2357e4f308 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.426658 27357 tablet_bootstrap.cc:492] T ce1aa011649f44d2b04ced407e5784eb P 6003e8384ae843f58b9dff24c59e87aa: No bootstrap required, opened a new log
I20260709 12:25:57.426990 27358 tablet_bootstrap.cc:492] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a: No bootstrap required, opened a new log
I20260709 12:25:57.427342 27357 ts_tablet_manager.cc:1403] T ce1aa011649f44d2b04ced407e5784eb P 6003e8384ae843f58b9dff24c59e87aa: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 12:25:57.427459 27358 ts_tablet_manager.cc:1403] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.003s
I20260709 12:25:57.430531 27357 raft_consensus.cc:359] T ce1aa011649f44d2b04ced407e5784eb P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.430728 27358 raft_consensus.cc:359] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.431075 27341 heartbeater.cc:499] Master 127.16.240.190:41523 was elected leader, sending a full tablet report...
I20260709 12:25:57.431391 27357 raft_consensus.cc:385] T ce1aa011649f44d2b04ced407e5784eb P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.431443 27358 raft_consensus.cc:385] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.432080 27357 raft_consensus.cc:740] T ce1aa011649f44d2b04ced407e5784eb P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6003e8384ae843f58b9dff24c59e87aa, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.432179 27358 raft_consensus.cc:740] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3bc1f809a947df942a4bad3a2ff46a, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.432708 27356 ts_tablet_manager.cc:1434] T 70926a90f10b41209eabbbd6321a6629 P cc9eb4205b3745a4bf66eb2357e4f308: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.006s
I20260709 12:25:57.433230 27357 consensus_queue.cc:260] T ce1aa011649f44d2b04ced407e5784eb P 6003e8384ae843f58b9dff24c59e87aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.433233 27358 consensus_queue.cc:260] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.434332 27356 tablet_bootstrap.cc:492] T ce1aa011649f44d2b04ced407e5784eb P cc9eb4205b3745a4bf66eb2357e4f308: Bootstrap starting.
I20260709 12:25:57.442375 27356 tablet_bootstrap.cc:654] T ce1aa011649f44d2b04ced407e5784eb P cc9eb4205b3745a4bf66eb2357e4f308: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.442709 27358 ts_tablet_manager.cc:1434] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.006s
I20260709 12:25:57.443881 27266 heartbeater.cc:499] Master 127.16.240.190:41523 was elected leader, sending a full tablet report...
I20260709 12:25:57.448740 27358 tablet_bootstrap.cc:492] T 70926a90f10b41209eabbbd6321a6629 P 4e3bc1f809a947df942a4bad3a2ff46a: Bootstrap starting.
I20260709 12:25:57.457217 27190 heartbeater.cc:499] Master 127.16.240.190:41523 was elected leader, sending a full tablet report...
I20260709 12:25:57.457873 27357 ts_tablet_manager.cc:1434] T ce1aa011649f44d2b04ced407e5784eb P 6003e8384ae843f58b9dff24c59e87aa: Time spent starting tablet: real 0.030s	user 0.011s	sys 0.015s
I20260709 12:25:57.457340 27356 tablet_bootstrap.cc:492] T ce1aa011649f44d2b04ced407e5784eb P cc9eb4205b3745a4bf66eb2357e4f308: No bootstrap required, opened a new log
I20260709 12:25:57.458829 27356 ts_tablet_manager.cc:1403] T ce1aa011649f44d2b04ced407e5784eb P cc9eb4205b3745a4bf66eb2357e4f308: Time spent bootstrapping tablet: real 0.025s	user 0.022s	sys 0.000s
I20260709 12:25:57.459184 27357 tablet_bootstrap.cc:492] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa: Bootstrap starting.
I20260709 12:25:57.462514 27356 raft_consensus.cc:359] T ce1aa011649f44d2b04ced407e5784eb P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.463315 27356 raft_consensus.cc:385] T ce1aa011649f44d2b04ced407e5784eb P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.463640 27356 raft_consensus.cc:740] T ce1aa011649f44d2b04ced407e5784eb P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9eb4205b3745a4bf66eb2357e4f308, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.464435 27356 consensus_queue.cc:260] T ce1aa011649f44d2b04ced407e5784eb P cc9eb4205b3745a4bf66eb2357e4f308 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.468192 27357 tablet_bootstrap.cc:654] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.468837 27356 ts_tablet_manager.cc:1434] T ce1aa011649f44d2b04ced407e5784eb P cc9eb4205b3745a4bf66eb2357e4f308: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:25:57.471210 27358 tablet_bootstrap.cc:654] T 70926a90f10b41209eabbbd6321a6629 P 4e3bc1f809a947df942a4bad3a2ff46a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.477573 27357 tablet_bootstrap.cc:492] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa: No bootstrap required, opened a new log
I20260709 12:25:57.477661 27358 tablet_bootstrap.cc:492] T 70926a90f10b41209eabbbd6321a6629 P 4e3bc1f809a947df942a4bad3a2ff46a: No bootstrap required, opened a new log
I20260709 12:25:57.478149 27357 ts_tablet_manager.cc:1403] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:25:57.478351 27358 ts_tablet_manager.cc:1403] T 70926a90f10b41209eabbbd6321a6629 P 4e3bc1f809a947df942a4bad3a2ff46a: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.000s
I20260709 12:25:57.480729 27357 raft_consensus.cc:359] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.481459 27357 raft_consensus.cc:385] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.481719 27357 raft_consensus.cc:740] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6003e8384ae843f58b9dff24c59e87aa, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.481752 27358 raft_consensus.cc:359] T 70926a90f10b41209eabbbd6321a6629 P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.483052 27358 raft_consensus.cc:385] T 70926a90f10b41209eabbbd6321a6629 P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.482703 27357 consensus_queue.cc:260] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.483505 27358 raft_consensus.cc:740] T 70926a90f10b41209eabbbd6321a6629 P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3bc1f809a947df942a4bad3a2ff46a, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.484972 27357 ts_tablet_manager.cc:1434] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:57.484686 27358 consensus_queue.cc:260] T 70926a90f10b41209eabbbd6321a6629 P 4e3bc1f809a947df942a4bad3a2ff46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.486953 27358 ts_tablet_manager.cc:1434] T 70926a90f10b41209eabbbd6321a6629 P 4e3bc1f809a947df942a4bad3a2ff46a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:57.489501 27364 raft_consensus.cc:493] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.490142 27364 raft_consensus.cc:515] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.493291 27364 leader_election.cc:290] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6003e8384ae843f58b9dff24c59e87aa (127.16.240.129:37067), cc9eb4205b3745a4bf66eb2357e4f308 (127.16.240.131:43109)
I20260709 12:25:57.505759 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1aa011649f44d2b04ced407e5784eb" candidate_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6003e8384ae843f58b9dff24c59e87aa" is_pre_election: true
I20260709 12:25:57.506733 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1aa011649f44d2b04ced407e5784eb" candidate_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" is_pre_election: true
I20260709 12:25:57.506796 27165 raft_consensus.cc:2468] T ce1aa011649f44d2b04ced407e5784eb P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3bc1f809a947df942a4bad3a2ff46a in term 0.
I20260709 12:25:57.507697 27316 raft_consensus.cc:2468] T ce1aa011649f44d2b04ced407e5784eb P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3bc1f809a947df942a4bad3a2ff46a in term 0.
I20260709 12:25:57.509044 27205 leader_election.cc:304] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3bc1f809a947df942a4bad3a2ff46a, cc9eb4205b3745a4bf66eb2357e4f308; no voters: 
I20260709 12:25:57.509811 27364 raft_consensus.cc:2804] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.510183 27364 raft_consensus.cc:493] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.510509 27364 raft_consensus.cc:3060] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.516650 27364 raft_consensus.cc:515] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.518364 27364 leader_election.cc:290] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a [CANDIDATE]: Term 1 election: Requested vote from peers 6003e8384ae843f58b9dff24c59e87aa (127.16.240.129:37067), cc9eb4205b3745a4bf66eb2357e4f308 (127.16.240.131:43109)
I20260709 12:25:57.519534 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1aa011649f44d2b04ced407e5784eb" candidate_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6003e8384ae843f58b9dff24c59e87aa"
I20260709 12:25:57.519869 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1aa011649f44d2b04ced407e5784eb" candidate_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9eb4205b3745a4bf66eb2357e4f308"
I20260709 12:25:57.520217 27165 raft_consensus.cc:3060] T ce1aa011649f44d2b04ced407e5784eb P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.521025 27316 raft_consensus.cc:3060] T ce1aa011649f44d2b04ced407e5784eb P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.528024 27316 raft_consensus.cc:2468] T ce1aa011649f44d2b04ced407e5784eb P cc9eb4205b3745a4bf66eb2357e4f308 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3bc1f809a947df942a4bad3a2ff46a in term 1.
I20260709 12:25:57.528293 27165 raft_consensus.cc:2468] T ce1aa011649f44d2b04ced407e5784eb P 6003e8384ae843f58b9dff24c59e87aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3bc1f809a947df942a4bad3a2ff46a in term 1.
I20260709 12:25:57.529255 27205 leader_election.cc:304] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3bc1f809a947df942a4bad3a2ff46a, cc9eb4205b3745a4bf66eb2357e4f308; no voters: 
I20260709 12:25:57.529994 27364 raft_consensus.cc:2804] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.531139 27364 raft_consensus.cc:697] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a [term 1 LEADER]: Becoming Leader. State: Replica: 4e3bc1f809a947df942a4bad3a2ff46a, State: Running, Role: LEADER
I20260709 12:25:57.531956 27364 consensus_queue.cc:237] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.542794 27061 catalog_manager.cc:5697] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3bc1f809a947df942a4bad3a2ff46a (127.16.240.130). New cstate: current_term: 1 leader_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.647351 27363 raft_consensus.cc:493] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.648444 27363 raft_consensus.cc:515] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.650790 27363 leader_election.cc:290] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3bc1f809a947df942a4bad3a2ff46a (127.16.240.130:37301), cc9eb4205b3745a4bf66eb2357e4f308 (127.16.240.131:43109)
I20260709 12:25:57.661805 27241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70926a90f10b41209eabbbd6321a6629" candidate_uuid: "6003e8384ae843f58b9dff24c59e87aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" is_pre_election: true
I20260709 12:25:57.662686 27241 raft_consensus.cc:2468] T 70926a90f10b41209eabbbd6321a6629 P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6003e8384ae843f58b9dff24c59e87aa in term 0.
I20260709 12:25:57.663843 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70926a90f10b41209eabbbd6321a6629" candidate_uuid: "6003e8384ae843f58b9dff24c59e87aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" is_pre_election: true
I20260709 12:25:57.664104 27129 leader_election.cc:304] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3bc1f809a947df942a4bad3a2ff46a, 6003e8384ae843f58b9dff24c59e87aa; no voters: 
I20260709 12:25:57.664472 27316 raft_consensus.cc:2468] T 70926a90f10b41209eabbbd6321a6629 P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6003e8384ae843f58b9dff24c59e87aa in term 0.
I20260709 12:25:57.665132 27363 raft_consensus.cc:2804] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.665514 27363 raft_consensus.cc:493] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.665926 27363 raft_consensus.cc:3060] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.672410 27363 raft_consensus.cc:515] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.674335 27363 leader_election.cc:290] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa [CANDIDATE]: Term 1 election: Requested vote from peers 4e3bc1f809a947df942a4bad3a2ff46a (127.16.240.130:37301), cc9eb4205b3745a4bf66eb2357e4f308 (127.16.240.131:43109)
I20260709 12:25:57.675338 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70926a90f10b41209eabbbd6321a6629" candidate_uuid: "6003e8384ae843f58b9dff24c59e87aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9eb4205b3745a4bf66eb2357e4f308"
I20260709 12:25:57.675216 27241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70926a90f10b41209eabbbd6321a6629" candidate_uuid: "6003e8384ae843f58b9dff24c59e87aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3bc1f809a947df942a4bad3a2ff46a"
I20260709 12:25:57.676167 27316 raft_consensus.cc:3060] T 70926a90f10b41209eabbbd6321a6629 P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.676293 27241 raft_consensus.cc:3060] T 70926a90f10b41209eabbbd6321a6629 P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.682317 27316 raft_consensus.cc:2468] T 70926a90f10b41209eabbbd6321a6629 P cc9eb4205b3745a4bf66eb2357e4f308 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6003e8384ae843f58b9dff24c59e87aa in term 1.
I20260709 12:25:57.682346 27241 raft_consensus.cc:2468] T 70926a90f10b41209eabbbd6321a6629 P 4e3bc1f809a947df942a4bad3a2ff46a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6003e8384ae843f58b9dff24c59e87aa in term 1.
I20260709 12:25:57.683601 27129 leader_election.cc:304] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6003e8384ae843f58b9dff24c59e87aa, cc9eb4205b3745a4bf66eb2357e4f308; no voters: 
I20260709 12:25:57.684456 27363 raft_consensus.cc:2804] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.685504 27363 raft_consensus.cc:697] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa [term 1 LEADER]: Becoming Leader. State: Replica: 6003e8384ae843f58b9dff24c59e87aa, State: Running, Role: LEADER
I20260709 12:25:57.686408 27363 consensus_queue.cc:237] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.693842 27061 catalog_manager.cc:5697] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6003e8384ae843f58b9dff24c59e87aa (127.16.240.129). New cstate: current_term: 1 leader_uuid: "6003e8384ae843f58b9dff24c59e87aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.767634 27061 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36314:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:57.769692 27061 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:57.795189 27154 tablet_service.cc:1511] Processing CreateTablet for tablet d2b667b5d2fc4436a5f33888913595a0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=77195d79b4e74323969aa667c524ec21]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:57.796609 27154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2b667b5d2fc4436a5f33888913595a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.796226 27230 tablet_service.cc:1511] Processing CreateTablet for tablet d2b667b5d2fc4436a5f33888913595a0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=77195d79b4e74323969aa667c524ec21]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:57.797646 27230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2b667b5d2fc4436a5f33888913595a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.798491 27306 tablet_service.cc:1511] Processing CreateTablet for tablet d2b667b5d2fc4436a5f33888913595a0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=77195d79b4e74323969aa667c524ec21]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:57.802218 27155 tablet_service.cc:1511] Processing CreateTablet for tablet 1e0177c792854eb58b5df9f58a0700b6 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=77195d79b4e74323969aa667c524ec21]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:57.802631 27231 tablet_service.cc:1511] Processing CreateTablet for tablet 1e0177c792854eb58b5df9f58a0700b6 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=77195d79b4e74323969aa667c524ec21]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:57.803781 27155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e0177c792854eb58b5df9f58a0700b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.803987 27231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e0177c792854eb58b5df9f58a0700b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.809226 27306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2b667b5d2fc4436a5f33888913595a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.810554 27305 tablet_service.cc:1511] Processing CreateTablet for tablet 1e0177c792854eb58b5df9f58a0700b6 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=77195d79b4e74323969aa667c524ec21]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:57.812131 27305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e0177c792854eb58b5df9f58a0700b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.816576 27358 tablet_bootstrap.cc:492] T d2b667b5d2fc4436a5f33888913595a0 P 4e3bc1f809a947df942a4bad3a2ff46a: Bootstrap starting.
I20260709 12:25:57.823285 27358 tablet_bootstrap.cc:654] T d2b667b5d2fc4436a5f33888913595a0 P 4e3bc1f809a947df942a4bad3a2ff46a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.831360 27358 tablet_bootstrap.cc:492] T d2b667b5d2fc4436a5f33888913595a0 P 4e3bc1f809a947df942a4bad3a2ff46a: No bootstrap required, opened a new log
I20260709 12:25:57.831971 27358 ts_tablet_manager.cc:1403] T d2b667b5d2fc4436a5f33888913595a0 P 4e3bc1f809a947df942a4bad3a2ff46a: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.006s
I20260709 12:25:57.833166 27357 tablet_bootstrap.cc:492] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa: Bootstrap starting.
I20260709 12:25:57.838770 27356 tablet_bootstrap.cc:492] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308: Bootstrap starting.
I20260709 12:25:57.840021 27357 tablet_bootstrap.cc:654] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.845870 27358 raft_consensus.cc:359] T d2b667b5d2fc4436a5f33888913595a0 P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.846891 27358 raft_consensus.cc:385] T d2b667b5d2fc4436a5f33888913595a0 P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.847191 27358 raft_consensus.cc:740] T d2b667b5d2fc4436a5f33888913595a0 P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3bc1f809a947df942a4bad3a2ff46a, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.847677 27356 tablet_bootstrap.cc:654] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.848068 27358 consensus_queue.cc:260] T d2b667b5d2fc4436a5f33888913595a0 P 4e3bc1f809a947df942a4bad3a2ff46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.853629 27358 ts_tablet_manager.cc:1434] T d2b667b5d2fc4436a5f33888913595a0 P 4e3bc1f809a947df942a4bad3a2ff46a: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 12:25:57.853835 27357 tablet_bootstrap.cc:492] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa: No bootstrap required, opened a new log
I20260709 12:25:57.854892 27357 ts_tablet_manager.cc:1403] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.002s
I20260709 12:25:57.855371 27358 tablet_bootstrap.cc:492] T 1e0177c792854eb58b5df9f58a0700b6 P 4e3bc1f809a947df942a4bad3a2ff46a: Bootstrap starting.
W20260709 12:25:57.858058 27110 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:57.861552 27357 raft_consensus.cc:359] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.862540 27357 raft_consensus.cc:385] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.862919 27357 raft_consensus.cc:740] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6003e8384ae843f58b9dff24c59e87aa, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.863950 27357 consensus_queue.cc:260] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.866808 27357 ts_tablet_manager.cc:1434] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:25:57.867278 27358 tablet_bootstrap.cc:654] T 1e0177c792854eb58b5df9f58a0700b6 P 4e3bc1f809a947df942a4bad3a2ff46a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.868173 27357 tablet_bootstrap.cc:492] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa: Bootstrap starting.
I20260709 12:25:57.868736 27356 tablet_bootstrap.cc:492] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308: No bootstrap required, opened a new log
I20260709 12:25:57.869318 27356 ts_tablet_manager.cc:1403] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.016s
I20260709 12:25:57.872695 27356 raft_consensus.cc:359] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.873494 27356 raft_consensus.cc:385] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.874244 27356 raft_consensus.cc:740] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9eb4205b3745a4bf66eb2357e4f308, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.875098 27356 consensus_queue.cc:260] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.877256 27357 tablet_bootstrap.cc:654] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.877445 27356 ts_tablet_manager.cc:1434] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:57.880986 27358 tablet_bootstrap.cc:492] T 1e0177c792854eb58b5df9f58a0700b6 P 4e3bc1f809a947df942a4bad3a2ff46a: No bootstrap required, opened a new log
I20260709 12:25:57.881711 27358 ts_tablet_manager.cc:1403] T 1e0177c792854eb58b5df9f58a0700b6 P 4e3bc1f809a947df942a4bad3a2ff46a: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.008s
I20260709 12:25:57.883596 27356 tablet_bootstrap.cc:492] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308: Bootstrap starting.
I20260709 12:25:57.885782 27358 raft_consensus.cc:359] T 1e0177c792854eb58b5df9f58a0700b6 P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.886914 27358 raft_consensus.cc:385] T 1e0177c792854eb58b5df9f58a0700b6 P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.887246 27358 raft_consensus.cc:740] T 1e0177c792854eb58b5df9f58a0700b6 P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3bc1f809a947df942a4bad3a2ff46a, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.888252 27358 consensus_queue.cc:260] T 1e0177c792854eb58b5df9f58a0700b6 P 4e3bc1f809a947df942a4bad3a2ff46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.889856 27357 tablet_bootstrap.cc:492] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa: No bootstrap required, opened a new log
I20260709 12:25:57.890517 27357 ts_tablet_manager.cc:1403] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.006s
I20260709 12:25:57.891278 27356 tablet_bootstrap.cc:654] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.893136 27358 ts_tablet_manager.cc:1434] T 1e0177c792854eb58b5df9f58a0700b6 P 4e3bc1f809a947df942a4bad3a2ff46a: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:25:57.894021 27357 raft_consensus.cc:359] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.894955 27357 raft_consensus.cc:385] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.895342 27357 raft_consensus.cc:740] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6003e8384ae843f58b9dff24c59e87aa, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.896353 27357 consensus_queue.cc:260] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.901221 27357 ts_tablet_manager.cc:1434] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:25:57.904155 27356 tablet_bootstrap.cc:492] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308: No bootstrap required, opened a new log
I20260709 12:25:57.904723 27356 ts_tablet_manager.cc:1403] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.011s
I20260709 12:25:57.907855 27356 raft_consensus.cc:359] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.908537 27356 raft_consensus.cc:385] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.908794 27356 raft_consensus.cc:740] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9eb4205b3745a4bf66eb2357e4f308, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.909477 27356 consensus_queue.cc:260] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:57.911276 27356 ts_tablet_manager.cc:1434] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:57.968187 27364 consensus_queue.cc:1048] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.983426 27389 consensus_queue.cc:1048] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:58.029142 27362 raft_consensus.cc:493] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.029740 27362 raft_consensus.cc:515] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:58.031955 27362 leader_election.cc:290] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6003e8384ae843f58b9dff24c59e87aa (127.16.240.129:37067), 4e3bc1f809a947df942a4bad3a2ff46a (127.16.240.130:37301)
I20260709 12:25:58.044987 27241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b667b5d2fc4436a5f33888913595a0" candidate_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" is_pre_election: true
I20260709 12:25:58.045159 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b667b5d2fc4436a5f33888913595a0" candidate_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6003e8384ae843f58b9dff24c59e87aa" is_pre_election: true
I20260709 12:25:58.045907 27241 raft_consensus.cc:2468] T d2b667b5d2fc4436a5f33888913595a0 P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9eb4205b3745a4bf66eb2357e4f308 in term 0.
I20260709 12:25:58.045986 27165 raft_consensus.cc:2468] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9eb4205b3745a4bf66eb2357e4f308 in term 0.
I20260709 12:25:58.047333 27280 leader_election.cc:304] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3bc1f809a947df942a4bad3a2ff46a, cc9eb4205b3745a4bf66eb2357e4f308; no voters: 
I20260709 12:25:58.048166 27362 raft_consensus.cc:2804] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.048497 27362 raft_consensus.cc:493] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.048784 27362 raft_consensus.cc:3060] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.055585 27362 raft_consensus.cc:515] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:58.057683 27362 leader_election.cc:290] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [CANDIDATE]: Term 1 election: Requested vote from peers 6003e8384ae843f58b9dff24c59e87aa (127.16.240.129:37067), 4e3bc1f809a947df942a4bad3a2ff46a (127.16.240.130:37301)
I20260709 12:25:58.058642 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b667b5d2fc4436a5f33888913595a0" candidate_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6003e8384ae843f58b9dff24c59e87aa"
I20260709 12:25:58.058959 27241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b667b5d2fc4436a5f33888913595a0" candidate_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3bc1f809a947df942a4bad3a2ff46a"
I20260709 12:25:58.059378 27165 raft_consensus.cc:3060] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.059549 27241 raft_consensus.cc:3060] T d2b667b5d2fc4436a5f33888913595a0 P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.066255 27165 raft_consensus.cc:2468] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9eb4205b3745a4bf66eb2357e4f308 in term 1.
I20260709 12:25:58.066283 27241 raft_consensus.cc:2468] T d2b667b5d2fc4436a5f33888913595a0 P 4e3bc1f809a947df942a4bad3a2ff46a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9eb4205b3745a4bf66eb2357e4f308 in term 1.
I20260709 12:25:58.068190 27280 leader_election.cc:304] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6003e8384ae843f58b9dff24c59e87aa, cc9eb4205b3745a4bf66eb2357e4f308; no voters: 
I20260709 12:25:58.069038 27362 raft_consensus.cc:2804] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.070742 27363 raft_consensus.cc:493] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.070780 27362 raft_consensus.cc:697] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [term 1 LEADER]: Becoming Leader. State: Replica: cc9eb4205b3745a4bf66eb2357e4f308, State: Running, Role: LEADER
I20260709 12:25:58.071823 27363 raft_consensus.cc:515] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:58.072240 27362 consensus_queue.cc:237] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:58.074276 27363 leader_election.cc:290] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3bc1f809a947df942a4bad3a2ff46a (127.16.240.130:37301), cc9eb4205b3745a4bf66eb2357e4f308 (127.16.240.131:43109)
I20260709 12:25:58.075676 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0177c792854eb58b5df9f58a0700b6" candidate_uuid: "6003e8384ae843f58b9dff24c59e87aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" is_pre_election: true
I20260709 12:25:58.076195 27241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0177c792854eb58b5df9f58a0700b6" candidate_uuid: "6003e8384ae843f58b9dff24c59e87aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" is_pre_election: true
I20260709 12:25:58.076524 27316 raft_consensus.cc:2468] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6003e8384ae843f58b9dff24c59e87aa in term 0.
I20260709 12:25:58.076936 27241 raft_consensus.cc:2468] T 1e0177c792854eb58b5df9f58a0700b6 P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6003e8384ae843f58b9dff24c59e87aa in term 0.
I20260709 12:25:58.078032 27129 leader_election.cc:304] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3bc1f809a947df942a4bad3a2ff46a, 6003e8384ae843f58b9dff24c59e87aa; no voters: 
I20260709 12:25:58.078788 27363 raft_consensus.cc:2804] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.079164 27363 raft_consensus.cc:493] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.079444 27363 raft_consensus.cc:3060] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.081669 27059 catalog_manager.cc:5697] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc9eb4205b3745a4bf66eb2357e4f308 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:58.083393 27373 consensus_queue.cc:1048] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:58.087530 27363 raft_consensus.cc:515] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:58.090021 27363 leader_election.cc:290] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [CANDIDATE]: Term 1 election: Requested vote from peers 4e3bc1f809a947df942a4bad3a2ff46a (127.16.240.130:37301), cc9eb4205b3745a4bf66eb2357e4f308 (127.16.240.131:43109)
I20260709 12:25:58.092692 27240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0177c792854eb58b5df9f58a0700b6" candidate_uuid: "6003e8384ae843f58b9dff24c59e87aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3bc1f809a947df942a4bad3a2ff46a"
I20260709 12:25:58.093477 27240 raft_consensus.cc:3060] T 1e0177c792854eb58b5df9f58a0700b6 P 4e3bc1f809a947df942a4bad3a2ff46a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.097395 27316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0177c792854eb58b5df9f58a0700b6" candidate_uuid: "6003e8384ae843f58b9dff24c59e87aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9eb4205b3745a4bf66eb2357e4f308"
I20260709 12:25:58.098003 27316 raft_consensus.cc:3060] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.099918 27240 raft_consensus.cc:2468] T 1e0177c792854eb58b5df9f58a0700b6 P 4e3bc1f809a947df942a4bad3a2ff46a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6003e8384ae843f58b9dff24c59e87aa in term 1.
I20260709 12:25:58.102201 27129 leader_election.cc:304] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3bc1f809a947df942a4bad3a2ff46a, 6003e8384ae843f58b9dff24c59e87aa; no voters: 
I20260709 12:25:58.103140 27373 raft_consensus.cc:2804] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.103657 27373 raft_consensus.cc:697] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [term 1 LEADER]: Becoming Leader. State: Replica: 6003e8384ae843f58b9dff24c59e87aa, State: Running, Role: LEADER
I20260709 12:25:58.104547 27373 consensus_queue.cc:237] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:58.106705 27363 consensus_queue.cc:1048] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.105037 27316 raft_consensus.cc:2468] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6003e8384ae843f58b9dff24c59e87aa in term 1.
I20260709 12:25:58.120847 27058 catalog_manager.cc:5697] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6003e8384ae843f58b9dff24c59e87aa (127.16.240.129). New cstate: current_term: 1 leader_uuid: "6003e8384ae843f58b9dff24c59e87aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.229436 27315 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2b667b5d2fc4436a5f33888913595a0"
dest_uuid: "cc9eb4205b3745a4bf66eb2357e4f308"
mode: GRACEFUL
new_leader_uuid: "6003e8384ae843f58b9dff24c59e87aa"
 from {username='slave'} at 127.0.0.1:53320
I20260709 12:25:58.230419 27315 raft_consensus.cc:606] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [term 1 LEADER]: Received request to transfer leadership to TS 6003e8384ae843f58b9dff24c59e87aa
I20260709 12:25:58.496598 27373 consensus_queue.cc:1048] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:58.517203 27398 consensus_queue.cc:1048] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:58.692142 27362 consensus_queue.cc:1048] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:58.700150 27362 consensus_queue.cc:1048] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.703395 27410 raft_consensus.cc:993] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308: : Instructing follower 6003e8384ae843f58b9dff24c59e87aa to start an election
I20260709 12:25:58.704785 27410 raft_consensus.cc:1081] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [term 1 LEADER]: Signalling peer 6003e8384ae843f58b9dff24c59e87aa to start an election
I20260709 12:25:58.716106 27165 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2b667b5d2fc4436a5f33888913595a0"
dest_uuid: "6003e8384ae843f58b9dff24c59e87aa"
 from {username='slave'} at 127.0.0.1:38020
I20260709 12:25:58.716876 27165 raft_consensus.cc:493] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:58.717280 27165 raft_consensus.cc:3060] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:58.733085 27165 raft_consensus.cc:515] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:58.735376 27165 leader_election.cc:290] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa [CANDIDATE]: Term 2 election: Requested vote from peers 4e3bc1f809a947df942a4bad3a2ff46a (127.16.240.130:37301), cc9eb4205b3745a4bf66eb2357e4f308 (127.16.240.131:43109)
I20260709 12:25:58.736377 27240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b667b5d2fc4436a5f33888913595a0" candidate_uuid: "6003e8384ae843f58b9dff24c59e87aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e3bc1f809a947df942a4bad3a2ff46a"
I20260709 12:25:58.736634 27315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b667b5d2fc4436a5f33888913595a0" candidate_uuid: "6003e8384ae843f58b9dff24c59e87aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc9eb4205b3745a4bf66eb2357e4f308"
I20260709 12:25:58.737097 27240 raft_consensus.cc:3060] T d2b667b5d2fc4436a5f33888913595a0 P 4e3bc1f809a947df942a4bad3a2ff46a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:58.737351 27315 raft_consensus.cc:3055] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:58.737733 27315 raft_consensus.cc:740] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc9eb4205b3745a4bf66eb2357e4f308, State: Running, Role: LEADER
I20260709 12:25:58.738714 27315 consensus_queue.cc:260] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:58.740108 27315 raft_consensus.cc:3060] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:58.747130 27240 raft_consensus.cc:2468] T d2b667b5d2fc4436a5f33888913595a0 P 4e3bc1f809a947df942a4bad3a2ff46a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6003e8384ae843f58b9dff24c59e87aa in term 2.
I20260709 12:25:58.748695 27129 leader_election.cc:304] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3bc1f809a947df942a4bad3a2ff46a, 6003e8384ae843f58b9dff24c59e87aa; no voters: 
I20260709 12:25:58.749636 27373 raft_consensus.cc:2804] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:58.749992 27315 raft_consensus.cc:2468] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6003e8384ae843f58b9dff24c59e87aa in term 2.
I20260709 12:25:58.750103 27373 raft_consensus.cc:697] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa [term 2 LEADER]: Becoming Leader. State: Replica: 6003e8384ae843f58b9dff24c59e87aa, State: Running, Role: LEADER
I20260709 12:25:58.751914 27373 consensus_queue.cc:237] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:58.758884 27061 catalog_manager.cc:5697] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa reported cstate change: term changed from 1 to 2, leader changed from cc9eb4205b3745a4bf66eb2357e4f308 (127.16.240.131) to 6003e8384ae843f58b9dff24c59e87aa (127.16.240.129). New cstate: current_term: 2 leader_uuid: "6003e8384ae843f58b9dff24c59e87aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.020102 17346 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:25:59.022178 17346 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:25:59.022627 17346 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:25:59.037672 27165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e0177c792854eb58b5df9f58a0700b6"
dest_uuid: "6003e8384ae843f58b9dff24c59e87aa"
mode: GRACEFUL
new_leader_uuid: "cc9eb4205b3745a4bf66eb2357e4f308"
 from {username='slave'} at 127.0.0.1:38022
I20260709 12:25:59.038196 27165 raft_consensus.cc:606] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [term 1 LEADER]: Received request to transfer leadership to TS cc9eb4205b3745a4bf66eb2357e4f308
I20260709 12:25:59.039526 17346 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:25:59.273959 27315 raft_consensus.cc:1275] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [term 2 FOLLOWER]: Refusing update from remote peer 6003e8384ae843f58b9dff24c59e87aa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:59.275667 27373 consensus_queue.cc:1048] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:59.287541 27240 raft_consensus.cc:1275] T d2b667b5d2fc4436a5f33888913595a0 P 4e3bc1f809a947df942a4bad3a2ff46a [term 2 FOLLOWER]: Refusing update from remote peer 6003e8384ae843f58b9dff24c59e87aa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:59.290977 27373 consensus_queue.cc:1048] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:59.511087 27363 raft_consensus.cc:993] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa: : Instructing follower cc9eb4205b3745a4bf66eb2357e4f308 to start an election
I20260709 12:25:59.512177 27363 raft_consensus.cc:1081] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [term 1 LEADER]: Signalling peer cc9eb4205b3745a4bf66eb2357e4f308 to start an election
I20260709 12:25:59.514619 27315 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e0177c792854eb58b5df9f58a0700b6"
dest_uuid: "cc9eb4205b3745a4bf66eb2357e4f308"
 from {username='slave'} at 127.0.0.1:53304
I20260709 12:25:59.515210 27315 raft_consensus.cc:493] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:59.515550 27315 raft_consensus.cc:3060] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:59.523598 27315 raft_consensus.cc:515] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:59.525946 27315 leader_election.cc:290] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308 [CANDIDATE]: Term 2 election: Requested vote from peers 6003e8384ae843f58b9dff24c59e87aa (127.16.240.129:37067), 4e3bc1f809a947df942a4bad3a2ff46a (127.16.240.130:37301)
I20260709 12:25:59.526952 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0177c792854eb58b5df9f58a0700b6" candidate_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6003e8384ae843f58b9dff24c59e87aa"
I20260709 12:25:59.527611 27165 raft_consensus.cc:3055] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:59.527382 27240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0177c792854eb58b5df9f58a0700b6" candidate_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e3bc1f809a947df942a4bad3a2ff46a"
I20260709 12:25:59.528093 27165 raft_consensus.cc:740] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6003e8384ae843f58b9dff24c59e87aa, State: Running, Role: LEADER
I20260709 12:25:59.528419 27240 raft_consensus.cc:3060] T 1e0177c792854eb58b5df9f58a0700b6 P 4e3bc1f809a947df942a4bad3a2ff46a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:59.529337 27165 consensus_queue.cc:260] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:59.530423 27165 raft_consensus.cc:3060] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:59.536351 27165 raft_consensus.cc:2468] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9eb4205b3745a4bf66eb2357e4f308 in term 2.
I20260709 12:25:59.537025 27240 raft_consensus.cc:2468] T 1e0177c792854eb58b5df9f58a0700b6 P 4e3bc1f809a947df942a4bad3a2ff46a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9eb4205b3745a4bf66eb2357e4f308 in term 2.
I20260709 12:25:59.538496 27280 leader_election.cc:304] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6003e8384ae843f58b9dff24c59e87aa, cc9eb4205b3745a4bf66eb2357e4f308; no voters: 
I20260709 12:25:59.539395 27418 raft_consensus.cc:2804] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:59.540407 27418 raft_consensus.cc:697] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308 [term 2 LEADER]: Becoming Leader. State: Replica: cc9eb4205b3745a4bf66eb2357e4f308, State: Running, Role: LEADER
I20260709 12:25:59.541337 27418 consensus_queue.cc:237] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } }
I20260709 12:25:59.549461 27060 catalog_manager.cc:5697] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308 reported cstate change: term changed from 1 to 2, leader changed from 6003e8384ae843f58b9dff24c59e87aa (127.16.240.129) to cc9eb4205b3745a4bf66eb2357e4f308 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6003e8384ae843f58b9dff24c59e87aa" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3bc1f809a947df942a4bad3a2ff46a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 37301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9eb4205b3745a4bf66eb2357e4f308" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 43109 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:59.677901 17346 tablet_server.cc:179] TabletServer@127.16.240.129:0 shutting down...
I20260709 12:25:59.703127 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:59.704180 17346 tablet_replica.cc:333] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa: stopping tablet replica
I20260709 12:25:59.705070 17346 raft_consensus.cc:2243] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.705499 17346 raft_consensus.cc:2272] T 1e0177c792854eb58b5df9f58a0700b6 P 6003e8384ae843f58b9dff24c59e87aa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.708020 17346 tablet_replica.cc:333] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa: stopping tablet replica
I20260709 12:25:59.708909 17346 raft_consensus.cc:2243] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.709939 17346 raft_consensus.cc:2272] T d2b667b5d2fc4436a5f33888913595a0 P 6003e8384ae843f58b9dff24c59e87aa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.713706 17346 tablet_replica.cc:333] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa: stopping tablet replica
I20260709 12:25:59.714251 17346 raft_consensus.cc:2243] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.715145 17346 raft_consensus.cc:2272] T 70926a90f10b41209eabbbd6321a6629 P 6003e8384ae843f58b9dff24c59e87aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.718029 17346 tablet_replica.cc:333] T ce1aa011649f44d2b04ced407e5784eb P 6003e8384ae843f58b9dff24c59e87aa: stopping tablet replica
I20260709 12:25:59.718555 17346 raft_consensus.cc:2243] T ce1aa011649f44d2b04ced407e5784eb P 6003e8384ae843f58b9dff24c59e87aa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.719045 17346 raft_consensus.cc:2272] T ce1aa011649f44d2b04ced407e5784eb P 6003e8384ae843f58b9dff24c59e87aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.738518 17346 tablet_server.cc:196] TabletServer@127.16.240.129:0 shutdown complete.
I20260709 12:25:59.761214 17346 tablet_server.cc:179] TabletServer@127.16.240.130:0 shutting down...
I20260709 12:25:59.796023 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:59.797060 17346 tablet_replica.cc:333] T 1e0177c792854eb58b5df9f58a0700b6 P 4e3bc1f809a947df942a4bad3a2ff46a: stopping tablet replica
I20260709 12:25:59.798103 17346 raft_consensus.cc:2243] T 1e0177c792854eb58b5df9f58a0700b6 P 4e3bc1f809a947df942a4bad3a2ff46a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.798595 17346 raft_consensus.cc:2272] T 1e0177c792854eb58b5df9f58a0700b6 P 4e3bc1f809a947df942a4bad3a2ff46a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.801380 17346 tablet_replica.cc:333] T d2b667b5d2fc4436a5f33888913595a0 P 4e3bc1f809a947df942a4bad3a2ff46a: stopping tablet replica
I20260709 12:25:59.801998 17346 raft_consensus.cc:2243] T d2b667b5d2fc4436a5f33888913595a0 P 4e3bc1f809a947df942a4bad3a2ff46a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.802436 17346 raft_consensus.cc:2272] T d2b667b5d2fc4436a5f33888913595a0 P 4e3bc1f809a947df942a4bad3a2ff46a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.806354 17346 tablet_replica.cc:333] T 70926a90f10b41209eabbbd6321a6629 P 4e3bc1f809a947df942a4bad3a2ff46a: stopping tablet replica
I20260709 12:25:59.806999 17346 raft_consensus.cc:2243] T 70926a90f10b41209eabbbd6321a6629 P 4e3bc1f809a947df942a4bad3a2ff46a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.807849 17346 raft_consensus.cc:2272] T 70926a90f10b41209eabbbd6321a6629 P 4e3bc1f809a947df942a4bad3a2ff46a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.811075 17346 tablet_replica.cc:333] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a: stopping tablet replica
I20260709 12:25:59.811690 17346 raft_consensus.cc:2243] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.812732 17346 raft_consensus.cc:2272] T ce1aa011649f44d2b04ced407e5784eb P 4e3bc1f809a947df942a4bad3a2ff46a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.838991 17346 tablet_server.cc:196] TabletServer@127.16.240.130:0 shutdown complete.
I20260709 12:25:59.858479 17346 tablet_server.cc:179] TabletServer@127.16.240.131:0 shutting down...
I20260709 12:25:59.897361 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:59.898272 17346 tablet_replica.cc:333] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308: stopping tablet replica
I20260709 12:25:59.899044 17346 raft_consensus.cc:2243] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.899569 17346 raft_consensus.cc:2272] T d2b667b5d2fc4436a5f33888913595a0 P cc9eb4205b3745a4bf66eb2357e4f308 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.903174 17346 tablet_replica.cc:333] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308: stopping tablet replica
I20260709 12:25:59.903937 17346 raft_consensus.cc:2243] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.904587 17346 pending_rounds.cc:70] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308: Trying to abort 1 pending ops.
I20260709 12:25:59.904755 17346 pending_rounds.cc:77] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305625434288963584 op_type: NO_OP noop_request { }
I20260709 12:25:59.905007 17346 raft_consensus.cc:2889] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:59.905260 17346 raft_consensus.cc:2272] T 1e0177c792854eb58b5df9f58a0700b6 P cc9eb4205b3745a4bf66eb2357e4f308 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.908509 17346 tablet_replica.cc:333] T ce1aa011649f44d2b04ced407e5784eb P cc9eb4205b3745a4bf66eb2357e4f308: stopping tablet replica
I20260709 12:25:59.909387 17346 raft_consensus.cc:2243] T ce1aa011649f44d2b04ced407e5784eb P cc9eb4205b3745a4bf66eb2357e4f308 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.910081 17346 raft_consensus.cc:2272] T ce1aa011649f44d2b04ced407e5784eb P cc9eb4205b3745a4bf66eb2357e4f308 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.912850 17346 tablet_replica.cc:333] T 70926a90f10b41209eabbbd6321a6629 P cc9eb4205b3745a4bf66eb2357e4f308: stopping tablet replica
I20260709 12:25:59.913393 17346 raft_consensus.cc:2243] T 70926a90f10b41209eabbbd6321a6629 P cc9eb4205b3745a4bf66eb2357e4f308 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.913996 17346 raft_consensus.cc:2272] T 70926a90f10b41209eabbbd6321a6629 P cc9eb4205b3745a4bf66eb2357e4f308 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.940588 17346 tablet_server.cc:196] TabletServer@127.16.240.131:0 shutdown complete.
I20260709 12:25:59.963721 17346 master.cc:562] Master@127.16.240.190:41523 shutting down...
I20260709 12:25:59.988685 17346 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.989370 17346 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.989743 17346 tablet_replica.cc:333] T 00000000000000000000000000000000 P a37bae6cfea44ee396a61714c7590f9f: stopping tablet replica
I20260709 12:26:00.013845 17346 master.cc:584] Master@127.16.240.190:41523 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (3356 ms)
[----------] 6 tests from LeaderRebalancerTest (320994 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:26:00.061141 17346 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.240.190:36287
I20260709 12:26:00.062454 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:00.069975 27428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:00.070839 27427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:00.072358 27430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:00.073758 17346 server_base.cc:1061] running on GCE node
I20260709 12:26:00.074872 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:00.075089 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:00.075287 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599960075272 us; error 0 us; skew 500 ppm
I20260709 12:26:00.075984 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:00.078996 17346 webserver.cc:533] Webserver started at http://127.16.240.190:46241/ using document root <none> and password file <none>
I20260709 12:26:00.079702 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:00.080034 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:00.080353 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:00.081565 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599638884573-17346-0/minicluster-data/master-0-root/instance:
uuid: "fcb1b270552441e5a8a441fe80860e36"
format_stamp: "Formatted at 2026-07-09 12:26:00 on dist-test-slave-7xpw"
I20260709 12:26:00.086434 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:26:00.091418 27435 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:00.092828 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:26:00.093294 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599638884573-17346-0/minicluster-data/master-0-root
uuid: "fcb1b270552441e5a8a441fe80860e36"
format_stamp: "Formatted at 2026-07-09 12:26:00 on dist-test-slave-7xpw"
I20260709 12:26:00.093839 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599638884573-17346-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599638884573-17346-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599638884573-17346-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:00.138334 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:00.139708 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:00.191215 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.190:36287
I20260709 12:26:00.191349 27486 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.190:36287 every 8 connection(s)
I20260709 12:26:00.195636 27487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.211733 27487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36: Bootstrap starting.
I20260709 12:26:00.217856 27487 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.225760 27487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36: No bootstrap required, opened a new log
I20260709 12:26:00.228870 27487 raft_consensus.cc:359] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcb1b270552441e5a8a441fe80860e36" member_type: VOTER }
I20260709 12:26:00.229315 27487 raft_consensus.cc:385] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.229493 27487 raft_consensus.cc:740] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcb1b270552441e5a8a441fe80860e36, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.230183 27487 consensus_queue.cc:260] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcb1b270552441e5a8a441fe80860e36" member_type: VOTER }
I20260709 12:26:00.230639 27487 raft_consensus.cc:399] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:00.230825 27487 raft_consensus.cc:493] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:00.231045 27487 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.236455 27487 raft_consensus.cc:515] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcb1b270552441e5a8a441fe80860e36" member_type: VOTER }
I20260709 12:26:00.237237 27487 leader_election.cc:304] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fcb1b270552441e5a8a441fe80860e36; no voters: 
I20260709 12:26:00.238750 27487 leader_election.cc:290] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:00.239123 27490 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:00.243356 27490 raft_consensus.cc:697] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36 [term 1 LEADER]: Becoming Leader. State: Replica: fcb1b270552441e5a8a441fe80860e36, State: Running, Role: LEADER
I20260709 12:26:00.244189 27490 consensus_queue.cc:237] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcb1b270552441e5a8a441fe80860e36" member_type: VOTER }
I20260709 12:26:00.248299 27492 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fcb1b270552441e5a8a441fe80860e36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcb1b270552441e5a8a441fe80860e36" member_type: VOTER } }
I20260709 12:26:00.248477 27487 sys_catalog.cc:565] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:00.248607 27491 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fcb1b270552441e5a8a441fe80860e36. Latest consensus state: current_term: 1 leader_uuid: "fcb1b270552441e5a8a441fe80860e36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcb1b270552441e5a8a441fe80860e36" member_type: VOTER } }
I20260709 12:26:00.249176 27492 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:00.249411 27491 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:00.255232 27494 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:00.266453 27494 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:00.268003 17346 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:00.278348 27494 catalog_manager.cc:1383] Generated new cluster ID: 67952014374845a2aa64845d9060864b
I20260709 12:26:00.278748 27494 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:00.299072 27494 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:00.300640 27494 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:00.319409 27494 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36: Generated new TSK 0
I20260709 12:26:00.320575 27494 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:00.335287 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:00.341971 27508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:00.343297 27509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:00.345623 27511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:00.349047 17346 server_base.cc:1061] running on GCE node
I20260709 12:26:00.350221 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:00.350486 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:00.351104 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599960350940 us; error 0 us; skew 500 ppm
I20260709 12:26:00.352315 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:00.355057 17346 webserver.cc:533] Webserver started at http://127.16.240.129:43897/ using document root <none> and password file <none>
I20260709 12:26:00.355628 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:00.355871 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:00.356173 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:00.357544 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599638884573-17346-0/minicluster-data/ts-0-root/instance:
uuid: "adb2f949f49447f89aa4c72935536a95"
format_stamp: "Formatted at 2026-07-09 12:26:00 on dist-test-slave-7xpw"
I20260709 12:26:00.363274 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 12:26:00.367486 27516 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:00.368647 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:26:00.369014 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599638884573-17346-0/minicluster-data/ts-0-root
uuid: "adb2f949f49447f89aa4c72935536a95"
format_stamp: "Formatted at 2026-07-09 12:26:00 on dist-test-slave-7xpw"
I20260709 12:26:00.369335 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599638884573-17346-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599638884573-17346-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599638884573-17346-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:00.387473 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:00.388942 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:00.390554 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:00.393069 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:00.393327 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:00.393589 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:00.393785 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:00.442804 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.129:43495
I20260709 12:26:00.442917 27579 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.129:43495 every 8 connection(s)
I20260709 12:26:00.449224 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:00.458534 27584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:00.460497 27585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:00.465674 17346 server_base.cc:1061] running on GCE node
W20260709 12:26:00.466135 27587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:00.467010 27580 heartbeater.cc:344] Connected to a master server at 127.16.240.190:36287
I20260709 12:26:00.467482 27580 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:00.467901 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:00.468158 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:00.468346 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599960468306 us; error 0 us; skew 500 ppm
I20260709 12:26:00.468871 27580 heartbeater.cc:507] Master 127.16.240.190:36287 requested a full tablet report, sending...
I20260709 12:26:00.469141 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:00.472043 27452 ts_manager.cc:194] Registered new tserver with Master: adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495)
I20260709 12:26:00.472735 17346 webserver.cc:533] Webserver started at http://127.16.240.130:45341/ using document root <none> and password file <none>
I20260709 12:26:00.473351 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:00.473582 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:00.473865 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:00.474661 27452 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48890
I20260709 12:26:00.475237 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599638884573-17346-0/minicluster-data/ts-1-root/instance:
uuid: "14900064b421439bb3283d698937fdc3"
format_stamp: "Formatted at 2026-07-09 12:26:00 on dist-test-slave-7xpw"
I20260709 12:26:00.480511 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:26:00.485347 27592 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:00.486491 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 12:26:00.486907 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599638884573-17346-0/minicluster-data/ts-1-root
uuid: "14900064b421439bb3283d698937fdc3"
format_stamp: "Formatted at 2026-07-09 12:26:00 on dist-test-slave-7xpw"
I20260709 12:26:00.487282 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599638884573-17346-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599638884573-17346-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599638884573-17346-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:00.500149 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:00.501401 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:00.502991 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:00.505635 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:00.505918 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:00.506177 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:00.506356 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:00.573707 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.130:34639
I20260709 12:26:00.573827 27654 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.130:34639 every 8 connection(s)
I20260709 12:26:00.579001 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:00.586987 27658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:00.589432 27659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:00.590289 17346 server_base.cc:1061] running on GCE node
W20260709 12:26:00.591336 27661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:00.592536 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:00.592839 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:00.593065 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599960593046 us; error 0 us; skew 500 ppm
I20260709 12:26:00.593921 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:00.593966 27655 heartbeater.cc:344] Connected to a master server at 127.16.240.190:36287
I20260709 12:26:00.594458 27655 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:00.595393 27655 heartbeater.cc:507] Master 127.16.240.190:36287 requested a full tablet report, sending...
I20260709 12:26:00.597674 17346 webserver.cc:533] Webserver started at http://127.16.240.131:41011/ using document root <none> and password file <none>
I20260709 12:26:00.598479 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:00.598726 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:00.599056 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:00.598907 27452 ts_manager.cc:194] Registered new tserver with Master: 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639)
I20260709 12:26:00.600796 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599638884573-17346-0/minicluster-data/ts-2-root/instance:
uuid: "883b0e22898a4bf7a51286a04aa3f5df"
format_stamp: "Formatted at 2026-07-09 12:26:00 on dist-test-slave-7xpw"
I20260709 12:26:00.601073 27452 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48906
I20260709 12:26:00.607211 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:26:00.612118 27666 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:00.613131 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:26:00.613510 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599638884573-17346-0/minicluster-data/ts-2-root
uuid: "883b0e22898a4bf7a51286a04aa3f5df"
format_stamp: "Formatted at 2026-07-09 12:26:00 on dist-test-slave-7xpw"
I20260709 12:26:00.613850 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599638884573-17346-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599638884573-17346-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599638884573-17346-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:00.628497 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:00.629743 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:00.631284 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:00.633741 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:00.633996 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:00.634245 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:00.634434 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:00.689544 27729 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.131:32823 every 8 connection(s)
I20260709 12:26:00.689568 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.131:32823
I20260709 12:26:00.708125 27730 heartbeater.cc:344] Connected to a master server at 127.16.240.190:36287
I20260709 12:26:00.708541 27730 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:00.709319 27730 heartbeater.cc:507] Master 127.16.240.190:36287 requested a full tablet report, sending...
I20260709 12:26:00.711889 27452 ts_manager.cc:194] Registered new tserver with Master: 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:00.712977 17346 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018927425s
I20260709 12:26:00.713373 27452 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48916
I20260709 12:26:00.745484 27452 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48924:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:00.748551 27452 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:00.829811 27620 tablet_service.cc:1511] Processing CreateTablet for tablet 7d11155c16cb45c3b96bd3b3b3f98a91 (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:00.831451 27620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d11155c16cb45c3b96bd3b3b3f98a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.832931 27694 tablet_service.cc:1511] Processing CreateTablet for tablet 7d11155c16cb45c3b96bd3b3b3f98a91 (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:00.834728 27692 tablet_service.cc:1511] Processing CreateTablet for tablet fffd970e02a74e58b67547bbd3bcb349 (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:00.837123 27693 tablet_service.cc:1511] Processing CreateTablet for tablet 882e2b233ed7404993be05bfd6bcd10f (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:00.835354 27694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d11155c16cb45c3b96bd3b3b3f98a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.839136 27692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fffd970e02a74e58b67547bbd3bcb349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.839926 27693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882e2b233ed7404993be05bfd6bcd10f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.850067 27619 tablet_service.cc:1511] Processing CreateTablet for tablet 882e2b233ed7404993be05bfd6bcd10f (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:00.851150 27618 tablet_service.cc:1511] Processing CreateTablet for tablet fffd970e02a74e58b67547bbd3bcb349 (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:00.852451 27544 tablet_service.cc:1511] Processing CreateTablet for tablet 7d11155c16cb45c3b96bd3b3b3f98a91 (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:00.853850 27544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d11155c16cb45c3b96bd3b3b3f98a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.855764 27619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882e2b233ed7404993be05bfd6bcd10f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.856611 27618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fffd970e02a74e58b67547bbd3bcb349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.859453 27543 tablet_service.cc:1511] Processing CreateTablet for tablet 882e2b233ed7404993be05bfd6bcd10f (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:00.861358 27543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882e2b233ed7404993be05bfd6bcd10f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.860919 27691 tablet_service.cc:1511] Processing CreateTablet for tablet 64512827e5014d88a48f42d23ebbdbfb (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:00.862478 27691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64512827e5014d88a48f42d23ebbdbfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.875685 27542 tablet_service.cc:1511] Processing CreateTablet for tablet fffd970e02a74e58b67547bbd3bcb349 (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:00.877367 27542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fffd970e02a74e58b67547bbd3bcb349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.885035 27745 tablet_bootstrap.cc:492] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df: Bootstrap starting.
I20260709 12:26:00.898571 27690 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc0d183a72448c19e920e6369670b15 (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:00.898969 27541 tablet_service.cc:1511] Processing CreateTablet for tablet 64512827e5014d88a48f42d23ebbdbfb (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:00.900187 27690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc0d183a72448c19e920e6369670b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.900472 27541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64512827e5014d88a48f42d23ebbdbfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.907428 27617 tablet_service.cc:1511] Processing CreateTablet for tablet 64512827e5014d88a48f42d23ebbdbfb (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:00.909307 27617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64512827e5014d88a48f42d23ebbdbfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.913295 27694 tablet_service.cc:1511] Processing CreateTablet for tablet 25d4d57609d4490daefbd04d78dca235 (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:00.916195 27694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d4d57609d4490daefbd04d78dca235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.925010 27540 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc0d183a72448c19e920e6369670b15 (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:00.925940 27692 tablet_service.cc:1511] Processing CreateTablet for tablet ccdbd0761f0e4f40bb624499866a1489 (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:00.927146 27540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc0d183a72448c19e920e6369670b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.927621 27692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccdbd0761f0e4f40bb624499866a1489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.943185 27620 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc0d183a72448c19e920e6369670b15 (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:00.944485 27539 tablet_service.cc:1511] Processing CreateTablet for tablet 25d4d57609d4490daefbd04d78dca235 (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:00.945238 27746 tablet_bootstrap.cc:492] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3: Bootstrap starting.
I20260709 12:26:00.945870 27620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc0d183a72448c19e920e6369670b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.946755 27539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d4d57609d4490daefbd04d78dca235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.955385 27693 tablet_service.cc:1511] Processing CreateTablet for tablet 6b7edee8e2d44a0097910a246ebe4255 (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:00.957206 27693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b7edee8e2d44a0097910a246ebe4255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.965257 27746 tablet_bootstrap.cc:654] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.965902 27618 tablet_service.cc:1511] Processing CreateTablet for tablet 25d4d57609d4490daefbd04d78dca235 (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:00.967196 27538 tablet_service.cc:1511] Processing CreateTablet for tablet ccdbd0761f0e4f40bb624499866a1489 (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:00.967833 27618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d4d57609d4490daefbd04d78dca235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.968648 27538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccdbd0761f0e4f40bb624499866a1489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.925697 27745 tablet_bootstrap.cc:654] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.985450 27619 tablet_service.cc:1511] Processing CreateTablet for tablet ccdbd0761f0e4f40bb624499866a1489 (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:00.986307 27537 tablet_service.cc:1511] Processing CreateTablet for tablet 6b7edee8e2d44a0097910a246ebe4255 (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:00.987165 27619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccdbd0761f0e4f40bb624499866a1489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.987275 27691 tablet_service.cc:1511] Processing CreateTablet for tablet b67abb18d5c047fa90bb2bc94494aaac (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:00.987669 27537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b7edee8e2d44a0097910a246ebe4255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.988669 27691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b67abb18d5c047fa90bb2bc94494aaac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.004850 27616 tablet_service.cc:1511] Processing CreateTablet for tablet 6b7edee8e2d44a0097910a246ebe4255 (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:01.007596 27616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b7edee8e2d44a0097910a246ebe4255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.036192 27746 tablet_bootstrap.cc:492] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3: No bootstrap required, opened a new log
I20260709 12:26:01.037149 27746 ts_tablet_manager.cc:1403] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3: Time spent bootstrapping tablet: real 0.092s	user 0.026s	sys 0.018s
I20260709 12:26:01.040814 27746 raft_consensus.cc:359] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.041664 27746 raft_consensus.cc:385] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.043871 27746 raft_consensus.cc:740] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14900064b421439bb3283d698937fdc3, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.044993 27746 consensus_queue.cc:260] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.075779 27655 heartbeater.cc:499] Master 127.16.240.190:36287 was elected leader, sending a full tablet report...
I20260709 12:26:01.082460 27746 ts_tablet_manager.cc:1434] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.011s
I20260709 12:26:01.083781 27746 tablet_bootstrap.cc:492] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 14900064b421439bb3283d698937fdc3: Bootstrap starting.
I20260709 12:26:01.086331 27745 tablet_bootstrap.cc:492] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df: No bootstrap required, opened a new log
I20260709 12:26:01.088831 27745 ts_tablet_manager.cc:1403] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df: Time spent bootstrapping tablet: real 0.204s	user 0.013s	sys 0.007s
I20260709 12:26:01.092566 27746 tablet_bootstrap.cc:654] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 14900064b421439bb3283d698937fdc3: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:01.096153 27437 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.16.240.130:34639, user_credentials={real_user=slave}} blocked reactor thread for 96115.1us
W20260709 12:26:01.096297 27438 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.16.240.131:32823, user_credentials={real_user=slave}} blocked reactor thread for 88880.6us
I20260709 12:26:01.102487 27750 tablet_bootstrap.cc:492] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95: Bootstrap starting.
I20260709 12:26:01.102365 27619 tablet_service.cc:1511] Processing CreateTablet for tablet b67abb18d5c047fa90bb2bc94494aaac (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:01.102732 27536 tablet_service.cc:1511] Processing CreateTablet for tablet b67abb18d5c047fa90bb2bc94494aaac (DEFAULT_TABLE table=test-workload [id=eb937797fd6143ae8072dd5e71012eae]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:01.103869 27619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b67abb18d5c047fa90bb2bc94494aaac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.104734 27536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b67abb18d5c047fa90bb2bc94494aaac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.110790 27746 tablet_bootstrap.cc:492] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 14900064b421439bb3283d698937fdc3: No bootstrap required, opened a new log
I20260709 12:26:01.111500 27746 ts_tablet_manager.cc:1403] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 14900064b421439bb3283d698937fdc3: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.006s
I20260709 12:26:01.114665 27746 raft_consensus.cc:359] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } } peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } }
I20260709 12:26:01.115711 27746 raft_consensus.cc:385] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.116062 27746 raft_consensus.cc:740] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14900064b421439bb3283d698937fdc3, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.116986 27746 consensus_queue.cc:260] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 14900064b421439bb3283d698937fdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } } peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } }
I20260709 12:26:01.119251 27746 ts_tablet_manager.cc:1434] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 14900064b421439bb3283d698937fdc3: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 12:26:01.120308 27746 tablet_bootstrap.cc:492] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3: Bootstrap starting.
I20260709 12:26:01.122784 27750 tablet_bootstrap.cc:654] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.129889 27745 raft_consensus.cc:359] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } } peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } }
I20260709 12:26:01.130851 27745 raft_consensus.cc:385] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.131178 27745 raft_consensus.cc:740] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.134049 27746 tablet_bootstrap.cc:654] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.149492 27745 consensus_queue.cc:260] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } } peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } }
I20260709 12:26:01.154247 27750 tablet_bootstrap.cc:492] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95: No bootstrap required, opened a new log
I20260709 12:26:01.155126 27750 ts_tablet_manager.cc:1403] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.011s
I20260709 12:26:01.159724 27750 raft_consensus.cc:359] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } } peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } }
I20260709 12:26:01.160833 27750 raft_consensus.cc:385] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.161235 27750 raft_consensus.cc:740] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.162549 27750 consensus_queue.cc:260] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } } peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } }
I20260709 12:26:01.164868 27730 heartbeater.cc:499] Master 127.16.240.190:36287 was elected leader, sending a full tablet report...
I20260709 12:26:01.165774 27745 ts_tablet_manager.cc:1434] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df: Time spent starting tablet: real 0.076s	user 0.011s	sys 0.009s
I20260709 12:26:01.166231 27746 tablet_bootstrap.cc:492] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3: No bootstrap required, opened a new log
I20260709 12:26:01.166790 27746 ts_tablet_manager.cc:1403] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3: Time spent bootstrapping tablet: real 0.047s	user 0.024s	sys 0.013s
I20260709 12:26:01.167315 27745 tablet_bootstrap.cc:492] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df: Bootstrap starting.
I20260709 12:26:01.170049 27746 raft_consensus.cc:359] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.171011 27746 raft_consensus.cc:385] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.171293 27746 raft_consensus.cc:740] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14900064b421439bb3283d698937fdc3, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.172101 27746 consensus_queue.cc:260] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.174361 27746 ts_tablet_manager.cc:1434] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:01.175436 27746 tablet_bootstrap.cc:492] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3: Bootstrap starting.
I20260709 12:26:01.178583 27745 tablet_bootstrap.cc:654] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.181314 27580 heartbeater.cc:499] Master 127.16.240.190:36287 was elected leader, sending a full tablet report...
I20260709 12:26:01.181551 27750 ts_tablet_manager.cc:1434] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95: Time spent starting tablet: real 0.026s	user 0.011s	sys 0.017s
I20260709 12:26:01.183097 27750 tablet_bootstrap.cc:492] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95: Bootstrap starting.
I20260709 12:26:01.183188 27746 tablet_bootstrap.cc:654] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.199501 27750 tablet_bootstrap.cc:654] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.200083 27746 tablet_bootstrap.cc:492] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3: No bootstrap required, opened a new log
I20260709 12:26:01.200770 27746 ts_tablet_manager.cc:1403] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.004s
I20260709 12:26:01.204532 27745 tablet_bootstrap.cc:492] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df: No bootstrap required, opened a new log
I20260709 12:26:01.205376 27745 ts_tablet_manager.cc:1403] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df: Time spent bootstrapping tablet: real 0.038s	user 0.024s	sys 0.003s
I20260709 12:26:01.210008 27745 raft_consensus.cc:359] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.210839 27745 raft_consensus.cc:385] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.211156 27745 raft_consensus.cc:740] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.205050 27746 raft_consensus.cc:359] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.211918 27746 raft_consensus.cc:385] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.212240 27746 raft_consensus.cc:740] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14900064b421439bb3283d698937fdc3, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.212504 27750 tablet_bootstrap.cc:492] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95: No bootstrap required, opened a new log
I20260709 12:26:01.213284 27750 ts_tablet_manager.cc:1403] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.007s
I20260709 12:26:01.212664 27745 consensus_queue.cc:260] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.213071 27746 consensus_queue.cc:260] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.215869 27745 ts_tablet_manager.cc:1434] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:26:01.216091 27746 ts_tablet_manager.cc:1434] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:26:01.217235 27745 tablet_bootstrap.cc:492] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df: Bootstrap starting.
I20260709 12:26:01.218007 27746 tablet_bootstrap.cc:492] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3: Bootstrap starting.
I20260709 12:26:01.225232 27745 tablet_bootstrap.cc:654] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.217240 27750 raft_consensus.cc:359] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.226209 27750 raft_consensus.cc:385] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.226604 27750 raft_consensus.cc:740] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.225243 27746 tablet_bootstrap.cc:654] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.227455 27750 consensus_queue.cc:260] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.245448 27750 ts_tablet_manager.cc:1434] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.006s
I20260709 12:26:01.247268 27750 tablet_bootstrap.cc:492] T ccdbd0761f0e4f40bb624499866a1489 P adb2f949f49447f89aa4c72935536a95: Bootstrap starting.
I20260709 12:26:01.258359 27750 tablet_bootstrap.cc:654] T ccdbd0761f0e4f40bb624499866a1489 P adb2f949f49447f89aa4c72935536a95: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:01.259810 27500 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:01.262290 27746 tablet_bootstrap.cc:492] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3: No bootstrap required, opened a new log
I20260709 12:26:01.262923 27746 ts_tablet_manager.cc:1403] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.019s
I20260709 12:26:01.263348 27745 tablet_bootstrap.cc:492] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df: No bootstrap required, opened a new log
I20260709 12:26:01.263934 27745 ts_tablet_manager.cc:1403] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.030s
I20260709 12:26:01.266251 27754 raft_consensus.cc:493] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.267030 27754 raft_consensus.cc:515] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } } peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } }
I20260709 12:26:01.268863 27745 raft_consensus.cc:359] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.269903 27745 raft_consensus.cc:385] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.270303 27745 raft_consensus.cc:740] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.272141 27745 consensus_queue.cc:260] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.274119 27754 leader_election.cc:290] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639), adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495)
I20260709 12:26:01.286067 27754 raft_consensus.cc:493] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.287165 27754 raft_consensus.cc:515] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.291405 27745 ts_tablet_manager.cc:1434] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df: Time spent starting tablet: real 0.027s	user 0.015s	sys 0.009s
I20260709 12:26:01.292989 27745 tablet_bootstrap.cc:492] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df: Bootstrap starting.
I20260709 12:26:01.267040 27746 raft_consensus.cc:359] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.295670 27746 raft_consensus.cc:385] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.296228 27746 raft_consensus.cc:740] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14900064b421439bb3283d698937fdc3, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.296644 27630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d11155c16cb45c3b96bd3b3b3f98a91" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3" is_pre_election: true
I20260709 12:26:01.297454 27630 raft_consensus.cc:2468] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 0.
I20260709 12:26:01.306052 27745 tablet_bootstrap.cc:654] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.315922 27668 leader_election.cc:304] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, 883b0e22898a4bf7a51286a04aa3f5df; no voters: 
I20260709 12:26:01.317883 27763 raft_consensus.cc:2804] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:01.318488 27763 raft_consensus.cc:493] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.318908 27763 raft_consensus.cc:3060] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.371675 27763 raft_consensus.cc:515] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } } peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } }
I20260709 12:26:01.375044 27630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d11155c16cb45c3b96bd3b3b3f98a91" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3"
I20260709 12:26:01.375859 27630 raft_consensus.cc:3060] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.390542 27750 tablet_bootstrap.cc:492] T ccdbd0761f0e4f40bb624499866a1489 P adb2f949f49447f89aa4c72935536a95: No bootstrap required, opened a new log
I20260709 12:26:01.391319 27750 ts_tablet_manager.cc:1403] T ccdbd0761f0e4f40bb624499866a1489 P adb2f949f49447f89aa4c72935536a95: Time spent bootstrapping tablet: real 0.145s	user 0.010s	sys 0.008s
I20260709 12:26:01.395329 27555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d11155c16cb45c3b96bd3b3b3f98a91" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95" is_pre_election: true
I20260709 12:26:01.395874 27754 leader_election.cc:290] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639)
I20260709 12:26:01.390466 27763 leader_election.cc:290] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 election: Requested vote from peers 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639), adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495)
I20260709 12:26:01.396497 27555 raft_consensus.cc:2468] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 0.
I20260709 12:26:01.394410 27746 consensus_queue.cc:260] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.395843 27750 raft_consensus.cc:359] T ccdbd0761f0e4f40bb624499866a1489 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.399169 27749 raft_consensus.cc:493] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.399771 27749 raft_consensus.cc:515] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.400991 27750 raft_consensus.cc:385] T ccdbd0761f0e4f40bb624499866a1489 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.401340 27750 raft_consensus.cc:740] T ccdbd0761f0e4f40bb624499866a1489 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.401355 27745 tablet_bootstrap.cc:492] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df: No bootstrap required, opened a new log
I20260709 12:26:01.402568 27745 ts_tablet_manager.cc:1403] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df: Time spent bootstrapping tablet: real 0.110s	user 0.027s	sys 0.018s
I20260709 12:26:01.402331 27750 consensus_queue.cc:260] T ccdbd0761f0e4f40bb624499866a1489 P adb2f949f49447f89aa4c72935536a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.404788 27750 ts_tablet_manager.cc:1434] T ccdbd0761f0e4f40bb624499866a1489 P adb2f949f49447f89aa4c72935536a95: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 12:26:01.405910 27750 tablet_bootstrap.cc:492] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95: Bootstrap starting.
I20260709 12:26:01.406216 27745 raft_consensus.cc:359] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.407054 27745 raft_consensus.cc:385] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.407356 27745 raft_consensus.cc:740] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.408927 27745 consensus_queue.cc:260] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.412796 27745 ts_tablet_manager.cc:1434] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:26:01.414019 27763 raft_consensus.cc:493] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.414834 27750 tablet_bootstrap.cc:654] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.414614 27763 raft_consensus.cc:515] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.417271 27763 leader_election.cc:290] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639)
I20260709 12:26:01.418310 27745 tablet_bootstrap.cc:492] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df: Bootstrap starting.
I20260709 12:26:01.429538 27745 tablet_bootstrap.cc:654] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.463416 27755 raft_consensus.cc:493] T ccdbd0761f0e4f40bb624499866a1489 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.465206 27755 raft_consensus.cc:515] T ccdbd0761f0e4f40bb624499866a1489 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.466457 27553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffd970e02a74e58b67547bbd3bcb349" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95" is_pre_election: true
I20260709 12:26:01.472543 27555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882e2b233ed7404993be05bfd6bcd10f" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95" is_pre_election: true
I20260709 12:26:01.473162 27552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d11155c16cb45c3b96bd3b3b3f98a91" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:01.473776 27552 raft_consensus.cc:3060] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:01.486316 27668 leader_election.cc:343] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:01.487490 27668 leader_election.cc:343] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.490237 27755 leader_election.cc:290] T ccdbd0761f0e4f40bb624499866a1489 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:01.497668 27552 raft_consensus.cc:2468] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 1.
I20260709 12:26:01.503923 27668 leader_election.cc:304] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 883b0e22898a4bf7a51286a04aa3f5df, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:01.505357 27763 raft_consensus.cc:2804] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:01.506031 27763 raft_consensus.cc:697] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Becoming Leader. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Running, Role: LEADER
I20260709 12:26:01.507108 27763 consensus_queue.cc:237] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } } peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } }
I20260709 12:26:01.523025 27630 raft_consensus.cc:2468] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 1.
I20260709 12:26:01.576738 27769 raft_consensus.cc:493] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.637722 27769 raft_consensus.cc:515] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.639151 27705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccdbd0761f0e4f40bb624499866a1489" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df" is_pre_election: true
I20260709 12:26:01.640336 27769 leader_election.cc:290] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:01.582774 27629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffd970e02a74e58b67547bbd3bcb349" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3" is_pre_election: true
I20260709 12:26:01.645797 27629 raft_consensus.cc:2468] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 0.
I20260709 12:26:01.584303 27628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882e2b233ed7404993be05bfd6bcd10f" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3" is_pre_election: true
I20260709 12:26:01.647648 27769 raft_consensus.cc:493] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.633226 27755 raft_consensus.cc:493] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.651801 27755 raft_consensus.cc:515] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.654742 27755 leader_election.cc:290] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:01.578114 27770 raft_consensus.cc:493] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.533120 27749 leader_election.cc:290] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:01.656246 27770 raft_consensus.cc:515] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.681397 27628 raft_consensus.cc:2468] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 0.
I20260709 12:26:01.681497 27450 catalog_manager.cc:5697] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df reported cstate change: term changed from 0 to 1, leader changed from <none> to 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131). New cstate: current_term: 1 leader_uuid: "883b0e22898a4bf7a51286a04aa3f5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:01.682757 27770 leader_election.cc:290] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
W20260709 12:26:01.658042 27519 leader_election.cc:343] T ccdbd0761f0e4f40bb624499866a1489 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.657944 27668 leader_election.cc:304] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14900064b421439bb3283d698937fdc3, 883b0e22898a4bf7a51286a04aa3f5df; no voters: adb2f949f49447f89aa4c72935536a95
I20260709 12:26:01.659060 27769 raft_consensus.cc:515] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.662683 27629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccdbd0761f0e4f40bb624499866a1489" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3" is_pre_election: true
I20260709 12:26:01.663451 27552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc0d183a72448c19e920e6369670b15" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95" is_pre_election: true
I20260709 12:26:01.685004 27552 raft_consensus.cc:2468] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 0.
I20260709 12:26:01.664288 27553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d4d57609d4490daefbd04d78dca235" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95" is_pre_election: true
I20260709 12:26:01.685372 27668 leader_election.cc:304] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14900064b421439bb3283d698937fdc3, 883b0e22898a4bf7a51286a04aa3f5df; no voters: adb2f949f49447f89aa4c72935536a95
I20260709 12:26:01.686456 27594 leader_election.cc:304] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:01.686806 27703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc0d183a72448c19e920e6369670b15" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df" is_pre_election: true
I20260709 12:26:01.678184 27705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc0d183a72448c19e920e6369670b15" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df" is_pre_election: true
I20260709 12:26:01.687817 27770 raft_consensus.cc:2804] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:01.686595 27754 raft_consensus.cc:2804] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:26:01.688329 27518 leader_election.cc:343] T ccdbd0761f0e4f40bb624499866a1489 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.688694 27763 raft_consensus.cc:2804] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:01.689262 27763 raft_consensus.cc:493] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.689939 27763 raft_consensus.cc:3060] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.688302 27754 raft_consensus.cc:493] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.691220 27754 raft_consensus.cc:3060] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.688452 27770 raft_consensus.cc:493] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.692294 27770 raft_consensus.cc:3060] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.664426 27630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc0d183a72448c19e920e6369670b15" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3" is_pre_election: true
W20260709 12:26:01.694404 27519 leader_election.cc:343] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.683568 27555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882e2b233ed7404993be05bfd6bcd10f" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95" is_pre_election: true
I20260709 12:26:01.695711 27746 ts_tablet_manager.cc:1434] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3: Time spent starting tablet: real 0.432s	user 0.045s	sys 0.074s
W20260709 12:26:01.698644 27594 leader_election.cc:343] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.698793 27704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d4d57609d4490daefbd04d78dca235" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df" is_pre_election: true
W20260709 12:26:01.699885 27594 leader_election.cc:343] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.697861 27705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882e2b233ed7404993be05bfd6bcd10f" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df" is_pre_election: true
I20260709 12:26:01.696031 27750 tablet_bootstrap.cc:492] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95: No bootstrap required, opened a new log
I20260709 12:26:01.701195 27750 ts_tablet_manager.cc:1403] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95: Time spent bootstrapping tablet: real 0.296s	user 0.086s	sys 0.158s
I20260709 12:26:01.704759 27750 raft_consensus.cc:359] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.710873 27750 raft_consensus.cc:385] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.708530 27769 leader_election.cc:290] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:01.709645 27555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffd970e02a74e58b67547bbd3bcb349" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95" is_pre_election: true
I20260709 12:26:01.710237 27745 tablet_bootstrap.cc:492] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df: No bootstrap required, opened a new log
I20260709 12:26:01.697896 27746 tablet_bootstrap.cc:492] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3: Bootstrap starting.
I20260709 12:26:01.711419 27750 raft_consensus.cc:740] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.712153 27745 ts_tablet_manager.cc:1403] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df: Time spent bootstrapping tablet: real 0.294s	user 0.091s	sys 0.119s
W20260709 12:26:01.713709 27594 leader_election.cc:343] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.712895 27750 consensus_queue.cc:260] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.710414 27763 raft_consensus.cc:515] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.715222 27705 raft_consensus.cc:2393] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14900064b421439bb3283d698937fdc3 in current term 1: Already voted for candidate 883b0e22898a4bf7a51286a04aa3f5df in this term.
I20260709 12:26:01.705461 27518 leader_election.cc:304] T ccdbd0761f0e4f40bb624499866a1489 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adb2f949f49447f89aa4c72935536a95; no voters: 14900064b421439bb3283d698937fdc3, 883b0e22898a4bf7a51286a04aa3f5df
I20260709 12:26:01.716333 27755 raft_consensus.cc:2749] T ccdbd0761f0e4f40bb624499866a1489 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:01.699937 27595 leader_election.cc:343] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.716881 27745 raft_consensus.cc:359] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.717680 27745 raft_consensus.cc:385] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.717983 27745 raft_consensus.cc:740] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.719010 27745 consensus_queue.cc:260] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.719844 27746 tablet_bootstrap.cc:654] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.719873 27763 leader_election.cc:290] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 election: Requested vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639)
I20260709 12:26:01.720670 27629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882e2b233ed7404993be05bfd6bcd10f" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3"
I20260709 12:26:01.709892 27770 raft_consensus.cc:515] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.721496 27629 raft_consensus.cc:3060] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.722092 27630 raft_consensus.cc:2393] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adb2f949f49447f89aa4c72935536a95 in current term 1: Already voted for candidate 14900064b421439bb3283d698937fdc3 in this term.
I20260709 12:26:01.722765 27750 ts_tablet_manager.cc:1434] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 12:26:01.724575 27750 tablet_bootstrap.cc:492] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95: Bootstrap starting.
I20260709 12:26:01.725260 27770 leader_election.cc:290] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 election: Requested vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:01.733213 27750 tablet_bootstrap.cc:654] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.733729 27553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc0d183a72448c19e920e6369670b15" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:01.719583 27555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882e2b233ed7404993be05bfd6bcd10f" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:01.734582 27746 tablet_bootstrap.cc:492] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3: No bootstrap required, opened a new log
I20260709 12:26:01.734615 27553 raft_consensus.cc:3060] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.735508 27746 ts_tablet_manager.cc:1403] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.008s
W20260709 12:26:01.740370 27668 leader_election.cc:343] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.739894 27746 raft_consensus.cc:359] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.741194 27746 raft_consensus.cc:385] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.741596 27746 raft_consensus.cc:740] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14900064b421439bb3283d698937fdc3, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.742885 27746 consensus_queue.cc:260] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.744273 27518 leader_election.cc:304] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adb2f949f49447f89aa4c72935536a95; no voters: 14900064b421439bb3283d698937fdc3, 883b0e22898a4bf7a51286a04aa3f5df
I20260709 12:26:01.746680 27746 ts_tablet_manager.cc:1434] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:26:01.748396 27746 tablet_bootstrap.cc:492] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3: Bootstrap starting.
W20260709 12:26:01.751958 27595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:32823, user_credentials={real_user=slave}} blocked reactor thread for 52211.8us
I20260709 12:26:01.754755 27705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffd970e02a74e58b67547bbd3bcb349" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df" is_pre_election: true
I20260709 12:26:01.757381 27750 tablet_bootstrap.cc:492] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95: No bootstrap required, opened a new log
I20260709 12:26:01.758124 27750 ts_tablet_manager.cc:1403] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.016s
I20260709 12:26:01.760766 27746 tablet_bootstrap.cc:654] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.762368 27750 raft_consensus.cc:359] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.763485 27750 raft_consensus.cc:385] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.763897 27750 raft_consensus.cc:740] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.764276 27704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc0d183a72448c19e920e6369670b15" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
I20260709 12:26:01.765674 27704 raft_consensus.cc:3060] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.764916 27750 consensus_queue.cc:260] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.772341 27763 raft_consensus.cc:493] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.773181 27763 raft_consensus.cc:515] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.778414 27763 leader_election.cc:290] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639)
I20260709 12:26:01.778954 27630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64512827e5014d88a48f42d23ebbdbfb" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3" is_pre_election: true
I20260709 12:26:01.780251 27555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64512827e5014d88a48f42d23ebbdbfb" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95" is_pre_election: true
W20260709 12:26:01.781136 27668 leader_election.cc:343] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.781179 27555 raft_consensus.cc:2468] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 0.
I20260709 12:26:01.783265 27668 leader_election.cc:304] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 883b0e22898a4bf7a51286a04aa3f5df, adb2f949f49447f89aa4c72935536a95; no voters: 14900064b421439bb3283d698937fdc3
I20260709 12:26:01.784529 27746 tablet_bootstrap.cc:492] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3: No bootstrap required, opened a new log
I20260709 12:26:01.784704 27763 raft_consensus.cc:2804] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:01.785339 27763 raft_consensus.cc:493] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.785946 27763 raft_consensus.cc:3060] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.785328 27746 ts_tablet_manager.cc:1403] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.016s
I20260709 12:26:01.794476 27746 raft_consensus.cc:359] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.795994 27746 raft_consensus.cc:385] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.796409 27746 raft_consensus.cc:740] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14900064b421439bb3283d698937fdc3, State: Initialized, Role: FOLLOWER
W20260709 12:26:01.797557 27595 leader_election.cc:343] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.798285 27595 leader_election.cc:304] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14900064b421439bb3283d698937fdc3; no voters: 883b0e22898a4bf7a51286a04aa3f5df, adb2f949f49447f89aa4c72935536a95
I20260709 12:26:01.799460 27770 raft_consensus.cc:2749] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:01.801400 27595 leader_election.cc:304] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14900064b421439bb3283d698937fdc3; no voters: 883b0e22898a4bf7a51286a04aa3f5df, adb2f949f49447f89aa4c72935536a95
I20260709 12:26:01.804608 27629 raft_consensus.cc:2468] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 1.
I20260709 12:26:01.806010 27763 raft_consensus.cc:515] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.806406 27668 leader_election.cc:304] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14900064b421439bb3283d698937fdc3, 883b0e22898a4bf7a51286a04aa3f5df; no voters: adb2f949f49447f89aa4c72935536a95
I20260709 12:26:01.808205 27746 consensus_queue.cc:260] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.809036 27553 raft_consensus.cc:2468] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 1.
I20260709 12:26:01.810168 27755 raft_consensus.cc:2749] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:01.811122 27763 leader_election.cc:290] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 election: Requested vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639)
I20260709 12:26:01.812057 27763 raft_consensus.cc:2804] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:01.812683 27763 raft_consensus.cc:697] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Becoming Leader. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Running, Role: LEADER
I20260709 12:26:01.813192 27754 raft_consensus.cc:515] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.814455 27705 raft_consensus.cc:2393] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14900064b421439bb3283d698937fdc3 in current term 1: Already voted for candidate 883b0e22898a4bf7a51286a04aa3f5df in this term.
I20260709 12:26:01.813856 27763 consensus_queue.cc:237] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.815374 27555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64512827e5014d88a48f42d23ebbdbfb" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:01.816042 27555 raft_consensus.cc:3060] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.817473 27754 leader_election.cc:290] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 election: Requested vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639)
I20260709 12:26:01.819792 27745 ts_tablet_manager.cc:1434] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df: Time spent starting tablet: real 0.107s	user 0.010s	sys 0.041s
I20260709 12:26:01.820997 27745 tablet_bootstrap.cc:492] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df: Bootstrap starting.
I20260709 12:26:01.821432 27630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffd970e02a74e58b67547bbd3bcb349" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3"
I20260709 12:26:01.822983 27552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffd970e02a74e58b67547bbd3bcb349" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:01.823685 27552 raft_consensus.cc:3060] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.827960 27630 raft_consensus.cc:3060] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.830896 27745 tablet_bootstrap.cc:654] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.842687 27745 tablet_bootstrap.cc:492] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df: No bootstrap required, opened a new log
I20260709 12:26:01.843225 27745 ts_tablet_manager.cc:1403] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.001s
I20260709 12:26:01.846338 27745 raft_consensus.cc:359] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.847069 27745 raft_consensus.cc:385] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.852797 27594 leader_election.cc:304] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:01.854200 27552 raft_consensus.cc:2468] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 1.
I20260709 12:26:01.856393 27668 leader_election.cc:304] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 883b0e22898a4bf7a51286a04aa3f5df, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:01.857604 27770 raft_consensus.cc:2749] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:01.858987 27595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:32823, user_credentials={real_user=slave}} blocked reactor thread for 57731.2us
I20260709 12:26:01.859952 27746 ts_tablet_manager.cc:1434] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3: Time spent starting tablet: real 0.071s	user 0.004s	sys 0.009s
I20260709 12:26:01.860313 27595 leader_election.cc:304] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14900064b421439bb3283d698937fdc3; no voters: 883b0e22898a4bf7a51286a04aa3f5df, adb2f949f49447f89aa4c72935536a95
I20260709 12:26:01.861501 27746 tablet_bootstrap.cc:492] T 64512827e5014d88a48f42d23ebbdbfb P 14900064b421439bb3283d698937fdc3: Bootstrap starting.
I20260709 12:26:01.864153 27704 raft_consensus.cc:2468] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 1.
I20260709 12:26:01.864369 27769 raft_consensus.cc:2804] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:01.865224 27769 raft_consensus.cc:697] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Becoming Leader. State: Replica: 14900064b421439bb3283d698937fdc3, State: Running, Role: LEADER
I20260709 12:26:01.865447 27629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64512827e5014d88a48f42d23ebbdbfb" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3"
W20260709 12:26:01.867035 27668 leader_election.cc:343] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:01.854336 27745 raft_consensus.cc:740] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.866482 27769 consensus_queue.cc:237] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.857846 27754 raft_consensus.cc:2804] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:01.868628 27754 raft_consensus.cc:697] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Becoming Leader. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Running, Role: LEADER
I20260709 12:26:01.868449 27745 consensus_queue.cc:260] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.869567 27754 consensus_queue.cc:237] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.870601 27555 raft_consensus.cc:2468] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 1.
I20260709 12:26:01.876199 27745 ts_tablet_manager.cc:1434] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.003s
I20260709 12:26:01.879009 27668 leader_election.cc:304] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 883b0e22898a4bf7a51286a04aa3f5df, adb2f949f49447f89aa4c72935536a95; no voters: 14900064b421439bb3283d698937fdc3
I20260709 12:26:01.882526 27778 raft_consensus.cc:2804] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:01.883109 27778 raft_consensus.cc:697] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Becoming Leader. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Running, Role: LEADER
I20260709 12:26:01.881462 27750 ts_tablet_manager.cc:1434] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95: Time spent starting tablet: real 0.123s	user 0.028s	sys 0.068s
I20260709 12:26:01.870446 27630 raft_consensus.cc:2468] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 1.
I20260709 12:26:01.886147 27770 raft_consensus.cc:2749] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:01.886507 27778 consensus_queue.cc:237] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.883559 27745 tablet_bootstrap.cc:492] T 6b7edee8e2d44a0097910a246ebe4255 P 883b0e22898a4bf7a51286a04aa3f5df: Bootstrap starting.
I20260709 12:26:01.900194 27750 tablet_bootstrap.cc:492] T 6b7edee8e2d44a0097910a246ebe4255 P adb2f949f49447f89aa4c72935536a95: Bootstrap starting.
I20260709 12:26:01.914810 27451 catalog_manager.cc:5697] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df reported cstate change: term changed from 0 to 1, leader changed from <none> to 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131). New cstate: current_term: 1 leader_uuid: "883b0e22898a4bf7a51286a04aa3f5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:01.918828 27745 tablet_bootstrap.cc:654] T 6b7edee8e2d44a0097910a246ebe4255 P 883b0e22898a4bf7a51286a04aa3f5df: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.922709 27750 tablet_bootstrap.cc:654] T 6b7edee8e2d44a0097910a246ebe4255 P adb2f949f49447f89aa4c72935536a95: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.928617 27745 tablet_bootstrap.cc:492] T 6b7edee8e2d44a0097910a246ebe4255 P 883b0e22898a4bf7a51286a04aa3f5df: No bootstrap required, opened a new log
I20260709 12:26:01.929119 27745 ts_tablet_manager.cc:1403] T 6b7edee8e2d44a0097910a246ebe4255 P 883b0e22898a4bf7a51286a04aa3f5df: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.000s
I20260709 12:26:01.929526 27746 tablet_bootstrap.cc:654] T 64512827e5014d88a48f42d23ebbdbfb P 14900064b421439bb3283d698937fdc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.928854 27452 catalog_manager.cc:5697] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 14900064b421439bb3283d698937fdc3 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "14900064b421439bb3283d698937fdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:01.931888 27745 raft_consensus.cc:359] T 6b7edee8e2d44a0097910a246ebe4255 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.932873 27745 raft_consensus.cc:385] T 6b7edee8e2d44a0097910a246ebe4255 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.933200 27745 raft_consensus.cc:740] T 6b7edee8e2d44a0097910a246ebe4255 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.934281 27745 consensus_queue.cc:260] T 6b7edee8e2d44a0097910a246ebe4255 P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.935884 27750 tablet_bootstrap.cc:492] T 6b7edee8e2d44a0097910a246ebe4255 P adb2f949f49447f89aa4c72935536a95: No bootstrap required, opened a new log
I20260709 12:26:01.936755 27750 ts_tablet_manager.cc:1403] T 6b7edee8e2d44a0097910a246ebe4255 P adb2f949f49447f89aa4c72935536a95: Time spent bootstrapping tablet: real 0.040s	user 0.003s	sys 0.013s
I20260709 12:26:01.938069 27745 ts_tablet_manager.cc:1434] T 6b7edee8e2d44a0097910a246ebe4255 P 883b0e22898a4bf7a51286a04aa3f5df: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:26:01.939301 27745 tablet_bootstrap.cc:492] T ccdbd0761f0e4f40bb624499866a1489 P 883b0e22898a4bf7a51286a04aa3f5df: Bootstrap starting.
I20260709 12:26:01.940436 27750 raft_consensus.cc:359] T 6b7edee8e2d44a0097910a246ebe4255 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.941332 27750 raft_consensus.cc:385] T 6b7edee8e2d44a0097910a246ebe4255 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.941705 27750 raft_consensus.cc:740] T 6b7edee8e2d44a0097910a246ebe4255 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.942713 27750 consensus_queue.cc:260] T 6b7edee8e2d44a0097910a246ebe4255 P adb2f949f49447f89aa4c72935536a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.945370 27750 ts_tablet_manager.cc:1434] T 6b7edee8e2d44a0097910a246ebe4255 P adb2f949f49447f89aa4c72935536a95: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:01.946569 27750 tablet_bootstrap.cc:492] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95: Bootstrap starting.
I20260709 12:26:01.947059 27745 tablet_bootstrap.cc:654] T ccdbd0761f0e4f40bb624499866a1489 P 883b0e22898a4bf7a51286a04aa3f5df: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.950078 27746 tablet_bootstrap.cc:492] T 64512827e5014d88a48f42d23ebbdbfb P 14900064b421439bb3283d698937fdc3: No bootstrap required, opened a new log
I20260709 12:26:01.950582 27746 ts_tablet_manager.cc:1403] T 64512827e5014d88a48f42d23ebbdbfb P 14900064b421439bb3283d698937fdc3: Time spent bootstrapping tablet: real 0.089s	user 0.012s	sys 0.008s
I20260709 12:26:01.953433 27746 raft_consensus.cc:359] T 64512827e5014d88a48f42d23ebbdbfb P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.954165 27746 raft_consensus.cc:385] T 64512827e5014d88a48f42d23ebbdbfb P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.954428 27746 raft_consensus.cc:740] T 64512827e5014d88a48f42d23ebbdbfb P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14900064b421439bb3283d698937fdc3, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.955108 27746 consensus_queue.cc:260] T 64512827e5014d88a48f42d23ebbdbfb P 14900064b421439bb3283d698937fdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.956691 27750 tablet_bootstrap.cc:654] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.957799 27746 ts_tablet_manager.cc:1434] T 64512827e5014d88a48f42d23ebbdbfb P 14900064b421439bb3283d698937fdc3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:26:01.959017 27746 tablet_bootstrap.cc:492] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3: Bootstrap starting.
I20260709 12:26:01.961104 27451 catalog_manager.cc:5697] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df reported cstate change: term changed from 0 to 1, leader changed from <none> to 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131). New cstate: current_term: 1 leader_uuid: "883b0e22898a4bf7a51286a04aa3f5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:01.965618 27745 tablet_bootstrap.cc:492] T ccdbd0761f0e4f40bb624499866a1489 P 883b0e22898a4bf7a51286a04aa3f5df: No bootstrap required, opened a new log
I20260709 12:26:01.965113 27451 catalog_manager.cc:5697] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df reported cstate change: term changed from 0 to 1, leader changed from <none> to 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131). New cstate: current_term: 1 leader_uuid: "883b0e22898a4bf7a51286a04aa3f5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:01.966177 27745 ts_tablet_manager.cc:1403] T ccdbd0761f0e4f40bb624499866a1489 P 883b0e22898a4bf7a51286a04aa3f5df: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.013s
I20260709 12:26:01.969594 27745 raft_consensus.cc:359] T ccdbd0761f0e4f40bb624499866a1489 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.970352 27745 raft_consensus.cc:385] T ccdbd0761f0e4f40bb624499866a1489 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.965584 27746 tablet_bootstrap.cc:654] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.971395 27750 tablet_bootstrap.cc:492] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95: No bootstrap required, opened a new log
I20260709 12:26:01.972271 27750 ts_tablet_manager.cc:1403] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.004s
I20260709 12:26:01.970620 27745 raft_consensus.cc:740] T ccdbd0761f0e4f40bb624499866a1489 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.974514 27745 consensus_queue.cc:260] T ccdbd0761f0e4f40bb624499866a1489 P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.974901 27750 raft_consensus.cc:359] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.976068 27750 raft_consensus.cc:385] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.976464 27750 raft_consensus.cc:740] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.977756 27745 ts_tablet_manager.cc:1434] T ccdbd0761f0e4f40bb624499866a1489 P 883b0e22898a4bf7a51286a04aa3f5df: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:26:01.977681 27750 consensus_queue.cc:260] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.978888 27745 tablet_bootstrap.cc:492] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df: Bootstrap starting.
I20260709 12:26:01.979027 27746 tablet_bootstrap.cc:492] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3: No bootstrap required, opened a new log
I20260709 12:26:01.980093 27746 ts_tablet_manager.cc:1403] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.002s
I20260709 12:26:01.983512 27746 raft_consensus.cc:359] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.984194 27750 ts_tablet_manager.cc:1434] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 12:26:01.984401 27746 raft_consensus.cc:385] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.984843 27746 raft_consensus.cc:740] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14900064b421439bb3283d698937fdc3, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.985467 27750 tablet_bootstrap.cc:492] T 25d4d57609d4490daefbd04d78dca235 P adb2f949f49447f89aa4c72935536a95: Bootstrap starting.
I20260709 12:26:01.985735 27745 tablet_bootstrap.cc:654] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.985935 27746 consensus_queue.cc:260] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:01.992120 27778 consensus_queue.cc:1048] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:01.994081 27750 tablet_bootstrap.cc:654] T 25d4d57609d4490daefbd04d78dca235 P adb2f949f49447f89aa4c72935536a95: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.002168 27746 ts_tablet_manager.cc:1434] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 12:26:02.040331 27750 tablet_bootstrap.cc:492] T 25d4d57609d4490daefbd04d78dca235 P adb2f949f49447f89aa4c72935536a95: No bootstrap required, opened a new log
I20260709 12:26:02.041000 27750 ts_tablet_manager.cc:1403] T 25d4d57609d4490daefbd04d78dca235 P adb2f949f49447f89aa4c72935536a95: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.035s
I20260709 12:26:02.041045 27745 tablet_bootstrap.cc:492] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df: No bootstrap required, opened a new log
I20260709 12:26:02.041641 27745 ts_tablet_manager.cc:1403] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df: Time spent bootstrapping tablet: real 0.063s	user 0.024s	sys 0.034s
I20260709 12:26:02.044229 27750 raft_consensus.cc:359] T 25d4d57609d4490daefbd04d78dca235 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.044509 27745 raft_consensus.cc:359] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.045179 27750 raft_consensus.cc:385] T 25d4d57609d4490daefbd04d78dca235 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.045365 27745 raft_consensus.cc:385] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.045571 27750 raft_consensus.cc:740] T 25d4d57609d4490daefbd04d78dca235 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.045784 27745 raft_consensus.cc:740] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.046458 27750 consensus_queue.cc:260] T 25d4d57609d4490daefbd04d78dca235 P adb2f949f49447f89aa4c72935536a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.046770 27745 consensus_queue.cc:260] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.048992 27750 ts_tablet_manager.cc:1434] T 25d4d57609d4490daefbd04d78dca235 P adb2f949f49447f89aa4c72935536a95: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 12:26:02.049091 27745 ts_tablet_manager.cc:1434] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:02.050078 27750 tablet_bootstrap.cc:492] T b67abb18d5c047fa90bb2bc94494aaac P adb2f949f49447f89aa4c72935536a95: Bootstrap starting.
I20260709 12:26:02.051908 27754 consensus_queue.cc:1048] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:02.058305 27750 tablet_bootstrap.cc:654] T b67abb18d5c047fa90bb2bc94494aaac P adb2f949f49447f89aa4c72935536a95: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:02.063735 27769 raft_consensus.cc:493] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.064646 27769 raft_consensus.cc:515] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.069270 27552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b67abb18d5c047fa90bb2bc94494aaac" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95" is_pre_election: true
W20260709 12:26:02.072072 27594 leader_election.cc:343] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:02.078150 27769 leader_election.cc:290] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:02.079404 27704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b67abb18d5c047fa90bb2bc94494aaac" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df" is_pre_election: true
I20260709 12:26:02.080194 27750 tablet_bootstrap.cc:492] T b67abb18d5c047fa90bb2bc94494aaac P adb2f949f49447f89aa4c72935536a95: No bootstrap required, opened a new log
I20260709 12:26:02.080299 27704 raft_consensus.cc:2468] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 0.
I20260709 12:26:02.080924 27750 ts_tablet_manager.cc:1403] T b67abb18d5c047fa90bb2bc94494aaac P adb2f949f49447f89aa4c72935536a95: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.011s
I20260709 12:26:02.081840 27595 leader_election.cc:304] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14900064b421439bb3283d698937fdc3, 883b0e22898a4bf7a51286a04aa3f5df; no voters: adb2f949f49447f89aa4c72935536a95
I20260709 12:26:02.080099 27782 raft_consensus.cc:493] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.083184 27782 raft_consensus.cc:515] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.083949 27769 raft_consensus.cc:2804] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:02.083814 27750 raft_consensus.cc:359] T b67abb18d5c047fa90bb2bc94494aaac P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.084416 27769 raft_consensus.cc:493] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.084563 27750 raft_consensus.cc:385] T b67abb18d5c047fa90bb2bc94494aaac P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:02.084867 27769 raft_consensus.cc:3060] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.086478 27782 leader_election.cc:290] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:02.087672 27770 raft_consensus.cc:493] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.088196 27630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882e2b233ed7404993be05bfd6bcd10f" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3" is_pre_election: true
I20260709 12:26:02.089066 27630 raft_consensus.cc:2393] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adb2f949f49447f89aa4c72935536a95 in current term 1: Already voted for candidate 883b0e22898a4bf7a51286a04aa3f5df in this term.
I20260709 12:26:02.088224 27770 raft_consensus.cc:515] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.084910 27750 raft_consensus.cc:740] T b67abb18d5c047fa90bb2bc94494aaac P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Initialized, Role: FOLLOWER
I20260709 12:26:02.090296 27750 consensus_queue.cc:260] T b67abb18d5c047fa90bb2bc94494aaac P adb2f949f49447f89aa4c72935536a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.091323 27770 leader_election.cc:290] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:02.091993 27555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccdbd0761f0e4f40bb624499866a1489" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95" is_pre_election: true
I20260709 12:26:02.092471 27750 ts_tablet_manager.cc:1434] T b67abb18d5c047fa90bb2bc94494aaac P adb2f949f49447f89aa4c72935536a95: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 12:26:02.087693 27704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882e2b233ed7404993be05bfd6bcd10f" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df" is_pre_election: true
I20260709 12:26:02.092698 27555 raft_consensus.cc:2468] T ccdbd0761f0e4f40bb624499866a1489 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 0.
I20260709 12:26:02.093061 27705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccdbd0761f0e4f40bb624499866a1489" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df" is_pre_election: true
I20260709 12:26:02.093735 27705 raft_consensus.cc:2468] T ccdbd0761f0e4f40bb624499866a1489 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 0.
I20260709 12:26:02.094044 27519 leader_election.cc:304] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adb2f949f49447f89aa4c72935536a95; no voters: 14900064b421439bb3283d698937fdc3, 883b0e22898a4bf7a51286a04aa3f5df
I20260709 12:26:02.096066 27595 leader_election.cc:304] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, 883b0e22898a4bf7a51286a04aa3f5df; no voters: 
I20260709 12:26:02.096174 27755 raft_consensus.cc:3060] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.098359 27769 raft_consensus.cc:515] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.100870 27769 leader_election.cc:290] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 election: Requested vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:02.101475 27769 raft_consensus.cc:2804] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:02.101847 27769 raft_consensus.cc:493] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.102191 27769 raft_consensus.cc:3060] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.102200 27555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b67abb18d5c047fa90bb2bc94494aaac" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:02.102485 27704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b67abb18d5c047fa90bb2bc94494aaac" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
I20260709 12:26:02.103269 27555 raft_consensus.cc:3060] T b67abb18d5c047fa90bb2bc94494aaac P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.103335 27704 raft_consensus.cc:3060] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.106799 27755 raft_consensus.cc:2749] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:02.110466 27769 raft_consensus.cc:515] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.110818 27555 raft_consensus.cc:2468] T b67abb18d5c047fa90bb2bc94494aaac P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 1.
I20260709 12:26:02.111593 27704 raft_consensus.cc:2468] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 1.
I20260709 12:26:02.112481 27594 leader_election.cc:304] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:02.112942 27769 leader_election.cc:290] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 election: Requested vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:02.113626 27769 raft_consensus.cc:2804] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:02.114102 27769 raft_consensus.cc:697] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Becoming Leader. State: Replica: 14900064b421439bb3283d698937fdc3, State: Running, Role: LEADER
I20260709 12:26:02.114702 27552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccdbd0761f0e4f40bb624499866a1489" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:02.115118 27704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccdbd0761f0e4f40bb624499866a1489" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
I20260709 12:26:02.114951 27769 consensus_queue.cc:237] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.115420 27552 raft_consensus.cc:3060] T ccdbd0761f0e4f40bb624499866a1489 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.116971 27704 raft_consensus.cc:3060] T ccdbd0761f0e4f40bb624499866a1489 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.124584 27552 raft_consensus.cc:2468] T ccdbd0761f0e4f40bb624499866a1489 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 1.
I20260709 12:26:02.124727 27704 raft_consensus.cc:2468] T ccdbd0761f0e4f40bb624499866a1489 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 1.
I20260709 12:26:02.126084 27594 leader_election.cc:304] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:02.127146 27769 raft_consensus.cc:2804] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:02.127689 27769 raft_consensus.cc:697] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Becoming Leader. State: Replica: 14900064b421439bb3283d698937fdc3, State: Running, Role: LEADER
I20260709 12:26:02.128010 27449 catalog_manager.cc:5697] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 14900064b421439bb3283d698937fdc3 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "14900064b421439bb3283d698937fdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.128661 27769 consensus_queue.cc:237] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.144141 27449 catalog_manager.cc:5697] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 14900064b421439bb3283d698937fdc3 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "14900064b421439bb3283d698937fdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.189682 27754 raft_consensus.cc:493] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.190796 27754 raft_consensus.cc:515] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.193349 27754 leader_election.cc:290] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639)
I20260709 12:26:02.194098 27552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d4d57609d4490daefbd04d78dca235" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95" is_pre_election: true
I20260709 12:26:02.194480 27630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d4d57609d4490daefbd04d78dca235" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3" is_pre_election: true
I20260709 12:26:02.195160 27552 raft_consensus.cc:2468] T 25d4d57609d4490daefbd04d78dca235 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 0.
I20260709 12:26:02.195398 27630 raft_consensus.cc:2468] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 0.
I20260709 12:26:02.196928 27668 leader_election.cc:304] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 883b0e22898a4bf7a51286a04aa3f5df, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:02.197968 27754 raft_consensus.cc:2804] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:02.198304 27754 raft_consensus.cc:493] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.198575 27754 raft_consensus.cc:3060] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.205399 27754 raft_consensus.cc:515] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.205482 27778 consensus_queue.cc:1048] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:02.207471 27754 leader_election.cc:290] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 election: Requested vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639)
I20260709 12:26:02.208613 27552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d4d57609d4490daefbd04d78dca235" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:02.209357 27629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d4d57609d4490daefbd04d78dca235" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3"
I20260709 12:26:02.210052 27629 raft_consensus.cc:3060] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.209354 27552 raft_consensus.cc:3060] T 25d4d57609d4490daefbd04d78dca235 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.221006 27769 raft_consensus.cc:493] T 64512827e5014d88a48f42d23ebbdbfb P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.221643 27769 raft_consensus.cc:515] T 64512827e5014d88a48f42d23ebbdbfb P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.222218 27552 raft_consensus.cc:2468] T 25d4d57609d4490daefbd04d78dca235 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 1.
I20260709 12:26:02.223989 27769 leader_election.cc:290] T 64512827e5014d88a48f42d23ebbdbfb P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:02.224218 27668 leader_election.cc:304] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 883b0e22898a4bf7a51286a04aa3f5df, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:02.224372 27763 consensus_queue.cc:1048] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:02.225711 27788 raft_consensus.cc:2804] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:02.226215 27788 raft_consensus.cc:697] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Becoming Leader. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Running, Role: LEADER
I20260709 12:26:02.226322 27552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64512827e5014d88a48f42d23ebbdbfb" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95" is_pre_election: true
I20260709 12:26:02.227460 27552 raft_consensus.cc:2393] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14900064b421439bb3283d698937fdc3 in current term 1: Already voted for candidate 883b0e22898a4bf7a51286a04aa3f5df in this term.
I20260709 12:26:02.227151 27788 consensus_queue.cc:237] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.230683 27704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64512827e5014d88a48f42d23ebbdbfb" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df" is_pre_election: true
I20260709 12:26:02.231662 27629 raft_consensus.cc:2468] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 1.
I20260709 12:26:02.232849 27595 leader_election.cc:304] T 64512827e5014d88a48f42d23ebbdbfb P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14900064b421439bb3283d698937fdc3; no voters: 883b0e22898a4bf7a51286a04aa3f5df, adb2f949f49447f89aa4c72935536a95
I20260709 12:26:02.233970 27769 raft_consensus.cc:3060] T 64512827e5014d88a48f42d23ebbdbfb P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.242962 27449 catalog_manager.cc:5697] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df reported cstate change: term changed from 0 to 1, leader changed from <none> to 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131). New cstate: current_term: 1 leader_uuid: "883b0e22898a4bf7a51286a04aa3f5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:02.245090 27769 raft_consensus.cc:2749] T 64512827e5014d88a48f42d23ebbdbfb P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:02.266575 27500 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:02.273437 27769 raft_consensus.cc:493] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.274242 27769 raft_consensus.cc:515] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.277119 27769 leader_election.cc:290] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:02.278285 27704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7edee8e2d44a0097910a246ebe4255" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df" is_pre_election: true
I20260709 12:26:02.278095 27552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7edee8e2d44a0097910a246ebe4255" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95" is_pre_election: true
I20260709 12:26:02.279062 27704 raft_consensus.cc:2468] T 6b7edee8e2d44a0097910a246ebe4255 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 0.
I20260709 12:26:02.279153 27552 raft_consensus.cc:2468] T 6b7edee8e2d44a0097910a246ebe4255 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 0.
I20260709 12:26:02.280295 27595 leader_election.cc:304] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, 883b0e22898a4bf7a51286a04aa3f5df; no voters: 
I20260709 12:26:02.280217 27788 consensus_queue.cc:1048] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:02.281275 27769 raft_consensus.cc:2804] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:02.281692 27769 raft_consensus.cc:493] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.282001 27769 raft_consensus.cc:3060] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.291208 27769 raft_consensus.cc:515] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.293846 27769 leader_election.cc:290] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 election: Requested vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:02.295267 27754 consensus_queue.cc:1048] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:02.296671 27704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7edee8e2d44a0097910a246ebe4255" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
I20260709 12:26:02.297304 27704 raft_consensus.cc:3060] T 6b7edee8e2d44a0097910a246ebe4255 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.304565 27770 consensus_queue.cc:1048] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:02.306546 27552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7edee8e2d44a0097910a246ebe4255" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:02.307266 27552 raft_consensus.cc:3060] T 6b7edee8e2d44a0097910a246ebe4255 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:02.311631 27704 raft_consensus.cc:2468] T 6b7edee8e2d44a0097910a246ebe4255 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 1.
I20260709 12:26:02.313642 27595 leader_election.cc:304] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, 883b0e22898a4bf7a51286a04aa3f5df; no voters: 
I20260709 12:26:02.314643 27769 raft_consensus.cc:2804] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:02.315506 27769 raft_consensus.cc:697] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Becoming Leader. State: Replica: 14900064b421439bb3283d698937fdc3, State: Running, Role: LEADER
I20260709 12:26:02.316457 27769 consensus_queue.cc:237] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.328835 27788 consensus_queue.cc:1048] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:02.321524 27552 raft_consensus.cc:2468] T 6b7edee8e2d44a0097910a246ebe4255 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 1.
I20260709 12:26:02.339623 27770 consensus_queue.cc:1048] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:02.348006 27452 catalog_manager.cc:5697] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 14900064b421439bb3283d698937fdc3 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "14900064b421439bb3283d698937fdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.354995 27778 consensus_queue.cc:1048] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:02.522862 27769 consensus_queue.cc:1048] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:02.535825 27770 consensus_queue.cc:1048] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:02.565901 27651 debug-util.cc:398] Leaking SignalData structure 0x7b08002c9a00 after lost signal to thread 17349
W20260709 12:26:02.567255 27651 debug-util.cc:398] Leaking SignalData structure 0x7b08002d1440 after lost signal to thread 27486
W20260709 12:26:02.569418 27651 debug-util.cc:398] Leaking SignalData structure 0x7b080018e220 after lost signal to thread 27654
I20260709 12:26:02.587775 27749 consensus_queue.cc:1048] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:02.605813 27749 consensus_queue.cc:1048] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:02.606101 27704 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d11155c16cb45c3b96bd3b3b3f98a91"
dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
mode: GRACEFUL
new_leader_uuid: "adb2f949f49447f89aa4c72935536a95"
 from {username='slave'} at 127.0.0.1:53864
I20260709 12:26:02.606885 27704 raft_consensus.cc:606] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Received request to transfer leadership to TS adb2f949f49447f89aa4c72935536a95
I20260709 12:26:02.620340 27705 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "882e2b233ed7404993be05bfd6bcd10f"
dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
mode: GRACEFUL
new_leader_uuid: "adb2f949f49447f89aa4c72935536a95"
 from {username='slave'} at 127.0.0.1:53864
I20260709 12:26:02.621032 27705 raft_consensus.cc:606] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Received request to transfer leadership to TS adb2f949f49447f89aa4c72935536a95
I20260709 12:26:02.629086 27705 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fffd970e02a74e58b67547bbd3bcb349"
dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
mode: GRACEFUL
new_leader_uuid: "adb2f949f49447f89aa4c72935536a95"
 from {username='slave'} at 127.0.0.1:53864
I20260709 12:26:02.629871 27705 raft_consensus.cc:606] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Received request to transfer leadership to TS adb2f949f49447f89aa4c72935536a95
I20260709 12:26:02.639561 27705 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64512827e5014d88a48f42d23ebbdbfb"
dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
mode: GRACEFUL
new_leader_uuid: "adb2f949f49447f89aa4c72935536a95"
 from {username='slave'} at 127.0.0.1:53864
I20260709 12:26:02.640590 27705 raft_consensus.cc:606] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Received request to transfer leadership to TS adb2f949f49447f89aa4c72935536a95
I20260709 12:26:02.652551 27705 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25d4d57609d4490daefbd04d78dca235"
dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
mode: GRACEFUL
new_leader_uuid: "14900064b421439bb3283d698937fdc3"
 from {username='slave'} at 127.0.0.1:53864
I20260709 12:26:02.652948 27788 consensus_queue.cc:1048] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:02.653513 27705 raft_consensus.cc:606] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Received request to transfer leadership to TS 14900064b421439bb3283d698937fdc3
W20260709 12:26:02.656592 17351 debug-util.cc:398] Leaking SignalData structure 0x7b0800343640 after lost signal to thread 27746
I20260709 12:26:02.664716 27788 consensus_queue.cc:1048] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:02.685766 27778 raft_consensus.cc:993] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df: : Instructing follower 14900064b421439bb3283d698937fdc3 to start an election
I20260709 12:26:02.686292 27778 raft_consensus.cc:1081] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Signalling peer 14900064b421439bb3283d698937fdc3 to start an election
I20260709 12:26:02.690557 27630 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25d4d57609d4490daefbd04d78dca235"
dest_uuid: "14900064b421439bb3283d698937fdc3"
 from {username='slave'} at 127.0.0.1:39264
I20260709 12:26:02.691238 27630 raft_consensus.cc:493] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:02.691634 27630 raft_consensus.cc:3060] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:02.704473 27630 raft_consensus.cc:515] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.714510 27629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b67abb18d5c047fa90bb2bc94494aaac"
dest_uuid: "14900064b421439bb3283d698937fdc3"
mode: GRACEFUL
new_leader_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
 from {username='slave'} at 127.0.0.1:39288
I20260709 12:26:02.714743 27552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d4d57609d4490daefbd04d78dca235" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:02.715224 27629 raft_consensus.cc:606] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Received request to transfer leadership to TS 883b0e22898a4bf7a51286a04aa3f5df
I20260709 12:26:02.715632 27552 raft_consensus.cc:3060] T 25d4d57609d4490daefbd04d78dca235 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:02.720505 27630 leader_election.cc:290] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 2 election: Requested vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:02.721832 27705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d4d57609d4490daefbd04d78dca235" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
I20260709 12:26:02.722796 27552 raft_consensus.cc:2468] T 25d4d57609d4490daefbd04d78dca235 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 2.
I20260709 12:26:02.722813 27705 raft_consensus.cc:3055] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:02.723634 27705 raft_consensus.cc:740] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Running, Role: LEADER
I20260709 12:26:02.724344 27594 leader_election.cc:304] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:02.725248 27749 raft_consensus.cc:2804] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:02.724820 27705 consensus_queue.cc:260] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.725795 27749 raft_consensus.cc:697] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [term 2 LEADER]: Becoming Leader. State: Replica: 14900064b421439bb3283d698937fdc3, State: Running, Role: LEADER
I20260709 12:26:02.726650 27705 raft_consensus.cc:3060] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:02.726894 27749 consensus_queue.cc:237] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.735132 27452 catalog_manager.cc:5697] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 reported cstate change: term changed from 1 to 2, leader changed from 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131) to 14900064b421439bb3283d698937fdc3 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "14900064b421439bb3283d698937fdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.738838 27705 raft_consensus.cc:2468] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 2.
I20260709 12:26:02.743438 27778 raft_consensus.cc:993] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df: : Instructing follower adb2f949f49447f89aa4c72935536a95 to start an election
I20260709 12:26:02.744015 27778 raft_consensus.cc:1081] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Signalling peer adb2f949f49447f89aa4c72935536a95 to start an election
I20260709 12:26:02.746496 27552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "882e2b233ed7404993be05bfd6bcd10f"
dest_uuid: "adb2f949f49447f89aa4c72935536a95"
 from {username='slave'} at 127.0.0.1:41398
I20260709 12:26:02.747216 27552 raft_consensus.cc:493] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:02.747704 27552 raft_consensus.cc:3060] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:02.757153 27552 raft_consensus.cc:515] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.759866 27552 leader_election.cc:290] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 2 election: Requested vote from peers 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:02.761128 27630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882e2b233ed7404993be05bfd6bcd10f" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14900064b421439bb3283d698937fdc3"
I20260709 12:26:02.761129 27705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882e2b233ed7404993be05bfd6bcd10f" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
I20260709 12:26:02.762068 27630 raft_consensus.cc:3060] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:02.762198 27705 raft_consensus.cc:3055] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:02.762671 27705 raft_consensus.cc:740] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Running, Role: LEADER
I20260709 12:26:02.763587 27705 consensus_queue.cc:260] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.765064 27705 raft_consensus.cc:3060] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:02.769496 27630 raft_consensus.cc:2468] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 2.
I20260709 12:26:02.771199 27518 leader_election.cc:304] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:02.772445 27755 raft_consensus.cc:2804] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:02.775385 27755 raft_consensus.cc:697] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 [term 2 LEADER]: Becoming Leader. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Running, Role: LEADER
I20260709 12:26:02.776377 27705 raft_consensus.cc:2468] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 2.
I20260709 12:26:02.776718 27755 consensus_queue.cc:237] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.785208 27452 catalog_manager.cc:5697] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 reported cstate change: term changed from 1 to 2, leader changed from 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131) to adb2f949f49447f89aa4c72935536a95 (127.16.240.129). New cstate: current_term: 2 leader_uuid: "adb2f949f49447f89aa4c72935536a95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.877492 27778 raft_consensus.cc:993] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df: : Instructing follower adb2f949f49447f89aa4c72935536a95 to start an election
I20260709 12:26:02.878057 27788 raft_consensus.cc:1081] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Signalling peer adb2f949f49447f89aa4c72935536a95 to start an election
I20260709 12:26:02.878535 27749 consensus_queue.cc:1048] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:02.880880 27552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64512827e5014d88a48f42d23ebbdbfb"
dest_uuid: "adb2f949f49447f89aa4c72935536a95"
 from {username='slave'} at 127.0.0.1:41398
I20260709 12:26:02.881549 27552 raft_consensus.cc:493] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:02.881932 27552 raft_consensus.cc:3060] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:02.894259 27552 raft_consensus.cc:515] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.896596 27552 leader_election.cc:290] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 2 election: Requested vote from peers 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:02.897895 27630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64512827e5014d88a48f42d23ebbdbfb" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14900064b421439bb3283d698937fdc3"
I20260709 12:26:02.898614 27630 raft_consensus.cc:3060] T 64512827e5014d88a48f42d23ebbdbfb P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:02.898996 27705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64512827e5014d88a48f42d23ebbdbfb" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
I20260709 12:26:02.899693 27705 raft_consensus.cc:3055] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:02.900099 27705 raft_consensus.cc:740] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Running, Role: LEADER
I20260709 12:26:02.901754 27705 consensus_queue.cc:260] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.903038 27705 raft_consensus.cc:3060] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:02.907656 27770 consensus_queue.cc:1048] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:02.919385 27705 raft_consensus.cc:2468] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 2.
I20260709 12:26:02.920986 27754 raft_consensus.cc:993] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df: : Instructing follower adb2f949f49447f89aa4c72935536a95 to start an election
I20260709 12:26:02.921540 27754 raft_consensus.cc:1081] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Signalling peer adb2f949f49447f89aa4c72935536a95 to start an election
I20260709 12:26:02.922812 27519 leader_election.cc:304] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 883b0e22898a4bf7a51286a04aa3f5df, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:02.924855 27755 raft_consensus.cc:2804] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:02.925397 27755 raft_consensus.cc:697] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95 [term 2 LEADER]: Becoming Leader. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Running, Role: LEADER
I20260709 12:26:02.926329 27755 consensus_queue.cc:237] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.931139 27552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fffd970e02a74e58b67547bbd3bcb349"
dest_uuid: "adb2f949f49447f89aa4c72935536a95"
 from {username='slave'} at 127.0.0.1:41398
I20260709 12:26:02.931833 27552 raft_consensus.cc:493] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:02.932276 27552 raft_consensus.cc:3060] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:02.936899 27630 raft_consensus.cc:2468] T 64512827e5014d88a48f42d23ebbdbfb P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 2.
I20260709 12:26:02.944363 27552 raft_consensus.cc:515] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.947208 27630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffd970e02a74e58b67547bbd3bcb349" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14900064b421439bb3283d698937fdc3"
I20260709 12:26:02.948473 27630 raft_consensus.cc:3060] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:02.949316 27552 leader_election.cc:290] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 2 election: Requested vote from peers 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:02.948294 27705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffd970e02a74e58b67547bbd3bcb349" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
I20260709 12:26:02.950585 27705 raft_consensus.cc:3055] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:02.951056 27705 raft_consensus.cc:740] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Running, Role: LEADER
I20260709 12:26:02.952498 27705 consensus_queue.cc:260] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.954092 27705 raft_consensus.cc:3060] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:02.955403 27452 catalog_manager.cc:5697] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95 reported cstate change: term changed from 1 to 2, leader changed from 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131) to adb2f949f49447f89aa4c72935536a95 (127.16.240.129). New cstate: current_term: 2 leader_uuid: "adb2f949f49447f89aa4c72935536a95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.962548 27630 raft_consensus.cc:2468] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 2.
I20260709 12:26:02.964051 27518 leader_election.cc:304] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:02.965076 27827 raft_consensus.cc:2804] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:02.965583 27827 raft_consensus.cc:697] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [term 2 LEADER]: Becoming Leader. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Running, Role: LEADER
I20260709 12:26:02.966578 27827 consensus_queue.cc:237] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:02.965413 27705 raft_consensus.cc:2468] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 2.
I20260709 12:26:02.976385 27452 catalog_manager.cc:5697] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 reported cstate change: term changed from 1 to 2, leader changed from 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131) to adb2f949f49447f89aa4c72935536a95 (127.16.240.129). New cstate: current_term: 2 leader_uuid: "adb2f949f49447f89aa4c72935536a95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.064857 27749 raft_consensus.cc:993] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3: : Instructing follower 883b0e22898a4bf7a51286a04aa3f5df to start an election
I20260709 12:26:03.065429 27749 raft_consensus.cc:1081] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Signalling peer 883b0e22898a4bf7a51286a04aa3f5df to start an election
I20260709 12:26:03.067665 27705 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b67abb18d5c047fa90bb2bc94494aaac"
dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
 from {username='slave'} at 127.0.0.1:53854
I20260709 12:26:03.068722 27705 raft_consensus.cc:493] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:03.069253 27705 raft_consensus.cc:3060] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:03.080240 27705 raft_consensus.cc:515] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:03.082739 27705 leader_election.cc:290] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 2 election: Requested vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639)
I20260709 12:26:03.083982 27552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b67abb18d5c047fa90bb2bc94494aaac" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:03.084300 27630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b67abb18d5c047fa90bb2bc94494aaac" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14900064b421439bb3283d698937fdc3"
I20260709 12:26:03.084721 27552 raft_consensus.cc:3060] T b67abb18d5c047fa90bb2bc94494aaac P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:03.084904 27630 raft_consensus.cc:3055] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:03.085287 27630 raft_consensus.cc:740] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14900064b421439bb3283d698937fdc3, State: Running, Role: LEADER
I20260709 12:26:03.086154 27630 consensus_queue.cc:260] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:03.087496 27630 raft_consensus.cc:3060] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:03.093165 27552 raft_consensus.cc:2468] T b67abb18d5c047fa90bb2bc94494aaac P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 2.
I20260709 12:26:03.094906 27668 leader_election.cc:304] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 883b0e22898a4bf7a51286a04aa3f5df, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:03.095579 27630 raft_consensus.cc:2468] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 2.
I20260709 12:26:03.096122 27778 raft_consensus.cc:2804] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:03.097020 27778 raft_consensus.cc:697] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df [term 2 LEADER]: Becoming Leader. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Running, Role: LEADER
I20260709 12:26:03.098021 27778 consensus_queue.cc:237] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:03.105834 27452 catalog_manager.cc:5697] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df reported cstate change: term changed from 1 to 2, leader changed from 14900064b421439bb3283d698937fdc3 (127.16.240.130) to 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131). New cstate: current_term: 2 leader_uuid: "883b0e22898a4bf7a51286a04aa3f5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:03.113190 27705 raft_consensus.cc:1275] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Refusing update from remote peer 14900064b421439bb3283d698937fdc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:03.115203 27749 consensus_queue.cc:1048] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:03.131971 27788 raft_consensus.cc:993] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df: : Instructing follower adb2f949f49447f89aa4c72935536a95 to start an election
I20260709 12:26:03.132715 27763 raft_consensus.cc:1081] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Signalling peer adb2f949f49447f89aa4c72935536a95 to start an election
I20260709 12:26:03.134832 27555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d11155c16cb45c3b96bd3b3b3f98a91"
dest_uuid: "adb2f949f49447f89aa4c72935536a95"
 from {username='slave'} at 127.0.0.1:41398
I20260709 12:26:03.135509 27555 raft_consensus.cc:493] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:03.135996 27555 raft_consensus.cc:3060] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:03.136281 27552 raft_consensus.cc:1275] T 25d4d57609d4490daefbd04d78dca235 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Refusing update from remote peer 14900064b421439bb3283d698937fdc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:03.138437 27770 consensus_queue.cc:1048] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:03.144785 27555 raft_consensus.cc:515] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } } peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } }
I20260709 12:26:03.148865 27630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d11155c16cb45c3b96bd3b3b3f98a91" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14900064b421439bb3283d698937fdc3"
I20260709 12:26:03.149477 27705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d11155c16cb45c3b96bd3b3b3f98a91" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
I20260709 12:26:03.149523 27630 raft_consensus.cc:3060] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:03.150327 27705 raft_consensus.cc:3055] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:03.150699 27705 raft_consensus.cc:740] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Running, Role: LEADER
I20260709 12:26:03.151451 27555 leader_election.cc:290] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 2 election: Requested vote from peers 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:03.155892 27705 consensus_queue.cc:260] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } } peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } }
I20260709 12:26:03.157480 27705 raft_consensus.cc:3060] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:03.162622 27630 raft_consensus.cc:2468] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 2.
I20260709 12:26:03.164500 27518 leader_election.cc:304] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:03.165449 27827 raft_consensus.cc:2804] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:03.165642 27630 raft_consensus.cc:1275] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Refusing update from remote peer adb2f949f49447f89aa4c72935536a95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:03.166003 27827 raft_consensus.cc:697] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95 [term 2 LEADER]: Becoming Leader. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Running, Role: LEADER
I20260709 12:26:03.166025 27705 raft_consensus.cc:2468] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 2.
I20260709 12:26:03.167272 27827 consensus_queue.cc:237] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } } peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } }
I20260709 12:26:03.167578 27755 consensus_queue.cc:1048] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:03.180325 27449 catalog_manager.cc:5697] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95 reported cstate change: term changed from 1 to 2, leader changed from 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131) to adb2f949f49447f89aa4c72935536a95 (127.16.240.129). New cstate: current_term: 2 leader_uuid: "adb2f949f49447f89aa4c72935536a95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:03.182322 27705 raft_consensus.cc:1275] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Refusing update from remote peer adb2f949f49447f89aa4c72935536a95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:03.184468 27827 consensus_queue.cc:1048] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:03.349228 27630 raft_consensus.cc:1275] T 64512827e5014d88a48f42d23ebbdbfb P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Refusing update from remote peer adb2f949f49447f89aa4c72935536a95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:03.351095 27832 consensus_queue.cc:1048] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:03.362890 27705 raft_consensus.cc:1275] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Refusing update from remote peer adb2f949f49447f89aa4c72935536a95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:03.364727 27827 consensus_queue.cc:1048] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:03.528119 27630 raft_consensus.cc:1275] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Refusing update from remote peer 883b0e22898a4bf7a51286a04aa3f5df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:03.530023 27763 consensus_queue.cc:1048] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:03.542008 27705 raft_consensus.cc:1275] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Refusing update from remote peer adb2f949f49447f89aa4c72935536a95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:03.544160 27755 consensus_queue.cc:1048] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:03.552897 27555 raft_consensus.cc:1275] T b67abb18d5c047fa90bb2bc94494aaac P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Refusing update from remote peer 883b0e22898a4bf7a51286a04aa3f5df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:03.554710 27763 consensus_queue.cc:1048] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:03.576397 27630 raft_consensus.cc:1275] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Refusing update from remote peer adb2f949f49447f89aa4c72935536a95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:03.576660 27629 raft_consensus.cc:1275] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Refusing update from remote peer adb2f949f49447f89aa4c72935536a95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:03.579030 27832 consensus_queue.cc:1048] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:03.580526 27832 consensus_queue.cc:1048] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:03.603529 27705 raft_consensus.cc:1275] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Refusing update from remote peer adb2f949f49447f89aa4c72935536a95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:03.606993 27832 consensus_queue.cc:1048] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:05.748921 27451 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46754:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:05.751863 27451 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:05.811689 27536 tablet_service.cc:1511] Processing CreateTablet for tablet 447b7a52ac2548b486ad0cbe53a3b89e (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:05.813036 27619 tablet_service.cc:1511] Processing CreateTablet for tablet 447b7a52ac2548b486ad0cbe53a3b89e (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:05.814581 27619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447b7a52ac2548b486ad0cbe53a3b89e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.816488 27691 tablet_service.cc:1511] Processing CreateTablet for tablet 447b7a52ac2548b486ad0cbe53a3b89e (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:05.817914 27691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447b7a52ac2548b486ad0cbe53a3b89e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.813072 27536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447b7a52ac2548b486ad0cbe53a3b89e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.822235 27539 tablet_service.cc:1511] Processing CreateTablet for tablet 87caca536d094157b02aa19b6a42ee99 (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:05.824868 27543 tablet_service.cc:1511] Processing CreateTablet for tablet 67a9888378254e8f91be48bd536f3c40 (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:05.828178 27617 tablet_service.cc:1511] Processing CreateTablet for tablet 87caca536d094157b02aa19b6a42ee99 (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:05.829736 27617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87caca536d094157b02aa19b6a42ee99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.833122 27616 tablet_service.cc:1511] Processing CreateTablet for tablet 67a9888378254e8f91be48bd536f3c40 (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:05.834599 27616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a9888378254e8f91be48bd536f3c40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.834472 27692 tablet_service.cc:1511] Processing CreateTablet for tablet 87caca536d094157b02aa19b6a42ee99 (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:05.835909 27692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87caca536d094157b02aa19b6a42ee99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.837024 27694 tablet_service.cc:1511] Processing CreateTablet for tablet f50f55a9615446939b227473f73e7809 (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:05.838073 27618 tablet_service.cc:1511] Processing CreateTablet for tablet f50f55a9615446939b227473f73e7809 (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:05.838747 27694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f50f55a9615446939b227473f73e7809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.839407 27618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f50f55a9615446939b227473f73e7809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.840828 27693 tablet_service.cc:1511] Processing CreateTablet for tablet 67a9888378254e8f91be48bd536f3c40 (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:05.842126 27537 tablet_service.cc:1511] Processing CreateTablet for tablet 383048ad6752482b980f43745a13a57f (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:05.843297 27690 tablet_service.cc:1511] Processing CreateTablet for tablet 383048ad6752482b980f43745a13a57f (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:05.844729 27542 tablet_service.cc:1511] Processing CreateTablet for tablet fb853c5fe6294ec59d55191cc58ef949 (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:05.845414 27620 tablet_service.cc:1511] Processing CreateTablet for tablet 383048ad6752482b980f43745a13a57f (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:05.848471 27689 tablet_service.cc:1511] Processing CreateTablet for tablet fb853c5fe6294ec59d55191cc58ef949 (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:05.850848 27688 tablet_service.cc:1511] Processing CreateTablet for tablet 6cd5cdd42faf4f659b227a00a806c6dc (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:05.853394 27687 tablet_service.cc:1511] Processing CreateTablet for tablet 8b10b7feeaa94428bbbfb9602eadcf8d (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:05.856830 27686 tablet_service.cc:1511] Processing CreateTablet for tablet 8002a467593c4b4a8f43a0df5fbc6ce9 (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:05.855336 27540 tablet_service.cc:1511] Processing CreateTablet for tablet f50f55a9615446939b227473f73e7809 (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:05.842176 27693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a9888378254e8f91be48bd536f3c40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.868330 27686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8002a467593c4b4a8f43a0df5fbc6ce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.871189 27689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb853c5fe6294ec59d55191cc58ef949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.876286 27687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b10b7feeaa94428bbbfb9602eadcf8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.880246 27688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cd5cdd42faf4f659b227a00a806c6dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.823716 27539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87caca536d094157b02aa19b6a42ee99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.888229 27537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383048ad6752482b980f43745a13a57f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.889026 27854 tablet_bootstrap.cc:492] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95: Bootstrap starting.
I20260709 12:26:05.892416 27542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb853c5fe6294ec59d55191cc58ef949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.896528 27543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a9888378254e8f91be48bd536f3c40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.900368 27540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f50f55a9615446939b227473f73e7809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.910542 27854 tablet_bootstrap.cc:654] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.913024 27855 tablet_bootstrap.cc:492] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df: Bootstrap starting.
I20260709 12:26:05.915366 27615 tablet_service.cc:1511] Processing CreateTablet for tablet fb853c5fe6294ec59d55191cc58ef949 (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:05.919940 27613 tablet_service.cc:1511] Processing CreateTablet for tablet 8b10b7feeaa94428bbbfb9602eadcf8d (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:05.920907 27615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb853c5fe6294ec59d55191cc58ef949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.922353 27612 tablet_service.cc:1511] Processing CreateTablet for tablet 8002a467593c4b4a8f43a0df5fbc6ce9 (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:05.917713 27614 tablet_service.cc:1511] Processing CreateTablet for tablet 6cd5cdd42faf4f659b227a00a806c6dc (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:05.923723 27612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8002a467593c4b4a8f43a0df5fbc6ce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.924639 27614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cd5cdd42faf4f659b227a00a806c6dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.925210 27613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b10b7feeaa94428bbbfb9602eadcf8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.928845 27536 tablet_service.cc:1511] Processing CreateTablet for tablet 6cd5cdd42faf4f659b227a00a806c6dc (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:05.929665 27544 tablet_service.cc:1511] Processing CreateTablet for tablet 8b10b7feeaa94428bbbfb9602eadcf8d (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:05.930421 27536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cd5cdd42faf4f659b227a00a806c6dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.931037 27544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b10b7feeaa94428bbbfb9602eadcf8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.940158 27690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383048ad6752482b980f43745a13a57f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.940218 27620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383048ad6752482b980f43745a13a57f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.944916 27541 tablet_service.cc:1511] Processing CreateTablet for tablet 8002a467593c4b4a8f43a0df5fbc6ce9 (DEFAULT_TABLE table=soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:05.946420 27541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8002a467593c4b4a8f43a0df5fbc6ce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.990331 27855 tablet_bootstrap.cc:654] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.031934 27853 tablet_bootstrap.cc:492] T 447b7a52ac2548b486ad0cbe53a3b89e P 14900064b421439bb3283d698937fdc3: Bootstrap starting.
I20260709 12:26:06.054817 27854 tablet_bootstrap.cc:492] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95: No bootstrap required, opened a new log
I20260709 12:26:06.055565 27854 ts_tablet_manager.cc:1403] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95: Time spent bootstrapping tablet: real 0.167s	user 0.019s	sys 0.010s
I20260709 12:26:06.063939 27854 raft_consensus.cc:359] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.064828 27854 raft_consensus.cc:385] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.072525 27854 raft_consensus.cc:740] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.073638 27854 consensus_queue.cc:260] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.082286 27853 tablet_bootstrap.cc:654] T 447b7a52ac2548b486ad0cbe53a3b89e P 14900064b421439bb3283d698937fdc3: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:06.041009 27595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:32823, user_credentials={real_user=slave}} blocked reactor thread for 56227us
I20260709 12:26:06.106483 27854 ts_tablet_manager.cc:1434] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.001s
I20260709 12:26:06.106585 27855 tablet_bootstrap.cc:492] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df: No bootstrap required, opened a new log
I20260709 12:26:06.112605 27854 tablet_bootstrap.cc:492] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95: Bootstrap starting.
I20260709 12:26:06.116082 27855 ts_tablet_manager.cc:1403] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df: Time spent bootstrapping tablet: real 0.203s	user 0.015s	sys 0.008s
I20260709 12:26:06.121025 27854 tablet_bootstrap.cc:654] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.130112 27855 raft_consensus.cc:359] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.131150 27855 raft_consensus.cc:385] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.131507 27855 raft_consensus.cc:740] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.138445 27854 tablet_bootstrap.cc:492] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95: No bootstrap required, opened a new log
I20260709 12:26:06.132764 27855 consensus_queue.cc:260] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.139441 27854 ts_tablet_manager.cc:1403] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.000s
I20260709 12:26:06.141853 27855 ts_tablet_manager.cc:1434] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df: Time spent starting tablet: real 0.025s	user 0.000s	sys 0.008s
I20260709 12:26:06.143036 27855 tablet_bootstrap.cc:492] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df: Bootstrap starting.
I20260709 12:26:06.144086 27854 raft_consensus.cc:359] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.145040 27854 raft_consensus.cc:385] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.145399 27854 raft_consensus.cc:740] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.146286 27854 consensus_queue.cc:260] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.152045 27853 tablet_bootstrap.cc:492] T 447b7a52ac2548b486ad0cbe53a3b89e P 14900064b421439bb3283d698937fdc3: No bootstrap required, opened a new log
I20260709 12:26:06.152151 27855 tablet_bootstrap.cc:654] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.152729 27853 ts_tablet_manager.cc:1403] T 447b7a52ac2548b486ad0cbe53a3b89e P 14900064b421439bb3283d698937fdc3: Time spent bootstrapping tablet: real 0.121s	user 0.014s	sys 0.014s
I20260709 12:26:06.156128 27853 raft_consensus.cc:359] T 447b7a52ac2548b486ad0cbe53a3b89e P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.156939 27853 raft_consensus.cc:385] T 447b7a52ac2548b486ad0cbe53a3b89e P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.157259 27853 raft_consensus.cc:740] T 447b7a52ac2548b486ad0cbe53a3b89e P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14900064b421439bb3283d698937fdc3, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.158048 27853 consensus_queue.cc:260] T 447b7a52ac2548b486ad0cbe53a3b89e P 14900064b421439bb3283d698937fdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.159677 27854 ts_tablet_manager.cc:1434] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:26:06.165400 27854 tablet_bootstrap.cc:492] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95: Bootstrap starting.
I20260709 12:26:06.173926 27853 ts_tablet_manager.cc:1434] T 447b7a52ac2548b486ad0cbe53a3b89e P 14900064b421439bb3283d698937fdc3: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.005s
I20260709 12:26:06.175132 27853 tablet_bootstrap.cc:492] T 383048ad6752482b980f43745a13a57f P 14900064b421439bb3283d698937fdc3: Bootstrap starting.
I20260709 12:26:06.176812 27855 tablet_bootstrap.cc:492] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df: No bootstrap required, opened a new log
I20260709 12:26:06.177824 27855 ts_tablet_manager.cc:1403] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.007s
I20260709 12:26:06.178670 27854 tablet_bootstrap.cc:654] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.183035 27853 tablet_bootstrap.cc:654] T 383048ad6752482b980f43745a13a57f P 14900064b421439bb3283d698937fdc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.182874 27855 raft_consensus.cc:359] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.184059 27855 raft_consensus.cc:385] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.184501 27855 raft_consensus.cc:740] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.185819 27855 consensus_queue.cc:260] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.188908 27778 raft_consensus.cc:493] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.189574 27778 raft_consensus.cc:515] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.195350 27552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50f55a9615446939b227473f73e7809" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95" is_pre_election: true
I20260709 12:26:06.195838 27854 tablet_bootstrap.cc:492] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95: No bootstrap required, opened a new log
I20260709 12:26:06.196414 27629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50f55a9615446939b227473f73e7809" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3" is_pre_election: true
I20260709 12:26:06.196652 27854 ts_tablet_manager.cc:1403] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.007s
W20260709 12:26:06.197098 27668 leader_election.cc:343] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:06.198132 27668 leader_election.cc:343] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.198494 27778 leader_election.cc:290] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639)
I20260709 12:26:06.198540 27668 leader_election.cc:304] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 883b0e22898a4bf7a51286a04aa3f5df; no voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95
I20260709 12:26:06.200521 27854 raft_consensus.cc:359] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.201373 27854 raft_consensus.cc:385] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.201719 27854 raft_consensus.cc:740] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.202924 27856 raft_consensus.cc:493] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.202692 27854 consensus_queue.cc:260] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.203503 27856 raft_consensus.cc:515] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.203948 27855 ts_tablet_manager.cc:1434] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 12:26:06.205228 27855 tablet_bootstrap.cc:492] T 447b7a52ac2548b486ad0cbe53a3b89e P 883b0e22898a4bf7a51286a04aa3f5df: Bootstrap starting.
I20260709 12:26:06.208590 27629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b10b7feeaa94428bbbfb9602eadcf8d" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3" is_pre_election: true
I20260709 12:26:06.211000 27854 ts_tablet_manager.cc:1434] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:26:06.212277 27854 tablet_bootstrap.cc:492] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95: Bootstrap starting.
I20260709 12:26:06.215806 27855 tablet_bootstrap.cc:654] T 447b7a52ac2548b486ad0cbe53a3b89e P 883b0e22898a4bf7a51286a04aa3f5df: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.221376 27854 tablet_bootstrap.cc:654] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:06.223285 27518 leader_election.cc:343] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.223771 27856 leader_election.cc:290] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:06.224799 27755 raft_consensus.cc:493] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.225744 27704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b10b7feeaa94428bbbfb9602eadcf8d" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df" is_pre_election: true
I20260709 12:26:06.226178 27755 raft_consensus.cc:515] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.233585 27755 leader_election.cc:290] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:06.233686 27853 tablet_bootstrap.cc:492] T 383048ad6752482b980f43745a13a57f P 14900064b421439bb3283d698937fdc3: No bootstrap required, opened a new log
I20260709 12:26:06.234808 27853 ts_tablet_manager.cc:1403] T 383048ad6752482b980f43745a13a57f P 14900064b421439bb3283d698937fdc3: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.004s
I20260709 12:26:06.237560 27778 raft_consensus.cc:2749] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:06.241560 27519 leader_election.cc:343] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.244037 27519 leader_election.cc:304] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adb2f949f49447f89aa4c72935536a95; no voters: 14900064b421439bb3283d698937fdc3, 883b0e22898a4bf7a51286a04aa3f5df
I20260709 12:26:06.246944 27755 raft_consensus.cc:2749] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.245659 27853 raft_consensus.cc:359] T 383048ad6752482b980f43745a13a57f P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.252415 27853 raft_consensus.cc:385] T 383048ad6752482b980f43745a13a57f P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.252534 27630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b7a52ac2548b486ad0cbe53a3b89e" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3" is_pre_election: true
I20260709 12:26:06.254055 27630 raft_consensus.cc:2468] T 447b7a52ac2548b486ad0cbe53a3b89e P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 0.
I20260709 12:26:06.251117 27704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b7a52ac2548b486ad0cbe53a3b89e" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df" is_pre_election: true
I20260709 12:26:06.255847 27853 raft_consensus.cc:740] T 383048ad6752482b980f43745a13a57f P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14900064b421439bb3283d698937fdc3, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.256064 27518 leader_election.cc:304] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95; no voters: 
W20260709 12:26:06.259006 27519 leader_election.cc:343] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.259662 27855 tablet_bootstrap.cc:492] T 447b7a52ac2548b486ad0cbe53a3b89e P 883b0e22898a4bf7a51286a04aa3f5df: No bootstrap required, opened a new log
I20260709 12:26:06.261601 27853 consensus_queue.cc:260] T 383048ad6752482b980f43745a13a57f P 14900064b421439bb3283d698937fdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.260210 27866 raft_consensus.cc:2804] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.263372 27866 raft_consensus.cc:493] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.263995 27866 raft_consensus.cc:3060] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.267902 27853 ts_tablet_manager.cc:1434] T 383048ad6752482b980f43745a13a57f P 14900064b421439bb3283d698937fdc3: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 12:26:06.269217 27853 tablet_bootstrap.cc:492] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3: Bootstrap starting.
I20260709 12:26:06.274850 27855 ts_tablet_manager.cc:1403] T 447b7a52ac2548b486ad0cbe53a3b89e P 883b0e22898a4bf7a51286a04aa3f5df: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.009s
I20260709 12:26:06.277585 27853 tablet_bootstrap.cc:654] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.278654 27855 raft_consensus.cc:359] T 447b7a52ac2548b486ad0cbe53a3b89e P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.279531 27855 raft_consensus.cc:385] T 447b7a52ac2548b486ad0cbe53a3b89e P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.279865 27855 raft_consensus.cc:740] T 447b7a52ac2548b486ad0cbe53a3b89e P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.280144 27854 tablet_bootstrap.cc:492] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95: No bootstrap required, opened a new log
I20260709 12:26:06.280720 27854 ts_tablet_manager.cc:1403] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.022s
I20260709 12:26:06.280900 27855 consensus_queue.cc:260] T 447b7a52ac2548b486ad0cbe53a3b89e P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.283990 27854 raft_consensus.cc:359] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.284762 27854 raft_consensus.cc:385] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.285059 27854 raft_consensus.cc:740] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.285986 27854 consensus_queue.cc:260] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.291227 27855 ts_tablet_manager.cc:1434] T 447b7a52ac2548b486ad0cbe53a3b89e P 883b0e22898a4bf7a51286a04aa3f5df: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.004s
I20260709 12:26:06.293684 27854 ts_tablet_manager.cc:1434] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:26:06.295146 27854 tablet_bootstrap.cc:492] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95: Bootstrap starting.
I20260709 12:26:06.301512 27866 raft_consensus.cc:515] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.303720 27867 raft_consensus.cc:493] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.305037 27755 raft_consensus.cc:493] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.302452 27854 tablet_bootstrap.cc:654] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.305728 27755 raft_consensus.cc:515] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.308899 27629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b7a52ac2548b486ad0cbe53a3b89e" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3"
I20260709 12:26:06.309890 27629 raft_consensus.cc:3060] T 447b7a52ac2548b486ad0cbe53a3b89e P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.310726 27704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b7a52ac2548b486ad0cbe53a3b89e" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
I20260709 12:26:06.311437 27704 raft_consensus.cc:3060] T 447b7a52ac2548b486ad0cbe53a3b89e P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:06.313544 27500 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:06.304454 27867 raft_consensus.cc:515] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.320892 27704 raft_consensus.cc:2468] T 447b7a52ac2548b486ad0cbe53a3b89e P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 1.
I20260709 12:26:06.322090 27866 leader_election.cc:290] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 election: Requested vote from peers 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:06.323057 27519 leader_election.cc:304] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 883b0e22898a4bf7a51286a04aa3f5df, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:06.325136 27854 tablet_bootstrap.cc:492] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95: No bootstrap required, opened a new log
I20260709 12:26:06.325778 27854 ts_tablet_manager.cc:1403] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.004s
I20260709 12:26:06.326517 27630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87caca536d094157b02aa19b6a42ee99" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3" is_pre_election: true
I20260709 12:26:06.328855 27867 leader_election.cc:290] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639)
I20260709 12:26:06.344107 27629 raft_consensus.cc:2468] T 447b7a52ac2548b486ad0cbe53a3b89e P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 1.
I20260709 12:26:06.346042 27855 tablet_bootstrap.cc:492] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df: Bootstrap starting.
I20260709 12:26:06.353082 27629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383048ad6752482b980f43745a13a57f" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3" is_pre_election: true
I20260709 12:26:06.354331 27629 raft_consensus.cc:2468] T 383048ad6752482b980f43745a13a57f P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 0.
I20260709 12:26:06.355012 27855 tablet_bootstrap.cc:654] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.329255 27854 raft_consensus.cc:359] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.330217 27866 raft_consensus.cc:2804] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.356215 27518 leader_election.cc:304] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:06.356921 27854 raft_consensus.cc:385] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.330475 27552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87caca536d094157b02aa19b6a42ee99" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95" is_pre_election: true
I20260709 12:26:06.357282 27854 raft_consensus.cc:740] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.357748 27552 raft_consensus.cc:2468] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 0.
W20260709 12:26:06.333488 27668 leader_election.cc:343] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.358188 27854 consensus_queue.cc:260] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.340415 27755 leader_election.cc:290] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:06.361720 27856 raft_consensus.cc:2804] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.362236 27704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383048ad6752482b980f43745a13a57f" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df" is_pre_election: true
I20260709 12:26:06.362708 27668 leader_election.cc:304] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 883b0e22898a4bf7a51286a04aa3f5df, adb2f949f49447f89aa4c72935536a95; no voters: 14900064b421439bb3283d698937fdc3
I20260709 12:26:06.362278 27856 raft_consensus.cc:493] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.364439 27856 raft_consensus.cc:3060] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.364683 27867 raft_consensus.cc:2804] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.365221 27867 raft_consensus.cc:493] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.365743 27867 raft_consensus.cc:3060] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:06.365693 27519 leader_election.cc:343] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.356400 27866 raft_consensus.cc:697] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 [term 1 LEADER]: Becoming Leader. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Running, Role: LEADER
I20260709 12:26:06.369071 27866 consensus_queue.cc:237] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.375396 27755 raft_consensus.cc:493] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.376641 27854 ts_tablet_manager.cc:1434] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95: Time spent starting tablet: real 0.051s	user 0.011s	sys 0.004s
I20260709 12:26:06.376158 27755 raft_consensus.cc:515] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.378652 27854 tablet_bootstrap.cc:492] T 6cd5cdd42faf4f659b227a00a806c6dc P adb2f949f49447f89aa4c72935536a95: Bootstrap starting.
I20260709 12:26:06.382481 27704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb853c5fe6294ec59d55191cc58ef949" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df" is_pre_election: true
W20260709 12:26:06.384060 27519 leader_election.cc:343] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.384613 27629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb853c5fe6294ec59d55191cc58ef949" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3" is_pre_election: true
W20260709 12:26:06.386113 27518 leader_election.cc:343] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.386584 27518 leader_election.cc:304] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adb2f949f49447f89aa4c72935536a95; no voters: 14900064b421439bb3283d698937fdc3, 883b0e22898a4bf7a51286a04aa3f5df
I20260709 12:26:06.381213 27755 leader_election.cc:290] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:06.387856 27871 raft_consensus.cc:2749] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.388785 27853 tablet_bootstrap.cc:492] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3: No bootstrap required, opened a new log
I20260709 12:26:06.391105 27853 ts_tablet_manager.cc:1403] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3: Time spent bootstrapping tablet: real 0.122s	user 0.047s	sys 0.048s
I20260709 12:26:06.391261 27854 tablet_bootstrap.cc:654] T 6cd5cdd42faf4f659b227a00a806c6dc P adb2f949f49447f89aa4c72935536a95: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.395077 27856 raft_consensus.cc:515] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.394556 27867 raft_consensus.cc:515] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.396473 27853 raft_consensus.cc:359] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.397841 27853 raft_consensus.cc:385] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.404019 27853 raft_consensus.cc:740] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14900064b421439bb3283d698937fdc3, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.398957 27552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87caca536d094157b02aa19b6a42ee99" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:06.405009 27552 raft_consensus.cc:3060] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.405049 27853 consensus_queue.cc:260] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.397491 27855 tablet_bootstrap.cc:492] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df: No bootstrap required, opened a new log
I20260709 12:26:06.407418 27855 ts_tablet_manager.cc:1403] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df: Time spent bootstrapping tablet: real 0.062s	user 0.025s	sys 0.007s
I20260709 12:26:06.408134 27704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383048ad6752482b980f43745a13a57f" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
W20260709 12:26:06.410295 27519 leader_election.cc:343] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.411454 27853 ts_tablet_manager.cc:1434] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260709 12:26:06.413353 27853 tablet_bootstrap.cc:492] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3: Bootstrap starting.
I20260709 12:26:06.416146 27855 raft_consensus.cc:359] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.417004 27855 raft_consensus.cc:385] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.417315 27855 raft_consensus.cc:740] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.418377 27448 catalog_manager.cc:5697] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 reported cstate change: term changed from 0 to 1, leader changed from <none> to adb2f949f49447f89aa4c72935536a95 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "adb2f949f49447f89aa4c72935536a95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.423308 27855 consensus_queue.cc:260] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.425957 27855 ts_tablet_manager.cc:1434] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:26:06.428218 27853 tablet_bootstrap.cc:654] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.400472 27867 leader_election.cc:290] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 election: Requested vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639)
I20260709 12:26:06.401139 27629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87caca536d094157b02aa19b6a42ee99" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3"
I20260709 12:26:06.403162 27630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383048ad6752482b980f43745a13a57f" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3"
I20260709 12:26:06.429575 27856 leader_election.cc:290] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 election: Requested vote from peers 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:06.430166 27630 raft_consensus.cc:3060] T 383048ad6752482b980f43745a13a57f P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.431613 27552 raft_consensus.cc:2468] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 1.
I20260709 12:26:06.433055 27668 leader_election.cc:304] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 883b0e22898a4bf7a51286a04aa3f5df, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:06.434208 27867 raft_consensus.cc:2804] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.434989 27867 raft_consensus.cc:697] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Becoming Leader. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Running, Role: LEADER
I20260709 12:26:06.435974 27867 consensus_queue.cc:237] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
W20260709 12:26:06.436499 27668 leader_election.cc:343] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.439509 27630 raft_consensus.cc:2468] T 383048ad6752482b980f43745a13a57f P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 1.
I20260709 12:26:06.440994 27518 leader_election.cc:304] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95; no voters: 883b0e22898a4bf7a51286a04aa3f5df
I20260709 12:26:06.441917 27856 raft_consensus.cc:2804] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.442662 27856 raft_consensus.cc:697] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [term 1 LEADER]: Becoming Leader. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Running, Role: LEADER
I20260709 12:26:06.443132 27855 tablet_bootstrap.cc:492] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df: Bootstrap starting.
I20260709 12:26:06.443656 27856 consensus_queue.cc:237] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.454571 27854 tablet_bootstrap.cc:492] T 6cd5cdd42faf4f659b227a00a806c6dc P adb2f949f49447f89aa4c72935536a95: No bootstrap required, opened a new log
I20260709 12:26:06.455492 27854 ts_tablet_manager.cc:1403] T 6cd5cdd42faf4f659b227a00a806c6dc P adb2f949f49447f89aa4c72935536a95: Time spent bootstrapping tablet: real 0.077s	user 0.032s	sys 0.000s
I20260709 12:26:06.461166 27854 raft_consensus.cc:359] T 6cd5cdd42faf4f659b227a00a806c6dc P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.462285 27854 raft_consensus.cc:385] T 6cd5cdd42faf4f659b227a00a806c6dc P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.462672 27854 raft_consensus.cc:740] T 6cd5cdd42faf4f659b227a00a806c6dc P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.467578 27451 catalog_manager.cc:5697] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df reported cstate change: term changed from 0 to 1, leader changed from <none> to 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131). New cstate: current_term: 1 leader_uuid: "883b0e22898a4bf7a51286a04aa3f5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:06.472241 27854 consensus_queue.cc:260] T 6cd5cdd42faf4f659b227a00a806c6dc P adb2f949f49447f89aa4c72935536a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.472929 27867 raft_consensus.cc:493] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.473915 27867 raft_consensus.cc:515] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.474740 27855 tablet_bootstrap.cc:654] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.477959 27630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b10b7feeaa94428bbbfb9602eadcf8d" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3" is_pre_election: true
I20260709 12:26:06.478143 27552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b10b7feeaa94428bbbfb9602eadcf8d" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95" is_pre_election: true
I20260709 12:26:06.478914 27552 raft_consensus.cc:2468] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 0.
W20260709 12:26:06.479525 27668 leader_election.cc:343] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.480351 27668 leader_election.cc:304] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 883b0e22898a4bf7a51286a04aa3f5df, adb2f949f49447f89aa4c72935536a95; no voters: 14900064b421439bb3283d698937fdc3
I20260709 12:26:06.481197 27778 raft_consensus.cc:2804] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.481575 27778 raft_consensus.cc:493] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.481931 27778 raft_consensus.cc:3060] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.476408 27854 ts_tablet_manager.cc:1434] T 6cd5cdd42faf4f659b227a00a806c6dc P adb2f949f49447f89aa4c72935536a95: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.001s
I20260709 12:26:06.482143 27853 tablet_bootstrap.cc:492] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3: No bootstrap required, opened a new log
I20260709 12:26:06.476493 27867 leader_election.cc:290] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639)
I20260709 12:26:06.491039 27853 ts_tablet_manager.cc:1403] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3: Time spent bootstrapping tablet: real 0.078s	user 0.036s	sys 0.019s
I20260709 12:26:06.485846 27854 tablet_bootstrap.cc:492] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95: Bootstrap starting.
I20260709 12:26:06.495411 27853 raft_consensus.cc:359] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.496248 27853 raft_consensus.cc:385] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.496727 27853 raft_consensus.cc:740] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14900064b421439bb3283d698937fdc3, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.496069 27448 catalog_manager.cc:5697] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 reported cstate change: term changed from 0 to 1, leader changed from <none> to adb2f949f49447f89aa4c72935536a95 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "adb2f949f49447f89aa4c72935536a95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.497665 27853 consensus_queue.cc:260] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.503381 27854 tablet_bootstrap.cc:654] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.506351 27855 tablet_bootstrap.cc:492] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df: No bootstrap required, opened a new log
I20260709 12:26:06.507094 27855 ts_tablet_manager.cc:1403] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.008s
I20260709 12:26:06.510923 27778 raft_consensus.cc:515] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.514618 27855 raft_consensus.cc:359] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.515152 27630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b10b7feeaa94428bbbfb9602eadcf8d" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3"
I20260709 12:26:06.524372 27778 leader_election.cc:290] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 election: Requested vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639)
I20260709 12:26:06.527853 27854 tablet_bootstrap.cc:492] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95: No bootstrap required, opened a new log
I20260709 12:26:06.516074 27552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b10b7feeaa94428bbbfb9602eadcf8d" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:06.571076 27630 raft_consensus.cc:3060] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.571537 27854 ts_tablet_manager.cc:1403] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.009s
I20260709 12:26:06.571686 27552 raft_consensus.cc:3060] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.573076 27853 ts_tablet_manager.cc:1434] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3: Time spent starting tablet: real 0.081s	user 0.024s	sys 0.038s
I20260709 12:26:06.574553 27853 tablet_bootstrap.cc:492] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3: Bootstrap starting.
I20260709 12:26:06.576195 27854 raft_consensus.cc:359] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.577397 27854 raft_consensus.cc:385] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.577811 27854 raft_consensus.cc:740] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.582710 27853 tablet_bootstrap.cc:654] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.583158 27552 raft_consensus.cc:2468] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 1.
I20260709 12:26:06.584472 27668 leader_election.cc:304] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 883b0e22898a4bf7a51286a04aa3f5df, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:06.585496 27778 raft_consensus.cc:2804] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.586023 27778 raft_consensus.cc:697] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Becoming Leader. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Running, Role: LEADER
I20260709 12:26:06.587185 27778 consensus_queue.cc:237] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.587116 27854 consensus_queue.cc:260] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.595503 27853 tablet_bootstrap.cc:492] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3: No bootstrap required, opened a new log
I20260709 12:26:06.597114 27854 ts_tablet_manager.cc:1434] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 12:26:06.570830 27855 raft_consensus.cc:385] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.597994 27855 raft_consensus.cc:740] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.600211 27853 ts_tablet_manager.cc:1403] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.010s
I20260709 12:26:06.603765 27854 tablet_bootstrap.cc:492] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95: Bootstrap starting.
I20260709 12:26:06.608000 27452 catalog_manager.cc:5697] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df reported cstate change: term changed from 0 to 1, leader changed from <none> to 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131). New cstate: current_term: 1 leader_uuid: "883b0e22898a4bf7a51286a04aa3f5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:06.595342 27630 raft_consensus.cc:2468] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 1.
I20260709 12:26:06.614938 27855 consensus_queue.cc:260] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.617069 27867 raft_consensus.cc:493] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.617587 27867 raft_consensus.cc:515] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.617982 27853 raft_consensus.cc:359] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.618795 27853 raft_consensus.cc:385] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.619083 27853 raft_consensus.cc:740] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14900064b421439bb3283d698937fdc3, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.620182 27853 consensus_queue.cc:260] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.621884 27867 leader_election.cc:290] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639)
I20260709 12:26:06.622974 27853 ts_tablet_manager.cc:1434] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 12:26:06.624290 27853 tablet_bootstrap.cc:492] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3: Bootstrap starting.
I20260709 12:26:06.625077 27855 ts_tablet_manager.cc:1434] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df: Time spent starting tablet: real 0.114s	user 0.019s	sys 0.027s
I20260709 12:26:06.626263 27855 tablet_bootstrap.cc:492] T 6cd5cdd42faf4f659b227a00a806c6dc P 883b0e22898a4bf7a51286a04aa3f5df: Bootstrap starting.
I20260709 12:26:06.628925 27629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a9888378254e8f91be48bd536f3c40" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3" is_pre_election: true
W20260709 12:26:06.631984 27668 leader_election.cc:343] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.632025 27555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a9888378254e8f91be48bd536f3c40" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95" is_pre_election: true
I20260709 12:26:06.634080 27853 tablet_bootstrap.cc:654] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:06.634027 27668 leader_election.cc:343] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.636657 27668 leader_election.cc:304] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 883b0e22898a4bf7a51286a04aa3f5df; no voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95
I20260709 12:26:06.638356 27867 raft_consensus.cc:2749] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.640874 27854 tablet_bootstrap.cc:654] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.645874 27855 tablet_bootstrap.cc:654] T 6cd5cdd42faf4f659b227a00a806c6dc P 883b0e22898a4bf7a51286a04aa3f5df: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.646806 27882 raft_consensus.cc:493] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.647346 27882 raft_consensus.cc:515] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.651008 27882 leader_election.cc:290] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:06.653591 27704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8002a467593c4b4a8f43a0df5fbc6ce9" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df" is_pre_election: true
I20260709 12:26:06.654035 27853 tablet_bootstrap.cc:492] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3: No bootstrap required, opened a new log
I20260709 12:26:06.654942 27853 ts_tablet_manager.cc:1403] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.012s
I20260709 12:26:06.654933 27854 tablet_bootstrap.cc:492] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95: No bootstrap required, opened a new log
I20260709 12:26:06.655814 27854 ts_tablet_manager.cc:1403] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.006s
W20260709 12:26:06.655911 27595 leader_election.cc:343] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.657315 27552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8002a467593c4b4a8f43a0df5fbc6ce9" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95" is_pre_election: true
W20260709 12:26:06.658860 27594 leader_election.cc:343] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.658532 27853 raft_consensus.cc:359] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.659408 27853 raft_consensus.cc:385] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.659373 27594 leader_election.cc:304] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14900064b421439bb3283d698937fdc3; no voters: 883b0e22898a4bf7a51286a04aa3f5df, adb2f949f49447f89aa4c72935536a95
I20260709 12:26:06.659608 27854 raft_consensus.cc:359] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.660480 27882 raft_consensus.cc:2749] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.660876 27854 raft_consensus.cc:385] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.659893 27853 raft_consensus.cc:740] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14900064b421439bb3283d698937fdc3, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.661206 27854 raft_consensus.cc:740] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.661799 27853 consensus_queue.cc:260] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.662012 27854 consensus_queue.cc:260] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.664489 27854 ts_tablet_manager.cc:1434] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:06.667266 27855 tablet_bootstrap.cc:492] T 6cd5cdd42faf4f659b227a00a806c6dc P 883b0e22898a4bf7a51286a04aa3f5df: No bootstrap required, opened a new log
I20260709 12:26:06.667332 27854 tablet_bootstrap.cc:492] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95: Bootstrap starting.
I20260709 12:26:06.668910 27853 ts_tablet_manager.cc:1434] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:26:06.670060 27853 tablet_bootstrap.cc:492] T 87caca536d094157b02aa19b6a42ee99 P 14900064b421439bb3283d698937fdc3: Bootstrap starting.
I20260709 12:26:06.675289 27854 tablet_bootstrap.cc:654] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.678745 27855 ts_tablet_manager.cc:1403] T 6cd5cdd42faf4f659b227a00a806c6dc P 883b0e22898a4bf7a51286a04aa3f5df: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.007s
I20260709 12:26:06.680557 27853 tablet_bootstrap.cc:654] T 87caca536d094157b02aa19b6a42ee99 P 14900064b421439bb3283d698937fdc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.683907 27855 raft_consensus.cc:359] T 6cd5cdd42faf4f659b227a00a806c6dc P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.684839 27855 raft_consensus.cc:385] T 6cd5cdd42faf4f659b227a00a806c6dc P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.685177 27855 raft_consensus.cc:740] T 6cd5cdd42faf4f659b227a00a806c6dc P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.686048 27855 consensus_queue.cc:260] T 6cd5cdd42faf4f659b227a00a806c6dc P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.689083 27855 ts_tablet_manager.cc:1434] T 6cd5cdd42faf4f659b227a00a806c6dc P 883b0e22898a4bf7a51286a04aa3f5df: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:26:06.690295 27855 tablet_bootstrap.cc:492] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df: Bootstrap starting.
I20260709 12:26:06.697597 27855 tablet_bootstrap.cc:654] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.698823 27853 tablet_bootstrap.cc:492] T 87caca536d094157b02aa19b6a42ee99 P 14900064b421439bb3283d698937fdc3: No bootstrap required, opened a new log
I20260709 12:26:06.699437 27853 ts_tablet_manager.cc:1403] T 87caca536d094157b02aa19b6a42ee99 P 14900064b421439bb3283d698937fdc3: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.000s
I20260709 12:26:06.702837 27853 raft_consensus.cc:359] T 87caca536d094157b02aa19b6a42ee99 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.703599 27853 raft_consensus.cc:385] T 87caca536d094157b02aa19b6a42ee99 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.703926 27853 raft_consensus.cc:740] T 87caca536d094157b02aa19b6a42ee99 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14900064b421439bb3283d698937fdc3, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.704689 27853 consensus_queue.cc:260] T 87caca536d094157b02aa19b6a42ee99 P 14900064b421439bb3283d698937fdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.707821 27853 ts_tablet_manager.cc:1434] T 87caca536d094157b02aa19b6a42ee99 P 14900064b421439bb3283d698937fdc3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.002s
I20260709 12:26:06.708928 27853 tablet_bootstrap.cc:492] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3: Bootstrap starting.
I20260709 12:26:06.716395 27853 tablet_bootstrap.cc:654] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.730379 27855 tablet_bootstrap.cc:492] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df: No bootstrap required, opened a new log
I20260709 12:26:06.731228 27855 ts_tablet_manager.cc:1403] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.001s
I20260709 12:26:06.731818 27853 tablet_bootstrap.cc:492] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3: No bootstrap required, opened a new log
I20260709 12:26:06.732559 27853 ts_tablet_manager.cc:1403] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.012s
I20260709 12:26:06.734112 27854 tablet_bootstrap.cc:492] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95: No bootstrap required, opened a new log
I20260709 12:26:06.734678 27854 ts_tablet_manager.cc:1403] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.016s
I20260709 12:26:06.734797 27855 raft_consensus.cc:359] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.735692 27855 raft_consensus.cc:385] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.735363 27853 raft_consensus.cc:359] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.736078 27855 raft_consensus.cc:740] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.736191 27853 raft_consensus.cc:385] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.736737 27853 raft_consensus.cc:740] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14900064b421439bb3283d698937fdc3, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.737062 27855 consensus_queue.cc:260] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.737452 27853 consensus_queue.cc:260] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.739955 27853 ts_tablet_manager.cc:1434] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:06.740922 27853 tablet_bootstrap.cc:492] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3: Bootstrap starting.
I20260709 12:26:06.741655 27854 raft_consensus.cc:359] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.742447 27854 raft_consensus.cc:385] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.742758 27854 raft_consensus.cc:740] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.743513 27854 consensus_queue.cc:260] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.746496 27854 ts_tablet_manager.cc:1434] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:26:06.755007 27853 tablet_bootstrap.cc:654] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.756166 27882 raft_consensus.cc:493] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.756763 27882 raft_consensus.cc:515] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.759157 27882 leader_election.cc:290] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:06.759923 27552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd5cdd42faf4f659b227a00a806c6dc" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95" is_pre_election: true
I20260709 12:26:06.760632 27552 raft_consensus.cc:2468] T 6cd5cdd42faf4f659b227a00a806c6dc P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 0.
I20260709 12:26:06.760864 27704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd5cdd42faf4f659b227a00a806c6dc" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df" is_pre_election: true
I20260709 12:26:06.761590 27704 raft_consensus.cc:2468] T 6cd5cdd42faf4f659b227a00a806c6dc P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 0.
I20260709 12:26:06.762061 27594 leader_election.cc:304] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:06.763420 27882 raft_consensus.cc:2804] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.763811 27882 raft_consensus.cc:493] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.764156 27882 raft_consensus.cc:3060] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.765170 27855 ts_tablet_manager.cc:1434] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.001s
I20260709 12:26:06.766454 27855 tablet_bootstrap.cc:492] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df: Bootstrap starting.
I20260709 12:26:06.769640 27856 consensus_queue.cc:1048] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.774401 27855 tablet_bootstrap.cc:654] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.779433 27866 raft_consensus.cc:493] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.780053 27866 raft_consensus.cc:515] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.781108 27853 tablet_bootstrap.cc:492] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3: No bootstrap required, opened a new log
I20260709 12:26:06.781668 27853 ts_tablet_manager.cc:1403] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.001s
I20260709 12:26:06.782397 27866 leader_election.cc:290] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:06.784824 27630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50f55a9615446939b227473f73e7809" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3" is_pre_election: true
I20260709 12:26:06.785751 27630 raft_consensus.cc:2468] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 0.
I20260709 12:26:06.788229 27518 leader_election.cc:304] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:06.794008 27856 raft_consensus.cc:2804] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.794515 27856 raft_consensus.cc:493] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.794903 27856 raft_consensus.cc:3060] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.799665 27866 raft_consensus.cc:493] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.784148 27705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50f55a9615446939b227473f73e7809" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df" is_pre_election: true
I20260709 12:26:06.808251 27705 raft_consensus.cc:2468] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 0.
I20260709 12:26:06.808715 27853 raft_consensus.cc:359] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.809540 27853 raft_consensus.cc:385] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.809818 27853 raft_consensus.cc:740] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14900064b421439bb3283d698937fdc3, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.810621 27853 consensus_queue.cc:260] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.800484 27866 raft_consensus.cc:515] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.812927 27853 ts_tablet_manager.cc:1434] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3: Time spent starting tablet: real 0.031s	user 0.012s	sys 0.009s
I20260709 12:26:06.814615 27866 leader_election.cc:290] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:06.815097 27630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8002a467593c4b4a8f43a0df5fbc6ce9" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3" is_pre_election: true
I20260709 12:26:06.815948 27630 raft_consensus.cc:2468] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 0.
I20260709 12:26:06.817430 27518 leader_election.cc:304] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:06.820387 27703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8002a467593c4b4a8f43a0df5fbc6ce9" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df" is_pre_election: true
W20260709 12:26:06.822849 27519 leader_election.cc:343] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.838083 27856 raft_consensus.cc:515] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.838496 27871 consensus_queue.cc:1048] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.818295 27866 raft_consensus.cc:2804] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.840027 27866 raft_consensus.cc:493] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.840428 27866 raft_consensus.cc:3060] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.858775 27882 raft_consensus.cc:515] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.868325 27867 consensus_queue.cc:1048] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:06.874409 27855 tablet_bootstrap.cc:492] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df: No bootstrap required, opened a new log
I20260709 12:26:06.875087 27855 ts_tablet_manager.cc:1403] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df: Time spent bootstrapping tablet: real 0.109s	user 0.027s	sys 0.054s
I20260709 12:26:06.881244 27856 leader_election.cc:290] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 election: Requested vote from peers 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:06.881825 27629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50f55a9615446939b227473f73e7809" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3"
I20260709 12:26:06.884276 27629 raft_consensus.cc:3060] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.888104 27867 raft_consensus.cc:493] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.888756 27867 raft_consensus.cc:515] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.890563 27855 raft_consensus.cc:359] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.891436 27867 leader_election.cc:290] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639)
I20260709 12:26:06.893043 27705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50f55a9615446939b227473f73e7809" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
I20260709 12:26:06.893867 27705 raft_consensus.cc:3060] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.891547 27855 raft_consensus.cc:385] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.897864 27855 raft_consensus.cc:740] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.899019 27629 raft_consensus.cc:2468] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 1.
I20260709 12:26:06.900987 27518 leader_election.cc:304] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:06.906011 27705 raft_consensus.cc:2468] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 1.
I20260709 12:26:06.901855 27755 raft_consensus.cc:2804] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.907815 27855 consensus_queue.cc:260] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.910854 27855 ts_tablet_manager.cc:1434] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.005s
I20260709 12:26:06.912324 27855 tablet_bootstrap.cc:492] T fb853c5fe6294ec59d55191cc58ef949 P 883b0e22898a4bf7a51286a04aa3f5df: Bootstrap starting.
I20260709 12:26:06.932884 27855 tablet_bootstrap.cc:654] T fb853c5fe6294ec59d55191cc58ef949 P 883b0e22898a4bf7a51286a04aa3f5df: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.948338 27555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383048ad6752482b980f43745a13a57f" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95" is_pre_election: true
I20260709 12:26:06.948570 27882 leader_election.cc:290] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 election: Requested vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:06.948666 27630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383048ad6752482b980f43745a13a57f" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3" is_pre_election: true
I20260709 12:26:06.949380 27882 raft_consensus.cc:493] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.949597 27630 raft_consensus.cc:2393] T 383048ad6752482b980f43745a13a57f P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 883b0e22898a4bf7a51286a04aa3f5df in current term 1: Already voted for candidate adb2f949f49447f89aa4c72935536a95 in this term.
I20260709 12:26:06.949898 27882 raft_consensus.cc:515] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.955276 27668 leader_election.cc:304] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 883b0e22898a4bf7a51286a04aa3f5df; no voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95
I20260709 12:26:06.955543 27866 raft_consensus.cc:515] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.957578 27778 raft_consensus.cc:3060] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.958525 27871 consensus_queue.cc:1048] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:06.959237 27704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8002a467593c4b4a8f43a0df5fbc6ce9" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
I20260709 12:26:06.959894 27704 raft_consensus.cc:3060] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.960302 27555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd5cdd42faf4f659b227a00a806c6dc" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:06.960949 27555 raft_consensus.cc:3060] T 6cd5cdd42faf4f659b227a00a806c6dc P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.963022 27882 leader_election.cc:290] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:06.963604 27866 leader_election.cc:290] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 election: Requested vote from peers 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:06.965484 27630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8002a467593c4b4a8f43a0df5fbc6ce9" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14900064b421439bb3283d698937fdc3"
I20260709 12:26:06.965890 27553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a9888378254e8f91be48bd536f3c40" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95" is_pre_election: true
I20260709 12:26:06.966156 27630 raft_consensus.cc:3060] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.969704 27705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd5cdd42faf4f659b227a00a806c6dc" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
I20260709 12:26:06.970459 27705 raft_consensus.cc:3060] T 6cd5cdd42faf4f659b227a00a806c6dc P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.966575 27553 raft_consensus.cc:2468] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 0.
I20260709 12:26:06.979533 27630 raft_consensus.cc:2468] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 1.
I20260709 12:26:06.979861 27705 raft_consensus.cc:2468] T 6cd5cdd42faf4f659b227a00a806c6dc P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 1.
I20260709 12:26:06.976323 27594 leader_election.cc:304] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:06.973891 27755 raft_consensus.cc:697] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 1 LEADER]: Becoming Leader. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Running, Role: LEADER
I20260709 12:26:06.985080 27882 raft_consensus.cc:2804] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.985044 27755 consensus_queue.cc:237] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.986164 27518 leader_election.cc:304] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:06.987330 27866 raft_consensus.cc:2804] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.988184 27866 raft_consensus.cc:697] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [term 1 LEADER]: Becoming Leader. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Running, Role: LEADER
I20260709 12:26:06.989233 27866 consensus_queue.cc:237] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:06.990547 27778 raft_consensus.cc:2749] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.985595 27882 raft_consensus.cc:493] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.992118 27882 raft_consensus.cc:3060] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.995254 27595 leader_election.cc:304] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, 883b0e22898a4bf7a51286a04aa3f5df; no voters: 
I20260709 12:26:07.001021 27858 raft_consensus.cc:2804] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:07.001577 27858 raft_consensus.cc:697] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Becoming Leader. State: Replica: 14900064b421439bb3283d698937fdc3, State: Running, Role: LEADER
I20260709 12:26:07.002080 27630 raft_consensus.cc:3060] T 87caca536d094157b02aa19b6a42ee99 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.008419 27705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a9888378254e8f91be48bd536f3c40" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df" is_pre_election: true
I20260709 12:26:07.008417 27855 tablet_bootstrap.cc:492] T fb853c5fe6294ec59d55191cc58ef949 P 883b0e22898a4bf7a51286a04aa3f5df: No bootstrap required, opened a new log
I20260709 12:26:07.009408 27705 raft_consensus.cc:2468] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 0.
I20260709 12:26:07.012346 27858 consensus_queue.cc:237] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:07.013610 27704 raft_consensus.cc:2468] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 1.
I20260709 12:26:07.015167 27555 raft_consensus.cc:2468] T 6cd5cdd42faf4f659b227a00a806c6dc P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 1.
I20260709 12:26:07.016803 27855 ts_tablet_manager.cc:1403] T fb853c5fe6294ec59d55191cc58ef949 P 883b0e22898a4bf7a51286a04aa3f5df: Time spent bootstrapping tablet: real 0.098s	user 0.017s	sys 0.001s
I20260709 12:26:07.017467 27451 catalog_manager.cc:5697] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 reported cstate change: term changed from 0 to 1, leader changed from <none> to adb2f949f49447f89aa4c72935536a95 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "adb2f949f49447f89aa4c72935536a95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.021471 27855 raft_consensus.cc:359] T fb853c5fe6294ec59d55191cc58ef949 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:07.022424 27855 raft_consensus.cc:385] T fb853c5fe6294ec59d55191cc58ef949 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.022804 27855 raft_consensus.cc:740] T fb853c5fe6294ec59d55191cc58ef949 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.025290 27855 consensus_queue.cc:260] T fb853c5fe6294ec59d55191cc58ef949 P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:07.023699 27778 consensus_queue.cc:1048] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:26:07.052485 27866 consensus_queue.cc:1048] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:07.059790 27451 catalog_manager.cc:5697] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 reported cstate change: term changed from 0 to 1, leader changed from <none> to adb2f949f49447f89aa4c72935536a95 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "adb2f949f49447f89aa4c72935536a95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.066226 27882 raft_consensus.cc:515] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:07.070178 27855 ts_tablet_manager.cc:1434] T fb853c5fe6294ec59d55191cc58ef949 P 883b0e22898a4bf7a51286a04aa3f5df: Time spent starting tablet: real 0.052s	user 0.019s	sys 0.025s
W20260709 12:26:07.080406 27595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:32823, user_credentials={real_user=slave}} blocked reactor thread for 53034.1us
I20260709 12:26:07.083050 27749 raft_consensus.cc:493] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.083588 27749 raft_consensus.cc:515] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:07.085716 27749 leader_election.cc:290] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
W20260709 12:26:07.086238 27594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:43495, user_credentials={real_user=slave}} blocked reactor thread for 84581.6us
I20260709 12:26:07.088809 27555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb853c5fe6294ec59d55191cc58ef949" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95" is_pre_election: true
I20260709 12:26:07.089644 27555 raft_consensus.cc:2468] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 0.
I20260709 12:26:07.092708 27882 leader_election.cc:290] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 election: Requested vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:07.094734 27594 leader_election.cc:304] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:07.097638 27704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb853c5fe6294ec59d55191cc58ef949" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df" is_pre_election: true
I20260709 12:26:07.098096 27705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a9888378254e8f91be48bd536f3c40" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
I20260709 12:26:07.098438 27704 raft_consensus.cc:2468] T fb853c5fe6294ec59d55191cc58ef949 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 0.
I20260709 12:26:07.098953 27705 raft_consensus.cc:3060] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.105589 27911 raft_consensus.cc:2804] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:07.106118 27911 raft_consensus.cc:493] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.106449 27911 raft_consensus.cc:3060] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.108933 27555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a9888378254e8f91be48bd536f3c40" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:07.109660 27555 raft_consensus.cc:3060] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.118855 27705 raft_consensus.cc:2468] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 1.
I20260709 12:26:07.120154 27595 leader_election.cc:304] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, 883b0e22898a4bf7a51286a04aa3f5df; no voters: 
I20260709 12:26:07.121387 27882 raft_consensus.cc:2804] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:07.121894 27882 raft_consensus.cc:697] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Becoming Leader. State: Replica: 14900064b421439bb3283d698937fdc3, State: Running, Role: LEADER
I20260709 12:26:07.122711 27882 consensus_queue.cc:237] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:07.123464 27448 catalog_manager.cc:5697] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 14900064b421439bb3283d698937fdc3 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "14900064b421439bb3283d698937fdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.135882 27555 raft_consensus.cc:2468] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 1.
I20260709 12:26:07.141762 27911 raft_consensus.cc:515] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:07.143836 27911 leader_election.cc:290] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 election: Requested vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:07.144731 27555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb853c5fe6294ec59d55191cc58ef949" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:07.145481 27555 raft_consensus.cc:3060] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.145525 27705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb853c5fe6294ec59d55191cc58ef949" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
I20260709 12:26:07.146234 27705 raft_consensus.cc:3060] T fb853c5fe6294ec59d55191cc58ef949 P 883b0e22898a4bf7a51286a04aa3f5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.156318 27705 raft_consensus.cc:2468] T fb853c5fe6294ec59d55191cc58ef949 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 1.
I20260709 12:26:07.157531 27595 leader_election.cc:304] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, 883b0e22898a4bf7a51286a04aa3f5df; no voters: 
I20260709 12:26:07.158258 27909 consensus_queue.cc:1048] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:07.158628 27907 raft_consensus.cc:2804] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:07.158725 27555 raft_consensus.cc:2468] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 1.
I20260709 12:26:07.159430 27907 raft_consensus.cc:697] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Becoming Leader. State: Replica: 14900064b421439bb3283d698937fdc3, State: Running, Role: LEADER
I20260709 12:26:07.160382 27907 consensus_queue.cc:237] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:07.153332 27448 catalog_manager.cc:5697] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 14900064b421439bb3283d698937fdc3 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "14900064b421439bb3283d698937fdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.186831 27909 consensus_queue.cc:1048] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:07.197158 27451 catalog_manager.cc:5697] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 14900064b421439bb3283d698937fdc3 (127.16.240.130). New cstate: current_term: 1 leader_uuid: "14900064b421439bb3283d698937fdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.368911 27755 consensus_queue.cc:1048] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:07.385939 27866 consensus_queue.cc:1048] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:07.404973 27703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87caca536d094157b02aa19b6a42ee99"
dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
mode: GRACEFUL
new_leader_uuid: "adb2f949f49447f89aa4c72935536a95"
 from {username='slave'} at 127.0.0.1:53864
I20260709 12:26:07.405647 27703 raft_consensus.cc:606] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Received request to transfer leadership to TS adb2f949f49447f89aa4c72935536a95
I20260709 12:26:07.407891 27909 raft_consensus.cc:993] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df: : Instructing follower adb2f949f49447f89aa4c72935536a95 to start an election
I20260709 12:26:07.408362 27909 raft_consensus.cc:1081] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Signalling peer adb2f949f49447f89aa4c72935536a95 to start an election
I20260709 12:26:07.412073 27553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87caca536d094157b02aa19b6a42ee99"
dest_uuid: "adb2f949f49447f89aa4c72935536a95"
 from {username='slave'} at 127.0.0.1:41398
I20260709 12:26:07.412731 27553 raft_consensus.cc:493] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:07.413106 27553 raft_consensus.cc:3060] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:07.417202 27911 consensus_queue.cc:1048] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:07.418134 27628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67a9888378254e8f91be48bd536f3c40"
dest_uuid: "14900064b421439bb3283d698937fdc3"
mode: GRACEFUL
new_leader_uuid: "adb2f949f49447f89aa4c72935536a95"
 from {username='slave'} at 127.0.0.1:39288
I20260709 12:26:07.418802 27628 raft_consensus.cc:606] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Received request to transfer leadership to TS adb2f949f49447f89aa4c72935536a95
I20260709 12:26:07.423938 27553 raft_consensus.cc:515] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:07.432562 27629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87caca536d094157b02aa19b6a42ee99" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14900064b421439bb3283d698937fdc3"
I20260709 12:26:07.433271 27629 raft_consensus.cc:3060] T 87caca536d094157b02aa19b6a42ee99 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:07.442211 27629 raft_consensus.cc:2468] T 87caca536d094157b02aa19b6a42ee99 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 2.
I20260709 12:26:07.443562 27518 leader_election.cc:304] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:07.444674 27866 raft_consensus.cc:2804] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:07.445206 27866 raft_consensus.cc:697] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95 [term 2 LEADER]: Becoming Leader. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Running, Role: LEADER
I20260709 12:26:07.446126 27866 consensus_queue.cc:237] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:07.459508 27451 catalog_manager.cc:5697] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95 reported cstate change: term changed from 1 to 2, leader changed from 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131) to adb2f949f49447f89aa4c72935536a95 (127.16.240.129). New cstate: current_term: 2 leader_uuid: "adb2f949f49447f89aa4c72935536a95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.464593 27705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87caca536d094157b02aa19b6a42ee99" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
I20260709 12:26:07.465375 27705 raft_consensus.cc:3055] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:07.465720 27705 raft_consensus.cc:740] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Running, Role: LEADER
I20260709 12:26:07.466540 27705 consensus_queue.cc:260] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:07.468205 27705 raft_consensus.cc:3060] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:07.474699 27866 consensus_queue.cc:1048] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:07.479411 27553 leader_election.cc:290] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 2 election: Requested vote from peers 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:07.483497 27858 consensus_queue.cc:1048] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:07.486768 27705 raft_consensus.cc:2468] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 2.
I20260709 12:26:07.510977 27552 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f50f55a9615446939b227473f73e7809"
dest_uuid: "adb2f949f49447f89aa4c72935536a95"
mode: GRACEFUL
new_leader_uuid: "14900064b421439bb3283d698937fdc3"
 from {username='slave'} at 127.0.0.1:41424
I20260709 12:26:07.511596 27552 raft_consensus.cc:606] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 1 LEADER]: Received request to transfer leadership to TS 14900064b421439bb3283d698937fdc3
I20260709 12:26:07.513825 27900 consensus_queue.cc:1048] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:07.530359 27705 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b10b7feeaa94428bbbfb9602eadcf8d"
dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
mode: GRACEFUL
new_leader_uuid: "14900064b421439bb3283d698937fdc3"
 from {username='slave'} at 127.0.0.1:53864
I20260709 12:26:07.531179 27705 raft_consensus.cc:606] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Received request to transfer leadership to TS 14900064b421439bb3283d698937fdc3
I20260709 12:26:07.538645 27552 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8002a467593c4b4a8f43a0df5fbc6ce9"
dest_uuid: "adb2f949f49447f89aa4c72935536a95"
mode: GRACEFUL
new_leader_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
 from {username='slave'} at 127.0.0.1:41424
I20260709 12:26:07.539307 27552 raft_consensus.cc:606] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [term 1 LEADER]: Received request to transfer leadership to TS 883b0e22898a4bf7a51286a04aa3f5df
I20260709 12:26:07.572639 27749 consensus_queue.cc:1048] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:07.586858 27858 consensus_queue.cc:1048] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:07.602224 27911 consensus_queue.cc:1048] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:07.605926 27911 consensus_queue.cc:1048] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:07.617611 27907 raft_consensus.cc:993] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3: : Instructing follower adb2f949f49447f89aa4c72935536a95 to start an election
I20260709 12:26:07.618085 27907 raft_consensus.cc:1081] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Signalling peer adb2f949f49447f89aa4c72935536a95 to start an election
I20260709 12:26:07.622280 27555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67a9888378254e8f91be48bd536f3c40"
dest_uuid: "adb2f949f49447f89aa4c72935536a95"
 from {username='slave'} at 127.0.0.1:41414
I20260709 12:26:07.622901 27555 raft_consensus.cc:493] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:07.623309 27555 raft_consensus.cc:3060] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:07.633150 27555 raft_consensus.cc:515] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:07.639827 27629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a9888378254e8f91be48bd536f3c40" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14900064b421439bb3283d698937fdc3"
I20260709 12:26:07.640502 27629 raft_consensus.cc:3055] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:07.640810 27629 raft_consensus.cc:740] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14900064b421439bb3283d698937fdc3, State: Running, Role: LEADER
I20260709 12:26:07.641638 27629 consensus_queue.cc:260] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:07.642766 27629 raft_consensus.cc:3060] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:07.655491 27629 raft_consensus.cc:2468] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 2.
I20260709 12:26:07.656634 27555 leader_election.cc:290] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 2 election: Requested vote from peers 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:07.657642 27518 leader_election.cc:304] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:07.657691 27705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a9888378254e8f91be48bd536f3c40" candidate_uuid: "adb2f949f49447f89aa4c72935536a95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
I20260709 12:26:07.658572 27705 raft_consensus.cc:3060] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:07.658595 27900 raft_consensus.cc:2804] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:07.659309 27900 raft_consensus.cc:697] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95 [term 2 LEADER]: Becoming Leader. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Running, Role: LEADER
I20260709 12:26:07.660224 27900 consensus_queue.cc:237] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:07.667183 27705 raft_consensus.cc:2468] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adb2f949f49447f89aa4c72935536a95 in term 2.
I20260709 12:26:07.668255 27451 catalog_manager.cc:5697] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95 reported cstate change: term changed from 1 to 2, leader changed from 14900064b421439bb3283d698937fdc3 (127.16.240.130) to adb2f949f49447f89aa4c72935536a95 (127.16.240.129). New cstate: current_term: 2 leader_uuid: "adb2f949f49447f89aa4c72935536a95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.769245 27778 raft_consensus.cc:993] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df: : Instructing follower 14900064b421439bb3283d698937fdc3 to start an election
I20260709 12:26:07.770363 27909 raft_consensus.cc:1081] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Signalling peer 14900064b421439bb3283d698937fdc3 to start an election
I20260709 12:26:07.772892 27629 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b10b7feeaa94428bbbfb9602eadcf8d"
dest_uuid: "14900064b421439bb3283d698937fdc3"
 from {username='slave'} at 127.0.0.1:39264
I20260709 12:26:07.773561 27629 raft_consensus.cc:493] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:07.773913 27629 raft_consensus.cc:3060] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:07.781041 27629 raft_consensus.cc:515] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:07.783061 27629 leader_election.cc:290] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 2 election: Requested vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:07.783977 27555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b10b7feeaa94428bbbfb9602eadcf8d" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:07.784353 27705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b10b7feeaa94428bbbfb9602eadcf8d" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
I20260709 12:26:07.784775 27555 raft_consensus.cc:3060] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:07.784989 27705 raft_consensus.cc:3055] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:07.785398 27705 raft_consensus.cc:740] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Running, Role: LEADER
I20260709 12:26:07.786120 27705 consensus_queue.cc:260] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:07.786980 27705 raft_consensus.cc:3060] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:07.793320 27705 raft_consensus.cc:2468] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 2.
I20260709 12:26:07.793674 27555 raft_consensus.cc:2468] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 2.
I20260709 12:26:07.794720 27595 leader_election.cc:304] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, 883b0e22898a4bf7a51286a04aa3f5df; no voters: 
I20260709 12:26:07.796254 27882 raft_consensus.cc:2804] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:07.796993 27882 raft_consensus.cc:697] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3 [term 2 LEADER]: Becoming Leader. State: Replica: 14900064b421439bb3283d698937fdc3, State: Running, Role: LEADER
I20260709 12:26:07.797837 27882 consensus_queue.cc:237] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:07.804980 27451 catalog_manager.cc:5697] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3 reported cstate change: term changed from 1 to 2, leader changed from 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131) to 14900064b421439bb3283d698937fdc3 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "14900064b421439bb3283d698937fdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.901432 27629 raft_consensus.cc:1275] T 87caca536d094157b02aa19b6a42ee99 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Refusing update from remote peer adb2f949f49447f89aa4c72935536a95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:07.903945 27900 consensus_queue.cc:1048] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:07.915561 27705 raft_consensus.cc:1275] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Refusing update from remote peer adb2f949f49447f89aa4c72935536a95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:07.921732 27866 consensus_queue.cc:1048] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:07.941360 27900 raft_consensus.cc:993] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95: : Instructing follower 14900064b421439bb3283d698937fdc3 to start an election
I20260709 12:26:07.941890 27866 raft_consensus.cc:1081] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 1 LEADER]: Signalling peer 14900064b421439bb3283d698937fdc3 to start an election
I20260709 12:26:07.943919 27629 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f50f55a9615446939b227473f73e7809"
dest_uuid: "14900064b421439bb3283d698937fdc3"
 from {username='slave'} at 127.0.0.1:39274
I20260709 12:26:07.944604 27629 raft_consensus.cc:493] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:07.945045 27629 raft_consensus.cc:3060] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:07.950932 27629 raft_consensus.cc:515] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:07.953305 27629 leader_election.cc:290] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 2 election: Requested vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131:32823)
I20260709 12:26:07.954023 27555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50f55a9615446939b227473f73e7809" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:07.954802 27555 raft_consensus.cc:3055] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:07.955171 27555 raft_consensus.cc:740] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Running, Role: LEADER
I20260709 12:26:07.956519 27705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50f55a9615446939b227473f73e7809" candidate_uuid: "14900064b421439bb3283d698937fdc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
I20260709 12:26:07.956147 27555 consensus_queue.cc:260] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:07.957108 27705 raft_consensus.cc:3060] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:07.957769 27555 raft_consensus.cc:3060] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:07.962756 27705 raft_consensus.cc:2468] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 2.
I20260709 12:26:07.964233 27595 leader_election.cc:304] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, 883b0e22898a4bf7a51286a04aa3f5df; no voters: 
I20260709 12:26:07.965054 27882 raft_consensus.cc:2804] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:07.965523 27882 raft_consensus.cc:697] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [term 2 LEADER]: Becoming Leader. State: Replica: 14900064b421439bb3283d698937fdc3, State: Running, Role: LEADER
I20260709 12:26:07.966729 27555 raft_consensus.cc:2468] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14900064b421439bb3283d698937fdc3 in term 2.
I20260709 12:26:07.966454 27882 consensus_queue.cc:237] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:07.975147 27452 catalog_manager.cc:5697] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 reported cstate change: term changed from 1 to 2, leader changed from adb2f949f49447f89aa4c72935536a95 (127.16.240.129) to 14900064b421439bb3283d698937fdc3 (127.16.240.130). New cstate: current_term: 2 leader_uuid: "14900064b421439bb3283d698937fdc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:08.096546 27900 raft_consensus.cc:993] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95: : Instructing follower 883b0e22898a4bf7a51286a04aa3f5df to start an election
I20260709 12:26:08.097074 27866 raft_consensus.cc:1081] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [term 1 LEADER]: Signalling peer 883b0e22898a4bf7a51286a04aa3f5df to start an election
I20260709 12:26:08.099391 27704 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8002a467593c4b4a8f43a0df5fbc6ce9"
dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
 from {username='slave'} at 127.0.0.1:53838
I20260709 12:26:08.100060 27704 raft_consensus.cc:493] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:08.100426 27704 raft_consensus.cc:3060] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:08.106523 27704 raft_consensus.cc:515] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:08.108364 27704 leader_election.cc:290] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 2 election: Requested vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639)
I20260709 12:26:08.110070 27629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8002a467593c4b4a8f43a0df5fbc6ce9" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14900064b421439bb3283d698937fdc3"
I20260709 12:26:08.110111 27555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8002a467593c4b4a8f43a0df5fbc6ce9" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:08.110790 27629 raft_consensus.cc:3060] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:08.110903 27555 raft_consensus.cc:3055] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:08.111480 27555 raft_consensus.cc:740] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Running, Role: LEADER
I20260709 12:26:08.112356 27555 consensus_queue.cc:260] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:08.115868 27555 raft_consensus.cc:3060] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:08.124193 27555 raft_consensus.cc:2468] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 2.
I20260709 12:26:08.125284 27668 leader_election.cc:304] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 883b0e22898a4bf7a51286a04aa3f5df, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:08.125809 27629 raft_consensus.cc:2468] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 2.
I20260709 12:26:08.126590 27909 raft_consensus.cc:2804] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:08.127144 27909 raft_consensus.cc:697] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 LEADER]: Becoming Leader. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Running, Role: LEADER
I20260709 12:26:08.128024 27909 consensus_queue.cc:237] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:08.135054 27452 catalog_manager.cc:5697] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df reported cstate change: term changed from 1 to 2, leader changed from adb2f949f49447f89aa4c72935536a95 (127.16.240.129) to 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131). New cstate: current_term: 2 leader_uuid: "883b0e22898a4bf7a51286a04aa3f5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:08.175601 27629 raft_consensus.cc:1275] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Refusing update from remote peer adb2f949f49447f89aa4c72935536a95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:08.177456 27866 consensus_queue.cc:1048] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:08.187491 27704 raft_consensus.cc:1275] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Refusing update from remote peer adb2f949f49447f89aa4c72935536a95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:08.190192 27871 consensus_queue.cc:1048] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:08.356046 27705 raft_consensus.cc:1275] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Refusing update from remote peer 14900064b421439bb3283d698937fdc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:08.358882 27858 consensus_queue.cc:1048] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:08.382360 27555 raft_consensus.cc:1275] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Refusing update from remote peer 14900064b421439bb3283d698937fdc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:08.387995 27882 consensus_queue.cc:1048] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:08.538671 27704 raft_consensus.cc:1275] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Refusing update from remote peer 14900064b421439bb3283d698937fdc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:08.539359 27555 raft_consensus.cc:1275] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Refusing update from remote peer 883b0e22898a4bf7a51286a04aa3f5df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:08.540542 27882 consensus_queue.cc:1048] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:08.541497 27909 consensus_queue.cc:1048] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:08.553496 27552 raft_consensus.cc:1275] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Refusing update from remote peer 14900064b421439bb3283d698937fdc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:08.556470 27882 consensus_queue.cc:1048] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:26:08.580879 27629 raft_consensus.cc:1275] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Refusing update from remote peer 883b0e22898a4bf7a51286a04aa3f5df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:08.592931 27778 consensus_queue.cc:1048] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:10.545238 27451 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46754:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:26:10.573698 27451 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46754:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:26:10.645378 17346 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:26:10.817155 27959 log.cc:927] Time spent T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 12:26:10.840193 27961 log.cc:927] Time spent T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 12:26:10.849968 27968 log.cc:927] Time spent T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:26:10.932348 27991 tablet.cc:1724] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:10.930120 27984 tablet.cc:1724] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:10.896075 27988 tablet.cc:1724] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:10.955101 27983 log.cc:927] Time spent T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 12:26:10.990650 27994 log.cc:927] Time spent T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 12:26:11.007161 27656 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:f50f55a9615446939b227473f73e7809)
W20260709 12:26:11.020593 27656 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:f50f55a9615446939b227473f73e7809)
W20260709 12:26:11.026221 27656 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:f50f55a9615446939b227473f73e7809)
I20260709 12:26:11.032807 27998 tablet.cc:1724] T 447b7a52ac2548b486ad0cbe53a3b89e P 14900064b421439bb3283d698937fdc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:11.074162 28004 tablet.cc:1724] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:11.119060 27999 tablet.cc:1724] T 447b7a52ac2548b486ad0cbe53a3b89e P 883b0e22898a4bf7a51286a04aa3f5df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:11.162326 27998 tablet.cc:1724] T 383048ad6752482b980f43745a13a57f P 14900064b421439bb3283d698937fdc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:11.164179 28005 tablet.cc:1724] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:11.169066 27551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "383048ad6752482b980f43745a13a57f"
dest_uuid: "adb2f949f49447f89aa4c72935536a95"
mode: GRACEFUL
new_leader_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
 from {username='slave'} at 127.0.0.1:41440
I20260709 12:26:11.221800 27551 raft_consensus.cc:606] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [term 1 LEADER]: Received request to transfer leadership to TS 883b0e22898a4bf7a51286a04aa3f5df
I20260709 12:26:11.181011 28009 tablet.cc:1724] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:11.214707 28010 tablet.cc:1724] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:11.170941 27668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:43495, user_credentials={real_user=slave}} blocked reactor thread for 138973us
I20260709 12:26:11.238305 27964 raft_consensus.cc:993] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95: : Instructing follower 883b0e22898a4bf7a51286a04aa3f5df to start an election
I20260709 12:26:11.239094 27941 raft_consensus.cc:1081] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [term 1 LEADER]: Signalling peer 883b0e22898a4bf7a51286a04aa3f5df to start an election
I20260709 12:26:11.241190 27991 tablet.cc:1724] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:11.247298 28000 log.cc:927] Time spent T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df: Append to log took a long time: real 0.168s	user 0.002s	sys 0.011s
I20260709 12:26:11.249585 28011 tablet.cc:1724] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:11.253741 27988 tablet.cc:1724] T 6cd5cdd42faf4f659b227a00a806c6dc P adb2f949f49447f89aa4c72935536a95: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:11.211467 27998 tablet.cc:1724] T 87caca536d094157b02aa19b6a42ee99 P 14900064b421439bb3283d698937fdc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:11.258002 28012 tablet.cc:1724] T 6cd5cdd42faf4f659b227a00a806c6dc P 883b0e22898a4bf7a51286a04aa3f5df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:11.281484 27699 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "383048ad6752482b980f43745a13a57f"
dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
 from {username='slave'} at 127.0.0.1:53838
I20260709 12:26:11.282226 27699 raft_consensus.cc:493] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:11.282658 27699 raft_consensus.cc:3060] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:11.297756 27451 catalog_manager.cc:5789] TS 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639) does not have the latest schema for tablet fb853c5fe6294ec59d55191cc58ef949 (table soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]). Expected version 1 got 0
I20260709 12:26:11.299072 27451 catalog_manager.cc:5789] TS 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639) does not have the latest schema for tablet 6cd5cdd42faf4f659b227a00a806c6dc (table soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]). Expected version 1 got 0
I20260709 12:26:11.300604 27451 catalog_manager.cc:5789] TS 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639) does not have the latest schema for tablet 8b10b7feeaa94428bbbfb9602eadcf8d (table soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]). Expected version 1 got 0
I20260709 12:26:11.306209 27448 catalog_manager.cc:5789] TS adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495) does not have the latest schema for tablet 383048ad6752482b980f43745a13a57f (table soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0]). Expected version 1 got 0
I20260709 12:26:11.307610 27984 tablet.cc:1724] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:11.328373 27999 tablet.cc:1724] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:11.368271 28009 tablet.cc:1724] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:11.375977 28004 tablet.cc:1724] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:11.393400 27629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f50f55a9615446939b227473f73e7809"
dest_uuid: "14900064b421439bb3283d698937fdc3"
mode: GRACEFUL
new_leader_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
 from {username='slave'} at 127.0.0.1:39304
I20260709 12:26:11.394304 27629 raft_consensus.cc:606] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [term 2 LEADER]: Received request to transfer leadership to TS 883b0e22898a4bf7a51286a04aa3f5df
I20260709 12:26:11.397442 17346 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:26:11.398166 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:11.401254 28005 tablet.cc:1724] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:11.387615 27699 raft_consensus.cc:515] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:11.408113 27988 tablet.cc:1724] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:11.408854 27699 leader_election.cc:290] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 2 election: Requested vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639)
I20260709 12:26:11.409824 27551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383048ad6752482b980f43745a13a57f" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:11.410658 27551 raft_consensus.cc:3055] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:11.411068 27551 raft_consensus.cc:740] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Running, Role: LEADER
I20260709 12:26:11.410460 28014 tablet.cc:1724] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:11.411890 27629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383048ad6752482b980f43745a13a57f" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "14900064b421439bb3283d698937fdc3"
I20260709 12:26:11.412544 27629 raft_consensus.cc:3060] T 383048ad6752482b980f43745a13a57f P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:11.412232 27551 consensus_queue.cc:260] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:11.413595 27551 raft_consensus.cc:3060] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:11.432750 28011 tablet.cc:1724] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:11.435787 27988 tablet.cc:1724] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:11.441861 27999 tablet.cc:1724] T fb853c5fe6294ec59d55191cc58ef949 P 883b0e22898a4bf7a51286a04aa3f5df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:11.446353 28012 tablet.cc:1724] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:11.448889 27998 tablet.cc:1724] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:11.463073 27629 raft_consensus.cc:2468] T 383048ad6752482b980f43745a13a57f P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 2.
I20260709 12:26:11.464071 27551 raft_consensus.cc:2468] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 2.
I20260709 12:26:11.471232 27668 leader_election.cc:304] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, 883b0e22898a4bf7a51286a04aa3f5df; no voters: 
I20260709 12:26:11.473603 28006 raft_consensus.cc:2804] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:11.474100 28006 raft_consensus.cc:697] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df [term 2 LEADER]: Becoming Leader. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Running, Role: LEADER
I20260709 12:26:11.475044 28006 consensus_queue.cc:237] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:11.480747 27629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dc0d183a72448c19e920e6369670b15"
dest_uuid: "14900064b421439bb3283d698937fdc3"
mode: GRACEFUL
new_leader_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
 from {username='slave'} at 127.0.0.1:39304
I20260709 12:26:11.482645 27629 raft_consensus.cc:606] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Received request to transfer leadership to TS 883b0e22898a4bf7a51286a04aa3f5df
I20260709 12:26:11.502331 27551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fffd970e02a74e58b67547bbd3bcb349"
dest_uuid: "adb2f949f49447f89aa4c72935536a95"
mode: GRACEFUL
new_leader_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
 from {username='slave'} at 127.0.0.1:41440
I20260709 12:26:11.503118 27551 raft_consensus.cc:606] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [term 2 LEADER]: Received request to transfer leadership to TS 883b0e22898a4bf7a51286a04aa3f5df
I20260709 12:26:11.504971 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:11.505640 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:11.518268 27448 catalog_manager.cc:5697] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df reported cstate change: term changed from 1 to 2, leader changed from adb2f949f49447f89aa4c72935536a95 (127.16.240.129) to 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131). New cstate: current_term: 2 leader_uuid: "883b0e22898a4bf7a51286a04aa3f5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.526331 27451 catalog_manager.cc:6242] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36: soft_deleted_table [id=3fbd582c3e914c71bc1033df21d109b0] alter complete (version 1)
I20260709 12:26:11.529982 27978 raft_consensus.cc:993] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3: : Instructing follower 883b0e22898a4bf7a51286a04aa3f5df to start an election
I20260709 12:26:11.530869 27911 raft_consensus.cc:1081] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [term 2 LEADER]: Signalling peer 883b0e22898a4bf7a51286a04aa3f5df to start an election
I20260709 12:26:11.532747 27699 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f50f55a9615446939b227473f73e7809"
dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
 from {username='slave'} at 127.0.0.1:53854
I20260709 12:26:11.533392 27699 raft_consensus.cc:493] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:11.533905 27699 raft_consensus.cc:3060] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:11.539942 27699 raft_consensus.cc:515] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:11.541797 27699 leader_election.cc:290] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 3 election: Requested vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639)
I20260709 12:26:11.542594 27551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50f55a9615446939b227473f73e7809" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:11.542825 27629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50f55a9615446939b227473f73e7809" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "14900064b421439bb3283d698937fdc3"
I20260709 12:26:11.543308 27551 raft_consensus.cc:3060] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:11.543532 27629 raft_consensus.cc:3055] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:11.543905 27629 raft_consensus.cc:740] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 14900064b421439bb3283d698937fdc3, State: Running, Role: LEADER
I20260709 12:26:11.544546 27629 consensus_queue.cc:260] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:11.545547 27629 raft_consensus.cc:3060] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:11.549957 27551 raft_consensus.cc:2468] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 3.
I20260709 12:26:11.550442 27629 raft_consensus.cc:2468] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 3.
I20260709 12:26:11.551820 27668 leader_election.cc:304] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 883b0e22898a4bf7a51286a04aa3f5df, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:11.552655 28006 raft_consensus.cc:2804] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:11.553139 28006 raft_consensus.cc:697] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [term 3 LEADER]: Becoming Leader. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Running, Role: LEADER
I20260709 12:26:11.553946 28006 consensus_queue.cc:237] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:11.562736 27448 catalog_manager.cc:5697] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df reported cstate change: term changed from 2 to 3, leader changed from 14900064b421439bb3283d698937fdc3 (127.16.240.130) to 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131). New cstate: current_term: 3 leader_uuid: "883b0e22898a4bf7a51286a04aa3f5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.668787 27978 raft_consensus.cc:993] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3: : Instructing follower 883b0e22898a4bf7a51286a04aa3f5df to start an election
I20260709 12:26:11.669620 27978 raft_consensus.cc:1081] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Signalling peer 883b0e22898a4bf7a51286a04aa3f5df to start an election
I20260709 12:26:11.672088 27699 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8dc0d183a72448c19e920e6369670b15"
dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
 from {username='slave'} at 127.0.0.1:53854
I20260709 12:26:11.672842 27699 raft_consensus.cc:493] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:11.673359 27699 raft_consensus.cc:3060] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:11.679085 27699 raft_consensus.cc:515] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:11.681048 27699 leader_election.cc:290] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 2 election: Requested vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639)
I20260709 12:26:11.681846 27551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc0d183a72448c19e920e6369670b15" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:11.682117 27629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc0d183a72448c19e920e6369670b15" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14900064b421439bb3283d698937fdc3"
I20260709 12:26:11.682499 27551 raft_consensus.cc:3060] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:11.682827 27629 raft_consensus.cc:3055] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:11.683178 27629 raft_consensus.cc:740] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14900064b421439bb3283d698937fdc3, State: Running, Role: LEADER
I20260709 12:26:11.683934 27629 consensus_queue.cc:260] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:11.684985 27629 raft_consensus.cc:3060] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:11.688513 27551 raft_consensus.cc:2468] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 2.
I20260709 12:26:11.689963 27668 leader_election.cc:304] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 883b0e22898a4bf7a51286a04aa3f5df, adb2f949f49447f89aa4c72935536a95; no voters: 
I20260709 12:26:11.690280 27629 raft_consensus.cc:2468] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 2.
I20260709 12:26:11.691133 28006 raft_consensus.cc:2804] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:11.691584 28006 raft_consensus.cc:697] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 LEADER]: Becoming Leader. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Running, Role: LEADER
I20260709 12:26:11.692458 28006 consensus_queue.cc:237] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:11.699683 27448 catalog_manager.cc:5697] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df reported cstate change: term changed from 1 to 2, leader changed from 14900064b421439bb3283d698937fdc3 (127.16.240.130) to 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131). New cstate: current_term: 2 leader_uuid: "883b0e22898a4bf7a51286a04aa3f5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.878213 27941 raft_consensus.cc:993] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95: : Instructing follower 883b0e22898a4bf7a51286a04aa3f5df to start an election
I20260709 12:26:11.878772 27941 raft_consensus.cc:1081] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [term 2 LEADER]: Signalling peer 883b0e22898a4bf7a51286a04aa3f5df to start an election
I20260709 12:26:11.880421 27701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fffd970e02a74e58b67547bbd3bcb349"
dest_uuid: "883b0e22898a4bf7a51286a04aa3f5df"
 from {username='slave'} at 127.0.0.1:53838
I20260709 12:26:11.880885 27701 raft_consensus.cc:493] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:11.881146 27701 raft_consensus.cc:3060] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:11.887208 27701 raft_consensus.cc:515] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:11.888981 27701 leader_election.cc:290] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 3 election: Requested vote from peers adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495), 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639)
I20260709 12:26:11.890070 27551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffd970e02a74e58b67547bbd3bcb349" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "adb2f949f49447f89aa4c72935536a95"
I20260709 12:26:11.890759 27551 raft_consensus.cc:3055] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:11.890798 27629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffd970e02a74e58b67547bbd3bcb349" candidate_uuid: "883b0e22898a4bf7a51286a04aa3f5df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "14900064b421439bb3283d698937fdc3"
I20260709 12:26:11.891229 27551 raft_consensus.cc:740] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adb2f949f49447f89aa4c72935536a95, State: Running, Role: LEADER
I20260709 12:26:11.891608 27629 raft_consensus.cc:3060] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:11.892364 27551 consensus_queue.cc:260] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:11.893810 27551 raft_consensus.cc:3060] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:11.899539 27629 raft_consensus.cc:2468] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 3.
I20260709 12:26:11.900874 27668 leader_election.cc:304] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14900064b421439bb3283d698937fdc3, 883b0e22898a4bf7a51286a04aa3f5df; no voters: 
I20260709 12:26:11.901257 27551 raft_consensus.cc:2468] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 883b0e22898a4bf7a51286a04aa3f5df in term 3.
I20260709 12:26:11.901924 28006 raft_consensus.cc:2804] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:11.902455 28006 raft_consensus.cc:697] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 3 LEADER]: Becoming Leader. State: Replica: 883b0e22898a4bf7a51286a04aa3f5df, State: Running, Role: LEADER
I20260709 12:26:11.903359 28006 consensus_queue.cc:237] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } }
I20260709 12:26:11.912074 27448 catalog_manager.cc:5697] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df reported cstate change: term changed from 2 to 3, leader changed from adb2f949f49447f89aa4c72935536a95 (127.16.240.129) to 883b0e22898a4bf7a51286a04aa3f5df (127.16.240.131). New cstate: current_term: 3 leader_uuid: "883b0e22898a4bf7a51286a04aa3f5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "883b0e22898a4bf7a51286a04aa3f5df" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 32823 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.979902 27551 raft_consensus.cc:1275] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Refusing update from remote peer 883b0e22898a4bf7a51286a04aa3f5df: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:11.981439 28006 consensus_queue.cc:1048] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:11.990636 27629 raft_consensus.cc:1275] T 383048ad6752482b980f43745a13a57f P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Refusing update from remote peer 883b0e22898a4bf7a51286a04aa3f5df: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:11.992023 28006 consensus_queue.cc:1048] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:26:12.081982 27552 raft_consensus.cc:1275] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 3 FOLLOWER]: Refusing update from remote peer 883b0e22898a4bf7a51286a04aa3f5df: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:12.083228 27939 consensus_queue.cc:1048] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:12.093211 27629 raft_consensus.cc:1275] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [term 3 FOLLOWER]: Refusing update from remote peer 883b0e22898a4bf7a51286a04aa3f5df: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:12.099735 28006 consensus_queue.cc:1048] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:12.180861 27552 raft_consensus.cc:1275] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Refusing update from remote peer 883b0e22898a4bf7a51286a04aa3f5df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:12.182523 28006 consensus_queue.cc:1048] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.193998 27629 raft_consensus.cc:1275] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Refusing update from remote peer 883b0e22898a4bf7a51286a04aa3f5df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:12.196978 27939 consensus_queue.cc:1048] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.479936 27629 raft_consensus.cc:1275] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3 [term 3 FOLLOWER]: Refusing update from remote peer 883b0e22898a4bf7a51286a04aa3f5df: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:12.481344 27939 consensus_queue.cc:1048] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "14900064b421439bb3283d698937fdc3" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:12.491214 27552 raft_consensus.cc:1275] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [term 3 FOLLOWER]: Refusing update from remote peer 883b0e22898a4bf7a51286a04aa3f5df: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:12.492843 27939 consensus_queue.cc:1048] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb2f949f49447f89aa4c72935536a95" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:12.506829 17346 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:12.517684 17346 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:12.519021 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:12.527806 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:12.528411 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:13.529536 17346 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:13.534943 17346 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:13.535497 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:13.544180 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:13.544910 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:14.546159 17346 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:14.552414 17346 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:14.553068 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:14.560650 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:14.561257 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:15.562330 17346 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:15.567818 17346 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:15.568220 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:15.572955 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:15.573338 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:16.574534 17346 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:16.579916 17346 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:16.580315 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:16.586848 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:16.587518 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:17.588842 17346 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:17.594534 17346 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:17.594954 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:17.601481 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:17.602097 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:18.603549 17346 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:18.610472 17346 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:18.610899 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:18.618479 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:18.618932 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:19.620285 17346 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:19.625391 17346 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:19.625814 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:19.630527 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:19.630923 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:20.632176 17346 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:20.638383 17346 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:20.639091 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:20.644517 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:20.644948 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:21.718616 17346 tablet_server.cc:179] TabletServer@127.16.240.129:0 shutting down...
W20260709 12:26:21.766642 27594 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
I20260709 12:26:21.767500 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:21.768959 17346 tablet_replica.cc:333] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95: stopping tablet replica
I20260709 12:26:21.770300 17346 raft_consensus.cc:2243] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:26:21.771970 27594 consensus_peers.cc:597] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 -> Peer adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495): Couldn't send request to peer adb2f949f49447f89aa4c72935536a95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:21.772408 17346 raft_consensus.cc:2272] T 67a9888378254e8f91be48bd536f3c40 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.776037 17346 tablet_replica.cc:333] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95: stopping tablet replica
I20260709 12:26:21.777141 17346 raft_consensus.cc:2243] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:21.778056 17346 raft_consensus.cc:2272] T 8002a467593c4b4a8f43a0df5fbc6ce9 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.781867 17346 tablet_replica.cc:333] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95: stopping tablet replica
I20260709 12:26:21.782727 17346 raft_consensus.cc:2243] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:21.783380 17346 raft_consensus.cc:2272] T fb853c5fe6294ec59d55191cc58ef949 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.787673 17346 tablet_replica.cc:333] T 6cd5cdd42faf4f659b227a00a806c6dc P adb2f949f49447f89aa4c72935536a95: stopping tablet replica
I20260709 12:26:21.788558 17346 raft_consensus.cc:2243] T 6cd5cdd42faf4f659b227a00a806c6dc P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:21.789204 17346 raft_consensus.cc:2272] T 6cd5cdd42faf4f659b227a00a806c6dc P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.792114 17346 tablet_replica.cc:333] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95: stopping tablet replica
I20260709 12:26:21.792909 17346 raft_consensus.cc:2243] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:21.793634 17346 raft_consensus.cc:2272] T 383048ad6752482b980f43745a13a57f P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.796540 17346 tablet_replica.cc:333] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95: stopping tablet replica
I20260709 12:26:21.797176 17346 raft_consensus.cc:2243] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:21.798192 17346 raft_consensus.cc:2272] T 87caca536d094157b02aa19b6a42ee99 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.800843 17346 tablet_replica.cc:333] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95: stopping tablet replica
I20260709 12:26:21.801504 17346 raft_consensus.cc:2243] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:21.802167 17346 raft_consensus.cc:2272] T f50f55a9615446939b227473f73e7809 P adb2f949f49447f89aa4c72935536a95 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.804898 17346 tablet_replica.cc:333] T 6b7edee8e2d44a0097910a246ebe4255 P adb2f949f49447f89aa4c72935536a95: stopping tablet replica
I20260709 12:26:21.805559 17346 raft_consensus.cc:2243] T 6b7edee8e2d44a0097910a246ebe4255 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:21.806102 17346 raft_consensus.cc:2272] T 6b7edee8e2d44a0097910a246ebe4255 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.808809 17346 tablet_replica.cc:333] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95: stopping tablet replica
I20260709 12:26:21.809415 17346 raft_consensus.cc:2243] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:21.810436 17346 raft_consensus.cc:2272] T 447b7a52ac2548b486ad0cbe53a3b89e P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.813619 17346 tablet_replica.cc:333] T 25d4d57609d4490daefbd04d78dca235 P adb2f949f49447f89aa4c72935536a95: stopping tablet replica
I20260709 12:26:21.814396 17346 raft_consensus.cc:2243] T 25d4d57609d4490daefbd04d78dca235 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:21.815223 17346 raft_consensus.cc:2272] T 25d4d57609d4490daefbd04d78dca235 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.818805 17346 tablet_replica.cc:333] T b67abb18d5c047fa90bb2bc94494aaac P adb2f949f49447f89aa4c72935536a95: stopping tablet replica
I20260709 12:26:21.819551 17346 raft_consensus.cc:2243] T b67abb18d5c047fa90bb2bc94494aaac P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:21.820130 17346 raft_consensus.cc:2272] T b67abb18d5c047fa90bb2bc94494aaac P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.822676 17346 tablet_replica.cc:333] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95: stopping tablet replica
I20260709 12:26:21.823341 17346 raft_consensus.cc:2243] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:21.824599 17346 raft_consensus.cc:2272] T 882e2b233ed7404993be05bfd6bcd10f P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.827438 17346 tablet_replica.cc:333] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95: stopping tablet replica
I20260709 12:26:21.828076 17346 raft_consensus.cc:2243] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:21.829030 17346 raft_consensus.cc:2272] T 64512827e5014d88a48f42d23ebbdbfb P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.831581 17346 tablet_replica.cc:333] T ccdbd0761f0e4f40bb624499866a1489 P adb2f949f49447f89aa4c72935536a95: stopping tablet replica
I20260709 12:26:21.832219 17346 raft_consensus.cc:2243] T ccdbd0761f0e4f40bb624499866a1489 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:21.832680 17346 raft_consensus.cc:2272] T ccdbd0761f0e4f40bb624499866a1489 P adb2f949f49447f89aa4c72935536a95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.835063 17346 tablet_replica.cc:333] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95: stopping tablet replica
I20260709 12:26:21.835584 17346 raft_consensus.cc:2243] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:21.836593 17346 raft_consensus.cc:2272] T 7d11155c16cb45c3b96bd3b3b3f98a91 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.839672 17346 tablet_replica.cc:333] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95: stopping tablet replica
I20260709 12:26:21.840334 17346 raft_consensus.cc:2243] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:21.841135 17346 raft_consensus.cc:2272] T 8dc0d183a72448c19e920e6369670b15 P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.844321 17346 tablet_replica.cc:333] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95: stopping tablet replica
I20260709 12:26:21.844923 17346 raft_consensus.cc:2243] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:21.845461 17346 raft_consensus.cc:2272] T fffd970e02a74e58b67547bbd3bcb349 P adb2f949f49447f89aa4c72935536a95 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.848234 17346 tablet_replica.cc:333] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95: stopping tablet replica
I20260709 12:26:21.848718 17346 raft_consensus.cc:2243] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:21.849277 17346 raft_consensus.cc:2272] T 8b10b7feeaa94428bbbfb9602eadcf8d P adb2f949f49447f89aa4c72935536a95 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:21.865449 27594 consensus_peers.cc:597] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 -> Peer adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495): Couldn't send request to peer adb2f949f49447f89aa4c72935536a95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:21.884500 27668 consensus_peers.cc:597] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df -> Peer adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495): Couldn't send request to peer adb2f949f49447f89aa4c72935536a95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:21.905364 17346 tablet_server.cc:196] TabletServer@127.16.240.129:0 shutdown complete.
W20260709 12:26:21.952775 27594 consensus_peers.cc:597] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 -> Peer adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495): Couldn't send request to peer adb2f949f49447f89aa4c72935536a95. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:43495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:21.953507 27594 consensus_peers.cc:597] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 -> Peer adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495): Couldn't send request to peer adb2f949f49447f89aa4c72935536a95. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:43495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:21.960933 17346 tablet_server.cc:179] TabletServer@127.16.240.130:0 shutting down...
W20260709 12:26:21.982734 27668 consensus_peers.cc:597] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df -> Peer adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495): Couldn't send request to peer adb2f949f49447f89aa4c72935536a95. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:43495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:21.997771 27668 consensus_peers.cc:597] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df -> Peer 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639): Couldn't send request to peer 14900064b421439bb3283d698937fdc3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:22.005366 27668 consensus_peers.cc:597] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df -> Peer 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639): Couldn't send request to peer 14900064b421439bb3283d698937fdc3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:22.007946 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:22.008726 17346 tablet_replica.cc:333] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3: stopping tablet replica
I20260709 12:26:22.009635 17346 raft_consensus.cc:2243] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.010470 17346 raft_consensus.cc:2272] T 67a9888378254e8f91be48bd536f3c40 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.013470 17346 tablet_replica.cc:333] T 87caca536d094157b02aa19b6a42ee99 P 14900064b421439bb3283d698937fdc3: stopping tablet replica
I20260709 12:26:22.014269 17346 raft_consensus.cc:2243] T 87caca536d094157b02aa19b6a42ee99 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.015069 17346 raft_consensus.cc:2272] T 87caca536d094157b02aa19b6a42ee99 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:22.015416 27668 consensus_peers.cc:597] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df -> Peer adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495): Couldn't send request to peer adb2f949f49447f89aa4c72935536a95. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:43495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:22.018873 17346 tablet_replica.cc:333] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3: stopping tablet replica
I20260709 12:26:22.019811 17346 raft_consensus.cc:2243] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:22.020967 17346 raft_consensus.cc:2272] T fb853c5fe6294ec59d55191cc58ef949 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.023658 17346 tablet_replica.cc:333] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3: stopping tablet replica
I20260709 12:26:22.024426 17346 raft_consensus.cc:2243] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.025040 17346 raft_consensus.cc:2272] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.028108 17346 tablet_replica.cc:333] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3: stopping tablet replica
I20260709 12:26:22.028772 17346 raft_consensus.cc:2243] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:22.029809 17346 raft_consensus.cc:2272] T 6cd5cdd42faf4f659b227a00a806c6dc P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.033473 17346 tablet_replica.cc:333] T 383048ad6752482b980f43745a13a57f P 14900064b421439bb3283d698937fdc3: stopping tablet replica
I20260709 12:26:22.034267 17346 raft_consensus.cc:2243] T 383048ad6752482b980f43745a13a57f P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.034987 17346 raft_consensus.cc:2272] T 383048ad6752482b980f43745a13a57f P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:22.037369 27594 consensus_peers.cc:597] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3 -> Peer adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495): Couldn't send request to peer adb2f949f49447f89aa4c72935536a95. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:43495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:22.038085 17346 tablet_replica.cc:333] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3: stopping tablet replica
I20260709 12:26:22.038787 17346 raft_consensus.cc:2243] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.039335 17346 raft_consensus.cc:2272] T f50f55a9615446939b227473f73e7809 P 14900064b421439bb3283d698937fdc3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.041836 17346 tablet_replica.cc:333] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3: stopping tablet replica
I20260709 12:26:22.042651 17346 raft_consensus.cc:2243] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:22.043682 17346 raft_consensus.cc:2272] T 6b7edee8e2d44a0097910a246ebe4255 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.046440 17346 tablet_replica.cc:333] T 447b7a52ac2548b486ad0cbe53a3b89e P 14900064b421439bb3283d698937fdc3: stopping tablet replica
I20260709 12:26:22.047086 17346 raft_consensus.cc:2243] T 447b7a52ac2548b486ad0cbe53a3b89e P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.047688 17346 raft_consensus.cc:2272] T 447b7a52ac2548b486ad0cbe53a3b89e P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.051177 17346 tablet_replica.cc:333] T 64512827e5014d88a48f42d23ebbdbfb P 14900064b421439bb3283d698937fdc3: stopping tablet replica
I20260709 12:26:22.052078 17346 raft_consensus.cc:2243] T 64512827e5014d88a48f42d23ebbdbfb P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.052654 17346 raft_consensus.cc:2272] T 64512827e5014d88a48f42d23ebbdbfb P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.055613 17346 tablet_replica.cc:333] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3: stopping tablet replica
I20260709 12:26:22.056484 17346 raft_consensus.cc:2243] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:22.058157 17346 raft_consensus.cc:2272] T ccdbd0761f0e4f40bb624499866a1489 P 14900064b421439bb3283d698937fdc3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:22.060290 27668 consensus_peers.cc:597] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df -> Peer adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495): Couldn't send request to peer adb2f949f49447f89aa4c72935536a95. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:43495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:22.061892 17346 tablet_replica.cc:333] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3: stopping tablet replica
I20260709 12:26:22.062541 17346 raft_consensus.cc:2243] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:22.063457 17346 raft_consensus.cc:2272] T 25d4d57609d4490daefbd04d78dca235 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.066244 17346 tablet_replica.cc:333] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3: stopping tablet replica
I20260709 12:26:22.066936 17346 raft_consensus.cc:2243] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.067526 17346 raft_consensus.cc:2272] T 882e2b233ed7404993be05bfd6bcd10f P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.070792 17346 tablet_replica.cc:333] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3: stopping tablet replica
I20260709 12:26:22.071415 17346 raft_consensus.cc:2243] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.072113 17346 raft_consensus.cc:2272] T b67abb18d5c047fa90bb2bc94494aaac P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.074582 17346 tablet_replica.cc:333] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 14900064b421439bb3283d698937fdc3: stopping tablet replica
I20260709 12:26:22.075204 17346 raft_consensus.cc:2243] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.075819 17346 raft_consensus.cc:2272] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.078469 17346 tablet_replica.cc:333] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3: stopping tablet replica
I20260709 12:26:22.079059 17346 raft_consensus.cc:2243] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.079628 17346 raft_consensus.cc:2272] T 8dc0d183a72448c19e920e6369670b15 P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.082363 17346 tablet_replica.cc:333] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3: stopping tablet replica
I20260709 12:26:22.083156 17346 raft_consensus.cc:2243] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.083848 17346 raft_consensus.cc:2272] T fffd970e02a74e58b67547bbd3bcb349 P 14900064b421439bb3283d698937fdc3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:22.086376 27668 consensus_peers.cc:597] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df -> Peer adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495): Couldn't send request to peer adb2f949f49447f89aa4c72935536a95. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:43495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:22.087100 17346 tablet_replica.cc:333] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3: stopping tablet replica
I20260709 12:26:22.087644 17346 raft_consensus.cc:2243] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:22.088799 17346 raft_consensus.cc:2272] T 8b10b7feeaa94428bbbfb9602eadcf8d P 14900064b421439bb3283d698937fdc3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:22.141206 27668 consensus_peers.cc:597] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df -> Peer 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639): Couldn't send request to peer 14900064b421439bb3283d698937fdc3. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:34639: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:22.152110 27668 consensus_peers.cc:597] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df -> Peer 14900064b421439bb3283d698937fdc3 (127.16.240.130:34639): Couldn't send request to peer 14900064b421439bb3283d698937fdc3. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:34639: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:22.170365 17346 tablet_server.cc:196] TabletServer@127.16.240.130:0 shutdown complete.
I20260709 12:26:22.213455 17346 tablet_server.cc:179] TabletServer@127.16.240.131:0 shutting down...
W20260709 12:26:22.236074 27668 consensus_peers.cc:597] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df -> Peer adb2f949f49447f89aa4c72935536a95 (127.16.240.129:43495): Couldn't send request to peer adb2f949f49447f89aa4c72935536a95. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:43495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:22.253258 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:22.254062 17346 tablet_replica.cc:333] T fb853c5fe6294ec59d55191cc58ef949 P 883b0e22898a4bf7a51286a04aa3f5df: stopping tablet replica
I20260709 12:26:22.255216 17346 raft_consensus.cc:2243] T fb853c5fe6294ec59d55191cc58ef949 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.256253 17346 raft_consensus.cc:2272] T fb853c5fe6294ec59d55191cc58ef949 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.259084 17346 tablet_replica.cc:333] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df: stopping tablet replica
I20260709 12:26:22.259807 17346 raft_consensus.cc:2243] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:22.260805 17346 raft_consensus.cc:2272] T 8002a467593c4b4a8f43a0df5fbc6ce9 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.263443 17346 tablet_replica.cc:333] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df: stopping tablet replica
I20260709 12:26:22.264241 17346 raft_consensus.cc:2243] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.264861 17346 raft_consensus.cc:2272] T 67a9888378254e8f91be48bd536f3c40 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.267445 17346 tablet_replica.cc:333] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df: stopping tablet replica
I20260709 12:26:22.268208 17346 raft_consensus.cc:2243] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:22.269215 17346 raft_consensus.cc:2272] T 383048ad6752482b980f43745a13a57f P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.272003 17346 tablet_replica.cc:333] T 6cd5cdd42faf4f659b227a00a806c6dc P 883b0e22898a4bf7a51286a04aa3f5df: stopping tablet replica
I20260709 12:26:22.272609 17346 raft_consensus.cc:2243] T 6cd5cdd42faf4f659b227a00a806c6dc P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.273217 17346 raft_consensus.cc:2272] T 6cd5cdd42faf4f659b227a00a806c6dc P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.275707 17346 tablet_replica.cc:333] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df: stopping tablet replica
I20260709 12:26:22.276394 17346 raft_consensus.cc:2243] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.277431 17346 raft_consensus.cc:2272] T 8b10b7feeaa94428bbbfb9602eadcf8d P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.280381 17346 tablet_replica.cc:333] T 447b7a52ac2548b486ad0cbe53a3b89e P 883b0e22898a4bf7a51286a04aa3f5df: stopping tablet replica
I20260709 12:26:22.281113 17346 raft_consensus.cc:2243] T 447b7a52ac2548b486ad0cbe53a3b89e P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.281741 17346 raft_consensus.cc:2272] T 447b7a52ac2548b486ad0cbe53a3b89e P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.284250 17346 tablet_replica.cc:333] T 6b7edee8e2d44a0097910a246ebe4255 P 883b0e22898a4bf7a51286a04aa3f5df: stopping tablet replica
I20260709 12:26:22.284837 17346 raft_consensus.cc:2243] T 6b7edee8e2d44a0097910a246ebe4255 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.285398 17346 raft_consensus.cc:2272] T 6b7edee8e2d44a0097910a246ebe4255 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.287814 17346 tablet_replica.cc:333] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df: stopping tablet replica
I20260709 12:26:22.288437 17346 raft_consensus.cc:2243] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:22.289417 17346 raft_consensus.cc:2272] T f50f55a9615446939b227473f73e7809 P 883b0e22898a4bf7a51286a04aa3f5df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.291935 17346 tablet_replica.cc:333] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df: stopping tablet replica
I20260709 12:26:22.292550 17346 raft_consensus.cc:2243] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.293071 17346 raft_consensus.cc:2272] T 87caca536d094157b02aa19b6a42ee99 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.295984 17346 tablet_replica.cc:333] T ccdbd0761f0e4f40bb624499866a1489 P 883b0e22898a4bf7a51286a04aa3f5df: stopping tablet replica
I20260709 12:26:22.296630 17346 raft_consensus.cc:2243] T ccdbd0761f0e4f40bb624499866a1489 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.297139 17346 raft_consensus.cc:2272] T ccdbd0761f0e4f40bb624499866a1489 P 883b0e22898a4bf7a51286a04aa3f5df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.300283 17346 tablet_replica.cc:333] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df: stopping tablet replica
I20260709 12:26:22.300900 17346 raft_consensus.cc:2243] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.301421 17346 raft_consensus.cc:2272] T 25d4d57609d4490daefbd04d78dca235 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.303681 17346 tablet_replica.cc:333] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df: stopping tablet replica
I20260709 12:26:22.304286 17346 raft_consensus.cc:2243] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.304777 17346 raft_consensus.cc:2272] T 64512827e5014d88a48f42d23ebbdbfb P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.307098 17346 tablet_replica.cc:333] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df: stopping tablet replica
I20260709 12:26:22.307668 17346 raft_consensus.cc:2243] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.308179 17346 raft_consensus.cc:2272] T 882e2b233ed7404993be05bfd6bcd10f P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.310593 17346 tablet_replica.cc:333] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df: stopping tablet replica
I20260709 12:26:22.311309 17346 raft_consensus.cc:2243] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:22.312233 17346 raft_consensus.cc:2272] T b67abb18d5c047fa90bb2bc94494aaac P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.315078 17346 tablet_replica.cc:333] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df: stopping tablet replica
I20260709 12:26:22.315685 17346 raft_consensus.cc:2243] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:22.316762 17346 raft_consensus.cc:2272] T fffd970e02a74e58b67547bbd3bcb349 P 883b0e22898a4bf7a51286a04aa3f5df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.319137 17346 tablet_replica.cc:333] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df: stopping tablet replica
I20260709 12:26:22.319856 17346 raft_consensus.cc:2243] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:22.320971 17346 raft_consensus.cc:2272] T 8dc0d183a72448c19e920e6369670b15 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.323436 17346 tablet_replica.cc:333] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df: stopping tablet replica
I20260709 12:26:22.324060 17346 raft_consensus.cc:2243] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.324590 17346 raft_consensus.cc:2272] T 7d11155c16cb45c3b96bd3b3b3f98a91 P 883b0e22898a4bf7a51286a04aa3f5df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.373605 17346 tablet_server.cc:196] TabletServer@127.16.240.131:0 shutdown complete.
I20260709 12:26:22.415904 17346 master.cc:562] Master@127.16.240.190:36287 shutting down...
I20260709 12:26:22.442891 17346 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:22.443606 17346 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.444020 17346 tablet_replica.cc:333] T 00000000000000000000000000000000 P fcb1b270552441e5a8a441fe80860e36: stopping tablet replica
I20260709 12:26:22.466315 17346 master.cc:584] Master@127.16.240.190:36287 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (22469 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:26:22.530232 17346 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.240.190:36433
I20260709 12:26:22.531497 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:22.537089 28055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:22.537324 28056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:22.545254 17346 server_base.cc:1061] running on GCE node
W20260709 12:26:22.545145 28058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:22.546777 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:22.546980 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:22.547103 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599982547092 us; error 0 us; skew 500 ppm
I20260709 12:26:22.547571 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:22.550480 17346 webserver.cc:533] Webserver started at http://127.16.240.190:41085/ using document root <none> and password file <none>
I20260709 12:26:22.551054 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:22.551313 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:22.551697 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:22.553620 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599638884573-17346-0/minicluster-data/master-0-root/instance:
uuid: "8a06ecf9378b447ca4d131f0019999c5"
format_stamp: "Formatted at 2026-07-09 12:26:22 on dist-test-slave-7xpw"
I20260709 12:26:22.560770 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.008s	sys 0.001s
I20260709 12:26:22.565505 28063 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:22.566404 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:26:22.566676 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599638884573-17346-0/minicluster-data/master-0-root
uuid: "8a06ecf9378b447ca4d131f0019999c5"
format_stamp: "Formatted at 2026-07-09 12:26:22 on dist-test-slave-7xpw"
I20260709 12:26:22.567050 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599638884573-17346-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599638884573-17346-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599638884573-17346-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:22.587201 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:22.588500 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:22.634902 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.190:36433
I20260709 12:26:22.634990 28115 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.190:36433 every 8 connection(s)
I20260709 12:26:22.640151 28116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:22.654532 28116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5: Bootstrap starting.
I20260709 12:26:22.662148 28116 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:22.667374 28116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5: No bootstrap required, opened a new log
I20260709 12:26:22.670394 28116 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a06ecf9378b447ca4d131f0019999c5" member_type: VOTER }
I20260709 12:26:22.670933 28116 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:22.671196 28116 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a06ecf9378b447ca4d131f0019999c5, State: Initialized, Role: FOLLOWER
I20260709 12:26:22.672103 28116 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a06ecf9378b447ca4d131f0019999c5" member_type: VOTER }
I20260709 12:26:22.672626 28116 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:22.672890 28116 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:22.673207 28116 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:22.678680 28116 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a06ecf9378b447ca4d131f0019999c5" member_type: VOTER }
I20260709 12:26:22.679344 28116 leader_election.cc:304] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a06ecf9378b447ca4d131f0019999c5; no voters: 
I20260709 12:26:22.680765 28116 leader_election.cc:290] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:22.681273 28119 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:22.682667 28119 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5 [term 1 LEADER]: Becoming Leader. State: Replica: 8a06ecf9378b447ca4d131f0019999c5, State: Running, Role: LEADER
I20260709 12:26:22.683422 28119 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a06ecf9378b447ca4d131f0019999c5" member_type: VOTER }
I20260709 12:26:22.684127 28116 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:22.688419 28121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a06ecf9378b447ca4d131f0019999c5. Latest consensus state: current_term: 1 leader_uuid: "8a06ecf9378b447ca4d131f0019999c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a06ecf9378b447ca4d131f0019999c5" member_type: VOTER } }
I20260709 12:26:22.689242 28121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:22.691685 28125 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:22.691133 28120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a06ecf9378b447ca4d131f0019999c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a06ecf9378b447ca4d131f0019999c5" member_type: VOTER } }
I20260709 12:26:22.692575 28120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:22.701184 28125 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:22.703184 17346 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:22.712643 28125 catalog_manager.cc:1383] Generated new cluster ID: f482f88cd421405382557377e0f54571
I20260709 12:26:22.712975 28125 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:22.747922 28125 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:22.749379 28125 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:22.767554 28125 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5: Generated new TSK 0
I20260709 12:26:22.768595 28125 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:22.835793 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:22.844537 28137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:22.845135 28138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:22.849737 28140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:22.852452 17346 server_base.cc:1061] running on GCE node
I20260709 12:26:22.854719 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:22.855005 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:22.855202 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599982855176 us; error 0 us; skew 500 ppm
I20260709 12:26:22.855737 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:22.858695 17346 webserver.cc:533] Webserver started at http://127.16.240.129:36445/ using document root <none> and password file <none>
I20260709 12:26:22.859633 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:22.859974 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:22.860273 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:22.861780 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599638884573-17346-0/minicluster-data/ts-0-root/instance:
uuid: "a007a2ab17a240d69915bf88b0d077f4"
format_stamp: "Formatted at 2026-07-09 12:26:22 on dist-test-slave-7xpw"
I20260709 12:26:22.866773 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:26:22.870889 28145 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:22.872046 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:26:22.872394 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599638884573-17346-0/minicluster-data/ts-0-root
uuid: "a007a2ab17a240d69915bf88b0d077f4"
format_stamp: "Formatted at 2026-07-09 12:26:22 on dist-test-slave-7xpw"
I20260709 12:26:22.872776 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599638884573-17346-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599638884573-17346-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599638884573-17346-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:22.884254 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:22.885633 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:22.887217 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:22.890100 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:22.890385 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:22.890933 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:22.891213 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:22.939975 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.129:33263
I20260709 12:26:22.940074 28208 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.129:33263 every 8 connection(s)
I20260709 12:26:22.945019 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:22.953950 28214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:22.954304 28213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:22.957710 17346 server_base.cc:1061] running on GCE node
W20260709 12:26:22.958036 28216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:22.959916 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:22.960199 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:22.960384 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599982960368 us; error 0 us; skew 500 ppm
I20260709 12:26:22.961074 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:22.964833 17346 webserver.cc:533] Webserver started at http://127.16.240.130:44949/ using document root <none> and password file <none>
I20260709 12:26:22.965735 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:22.966015 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:22.966029 28209 heartbeater.cc:344] Connected to a master server at 127.16.240.190:36433
I20260709 12:26:22.966336 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:22.966629 28209 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:22.967451 28209 heartbeater.cc:507] Master 127.16.240.190:36433 requested a full tablet report, sending...
I20260709 12:26:22.968044 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599638884573-17346-0/minicluster-data/ts-1-root/instance:
uuid: "ef5f5a402ae145969aaa2c646aa7676a"
format_stamp: "Formatted at 2026-07-09 12:26:22 on dist-test-slave-7xpw"
I20260709 12:26:22.970348 28081 ts_manager.cc:194] Registered new tserver with Master: a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263)
I20260709 12:26:22.973076 28081 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34664
I20260709 12:26:22.975837 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:22.981432 28221 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:22.982455 17346 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 12:26:22.982820 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599638884573-17346-0/minicluster-data/ts-1-root
uuid: "ef5f5a402ae145969aaa2c646aa7676a"
format_stamp: "Formatted at 2026-07-09 12:26:22 on dist-test-slave-7xpw"
I20260709 12:26:22.983124 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599638884573-17346-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599638884573-17346-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599638884573-17346-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:22.995333 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:22.997155 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:22.998811 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:23.001238 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:23.001499 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:23.001748 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:23.001930 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:23.050289 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.130:34303
I20260709 12:26:23.050423 28283 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.130:34303 every 8 connection(s)
I20260709 12:26:23.055737 17346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:23.065137 28287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:23.068293 28289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:23.076035 28284 heartbeater.cc:344] Connected to a master server at 127.16.240.190:36433
W20260709 12:26:23.076421 28291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:23.077032 28284 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:23.078850 17346 server_base.cc:1061] running on GCE node
I20260709 12:26:23.078959 28284 heartbeater.cc:507] Master 127.16.240.190:36433 requested a full tablet report, sending...
I20260709 12:26:23.080125 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:23.080447 17346 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:23.080677 17346 hybrid_clock.cc:648] HybridClock initialized: now 1783599983080650 us; error 0 us; skew 500 ppm
I20260709 12:26:23.081313 17346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:23.081632 28081 ts_manager.cc:194] Registered new tserver with Master: ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:23.083536 28081 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34668
I20260709 12:26:23.084167 17346 webserver.cc:533] Webserver started at http://127.16.240.131:39659/ using document root <none> and password file <none>
I20260709 12:26:23.084913 17346 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:23.085139 17346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:23.085480 17346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:23.086709 17346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599638884573-17346-0/minicluster-data/ts-2-root/instance:
uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
format_stamp: "Formatted at 2026-07-09 12:26:23 on dist-test-slave-7xpw"
I20260709 12:26:23.091637 17346 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.007s
I20260709 12:26:23.097084 28296 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:23.104271 17346 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:26:23.104842 17346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599638884573-17346-0/minicluster-data/ts-2-root
uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
format_stamp: "Formatted at 2026-07-09 12:26:23 on dist-test-slave-7xpw"
I20260709 12:26:23.105294 17346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599638884573-17346-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599638884573-17346-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599638884573-17346-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:23.119246 17346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:23.120858 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:23.122465 17346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:23.124969 17346 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:23.125213 17346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:23.125500 17346 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:23.125648 17346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:23.175235 17346 rpc_server.cc:307] RPC server started. Bound to: 127.16.240.131:42713
I20260709 12:26:23.175343 28358 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.240.131:42713 every 8 connection(s)
I20260709 12:26:23.192979 28359 heartbeater.cc:344] Connected to a master server at 127.16.240.190:36433
I20260709 12:26:23.193895 28359 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:23.194707 28359 heartbeater.cc:507] Master 127.16.240.190:36433 requested a full tablet report, sending...
I20260709 12:26:23.196897 28081 ts_manager.cc:194] Registered new tserver with Master: 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:23.197813 17346 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017989517s
I20260709 12:26:23.198788 28081 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34682
I20260709 12:26:23.228057 28081 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34684:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:23.231177 28081 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:23.313934 28248 tablet_service.cc:1511] Processing CreateTablet for tablet e4ccd09ed5bc42808c274a7a88028d76 (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:23.316936 28247 tablet_service.cc:1511] Processing CreateTablet for tablet b71b973b042c49ba9466c769a907c2b8 (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:23.320029 28249 tablet_service.cc:1511] Processing CreateTablet for tablet 09cace777e504d84805965eaafee6018 (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:23.320744 28246 tablet_service.cc:1511] Processing CreateTablet for tablet d2b46510cb6842b6ae8df00c91fd7217 (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:23.315685 28248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ccd09ed5bc42808c274a7a88028d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.322227 28246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2b46510cb6842b6ae8df00c91fd7217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.322934 28249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09cace777e504d84805965eaafee6018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.325793 28247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b71b973b042c49ba9466c769a907c2b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.329572 28174 tablet_service.cc:1511] Processing CreateTablet for tablet 09cace777e504d84805965eaafee6018 (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:23.329932 28173 tablet_service.cc:1511] Processing CreateTablet for tablet e4ccd09ed5bc42808c274a7a88028d76 (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:23.331166 28174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09cace777e504d84805965eaafee6018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.332866 28172 tablet_service.cc:1511] Processing CreateTablet for tablet b71b973b042c49ba9466c769a907c2b8 (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:23.334345 28170 tablet_service.cc:1511] Processing CreateTablet for tablet 149bf0909a37428b9e09d5580f6342d0 (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:23.334359 28172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b71b973b042c49ba9466c769a907c2b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.335599 28171 tablet_service.cc:1511] Processing CreateTablet for tablet d2b46510cb6842b6ae8df00c91fd7217 (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:23.337160 28171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2b46510cb6842b6ae8df00c91fd7217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.339537 28173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ccd09ed5bc42808c274a7a88028d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.344182 28170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 149bf0909a37428b9e09d5580f6342d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.359131 28324 tablet_service.cc:1511] Processing CreateTablet for tablet 09cace777e504d84805965eaafee6018 (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:23.361132 28324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09cace777e504d84805965eaafee6018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.361449 28322 tablet_service.cc:1511] Processing CreateTablet for tablet b71b973b042c49ba9466c769a907c2b8 (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:23.362885 28322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b71b973b042c49ba9466c769a907c2b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.359102 28323 tablet_service.cc:1511] Processing CreateTablet for tablet e4ccd09ed5bc42808c274a7a88028d76 (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:23.364672 28323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ccd09ed5bc42808c274a7a88028d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.369110 28321 tablet_service.cc:1511] Processing CreateTablet for tablet d2b46510cb6842b6ae8df00c91fd7217 (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:23.372920 28321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2b46510cb6842b6ae8df00c91fd7217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.378676 28245 tablet_service.cc:1511] Processing CreateTablet for tablet 149bf0909a37428b9e09d5580f6342d0 (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:23.381935 28245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 149bf0909a37428b9e09d5580f6342d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.397836 28247 tablet_service.cc:1511] Processing CreateTablet for tablet d085b020751c45dea7e6434ac0bd152b (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:23.399472 28247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d085b020751c45dea7e6434ac0bd152b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.401532 28169 tablet_service.cc:1511] Processing CreateTablet for tablet d085b020751c45dea7e6434ac0bd152b (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:23.403694 28169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d085b020751c45dea7e6434ac0bd152b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.415169 28376 tablet_bootstrap.cc:492] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2: Bootstrap starting.
I20260709 12:26:23.420197 28374 tablet_bootstrap.cc:492] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a: Bootstrap starting.
I20260709 12:26:23.425238 28324 tablet_service.cc:1511] Processing CreateTablet for tablet cbad5c4d8fb6444f880e49cdfec8c39d (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:23.408707 28320 tablet_service.cc:1511] Processing CreateTablet for tablet 149bf0909a37428b9e09d5580f6342d0 (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:23.426772 28324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbad5c4d8fb6444f880e49cdfec8c39d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.405543 28319 tablet_service.cc:1511] Processing CreateTablet for tablet d085b020751c45dea7e6434ac0bd152b (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:23.428028 28319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d085b020751c45dea7e6434ac0bd152b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.411530 28168 tablet_service.cc:1511] Processing CreateTablet for tablet cbad5c4d8fb6444f880e49cdfec8c39d (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:23.431769 28168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbad5c4d8fb6444f880e49cdfec8c39d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.433754 28249 tablet_service.cc:1511] Processing CreateTablet for tablet cbad5c4d8fb6444f880e49cdfec8c39d (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:23.435222 28249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbad5c4d8fb6444f880e49cdfec8c39d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.439608 28320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 149bf0909a37428b9e09d5580f6342d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.451284 28246 tablet_service.cc:1511] Processing CreateTablet for tablet f4749e4e08c14875922b881d4fd5d500 (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:23.452788 28246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4749e4e08c14875922b881d4fd5d500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.455094 28318 tablet_service.cc:1511] Processing CreateTablet for tablet f4749e4e08c14875922b881d4fd5d500 (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:23.456290 28375 tablet_bootstrap.cc:492] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4: Bootstrap starting.
I20260709 12:26:23.451283 28174 tablet_service.cc:1511] Processing CreateTablet for tablet f4749e4e08c14875922b881d4fd5d500 (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:23.456637 28170 tablet_service.cc:1511] Processing CreateTablet for tablet 57ab36077d1643788dabe2f6a3af3488 (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:23.457799 28174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4749e4e08c14875922b881d4fd5d500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.458583 28170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57ab36077d1643788dabe2f6a3af3488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.462819 28374 tablet_bootstrap.cc:654] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.456717 28318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4749e4e08c14875922b881d4fd5d500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.472703 28245 tablet_service.cc:1511] Processing CreateTablet for tablet 57ab36077d1643788dabe2f6a3af3488 (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:23.474189 28245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57ab36077d1643788dabe2f6a3af3488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.489291 28322 tablet_service.cc:1511] Processing CreateTablet for tablet 57ab36077d1643788dabe2f6a3af3488 (DEFAULT_TABLE table=test-workload [id=0082cd154b234b2685a8c8312f8e1a01]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:23.490828 28322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57ab36077d1643788dabe2f6a3af3488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.498144 28375 tablet_bootstrap.cc:654] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.489737 28376 tablet_bootstrap.cc:654] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.527315 28374 tablet_bootstrap.cc:492] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a: No bootstrap required, opened a new log
I20260709 12:26:23.527892 28374 ts_tablet_manager.cc:1403] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.006s
I20260709 12:26:23.530982 28374 raft_consensus.cc:359] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } } peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } }
I20260709 12:26:23.533442 28375 tablet_bootstrap.cc:492] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4: No bootstrap required, opened a new log
I20260709 12:26:23.537016 28375 ts_tablet_manager.cc:1403] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4: Time spent bootstrapping tablet: real 0.081s	user 0.008s	sys 0.005s
I20260709 12:26:23.531733 28374 raft_consensus.cc:385] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:23.540601 28374 raft_consensus.cc:740] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.540455 28375 raft_consensus.cc:359] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } } peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } }
I20260709 12:26:23.541358 28375 raft_consensus.cc:385] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:23.541682 28375 raft_consensus.cc:740] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.542132 28376 tablet_bootstrap.cc:492] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2: No bootstrap required, opened a new log
I20260709 12:26:23.541865 28374 consensus_queue.cc:260] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } } peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } }
I20260709 12:26:23.542438 28375 consensus_queue.cc:260] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } } peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } }
I20260709 12:26:23.542856 28376 ts_tablet_manager.cc:1403] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent bootstrapping tablet: real 0.128s	user 0.010s	sys 0.008s
I20260709 12:26:23.545037 28209 heartbeater.cc:499] Master 127.16.240.190:36433 was elected leader, sending a full tablet report...
I20260709 12:26:23.545557 28375 ts_tablet_manager.cc:1434] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:26:23.546831 28375 tablet_bootstrap.cc:492] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4: Bootstrap starting.
I20260709 12:26:23.547370 28376 raft_consensus.cc:359] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } } peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } }
I20260709 12:26:23.548568 28376 raft_consensus.cc:385] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:23.549131 28376 raft_consensus.cc:740] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.550369 28376 consensus_queue.cc:260] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } } peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } }
I20260709 12:26:23.552124 28284 heartbeater.cc:499] Master 127.16.240.190:36433 was elected leader, sending a full tablet report...
I20260709 12:26:23.553140 28374 ts_tablet_manager.cc:1434] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a: Time spent starting tablet: real 0.025s	user 0.011s	sys 0.004s
I20260709 12:26:23.554795 28374 tablet_bootstrap.cc:492] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a: Bootstrap starting.
W20260709 12:26:23.557588 28285 tablet.cc:2406] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:26:23.564337 28374 tablet_bootstrap.cc:654] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.566794 28375 tablet_bootstrap.cc:654] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.571580 28359 heartbeater.cc:499] Master 127.16.240.190:36433 was elected leader, sending a full tablet report...
I20260709 12:26:23.572527 28376 ts_tablet_manager.cc:1434] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent starting tablet: real 0.029s	user 0.023s	sys 0.006s
I20260709 12:26:23.574038 28376 tablet_bootstrap.cc:492] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2: Bootstrap starting.
I20260709 12:26:23.588366 28374 tablet_bootstrap.cc:492] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a: No bootstrap required, opened a new log
I20260709 12:26:23.589118 28374 ts_tablet_manager.cc:1403] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a: Time spent bootstrapping tablet: real 0.035s	user 0.026s	sys 0.007s
I20260709 12:26:23.589468 28376 tablet_bootstrap.cc:654] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.592769 28374 raft_consensus.cc:359] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.593961 28374 raft_consensus.cc:385] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:23.594440 28374 raft_consensus.cc:740] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.595808 28374 consensus_queue.cc:260] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.599169 28374 ts_tablet_manager.cc:1434] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:26:23.600456 28374 tablet_bootstrap.cc:492] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a: Bootstrap starting.
I20260709 12:26:23.601331 28376 tablet_bootstrap.cc:492] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2: No bootstrap required, opened a new log
I20260709 12:26:23.601928 28376 ts_tablet_manager.cc:1403] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.001s
I20260709 12:26:23.605212 28376 raft_consensus.cc:359] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.606045 28376 raft_consensus.cc:385] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:23.606374 28376 raft_consensus.cc:740] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.607791 28374 tablet_bootstrap.cc:654] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.607534 28376 consensus_queue.cc:260] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.610335 28376 ts_tablet_manager.cc:1434] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:26:23.611828 28376 tablet_bootstrap.cc:492] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2: Bootstrap starting.
I20260709 12:26:23.620219 28374 tablet_bootstrap.cc:492] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a: No bootstrap required, opened a new log
I20260709 12:26:23.621007 28374 ts_tablet_manager.cc:1403] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 12:26:23.621215 28376 tablet_bootstrap.cc:654] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.624799 28374 raft_consensus.cc:359] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.626127 28374 raft_consensus.cc:385] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:23.626596 28374 raft_consensus.cc:740] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.628021 28374 consensus_queue.cc:260] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.631450 28374 ts_tablet_manager.cc:1434] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:26:23.632642 28374 tablet_bootstrap.cc:492] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a: Bootstrap starting.
I20260709 12:26:23.633260 28376 tablet_bootstrap.cc:492] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2: No bootstrap required, opened a new log
I20260709 12:26:23.633850 28376 ts_tablet_manager.cc:1403] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 12:26:23.637220 28376 raft_consensus.cc:359] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.638046 28376 raft_consensus.cc:385] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:23.638362 28376 raft_consensus.cc:740] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.639349 28376 consensus_queue.cc:260] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.640009 28374 tablet_bootstrap.cc:654] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.642135 28376 ts_tablet_manager.cc:1434] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:23.643325 28376 tablet_bootstrap.cc:492] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2: Bootstrap starting.
I20260709 12:26:23.647200 28375 tablet_bootstrap.cc:492] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4: No bootstrap required, opened a new log
I20260709 12:26:23.647935 28375 ts_tablet_manager.cc:1403] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4: Time spent bootstrapping tablet: real 0.102s	user 0.034s	sys 0.045s
I20260709 12:26:23.651819 28376 tablet_bootstrap.cc:654] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.652025 28375 raft_consensus.cc:359] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.652881 28375 raft_consensus.cc:385] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:23.653219 28375 raft_consensus.cc:740] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.653424 28374 tablet_bootstrap.cc:492] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a: No bootstrap required, opened a new log
I20260709 12:26:23.654142 28374 ts_tablet_manager.cc:1403] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 12:26:23.654136 28375 consensus_queue.cc:260] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.657054 28375 ts_tablet_manager.cc:1434] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:26:23.659180 28375 tablet_bootstrap.cc:492] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4: Bootstrap starting.
I20260709 12:26:23.659202 28374 raft_consensus.cc:359] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.660705 28374 raft_consensus.cc:385] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:23.661199 28374 raft_consensus.cc:740] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.662370 28374 consensus_queue.cc:260] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.664258 28376 tablet_bootstrap.cc:492] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2: No bootstrap required, opened a new log
I20260709 12:26:23.664937 28376 ts_tablet_manager.cc:1403] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 12:26:23.666667 28375 tablet_bootstrap.cc:654] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.667996 28374 ts_tablet_manager.cc:1434] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:26:23.668445 28376 raft_consensus.cc:359] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.669305 28376 raft_consensus.cc:385] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:23.669448 28374 tablet_bootstrap.cc:492] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a: Bootstrap starting.
I20260709 12:26:23.669685 28376 raft_consensus.cc:740] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.671012 28376 consensus_queue.cc:260] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.674002 28376 ts_tablet_manager.cc:1434] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:26:23.675374 28376 tablet_bootstrap.cc:492] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2: Bootstrap starting.
I20260709 12:26:23.678395 28374 tablet_bootstrap.cc:654] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.683095 28376 tablet_bootstrap.cc:654] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.689719 28375 tablet_bootstrap.cc:492] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4: No bootstrap required, opened a new log
I20260709 12:26:23.690402 28375 ts_tablet_manager.cc:1403] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.016s
I20260709 12:26:23.693086 28374 tablet_bootstrap.cc:492] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a: No bootstrap required, opened a new log
I20260709 12:26:23.693893 28374 ts_tablet_manager.cc:1403] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.018s
I20260709 12:26:23.693995 28375 raft_consensus.cc:359] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.694841 28375 raft_consensus.cc:385] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:23.695149 28375 raft_consensus.cc:740] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.695267 28376 tablet_bootstrap.cc:492] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2: No bootstrap required, opened a new log
I20260709 12:26:23.695964 28376 ts_tablet_manager.cc:1403] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.009s
I20260709 12:26:23.696187 28375 consensus_queue.cc:260] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
W20260709 12:26:23.697348 28129 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:23.699260 28374 raft_consensus.cc:359] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.699535 28376 raft_consensus.cc:359] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.700325 28374 raft_consensus.cc:385] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:23.700359 28376 raft_consensus.cc:385] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:23.701014 28376 raft_consensus.cc:740] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.701004 28374 raft_consensus.cc:740] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.701862 28375 ts_tablet_manager.cc:1434] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.005s
I20260709 12:26:23.702181 28376 consensus_queue.cc:260] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.702955 28375 tablet_bootstrap.cc:492] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4: Bootstrap starting.
I20260709 12:26:23.702513 28374 consensus_queue.cc:260] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.703832 28381 raft_consensus.cc:493] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.704340 28381 raft_consensus.cc:515] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.705228 28376 ts_tablet_manager.cc:1434] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:26:23.706516 28376 tablet_bootstrap.cc:492] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2: Bootstrap starting.
I20260709 12:26:23.710870 28375 tablet_bootstrap.cc:654] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.713754 28376 tablet_bootstrap.cc:654] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.721014 28381 leader_election.cc:290] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:23.728288 28375 tablet_bootstrap.cc:492] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4: No bootstrap required, opened a new log
I20260709 12:26:23.728967 28375 ts_tablet_manager.cc:1403] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.005s
I20260709 12:26:23.729029 28376 tablet_bootstrap.cc:492] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2: No bootstrap required, opened a new log
I20260709 12:26:23.729347 28374 ts_tablet_manager.cc:1434] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.004s
I20260709 12:26:23.729805 28376 ts_tablet_manager.cc:1403] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.007s
I20260709 12:26:23.730466 28374 tablet_bootstrap.cc:492] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a: Bootstrap starting.
I20260709 12:26:23.732424 28375 raft_consensus.cc:359] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.733202 28375 raft_consensus.cc:385] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:23.733521 28375 raft_consensus.cc:740] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.733590 28376 raft_consensus.cc:359] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.734485 28376 raft_consensus.cc:385] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:23.734428 28375 consensus_queue.cc:260] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.734946 28376 raft_consensus.cc:740] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.736023 28376 consensus_queue.cc:260] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.740164 28375 ts_tablet_manager.cc:1434] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.006s
I20260709 12:26:23.741433 28375 tablet_bootstrap.cc:492] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4: Bootstrap starting.
I20260709 12:26:23.742630 28376 ts_tablet_manager.cc:1434] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.007s
I20260709 12:26:23.743824 28374 tablet_bootstrap.cc:654] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.743933 28376 tablet_bootstrap.cc:492] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2: Bootstrap starting.
I20260709 12:26:23.751719 28376 tablet_bootstrap.cc:654] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.748345 28375 tablet_bootstrap.cc:654] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.758036 28374 tablet_bootstrap.cc:492] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a: No bootstrap required, opened a new log
I20260709 12:26:23.758628 28374 ts_tablet_manager.cc:1403] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.004s
I20260709 12:26:23.762068 28374 raft_consensus.cc:359] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.762243 28334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:23.762926 28374 raft_consensus.cc:385] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:23.763298 28374 raft_consensus.cc:740] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.763473 28334 raft_consensus.cc:2468] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 0.
I20260709 12:26:23.767414 28381 raft_consensus.cc:493] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.768100 28381 raft_consensus.cc:515] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } } peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } }
I20260709 12:26:23.769232 28376 tablet_bootstrap.cc:492] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2: No bootstrap required, opened a new log
I20260709 12:26:23.769943 28376 ts_tablet_manager.cc:1403] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.001s
I20260709 12:26:23.770972 28381 leader_election.cc:290] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713), a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263)
I20260709 12:26:23.773348 28374 consensus_queue.cc:260] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.773341 28376 raft_consensus.cc:359] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.774493 28376 raft_consensus.cc:385] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:23.774809 28376 raft_consensus.cc:740] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.774892 28334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cace777e504d84805965eaafee6018" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:23.775375 28375 tablet_bootstrap.cc:492] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4: No bootstrap required, opened a new log
I20260709 12:26:23.775995 28375 ts_tablet_manager.cc:1403] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.013s
I20260709 12:26:23.775592 28334 raft_consensus.cc:2468] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 0.
I20260709 12:26:23.775733 28376 consensus_queue.cc:260] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.776149 28374 ts_tablet_manager.cc:1434] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 12:26:23.778093 28374 tablet_bootstrap.cc:492] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a: Bootstrap starting.
I20260709 12:26:23.779989 28375 raft_consensus.cc:359] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.781704 28375 raft_consensus.cc:385] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:23.782047 28375 raft_consensus.cc:740] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.783195 28375 consensus_queue.cc:260] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.782015 28376 ts_tablet_manager.cc:1434] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:26:23.786698 28376 tablet_bootstrap.cc:492] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2: Bootstrap starting.
I20260709 12:26:23.786572 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:23.787303 28375 ts_tablet_manager.cc:1434] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:26:23.788241 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cace777e504d84805965eaafee6018" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:23.788525 28375 tablet_bootstrap.cc:492] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4: Bootstrap starting.
I20260709 12:26:23.788954 28183 raft_consensus.cc:2468] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 0.
W20260709 12:26:23.791326 28223 leader_election.cc:343] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:23.792245 28380 raft_consensus.cc:493] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.792354 28223 leader_election.cc:304] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:23.792915 28380 raft_consensus.cc:515] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.795217 28376 tablet_bootstrap.cc:654] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.797197 28375 tablet_bootstrap.cc:654] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.800132 28380 leader_election.cc:290] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:23.815284 28374 tablet_bootstrap.cc:654] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.813396 28381 raft_consensus.cc:493] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.826241 28380 raft_consensus.cc:493] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.824957 28381 raft_consensus.cc:515] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.836094 28381 leader_election.cc:290] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:23.836792 28381 raft_consensus.cc:2804] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:23.837133 28381 raft_consensus.cc:493] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:23.837477 28381 raft_consensus.cc:3060] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:23.832093 28380 raft_consensus.cc:515] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.839475 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71b973b042c49ba9466c769a907c2b8" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:23.840204 28183 raft_consensus.cc:2468] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 0.
I20260709 12:26:23.841748 28380 leader_election.cc:290] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:23.842578 28224 leader_election.cc:304] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:23.843463 28400 raft_consensus.cc:493] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.843850 28223 leader_election.cc:304] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:23.844056 28400 raft_consensus.cc:515] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.845810 28401 raft_consensus.cc:2804] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:23.846354 28400 leader_election.cc:290] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:23.846930 28376 tablet_bootstrap.cc:492] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2: No bootstrap required, opened a new log
I20260709 12:26:23.847451 28376 ts_tablet_manager.cc:1403] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent bootstrapping tablet: real 0.061s	user 0.029s	sys 0.012s
I20260709 12:26:23.848409 28375 tablet_bootstrap.cc:492] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4: No bootstrap required, opened a new log
I20260709 12:26:23.849359 28375 ts_tablet_manager.cc:1403] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4: Time spent bootstrapping tablet: real 0.061s	user 0.025s	sys 0.000s
I20260709 12:26:23.850579 28376 raft_consensus.cc:359] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.851738 28376 raft_consensus.cc:385] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:23.846941 28400 raft_consensus.cc:2804] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:23.852273 28376 raft_consensus.cc:740] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.852916 28400 raft_consensus.cc:493] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:23.853293 28400 raft_consensus.cc:3060] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:23.853752 28376 consensus_queue.cc:260] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.846367 28401 raft_consensus.cc:493] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:23.854827 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "149bf0909a37428b9e09d5580f6342d0" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:23.855270 28401 raft_consensus.cc:3060] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:23.855716 28183 raft_consensus.cc:2468] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 0.
I20260709 12:26:23.857035 28376 ts_tablet_manager.cc:1434] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:26:23.858299 28376 tablet_bootstrap.cc:492] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2: Bootstrap starting.
I20260709 12:26:23.858839 28333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "149bf0909a37428b9e09d5580f6342d0" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:23.859632 28333 raft_consensus.cc:2468] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 0.
I20260709 12:26:23.860198 28334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbad5c4d8fb6444f880e49cdfec8c39d" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:23.860888 28334 raft_consensus.cc:2468] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 0.
I20260709 12:26:23.861312 28148 leader_election.cc:304] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: 
I20260709 12:26:23.862453 28380 raft_consensus.cc:2804] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:23.862852 28380 raft_consensus.cc:493] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:23.863387 28380 raft_consensus.cc:3060] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:23.864848 28376 tablet_bootstrap.cc:654] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.867785 28148 leader_election.cc:304] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: 
I20260709 12:26:23.869457 28223 leader_election.cc:304] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:23.869475 28401 raft_consensus.cc:515] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.872527 28401 leader_election.cc:290] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:23.873787 28401 raft_consensus.cc:2804] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:23.874167 28401 raft_consensus.cc:493] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:23.874094 28381 raft_consensus.cc:515] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } } peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } }
I20260709 12:26:23.874732 28401 raft_consensus.cc:3060] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:23.874689 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:23.866350 28375 raft_consensus.cc:359] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.880208 28375 raft_consensus.cc:385] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:26:23.880221 28223 leader_election.cc:343] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:23.887354 28380 raft_consensus.cc:515] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.890631 28380 leader_election.cc:290] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:23.891273 28380 raft_consensus.cc:2804] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:23.891590 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cace777e504d84805965eaafee6018" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:23.896188 28183 raft_consensus.cc:3060] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:23.897037 28333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "149bf0909a37428b9e09d5580f6342d0" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:23.897568 28333 raft_consensus.cc:2468] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 0.
I20260709 12:26:23.898202 28334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71b973b042c49ba9466c769a907c2b8" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:23.898718 28334 raft_consensus.cc:2468] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 0.
I20260709 12:26:23.902041 28333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "149bf0909a37428b9e09d5580f6342d0" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:23.892832 28381 leader_election.cc:290] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 election: Requested vote from peers 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713), a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263)
I20260709 12:26:23.887923 28375 raft_consensus.cc:740] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.902760 28400 raft_consensus.cc:515] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.903487 28334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:23.904249 28334 raft_consensus.cc:3060] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:23.891639 28380 raft_consensus.cc:493] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:23.902746 28333 raft_consensus.cc:3060] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:23.916685 28183 raft_consensus.cc:2468] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 1.
I20260709 12:26:23.907146 28376 tablet_bootstrap.cc:492] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2: No bootstrap required, opened a new log
I20260709 12:26:23.906970 28375 consensus_queue.cc:260] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.918085 28223 leader_election.cc:304] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:23.907393 28332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cace777e504d84805965eaafee6018" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:23.919106 28332 raft_consensus.cc:3060] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:23.908393 28374 tablet_bootstrap.cc:492] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a: No bootstrap required, opened a new log
I20260709 12:26:23.919790 28375 ts_tablet_manager.cc:1434] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.002s
I20260709 12:26:23.920161 28374 ts_tablet_manager.cc:1403] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a: Time spent bootstrapping tablet: real 0.142s	user 0.019s	sys 0.007s
I20260709 12:26:23.920724 28406 raft_consensus.cc:2804] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:23.921489 28376 ts_tablet_manager.cc:1403] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent bootstrapping tablet: real 0.063s	user 0.016s	sys 0.004s
I20260709 12:26:23.910503 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71b973b042c49ba9466c769a907c2b8" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:23.923483 28184 raft_consensus.cc:3060] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:23.924665 28376 raft_consensus.cc:359] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.909142 28400 leader_election.cc:290] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:23.914031 28381 raft_consensus.cc:493] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.925551 28380 raft_consensus.cc:3060] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:23.925726 28381 raft_consensus.cc:515] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.911623 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71b973b042c49ba9466c769a907c2b8" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:23.928216 28331 raft_consensus.cc:3060] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:23.928411 28381 leader_election.cc:290] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:23.920904 28375 tablet_bootstrap.cc:492] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4: Bootstrap starting.
I20260709 12:26:23.933988 28380 raft_consensus.cc:515] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.912889 28401 raft_consensus.cc:515] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.935861 28376 raft_consensus.cc:385] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:23.936206 28376 raft_consensus.cc:740] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.915112 28334 raft_consensus.cc:2468] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 1.
I20260709 12:26:23.925702 28374 raft_consensus.cc:359] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.937095 28376 consensus_queue.cc:260] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.938971 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ccd09ed5bc42808c274a7a88028d76" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:23.939579 28375 tablet_bootstrap.cc:654] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:23.939776 28330 raft_consensus.cc:2468] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 0.
I20260709 12:26:23.940299 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "149bf0909a37428b9e09d5580f6342d0" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:23.941211 28182 raft_consensus.cc:2393] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ef5f5a402ae145969aaa2c646aa7676a in current term 1: Already voted for candidate a007a2ab17a240d69915bf88b0d077f4 in this term.
I20260709 12:26:23.941773 28376 ts_tablet_manager.cc:1434] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:26:23.936944 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ccd09ed5bc42808c274a7a88028d76" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:23.943212 28183 raft_consensus.cc:2468] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 0.
I20260709 12:26:23.946695 28223 leader_election.cc:304] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:23.947643 28400 raft_consensus.cc:2804] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:23.948084 28400 raft_consensus.cc:493] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:23.948432 28400 raft_consensus.cc:3060] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:23.948681 28332 raft_consensus.cc:2468] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 1.
I20260709 12:26:23.952654 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbad5c4d8fb6444f880e49cdfec8c39d" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:23.953682 28330 raft_consensus.cc:3060] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:23.956012 28406 raft_consensus.cc:697] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Becoming Leader. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:23.957340 28406 consensus_queue.cc:237] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } } peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } }
I20260709 12:26:23.960143 28331 raft_consensus.cc:2468] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 1.
I20260709 12:26:23.963092 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "149bf0909a37428b9e09d5580f6342d0" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:23.937836 28380 leader_election.cc:290] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:23.938490 28374 raft_consensus.cc:385] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:23.965451 28374 raft_consensus.cc:740] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.966485 28374 consensus_queue.cc:260] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.925077 28333 raft_consensus.cc:2468] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 1.
I20260709 12:26:23.967579 28400 raft_consensus.cc:515] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.968232 28184 raft_consensus.cc:2468] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 1.
I20260709 12:26:23.969648 28374 ts_tablet_manager.cc:1434] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 12:26:23.970484 28223 leader_election.cc:304] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:23.971204 28400 leader_election.cc:290] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:23.971009 28148 leader_election.cc:304] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: 
I20260709 12:26:23.971872 28400 raft_consensus.cc:2804] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:23.972371 28400 raft_consensus.cc:697] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Becoming Leader. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:23.972456 28380 raft_consensus.cc:2804] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:23.973596 28380 raft_consensus.cc:697] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Becoming Leader. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:23.973533 28400 consensus_queue.cc:237] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.976244 28374 tablet_bootstrap.cc:492] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a: Bootstrap starting.
I20260709 12:26:23.974866 28380 consensus_queue.cc:237] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.962208 28224 leader_election.cc:304] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:23.937346 28401 leader_election.cc:290] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:23.985272 28406 raft_consensus.cc:2804] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:23.985982 28406 raft_consensus.cc:697] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Becoming Leader. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:23.990404 28406 consensus_queue.cc:237] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:23.989104 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ccd09ed5bc42808c274a7a88028d76" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:23.993527 28184 raft_consensus.cc:3060] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:23.994666 28330 raft_consensus.cc:2468] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 1.
I20260709 12:26:23.996695 28148 leader_election.cc:304] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: 
I20260709 12:26:23.998190 28408 raft_consensus.cc:2804] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:23.989125 28224 leader_election.cc:304] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5f5a402ae145969aaa2c646aa7676a; no voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:24.010589 28401 raft_consensus.cc:2749] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:24.014459 28374 tablet_bootstrap.cc:654] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:24.016383 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ccd09ed5bc42808c274a7a88028d76" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:24.017107 28330 raft_consensus.cc:3060] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:24.020124 28382 raft_consensus.cc:493] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.020946 28382 raft_consensus.cc:515] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.021131 28081 catalog_manager.cc:5697] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "a007a2ab17a240d69915bf88b0d077f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.024045 28408 raft_consensus.cc:697] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Becoming Leader. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:24.014503 28375 tablet_bootstrap.cc:492] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4: No bootstrap required, opened a new log
I20260709 12:26:24.029724 28408 consensus_queue.cc:237] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.038689 28259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbad5c4d8fb6444f880e49cdfec8c39d" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:24.032227 28375 ts_tablet_manager.cc:1403] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4: Time spent bootstrapping tablet: real 0.112s	user 0.036s	sys 0.032s
I20260709 12:26:24.036788 28382 leader_election.cc:290] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:24.039695 28184 raft_consensus.cc:2468] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 1.
I20260709 12:26:24.053622 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbad5c4d8fb6444f880e49cdfec8c39d" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:24.051952 28258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "149bf0909a37428b9e09d5580f6342d0" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:24.046620 28077 catalog_manager.cc:5697] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130). New cstate: current_term: 1 leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.053006 28259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "149bf0909a37428b9e09d5580f6342d0" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:24.055152 28223 leader_election.cc:304] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:24.055300 28258 raft_consensus.cc:2393] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a007a2ab17a240d69915bf88b0d077f4 in current term 1: Already voted for candidate ef5f5a402ae145969aaa2c646aa7676a in this term.
W20260709 12:26:24.052731 28149 leader_election.cc:343] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:24.056214 28406 raft_consensus.cc:2804] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:24.056741 28406 raft_consensus.cc:697] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Becoming Leader. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:24.058018 28406 consensus_queue.cc:237] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
W20260709 12:26:24.064371 28149 leader_election.cc:343] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:24.069700 28375 raft_consensus.cc:359] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.071153 28375 raft_consensus.cc:385] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:24.071535 28375 raft_consensus.cc:740] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Initialized, Role: FOLLOWER
I20260709 12:26:24.064280 28330 raft_consensus.cc:2468] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 1.
I20260709 12:26:24.074878 28375 consensus_queue.cc:260] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.077978 28375 ts_tablet_manager.cc:1434] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.001s
I20260709 12:26:24.080029 28375 tablet_bootstrap.cc:492] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4: Bootstrap starting.
I20260709 12:26:24.086853 28374 tablet_bootstrap.cc:492] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a: No bootstrap required, opened a new log
I20260709 12:26:24.088130 28375 tablet_bootstrap.cc:654] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:24.088680 28374 ts_tablet_manager.cc:1403] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a: Time spent bootstrapping tablet: real 0.113s	user 0.024s	sys 0.000s
I20260709 12:26:24.090654 28259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4749e4e08c14875922b881d4fd5d500" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:24.091382 28259 raft_consensus.cc:2468] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 0.
I20260709 12:26:24.093199 28300 leader_election.cc:304] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:24.094211 28382 raft_consensus.cc:2804] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:24.094683 28382 raft_consensus.cc:493] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.095052 28382 raft_consensus.cc:3060] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:24.095220 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4749e4e08c14875922b881d4fd5d500" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
W20260709 12:26:24.097616 28298 leader_election.cc:343] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:24.099642 28374 raft_consensus.cc:359] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.100155 28406 raft_consensus.cc:493] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.101589 28374 raft_consensus.cc:385] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:24.101608 28406 raft_consensus.cc:515] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.102543 28374 raft_consensus.cc:740] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Initialized, Role: FOLLOWER
I20260709 12:26:24.103144 28375 tablet_bootstrap.cc:492] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4: No bootstrap required, opened a new log
I20260709 12:26:24.103718 28375 ts_tablet_manager.cc:1403] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.008s
I20260709 12:26:24.104341 28374 consensus_queue.cc:260] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.106340 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d085b020751c45dea7e6434ac0bd152b" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:24.107121 28184 raft_consensus.cc:2468] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 0.
I20260709 12:26:24.106788 28375 raft_consensus.cc:359] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.107228 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d085b020751c45dea7e6434ac0bd152b" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:24.107731 28375 raft_consensus.cc:385] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:24.108086 28375 raft_consensus.cc:740] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Initialized, Role: FOLLOWER
I20260709 12:26:24.107997 28330 raft_consensus.cc:2468] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 0.
I20260709 12:26:24.108583 28223 leader_election.cc:304] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:24.109128 28375 consensus_queue.cc:260] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.109347 28406 leader_election.cc:290] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:24.110855 28375 ts_tablet_manager.cc:1434] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:26:24.111649 28375 tablet_bootstrap.cc:492] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4: Bootstrap starting.
I20260709 12:26:24.112278 28401 raft_consensus.cc:2804] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:24.112715 28401 raft_consensus.cc:493] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.113044 28401 raft_consensus.cc:3060] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:24.114723 28382 raft_consensus.cc:515] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.116181 28375 tablet_bootstrap.cc:654] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:24.118057 28374 ts_tablet_manager.cc:1434] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.002s
I20260709 12:26:24.120069 28259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4749e4e08c14875922b881d4fd5d500" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:24.120700 28259 raft_consensus.cc:3060] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:24.120807 28374 tablet_bootstrap.cc:492] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a: Bootstrap starting.
I20260709 12:26:24.120910 28401 raft_consensus.cc:515] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.123961 28401 leader_election.cc:290] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:24.124668 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d085b020751c45dea7e6434ac0bd152b" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:24.124891 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d085b020751c45dea7e6434ac0bd152b" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:24.117915 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4749e4e08c14875922b881d4fd5d500" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:24.125417 28330 raft_consensus.cc:3060] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:24.125692 28184 raft_consensus.cc:3060] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:24.125389 28183 raft_consensus.cc:3060] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:24.137118 28183 raft_consensus.cc:2468] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 1.
I20260709 12:26:24.139130 28223 leader_election.cc:304] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:24.141547 28259 raft_consensus.cc:2468] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 1.
I20260709 12:26:24.142930 28300 leader_election.cc:304] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:24.143046 28330 raft_consensus.cc:2468] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 1.
I20260709 12:26:24.137039 28374 tablet_bootstrap.cc:654] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:24.145790 28184 raft_consensus.cc:2468] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 1.
I20260709 12:26:24.146070 28428 raft_consensus.cc:2804] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:24.148211 28382 leader_election.cc:290] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 1 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:24.149626 28401 raft_consensus.cc:2804] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:24.150463 28401 raft_consensus.cc:697] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Becoming Leader. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:24.151696 28401 consensus_queue.cc:237] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.154063 28428 raft_consensus.cc:697] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 LEADER]: Becoming Leader. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Running, Role: LEADER
I20260709 12:26:24.155550 28428 consensus_queue.cc:237] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.166718 28374 tablet_bootstrap.cc:492] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a: No bootstrap required, opened a new log
I20260709 12:26:24.167912 28374 ts_tablet_manager.cc:1403] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.004s
I20260709 12:26:24.171643 28374 raft_consensus.cc:359] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.173022 28374 raft_consensus.cc:385] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:24.173316 28374 raft_consensus.cc:740] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Initialized, Role: FOLLOWER
I20260709 12:26:24.174388 28375 tablet_bootstrap.cc:492] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4: No bootstrap required, opened a new log
I20260709 12:26:24.174121 28374 consensus_queue.cc:260] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.174961 28375 ts_tablet_manager.cc:1403] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4: Time spent bootstrapping tablet: real 0.063s	user 0.028s	sys 0.024s
I20260709 12:26:24.177047 28374 ts_tablet_manager.cc:1434] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:24.177991 28375 raft_consensus.cc:359] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.178612 28375 raft_consensus.cc:385] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:24.178952 28375 raft_consensus.cc:740] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Initialized, Role: FOLLOWER
I20260709 12:26:24.178187 28077 catalog_manager.cc:5697] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:24.179899 28375 consensus_queue.cc:260] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.182408 28375 ts_tablet_manager.cc:1434] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:24.191870 28081 catalog_manager.cc:5697] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130). New cstate: current_term: 1 leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.193827 28081 catalog_manager.cc:5697] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130). New cstate: current_term: 1 leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.195147 28081 catalog_manager.cc:5697] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130). New cstate: current_term: 1 leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.196573 28081 catalog_manager.cc:5697] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130). New cstate: current_term: 1 leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.208302 28080 catalog_manager.cc:5697] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "a007a2ab17a240d69915bf88b0d077f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.226603 28401 raft_consensus.cc:493] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.227046 28401 raft_consensus.cc:515] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.229182 28401 leader_election.cc:290] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:24.230357 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ab36077d1643788dabe2f6a3af3488" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:24.230190 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ab36077d1643788dabe2f6a3af3488" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:24.231078 28330 raft_consensus.cc:2468] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 0.
I20260709 12:26:24.231088 28184 raft_consensus.cc:2468] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 0.
I20260709 12:26:24.233052 28224 leader_election.cc:304] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:24.233852 28401 raft_consensus.cc:2804] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:24.234234 28401 raft_consensus.cc:493] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.234751 28401 raft_consensus.cc:3060] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:24.241299 28401 raft_consensus.cc:515] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.243052 28401 leader_election.cc:290] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:24.244127 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ab36077d1643788dabe2f6a3af3488" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:24.244300 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ab36077d1643788dabe2f6a3af3488" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:24.245183 28184 raft_consensus.cc:3060] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:24.245218 28330 raft_consensus.cc:3060] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:24.253293 28184 raft_consensus.cc:2468] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 1.
I20260709 12:26:24.253293 28330 raft_consensus.cc:2468] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 1.
I20260709 12:26:24.254904 28223 leader_election.cc:304] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:24.255860 28401 raft_consensus.cc:2804] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:24.256330 28401 raft_consensus.cc:697] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Becoming Leader. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:24.257898 28401 consensus_queue.cc:237] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.267127 28408 raft_consensus.cc:493] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.266793 28080 catalog_manager.cc:5697] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130). New cstate: current_term: 1 leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.268141 28408 raft_consensus.cc:515] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.271546 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:24.270888 28408 leader_election.cc:290] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:24.271214 28259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:24.272796 28330 raft_consensus.cc:2393] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a007a2ab17a240d69915bf88b0d077f4 in current term 1: Already voted for candidate ef5f5a402ae145969aaa2c646aa7676a in this term.
I20260709 12:26:24.274785 28149 leader_election.cc:304] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4; no voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:24.275589 28408 raft_consensus.cc:3060] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:24.281673 28408 raft_consensus.cc:2749] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:24.360081 28408 consensus_queue.cc:1048] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:24.373802 28408 consensus_queue.cc:1048] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:24.395071 28401 consensus_queue.cc:1048] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:24.395718 28406 consensus_queue.cc:1048] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:24.420868 28406 consensus_queue.cc:1048] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:24.433981 28444 consensus_queue.cc:1048] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:24.435233 28406 consensus_queue.cc:1048] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:24.460427 28444 consensus_queue.cc:1048] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:24.493141 28444 consensus_queue.cc:1048] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:24.494513 28406 raft_consensus.cc:493] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.495194 28406 raft_consensus.cc:515] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.497902 28406 leader_election.cc:290] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:24.498687 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbad5c4d8fb6444f880e49cdfec8c39d" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:24.499029 28333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbad5c4d8fb6444f880e49cdfec8c39d" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:24.499962 28333 raft_consensus.cc:2393] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef5f5a402ae145969aaa2c646aa7676a in current term 1: Already voted for candidate a007a2ab17a240d69915bf88b0d077f4 in this term.
I20260709 12:26:24.501143 28224 leader_election.cc:304] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5f5a402ae145969aaa2c646aa7676a; no voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:24.501909 28406 raft_consensus.cc:3060] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:24.511960 28259 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09cace777e504d84805965eaafee6018"
dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
mode: GRACEFUL
new_leader_uuid: "a007a2ab17a240d69915bf88b0d077f4"
 from {username='slave'} at 127.0.0.1:43054
I20260709 12:26:24.512778 28259 raft_consensus.cc:606] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Received request to transfer leadership to TS a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:24.515630 28444 consensus_queue.cc:1048] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:24.518142 28408 consensus_queue.cc:1048] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:24.522382 28406 raft_consensus.cc:2749] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:24.523118 28259 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4ccd09ed5bc42808c274a7a88028d76"
dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
mode: GRACEFUL
new_leader_uuid: "a007a2ab17a240d69915bf88b0d077f4"
 from {username='slave'} at 127.0.0.1:43054
I20260709 12:26:24.523963 28259 raft_consensus.cc:606] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Received request to transfer leadership to TS a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:24.526846 28444 raft_consensus.cc:993] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a: : Instructing follower a007a2ab17a240d69915bf88b0d077f4 to start an election
I20260709 12:26:24.527311 28444 raft_consensus.cc:1081] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Signalling peer a007a2ab17a240d69915bf88b0d077f4 to start an election
I20260709 12:26:24.529266 28184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4ccd09ed5bc42808c274a7a88028d76"
dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
 from {username='slave'} at 127.0.0.1:46240
I20260709 12:26:24.530364 28184 raft_consensus.cc:493] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.530870 28184 raft_consensus.cc:3060] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.533349 28259 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b71b973b042c49ba9466c769a907c2b8"
dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
mode: GRACEFUL
new_leader_uuid: "a007a2ab17a240d69915bf88b0d077f4"
 from {username='slave'} at 127.0.0.1:43054
I20260709 12:26:24.534055 28259 raft_consensus.cc:606] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Received request to transfer leadership to TS a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:24.539176 28184 raft_consensus.cc:515] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.541209 28258 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217"
dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
mode: GRACEFUL
new_leader_uuid: "a007a2ab17a240d69915bf88b0d077f4"
 from {username='slave'} at 127.0.0.1:43054
I20260709 12:26:24.541944 28258 raft_consensus.cc:606] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Received request to transfer leadership to TS a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:24.543998 28184 leader_election.cc:290] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 2 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:24.545313 28333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ccd09ed5bc42808c274a7a88028d76" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:24.545676 28406 consensus_queue.cc:1048] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:24.546231 28333 raft_consensus.cc:3060] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.548229 28258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ccd09ed5bc42808c274a7a88028d76" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:24.548962 28258 raft_consensus.cc:3055] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.549289 28258 raft_consensus.cc:740] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:24.550565 28258 consensus_queue.cc:260] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.557220 28258 raft_consensus.cc:3060] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.561970 28333 raft_consensus.cc:2468] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 2.
I20260709 12:26:24.562080 28380 consensus_queue.cc:1048] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:24.563333 28148 leader_election.cc:304] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: 
I20260709 12:26:24.564294 28380 raft_consensus.cc:2804] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.565172 28380 raft_consensus.cc:697] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Becoming Leader. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:24.566074 28380 consensus_queue.cc:237] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.570631 28258 raft_consensus.cc:2468] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 2.
I20260709 12:26:24.573671 28183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "149bf0909a37428b9e09d5580f6342d0"
dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
mode: GRACEFUL
new_leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
 from {username='slave'} at 127.0.0.1:46270
I20260709 12:26:24.574462 28183 raft_consensus.cc:606] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Received request to transfer leadership to TS ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:24.591372 28184 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbad5c4d8fb6444f880e49cdfec8c39d"
dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
mode: GRACEFUL
new_leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
 from {username='slave'} at 127.0.0.1:46270
I20260709 12:26:24.592113 28184 raft_consensus.cc:606] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Received request to transfer leadership to TS ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:24.591882 28406 consensus_queue.cc:1048] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:24.596920 28080 catalog_manager.cc:5697] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 reported cstate change: term changed from 1 to 2, leader changed from ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130) to a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129). New cstate: current_term: 2 leader_uuid: "a007a2ab17a240d69915bf88b0d077f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.623303 28330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4749e4e08c14875922b881d4fd5d500"
dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
mode: GRACEFUL
new_leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
 from {username='slave'} at 127.0.0.1:43568
I20260709 12:26:24.624037 28330 raft_consensus.cc:606] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 LEADER]: Received request to transfer leadership to TS ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:24.626200 28428 consensus_queue.cc:1048] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:24.631421 28257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57ab36077d1643788dabe2f6a3af3488"
dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
mode: GRACEFUL
new_leader_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
 from {username='slave'} at 127.0.0.1:43054
I20260709 12:26:24.632141 28257 raft_consensus.cc:606] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Received request to transfer leadership to TS 762fe3ee980d4126b2d1302af1fbe8b2
I20260709 12:26:24.638515 28429 consensus_queue.cc:1048] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:24.649261 28428 raft_consensus.cc:993] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2: : Instructing follower ef5f5a402ae145969aaa2c646aa7676a to start an election
I20260709 12:26:24.649866 28429 raft_consensus.cc:1081] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 LEADER]: Signalling peer ef5f5a402ae145969aaa2c646aa7676a to start an election
I20260709 12:26:24.651968 28257 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4749e4e08c14875922b881d4fd5d500"
dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
 from {username='slave'} at 127.0.0.1:43050
I20260709 12:26:24.652680 28257 raft_consensus.cc:493] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.653106 28257 raft_consensus.cc:3060] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.661530 28257 raft_consensus.cc:515] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.663671 28257 leader_election.cc:290] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:24.664541 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4749e4e08c14875922b881d4fd5d500" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:24.664897 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4749e4e08c14875922b881d4fd5d500" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:24.665292 28184 raft_consensus.cc:3060] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.665657 28330 raft_consensus.cc:3055] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.666031 28330 raft_consensus.cc:740] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Running, Role: LEADER
I20260709 12:26:24.666919 28330 consensus_queue.cc:260] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.668745 28330 raft_consensus.cc:3060] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.675292 28184 raft_consensus.cc:2468] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 2.
I20260709 12:26:24.677336 28223 leader_election.cc:304] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:24.678205 28406 raft_consensus.cc:2804] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.678521 28330 raft_consensus.cc:2468] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 2.
I20260709 12:26:24.678668 28406 raft_consensus.cc:697] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Becoming Leader. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:24.679803 28406 consensus_queue.cc:237] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.687309 28080 catalog_manager.cc:5697] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a reported cstate change: term changed from 1 to 2, leader changed from 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131) to ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130). New cstate: current_term: 2 leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.796069 28406 consensus_queue.cc:1048] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:24.808270 28406 consensus_queue.cc:1048] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:24.817584 28401 raft_consensus.cc:993] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a: : Instructing follower 762fe3ee980d4126b2d1302af1fbe8b2 to start an election
I20260709 12:26:24.818109 28406 raft_consensus.cc:1081] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Signalling peer 762fe3ee980d4126b2d1302af1fbe8b2 to start an election
I20260709 12:26:24.819975 28330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57ab36077d1643788dabe2f6a3af3488"
dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
 from {username='slave'} at 127.0.0.1:43544
I20260709 12:26:24.820503 28330 raft_consensus.cc:493] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.820825 28330 raft_consensus.cc:3060] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.827097 28330 raft_consensus.cc:515] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.828984 28330 leader_election.cc:290] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 2 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:24.830677 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ab36077d1643788dabe2f6a3af3488" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:24.830808 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ab36077d1643788dabe2f6a3af3488" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:24.831888 28184 raft_consensus.cc:3060] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.831997 28257 raft_consensus.cc:3055] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.832768 28257 raft_consensus.cc:740] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:24.833680 28257 consensus_queue.cc:260] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.835657 28257 raft_consensus.cc:3060] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.839636 28184 raft_consensus.cc:2468] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 2.
I20260709 12:26:24.841002 28298 leader_election.cc:304] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: 
I20260709 12:26:24.841570 28257 raft_consensus.cc:2468] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 2.
I20260709 12:26:24.841892 28429 raft_consensus.cc:2804] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.842429 28429 raft_consensus.cc:697] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 LEADER]: Becoming Leader. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Running, Role: LEADER
I20260709 12:26:24.843274 28429 consensus_queue.cc:237] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.850914 28077 catalog_manager.cc:5697] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 reported cstate change: term changed from 1 to 2, leader changed from ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130) to 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:24.908666 28411 raft_consensus.cc:993] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a: : Instructing follower a007a2ab17a240d69915bf88b0d077f4 to start an election
I20260709 12:26:24.909184 28381 raft_consensus.cc:1081] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Signalling peer a007a2ab17a240d69915bf88b0d077f4 to start an election
I20260709 12:26:24.910902 28184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217"
dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
 from {username='slave'} at 127.0.0.1:46240
I20260709 12:26:24.911501 28184 raft_consensus.cc:493] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.911911 28184 raft_consensus.cc:3060] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.919247 28184 raft_consensus.cc:515] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.920972 28184 leader_election.cc:290] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 2 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:24.921908 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:24.922191 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:24.922667 28257 raft_consensus.cc:3055] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.922731 28330 raft_consensus.cc:3060] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.923173 28257 raft_consensus.cc:740] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:24.924098 28257 consensus_queue.cc:260] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.925450 28257 raft_consensus.cc:3060] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.930848 28330 raft_consensus.cc:2468] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 2.
I20260709 12:26:24.932408 28148 leader_election.cc:304] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: 
I20260709 12:26:24.932744 28257 raft_consensus.cc:2468] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 2.
I20260709 12:26:24.933177 28380 raft_consensus.cc:2804] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.933714 28380 raft_consensus.cc:697] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Becoming Leader. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:24.934535 28380 consensus_queue.cc:237] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.940570 28401 raft_consensus.cc:993] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a: : Instructing follower a007a2ab17a240d69915bf88b0d077f4 to start an election
I20260709 12:26:24.941075 28381 raft_consensus.cc:1081] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Signalling peer a007a2ab17a240d69915bf88b0d077f4 to start an election
I20260709 12:26:24.942824 28184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b71b973b042c49ba9466c769a907c2b8"
dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
 from {username='slave'} at 127.0.0.1:46240
I20260709 12:26:24.942358 28077 catalog_manager.cc:5697] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 reported cstate change: term changed from 1 to 2, leader changed from ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130) to a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129). New cstate: current_term: 2 leader_uuid: "a007a2ab17a240d69915bf88b0d077f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.943389 28184 raft_consensus.cc:493] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.943907 28184 raft_consensus.cc:3060] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.950457 28380 raft_consensus.cc:993] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4: : Instructing follower ef5f5a402ae145969aaa2c646aa7676a to start an election
I20260709 12:26:24.951025 28380 raft_consensus.cc:1081] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Signalling peer ef5f5a402ae145969aaa2c646aa7676a to start an election
I20260709 12:26:24.951647 28184 raft_consensus.cc:515] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.953822 28258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "149bf0909a37428b9e09d5580f6342d0"
dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
 from {username='slave'} at 127.0.0.1:43040
I20260709 12:26:24.954252 28184 leader_election.cc:290] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 2 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:24.954530 28258 raft_consensus.cc:493] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.955004 28258 raft_consensus.cc:3060] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.955300 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71b973b042c49ba9466c769a907c2b8" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:24.955853 28330 raft_consensus.cc:3060] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.957504 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71b973b042c49ba9466c769a907c2b8" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:24.958169 28257 raft_consensus.cc:3055] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.958498 28257 raft_consensus.cc:740] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:24.959342 28257 consensus_queue.cc:260] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.960798 28257 raft_consensus.cc:3060] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.961925 28258 raft_consensus.cc:515] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.964005 28330 raft_consensus.cc:2468] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 2.
I20260709 12:26:24.964795 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "149bf0909a37428b9e09d5580f6342d0" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:24.965386 28148 leader_election.cc:304] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: 
I20260709 12:26:24.965983 28258 leader_election.cc:290] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:24.966387 28408 raft_consensus.cc:2804] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.966918 28408 raft_consensus.cc:697] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Becoming Leader. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:24.967957 28333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "149bf0909a37428b9e09d5580f6342d0" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:24.967798 28408 consensus_queue.cc:237] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.968618 28333 raft_consensus.cc:3060] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.968641 28257 raft_consensus.cc:2468] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 2.
I20260709 12:26:24.965432 28184 raft_consensus.cc:3055] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.970182 28184 raft_consensus.cc:740] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:24.971312 28184 consensus_queue.cc:260] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.972941 28184 raft_consensus.cc:3060] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.976462 28077 catalog_manager.cc:5697] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 reported cstate change: term changed from 1 to 2, leader changed from ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130) to a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129). New cstate: current_term: 2 leader_uuid: "a007a2ab17a240d69915bf88b0d077f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.977685 28333 raft_consensus.cc:2468] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 2.
I20260709 12:26:24.979112 28224 leader_election.cc:304] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:24.979998 28381 raft_consensus.cc:2804] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.980502 28381 raft_consensus.cc:697] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Becoming Leader. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:24.980775 28184 raft_consensus.cc:2468] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 2.
I20260709 12:26:24.981333 28381 consensus_queue.cc:237] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:24.988178 28416 raft_consensus.cc:993] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4: : Instructing follower ef5f5a402ae145969aaa2c646aa7676a to start an election
I20260709 12:26:24.988662 28408 raft_consensus.cc:1081] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Signalling peer ef5f5a402ae145969aaa2c646aa7676a to start an election
I20260709 12:26:24.990327 28257 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbad5c4d8fb6444f880e49cdfec8c39d"
dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
 from {username='slave'} at 127.0.0.1:43040
I20260709 12:26:24.990911 28257 raft_consensus.cc:493] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.989988 28077 catalog_manager.cc:5697] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a reported cstate change: term changed from 1 to 2, leader changed from a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129) to ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130). New cstate: current_term: 2 leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.991245 28257 raft_consensus.cc:3060] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.999053 28257 raft_consensus.cc:515] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:25.000948 28257 leader_election.cc:290] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:25.001899 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbad5c4d8fb6444f880e49cdfec8c39d" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:25.002444 28333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbad5c4d8fb6444f880e49cdfec8c39d" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:25.002703 28184 raft_consensus.cc:3055] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:25.003149 28184 raft_consensus.cc:740] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:25.003173 28333 raft_consensus.cc:3060] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.004007 28184 consensus_queue.cc:260] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:25.005064 28184 raft_consensus.cc:3060] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.009163 28333 raft_consensus.cc:2468] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 2.
I20260709 12:26:25.011066 28184 raft_consensus.cc:2468] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 2.
I20260709 12:26:25.011204 28224 leader_election.cc:304] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:25.012267 28381 raft_consensus.cc:2804] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:25.012787 28381 raft_consensus.cc:697] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Becoming Leader. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:25.013584 28381 consensus_queue.cc:237] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:25.021253 28077 catalog_manager.cc:5697] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a reported cstate change: term changed from 1 to 2, leader changed from a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129) to ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130). New cstate: current_term: 2 leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:25.051985 28400 raft_consensus.cc:993] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a: : Instructing follower a007a2ab17a240d69915bf88b0d077f4 to start an election
I20260709 12:26:25.052479 28381 raft_consensus.cc:1081] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Signalling peer a007a2ab17a240d69915bf88b0d077f4 to start an election
I20260709 12:26:25.054260 28184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09cace777e504d84805965eaafee6018"
dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
 from {username='slave'} at 127.0.0.1:46240
I20260709 12:26:25.055080 28184 raft_consensus.cc:493] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:25.055593 28184 raft_consensus.cc:3060] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.061474 28184 raft_consensus.cc:515] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } } peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } }
I20260709 12:26:25.063295 28184 leader_election.cc:290] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 2 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:25.064277 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cace777e504d84805965eaafee6018" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:25.064481 28333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cace777e504d84805965eaafee6018" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:25.064972 28257 raft_consensus.cc:3055] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:25.065094 28333 raft_consensus.cc:3060] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.065301 28257 raft_consensus.cc:740] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:25.066192 28257 consensus_queue.cc:260] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } } peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } }
I20260709 12:26:25.067359 28257 raft_consensus.cc:3060] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.071125 28333 raft_consensus.cc:2468] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 2.
I20260709 12:26:25.072875 28148 leader_election.cc:304] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: 
I20260709 12:26:25.073345 28257 raft_consensus.cc:2468] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 2.
I20260709 12:26:25.074543 28408 raft_consensus.cc:2804] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:25.075179 28408 raft_consensus.cc:697] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Becoming Leader. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:25.076004 28408 consensus_queue.cc:237] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } } peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } }
I20260709 12:26:25.083554 28077 catalog_manager.cc:5697] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 reported cstate change: term changed from 1 to 2, leader changed from ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130) to a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129). New cstate: current_term: 2 leader_uuid: "a007a2ab17a240d69915bf88b0d077f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:25.101191 28333 raft_consensus.cc:1275] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Refusing update from remote peer ef5f5a402ae145969aaa2c646aa7676a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.102553 28381 consensus_queue.cc:1048] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.114066 28330 raft_consensus.cc:1275] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.115187 28184 raft_consensus.cc:1275] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Refusing update from remote peer ef5f5a402ae145969aaa2c646aa7676a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.116022 28408 consensus_queue.cc:1048] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:25.117276 28381 consensus_queue.cc:1048] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:25.128597 28257 raft_consensus.cc:1275] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.130438 28461 consensus_queue.cc:1048] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.276348 28257 raft_consensus.cc:1275] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Refusing update from remote peer 762fe3ee980d4126b2d1302af1fbe8b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.277942 28429 consensus_queue.cc:1048] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.286486 28184 raft_consensus.cc:1275] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Refusing update from remote peer 762fe3ee980d4126b2d1302af1fbe8b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.288094 28462 consensus_queue.cc:1048] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.366291 28257 raft_consensus.cc:1275] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.368068 28461 consensus_queue.cc:1048] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.372869 28330 raft_consensus.cc:1275] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.374483 28408 consensus_queue.cc:1048] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.412606 28257 raft_consensus.cc:1275] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.414023 28184 raft_consensus.cc:1275] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Refusing update from remote peer ef5f5a402ae145969aaa2c646aa7676a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.414397 28408 consensus_queue.cc:1048] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.416020 28381 consensus_queue.cc:1048] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:25.426959 28330 raft_consensus.cc:1275] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.428593 28333 raft_consensus.cc:1275] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Refusing update from remote peer ef5f5a402ae145969aaa2c646aa7676a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.429193 28416 consensus_queue.cc:1048] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.431941 28381 consensus_queue.cc:1048] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:25.513278 28333 raft_consensus.cc:1275] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.514735 28408 consensus_queue.cc:1048] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.516997 28184 raft_consensus.cc:1275] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Refusing update from remote peer ef5f5a402ae145969aaa2c646aa7676a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.519150 28381 consensus_queue.cc:1048] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.526301 28257 raft_consensus.cc:1275] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.527700 28416 consensus_queue.cc:1048] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:25.541275 28333 raft_consensus.cc:1275] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Refusing update from remote peer ef5f5a402ae145969aaa2c646aa7676a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.543093 28468 consensus_queue.cc:1048] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:27.662614 28077 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34696:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:27.664844 28077 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:27.719732 28171 tablet_service.cc:1511] Processing CreateTablet for tablet afb8fe651f554ca7a29cac9646c16b61 (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:27.721458 28171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afb8fe651f554ca7a29cac9646c16b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.721179 28245 tablet_service.cc:1511] Processing CreateTablet for tablet afb8fe651f554ca7a29cac9646c16b61 (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:27.721717 28322 tablet_service.cc:1511] Processing CreateTablet for tablet afb8fe651f554ca7a29cac9646c16b61 (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:27.722646 28245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afb8fe651f554ca7a29cac9646c16b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.723009 28322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afb8fe651f554ca7a29cac9646c16b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.729231 28246 tablet_service.cc:1511] Processing CreateTablet for tablet ab7f40e72e304df3a4e1f0f7a0712493 (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:27.730090 28174 tablet_service.cc:1511] Processing CreateTablet for tablet c05e47844561411c80bf0b4c4afb750c (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:27.730736 28246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7f40e72e304df3a4e1f0f7a0712493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.730489 28169 tablet_service.cc:1511] Processing CreateTablet for tablet ab7f40e72e304df3a4e1f0f7a0712493 (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:27.731572 28174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c05e47844561411c80bf0b4c4afb750c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.733042 28169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7f40e72e304df3a4e1f0f7a0712493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.734097 28318 tablet_service.cc:1511] Processing CreateTablet for tablet c05e47844561411c80bf0b4c4afb750c (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:27.734439 28319 tablet_service.cc:1511] Processing CreateTablet for tablet ab7f40e72e304df3a4e1f0f7a0712493 (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:27.735441 28318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c05e47844561411c80bf0b4c4afb750c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.726833 28249 tablet_service.cc:1511] Processing CreateTablet for tablet c05e47844561411c80bf0b4c4afb750c (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:27.736658 28319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7f40e72e304df3a4e1f0f7a0712493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.737522 28249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c05e47844561411c80bf0b4c4afb750c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:27.741605 28129 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:27.748091 28170 tablet_service.cc:1511] Processing CreateTablet for tablet 0049d7e49a5246daa1156c4f09a566ae (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:27.749733 28170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0049d7e49a5246daa1156c4f09a566ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.766896 28247 tablet_service.cc:1511] Processing CreateTablet for tablet 0049d7e49a5246daa1156c4f09a566ae (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:27.768463 28247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0049d7e49a5246daa1156c4f09a566ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.771978 28320 tablet_service.cc:1511] Processing CreateTablet for tablet 0049d7e49a5246daa1156c4f09a566ae (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:27.773391 28320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0049d7e49a5246daa1156c4f09a566ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.776321 28248 tablet_service.cc:1511] Processing CreateTablet for tablet 64990029b0c741de97237387efd30fcb (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:27.777289 28168 tablet_service.cc:1511] Processing CreateTablet for tablet 64990029b0c741de97237387efd30fcb (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:27.778538 28248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64990029b0c741de97237387efd30fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.778791 28168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64990029b0c741de97237387efd30fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.785024 28481 tablet_bootstrap.cc:492] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4: Bootstrap starting.
I20260709 12:26:27.806581 28319 tablet_service.cc:1511] Processing CreateTablet for tablet 64990029b0c741de97237387efd30fcb (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:27.807130 28174 tablet_service.cc:1511] Processing CreateTablet for tablet 85e61260833443b8bc7f6fb485560fec (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:27.808547 28319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64990029b0c741de97237387efd30fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.808655 28174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85e61260833443b8bc7f6fb485560fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.822444 28481 tablet_bootstrap.cc:654] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:27.828775 28482 tablet_bootstrap.cc:492] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2: Bootstrap starting.
I20260709 12:26:27.831336 28318 tablet_service.cc:1511] Processing CreateTablet for tablet 85e61260833443b8bc7f6fb485560fec (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:27.833567 28318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85e61260833443b8bc7f6fb485560fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.834319 28171 tablet_service.cc:1511] Processing CreateTablet for tablet 854aa830a3e14c8c9cdfe10e94c72b1d (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:27.828783 28483 tablet_bootstrap.cc:492] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a: Bootstrap starting.
I20260709 12:26:27.835855 28171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854aa830a3e14c8c9cdfe10e94c72b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.836886 28245 tablet_service.cc:1511] Processing CreateTablet for tablet 85e61260833443b8bc7f6fb485560fec (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:27.846812 28245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85e61260833443b8bc7f6fb485560fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.849505 28483 tablet_bootstrap.cc:654] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:27.859256 28247 tablet_service.cc:1511] Processing CreateTablet for tablet 854aa830a3e14c8c9cdfe10e94c72b1d (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:27.860780 28247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854aa830a3e14c8c9cdfe10e94c72b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.862885 28481 tablet_bootstrap.cc:492] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4: No bootstrap required, opened a new log
I20260709 12:26:27.863498 28481 ts_tablet_manager.cc:1403] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4: Time spent bootstrapping tablet: real 0.079s	user 0.013s	sys 0.000s
I20260709 12:26:27.866812 28482 tablet_bootstrap.cc:654] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:27.873766 28322 tablet_service.cc:1511] Processing CreateTablet for tablet 854aa830a3e14c8c9cdfe10e94c72b1d (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:27.875586 28322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854aa830a3e14c8c9cdfe10e94c72b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.875989 28481 raft_consensus.cc:359] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:27.876875 28481 raft_consensus.cc:385] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:27.877206 28481 raft_consensus.cc:740] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Initialized, Role: FOLLOWER
I20260709 12:26:27.878139 28481 consensus_queue.cc:260] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:27.888763 28174 tablet_service.cc:1511] Processing CreateTablet for tablet c87492f293854900a93fe85ba9e569c6 (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:27.890435 28481 ts_tablet_manager.cc:1434] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:26:27.892943 28174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c87492f293854900a93fe85ba9e569c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.900938 28483 tablet_bootstrap.cc:492] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a: No bootstrap required, opened a new log
I20260709 12:26:27.901618 28483 ts_tablet_manager.cc:1403] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a: Time spent bootstrapping tablet: real 0.073s	user 0.009s	sys 0.004s
I20260709 12:26:27.904935 28483 raft_consensus.cc:359] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:27.905731 28483 raft_consensus.cc:385] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:27.906036 28483 raft_consensus.cc:740] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Initialized, Role: FOLLOWER
I20260709 12:26:27.908022 28481 tablet_bootstrap.cc:492] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4: Bootstrap starting.
I20260709 12:26:27.906831 28483 consensus_queue.cc:260] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:27.915369 28483 ts_tablet_manager.cc:1434] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:26:27.916605 28483 tablet_bootstrap.cc:492] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a: Bootstrap starting.
I20260709 12:26:27.922820 28481 tablet_bootstrap.cc:654] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:27.924575 28483 tablet_bootstrap.cc:654] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:27.937598 28483 tablet_bootstrap.cc:492] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a: No bootstrap required, opened a new log
I20260709 12:26:27.939023 28170 tablet_service.cc:1511] Processing CreateTablet for tablet 0392296a999544ee9a994e212c46bbf2 (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:27.940557 28483 ts_tablet_manager.cc:1403] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.000s
I20260709 12:26:27.940711 28319 tablet_service.cc:1511] Processing CreateTablet for tablet 0392296a999544ee9a994e212c46bbf2 (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:27.939687 28246 tablet_service.cc:1511] Processing CreateTablet for tablet 0392296a999544ee9a994e212c46bbf2 (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:27.942237 28319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0392296a999544ee9a994e212c46bbf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.942744 28246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0392296a999544ee9a994e212c46bbf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.938037 28318 tablet_service.cc:1511] Processing CreateTablet for tablet c87492f293854900a93fe85ba9e569c6 (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:27.943972 28483 raft_consensus.cc:359] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:27.944561 28245 tablet_service.cc:1511] Processing CreateTablet for tablet c87492f293854900a93fe85ba9e569c6 (DEFAULT_TABLE table=soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:27.945050 28483 raft_consensus.cc:385] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:27.945384 28483 raft_consensus.cc:740] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Initialized, Role: FOLLOWER
I20260709 12:26:27.945861 28245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c87492f293854900a93fe85ba9e569c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.946348 28483 consensus_queue.cc:260] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:27.941293 28170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0392296a999544ee9a994e212c46bbf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.945539 28318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c87492f293854900a93fe85ba9e569c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.953883 28482 tablet_bootstrap.cc:492] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2: No bootstrap required, opened a new log
I20260709 12:26:27.954542 28482 ts_tablet_manager.cc:1403] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent bootstrapping tablet: real 0.126s	user 0.023s	sys 0.042s
I20260709 12:26:27.957593 28483 ts_tablet_manager.cc:1434] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:26:27.966902 28483 tablet_bootstrap.cc:492] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a: Bootstrap starting.
I20260709 12:26:27.974453 28483 tablet_bootstrap.cc:654] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:27.957679 28482 raft_consensus.cc:359] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:27.980697 28482 raft_consensus.cc:385] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:27.981051 28482 raft_consensus.cc:740] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Initialized, Role: FOLLOWER
I20260709 12:26:27.981884 28482 consensus_queue.cc:260] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:27.993448 28483 tablet_bootstrap.cc:492] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a: No bootstrap required, opened a new log
I20260709 12:26:27.994226 28483 ts_tablet_manager.cc:1403] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.008s
I20260709 12:26:27.997278 28481 tablet_bootstrap.cc:492] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4: No bootstrap required, opened a new log
I20260709 12:26:27.997939 28481 ts_tablet_manager.cc:1403] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.000s
I20260709 12:26:27.998013 28482 ts_tablet_manager.cc:1434] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.001s
I20260709 12:26:27.998553 28483 raft_consensus.cc:359] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:27.999325 28482 tablet_bootstrap.cc:492] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2: Bootstrap starting.
I20260709 12:26:27.999631 28483 raft_consensus.cc:385] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.000121 28483 raft_consensus.cc:740] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.001032 28483 consensus_queue.cc:260] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.001444 28481 raft_consensus.cc:359] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.002241 28481 raft_consensus.cc:385] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.002662 28481 raft_consensus.cc:740] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.006291 28483 ts_tablet_manager.cc:1434] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 12:26:28.007834 28483 tablet_bootstrap.cc:492] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a: Bootstrap starting.
I20260709 12:26:28.009827 28482 tablet_bootstrap.cc:654] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:28.015702 28483 tablet_bootstrap.cc:654] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:28.003424 28481 consensus_queue.cc:260] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.019649 28481 ts_tablet_manager.cc:1434] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:26:28.022847 28482 tablet_bootstrap.cc:492] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2: No bootstrap required, opened a new log
I20260709 12:26:28.023437 28482 ts_tablet_manager.cc:1403] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 12:26:28.024605 28481 tablet_bootstrap.cc:492] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4: Bootstrap starting.
I20260709 12:26:28.026777 28482 raft_consensus.cc:359] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.027681 28482 raft_consensus.cc:385] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.028244 28482 raft_consensus.cc:740] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.029053 28482 consensus_queue.cc:260] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.031515 28482 ts_tablet_manager.cc:1434] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:26:28.032508 28481 tablet_bootstrap.cc:654] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:28.032635 28482 tablet_bootstrap.cc:492] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2: Bootstrap starting.
I20260709 12:26:28.042876 28482 tablet_bootstrap.cc:654] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:28.055373 28481 tablet_bootstrap.cc:492] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4: No bootstrap required, opened a new log
I20260709 12:26:28.056217 28481 ts_tablet_manager.cc:1403] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.011s
I20260709 12:26:28.060810 28481 raft_consensus.cc:359] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.062975 28481 raft_consensus.cc:385] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.063290 28481 raft_consensus.cc:740] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.063357 28482 tablet_bootstrap.cc:492] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2: No bootstrap required, opened a new log
I20260709 12:26:28.064251 28482 ts_tablet_manager.cc:1403] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.005s
I20260709 12:26:28.064262 28481 consensus_queue.cc:260] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.067147 28481 ts_tablet_manager.cc:1434] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:26:28.067715 28482 raft_consensus.cc:359] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.068238 28481 tablet_bootstrap.cc:492] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4: Bootstrap starting.
I20260709 12:26:28.068567 28482 raft_consensus.cc:385] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.068907 28482 raft_consensus.cc:740] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.069747 28482 consensus_queue.cc:260] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.072705 28482 ts_tablet_manager.cc:1434] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:28.076604 28481 tablet_bootstrap.cc:654] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:28.080240 28482 tablet_bootstrap.cc:492] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2: Bootstrap starting.
I20260709 12:26:28.090293 28481 tablet_bootstrap.cc:492] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4: No bootstrap required, opened a new log
I20260709 12:26:28.090986 28481 ts_tablet_manager.cc:1403] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.000s
I20260709 12:26:28.091372 28482 tablet_bootstrap.cc:654] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:28.094328 28481 raft_consensus.cc:359] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.095593 28481 raft_consensus.cc:385] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.095902 28408 raft_consensus.cc:493] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.096076 28481 raft_consensus.cc:740] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.096554 28408 raft_consensus.cc:515] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.096948 28481 consensus_queue.cc:260] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.101552 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7f40e72e304df3a4e1f0f7a0712493" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:28.101584 28333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7f40e72e304df3a4e1f0f7a0712493" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:28.102818 28333 raft_consensus.cc:2468] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 0.
W20260709 12:26:28.103799 28149 leader_election.cc:343] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:28.099728 28408 leader_election.cc:290] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:28.105335 28481 ts_tablet_manager.cc:1434] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.005s
I20260709 12:26:28.105098 28148 leader_election.cc:304] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:28.106451 28481 tablet_bootstrap.cc:492] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4: Bootstrap starting.
I20260709 12:26:28.106391 28408 raft_consensus.cc:2804] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:28.106957 28408 raft_consensus.cc:493] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.107483 28408 raft_consensus.cc:3060] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.114773 28481 tablet_bootstrap.cc:654] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:28.118396 28468 raft_consensus.cc:493] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.119154 28468 raft_consensus.cc:515] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.124136 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05e47844561411c80bf0b4c4afb750c" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:28.124770 28468 leader_election.cc:290] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:28.124936 28184 raft_consensus.cc:2468] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 0.
I20260709 12:26:28.117973 28482 tablet_bootstrap.cc:492] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2: No bootstrap required, opened a new log
I20260709 12:26:28.126578 28223 leader_election.cc:304] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:28.126914 28482 ts_tablet_manager.cc:1403] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.006s
I20260709 12:26:28.127600 28468 raft_consensus.cc:2804] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:28.128080 28468 raft_consensus.cc:493] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.128501 28468 raft_consensus.cc:3060] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.126801 28333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05e47844561411c80bf0b4c4afb750c" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:28.129617 28333 raft_consensus.cc:2468] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 0.
I20260709 12:26:28.130348 28482 raft_consensus.cc:359] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.131139 28482 raft_consensus.cc:385] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.131430 28482 raft_consensus.cc:740] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.133173 28408 raft_consensus.cc:515] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.124100 28498 raft_consensus.cc:493] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.136420 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7f40e72e304df3a4e1f0f7a0712493" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:28.137135 28498 raft_consensus.cc:515] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
W20260709 12:26:28.138116 28149 leader_election.cc:343] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:28.139056 28482 consensus_queue.cc:260] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.144927 28482 ts_tablet_manager.cc:1434] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:26:28.145859 28498 leader_election.cc:290] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:28.141013 28468 raft_consensus.cc:515] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.141923 28333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7f40e72e304df3a4e1f0f7a0712493" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:28.146709 28333 raft_consensus.cc:3060] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.147003 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0049d7e49a5246daa1156c4f09a566ae" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:28.147075 28481 tablet_bootstrap.cc:492] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4: No bootstrap required, opened a new log
I20260709 12:26:28.148916 28481 ts_tablet_manager.cc:1403] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.012s
W20260709 12:26:28.149178 28223 leader_election.cc:343] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:28.152271 28481 raft_consensus.cc:359] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.153170 28481 raft_consensus.cc:385] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.153857 28481 raft_consensus.cc:740] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.154829 28481 consensus_queue.cc:260] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.159021 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0049d7e49a5246daa1156c4f09a566ae" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:28.159821 28330 raft_consensus.cc:2468] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 0.
I20260709 12:26:28.161305 28224 leader_election.cc:304] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:28.161625 28482 tablet_bootstrap.cc:492] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2: Bootstrap starting.
I20260709 12:26:28.142213 28483 tablet_bootstrap.cc:492] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a: No bootstrap required, opened a new log
I20260709 12:26:28.142493 28408 leader_election.cc:290] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:28.170157 28499 raft_consensus.cc:2804] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:28.170661 28499 raft_consensus.cc:493] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.171060 28499 raft_consensus.cc:3060] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.173250 28482 tablet_bootstrap.cc:654] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:28.174757 28481 ts_tablet_manager.cc:1434] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.004s
I20260709 12:26:28.176107 28481 tablet_bootstrap.cc:492] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4: Bootstrap starting.
I20260709 12:26:28.176589 28333 raft_consensus.cc:2468] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 1.
I20260709 12:26:28.173272 28483 ts_tablet_manager.cc:1403] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a: Time spent bootstrapping tablet: real 0.166s	user 0.049s	sys 0.077s
I20260709 12:26:28.180559 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05e47844561411c80bf0b4c4afb750c" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:28.181756 28184 raft_consensus.cc:3060] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.185243 28481 tablet_bootstrap.cc:654] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:28.184782 28483 raft_consensus.cc:359] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.186816 28483 raft_consensus.cc:385] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.187126 28483 raft_consensus.cc:740] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.191609 28408 raft_consensus.cc:493] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.192327 28408 raft_consensus.cc:515] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.192988 28148 leader_election.cc:304] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:28.194258 28496 raft_consensus.cc:2804] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:28.194904 28408 leader_election.cc:290] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:28.191408 28483 consensus_queue.cc:260] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.197489 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64990029b0c741de97237387efd30fcb" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:28.198501 28257 raft_consensus.cc:2468] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 0.
I20260709 12:26:28.200335 28149 leader_election.cc:304] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:28.200402 28333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64990029b0c741de97237387efd30fcb" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
W20260709 12:26:28.201987 28148 leader_election.cc:343] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:28.202040 28408 raft_consensus.cc:2804] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:28.202684 28408 raft_consensus.cc:493] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.203142 28408 raft_consensus.cc:3060] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.203946 28481 tablet_bootstrap.cc:492] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4: No bootstrap required, opened a new log
I20260709 12:26:28.204725 28481 ts_tablet_manager.cc:1403] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.011s
I20260709 12:26:28.209654 28481 raft_consensus.cc:359] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.210961 28481 raft_consensus.cc:385] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.211400 28481 raft_consensus.cc:740] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.212488 28481 consensus_queue.cc:260] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.217902 28468 leader_election.cc:290] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:28.218072 28333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05e47844561411c80bf0b4c4afb750c" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:28.218866 28333 raft_consensus.cc:3060] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.220005 28483 ts_tablet_manager.cc:1434] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a: Time spent starting tablet: real 0.038s	user 0.016s	sys 0.011s
I20260709 12:26:28.221006 28184 raft_consensus.cc:2468] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 1.
I20260709 12:26:28.222653 28408 raft_consensus.cc:515] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.226060 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64990029b0c741de97237387efd30fcb" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:28.226466 28333 raft_consensus.cc:2468] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 1.
I20260709 12:26:28.226725 28257 raft_consensus.cc:3060] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.228799 28224 leader_election.cc:304] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:28.230342 28483 tablet_bootstrap.cc:492] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a: Bootstrap starting.
I20260709 12:26:28.230721 28468 raft_consensus.cc:2804] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:28.231345 28468 raft_consensus.cc:697] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Becoming Leader. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:28.235880 28496 raft_consensus.cc:697] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Becoming Leader. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:28.237937 28496 consensus_queue.cc:237] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.240830 28483 tablet_bootstrap.cc:654] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:28.241156 28257 raft_consensus.cc:2468] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 1.
I20260709 12:26:28.245759 28149 leader_election.cc:304] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:28.246397 28468 consensus_queue.cc:237] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.253661 28502 raft_consensus.cc:493] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.254608 28502 raft_consensus.cc:515] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.255942 28499 raft_consensus.cc:515] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.260456 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0049d7e49a5246daa1156c4f09a566ae" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:28.261283 28184 raft_consensus.cc:3060] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.264536 28508 raft_consensus.cc:2804] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:28.265493 28508 raft_consensus.cc:697] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Becoming Leader. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:28.266496 28508 consensus_queue.cc:237] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.273900 28482 tablet_bootstrap.cc:492] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2: No bootstrap required, opened a new log
I20260709 12:26:28.274597 28482 ts_tablet_manager.cc:1403] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent bootstrapping tablet: real 0.113s	user 0.018s	sys 0.017s
I20260709 12:26:28.276338 28408 leader_election.cc:290] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:28.279160 28482 raft_consensus.cc:359] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.283372 28483 tablet_bootstrap.cc:492] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a: No bootstrap required, opened a new log
I20260709 12:26:28.284279 28483 ts_tablet_manager.cc:1403] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.013s
I20260709 12:26:28.283784 28482 raft_consensus.cc:385] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.285521 28482 raft_consensus.cc:740] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.286579 28482 consensus_queue.cc:260] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.286387 28077 catalog_manager.cc:5697] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130). New cstate: current_term: 1 leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:28.289234 28482 ts_tablet_manager.cc:1434] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:26:28.292774 28482 tablet_bootstrap.cc:492] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2: Bootstrap starting.
I20260709 12:26:28.295377 28502 leader_election.cc:290] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:28.296396 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0049d7e49a5246daa1156c4f09a566ae" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:28.291841 28483 raft_consensus.cc:359] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.297636 28483 raft_consensus.cc:385] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.297995 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0049d7e49a5246daa1156c4f09a566ae" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:28.298779 28330 raft_consensus.cc:3060] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.298274 28483 raft_consensus.cc:740] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.297358 28257 raft_consensus.cc:2393] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a007a2ab17a240d69915bf88b0d077f4 in current term 1: Already voted for candidate ef5f5a402ae145969aaa2c646aa7676a in this term.
I20260709 12:26:28.300374 28483 consensus_queue.cc:260] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.306828 28483 ts_tablet_manager.cc:1434] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.004s
I20260709 12:26:28.308050 28483 tablet_bootstrap.cc:492] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a: Bootstrap starting.
I20260709 12:26:28.309273 28499 leader_election.cc:290] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:28.310185 28481 ts_tablet_manager.cc:1434] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4: Time spent starting tablet: real 0.105s	user 0.022s	sys 0.050s
I20260709 12:26:28.311069 28470 raft_consensus.cc:493] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.311384 28330 raft_consensus.cc:2468] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 1.
I20260709 12:26:28.311652 28470 raft_consensus.cc:515] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.312966 28224 leader_election.cc:304] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:28.314221 28470 leader_election.cc:290] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:28.314543 28505 raft_consensus.cc:493] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.315004 28499 raft_consensus.cc:2804] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:28.315625 28499 raft_consensus.cc:697] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Becoming Leader. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:28.315157 28505 raft_consensus.cc:515] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.316625 28333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64990029b0c741de97237387efd30fcb" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:28.317286 28333 raft_consensus.cc:3060] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.320148 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0049d7e49a5246daa1156c4f09a566ae" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:28.322396 28080 catalog_manager.cc:5697] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "a007a2ab17a240d69915bf88b0d077f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:28.323509 28331 raft_consensus.cc:2393] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a007a2ab17a240d69915bf88b0d077f4 in current term 1: Already voted for candidate ef5f5a402ae145969aaa2c646aa7676a in this term.
I20260709 12:26:28.325304 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:28.325460 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:28.326191 28257 raft_consensus.cc:2468] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 0.
I20260709 12:26:28.326242 28183 raft_consensus.cc:2468] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 0.
I20260709 12:26:28.326906 28148 leader_election.cc:304] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4; no voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:28.327149 28333 raft_consensus.cc:2468] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 1.
I20260709 12:26:28.327883 28298 leader_election.cc:304] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: 
I20260709 12:26:28.328675 28481 tablet_bootstrap.cc:492] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4: Bootstrap starting.
I20260709 12:26:28.330263 28470 raft_consensus.cc:2804] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:28.330783 28470 raft_consensus.cc:493] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.331147 28470 raft_consensus.cc:3060] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.331909 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:28.332113 28505 leader_election.cc:290] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:28.332957 28257 raft_consensus.cc:2468] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 0.
I20260709 12:26:28.337558 28149 leader_election.cc:304] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:28.340327 28483 tablet_bootstrap.cc:654] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:28.341440 28470 raft_consensus.cc:515] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.333981 28499 consensus_queue.cc:237] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.335186 28184 raft_consensus.cc:2468] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 1.
I20260709 12:26:28.344475 28496 raft_consensus.cc:2749] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:28.344447 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:28.344748 28505 raft_consensus.cc:2804] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:28.347240 28481 tablet_bootstrap.cc:654] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:28.348699 28330 raft_consensus.cc:2393] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a007a2ab17a240d69915bf88b0d077f4 in current term 1: Already voted for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in this term.
I20260709 12:26:28.348273 28505 raft_consensus.cc:493] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.349704 28482 tablet_bootstrap.cc:654] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:28.349929 28505 raft_consensus.cc:3060] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.347992 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:28.358457 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:28.362205 28257 raft_consensus.cc:3060] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.358971 28470 leader_election.cc:290] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 1 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:28.367265 28505 raft_consensus.cc:515] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.369841 28184 raft_consensus.cc:2393] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 762fe3ee980d4126b2d1302af1fbe8b2 in current term 1: Already voted for candidate a007a2ab17a240d69915bf88b0d077f4 in this term.
I20260709 12:26:28.380168 28505 leader_election.cc:290] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:28.380020 28258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:28.380061 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:28.382921 28330 raft_consensus.cc:2393] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a007a2ab17a240d69915bf88b0d077f4 in current term 1: Already voted for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in this term.
I20260709 12:26:28.385340 28483 tablet_bootstrap.cc:492] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a: No bootstrap required, opened a new log
I20260709 12:26:28.385999 28483 ts_tablet_manager.cc:1403] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.008s
I20260709 12:26:28.386220 28481 tablet_bootstrap.cc:492] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4: No bootstrap required, opened a new log
I20260709 12:26:28.386796 28481 ts_tablet_manager.cc:1403] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4: Time spent bootstrapping tablet: real 0.058s	user 0.017s	sys 0.010s
I20260709 12:26:28.386862 28149 leader_election.cc:304] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4; no voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:28.387885 28505 raft_consensus.cc:2749] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:28.393076 28483 raft_consensus.cc:359] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.393668 28482 tablet_bootstrap.cc:492] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2: No bootstrap required, opened a new log
I20260709 12:26:28.394061 28483 raft_consensus.cc:385] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.394084 28257 raft_consensus.cc:2468] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 1.
I20260709 12:26:28.394604 28483 raft_consensus.cc:740] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.401432 28482 ts_tablet_manager.cc:1403] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent bootstrapping tablet: real 0.110s	user 0.015s	sys 0.003s
I20260709 12:26:28.401337 28483 consensus_queue.cc:260] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.441224 28300 leader_election.cc:304] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:28.447432 28470 raft_consensus.cc:2804] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:28.447189 28505 raft_consensus.cc:493] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.448879 28505 raft_consensus.cc:515] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.451474 28482 raft_consensus.cc:359] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.453279 28482 raft_consensus.cc:385] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.453774 28482 raft_consensus.cc:740] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.456485 28505 leader_election.cc:290] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:28.405558 28483 ts_tablet_manager.cc:1434] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.005s
I20260709 12:26:28.455651 28482 consensus_queue.cc:260] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
W20260709 12:26:28.458707 28300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.130:34303, user_credentials={real_user=slave}} blocked reactor thread for 62712.7us
I20260709 12:26:28.460796 28483 tablet_bootstrap.cc:492] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a: Bootstrap starting.
I20260709 12:26:28.462555 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e61260833443b8bc7f6fb485560fec" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:28.463591 28330 raft_consensus.cc:2468] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 0.
I20260709 12:26:28.467417 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e61260833443b8bc7f6fb485560fec" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:28.468588 28257 raft_consensus.cc:2468] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 0.
I20260709 12:26:28.466526 28481 raft_consensus.cc:359] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.471189 28148 leader_election.cc:304] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: 
I20260709 12:26:28.473006 28481 raft_consensus.cc:385] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.473762 28505 raft_consensus.cc:2804] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:28.474227 28505 raft_consensus.cc:493] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.474632 28505 raft_consensus.cc:3060] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.474303 28481 raft_consensus.cc:740] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.477876 28481 consensus_queue.cc:260] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.501123 28470 raft_consensus.cc:697] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 LEADER]: Becoming Leader. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Running, Role: LEADER
I20260709 12:26:28.518051 28470 consensus_queue.cc:237] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.519683 28481 ts_tablet_manager.cc:1434] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4: Time spent starting tablet: real 0.133s	user 0.013s	sys 0.004s
I20260709 12:26:28.528311 28481 tablet_bootstrap.cc:492] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4: Bootstrap starting.
I20260709 12:26:28.520339 28081 catalog_manager.cc:5697] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130). New cstate: current_term: 1 leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:28.521572 28482 ts_tablet_manager.cc:1434] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent starting tablet: real 0.120s	user 0.038s	sys 0.033s
I20260709 12:26:28.534018 28482 tablet_bootstrap.cc:492] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2: Bootstrap starting.
I20260709 12:26:28.522694 28505 raft_consensus.cc:515] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.538810 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e61260833443b8bc7f6fb485560fec" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:28.539917 28257 raft_consensus.cc:3060] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.526081 28483 tablet_bootstrap.cc:654] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:28.543203 28482 tablet_bootstrap.cc:654] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:28.554898 28483 tablet_bootstrap.cc:492] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a: No bootstrap required, opened a new log
I20260709 12:26:28.556090 28483 ts_tablet_manager.cc:1403] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a: Time spent bootstrapping tablet: real 0.096s	user 0.021s	sys 0.003s
I20260709 12:26:28.561028 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e61260833443b8bc7f6fb485560fec" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:28.565276 28330 raft_consensus.cc:3060] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.572301 28079 catalog_manager.cc:5697] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:28.574317 28481 tablet_bootstrap.cc:654] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:28.575132 28496 raft_consensus.cc:493] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.576100 28496 raft_consensus.cc:515] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.586531 28258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854aa830a3e14c8c9cdfe10e94c72b1d" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
W20260709 12:26:28.589394 28149 leader_election.cc:343] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:28.601673 28080 catalog_manager.cc:5697] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "a007a2ab17a240d69915bf88b0d077f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:28.604425 28496 leader_election.cc:290] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:28.606938 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854aa830a3e14c8c9cdfe10e94c72b1d" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
W20260709 12:26:28.616400 28148 leader_election.cc:343] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:28.616961 28148 leader_election.cc:304] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4; no voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:28.620672 28496 raft_consensus.cc:2749] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:28.597574 28505 leader_election.cc:290] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:28.609218 28257 raft_consensus.cc:2468] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 1.
I20260709 12:26:28.630867 28482 tablet_bootstrap.cc:492] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2: No bootstrap required, opened a new log
I20260709 12:26:28.631603 28482 ts_tablet_manager.cc:1403] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent bootstrapping tablet: real 0.098s	user 0.040s	sys 0.051s
I20260709 12:26:28.633783 28481 tablet_bootstrap.cc:492] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4: No bootstrap required, opened a new log
I20260709 12:26:28.634609 28481 ts_tablet_manager.cc:1403] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4: Time spent bootstrapping tablet: real 0.107s	user 0.023s	sys 0.029s
I20260709 12:26:28.635533 28483 raft_consensus.cc:359] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.636441 28483 raft_consensus.cc:385] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.636271 28482 raft_consensus.cc:359] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.636840 28483 raft_consensus.cc:740] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.637207 28482 raft_consensus.cc:385] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.637539 28482 raft_consensus.cc:740] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.637751 28483 consensus_queue.cc:260] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.638521 28481 raft_consensus.cc:359] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.638500 28482 consensus_queue.cc:260] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.640688 28481 raft_consensus.cc:385] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.641115 28481 raft_consensus.cc:740] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.642037 28482 ts_tablet_manager.cc:1434] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:26:28.642728 28483 ts_tablet_manager.cc:1434] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.001s
I20260709 12:26:28.642141 28481 consensus_queue.cc:260] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.643852 28482 tablet_bootstrap.cc:492] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2: Bootstrap starting.
I20260709 12:26:28.644309 28483 tablet_bootstrap.cc:492] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a: Bootstrap starting.
I20260709 12:26:28.646716 28481 ts_tablet_manager.cc:1434] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 12:26:28.648305 28481 tablet_bootstrap.cc:492] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4: Bootstrap starting.
I20260709 12:26:28.650437 28149 leader_election.cc:304] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:28.652977 28483 tablet_bootstrap.cc:654] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:28.653213 28505 raft_consensus.cc:2804] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:28.653891 28505 raft_consensus.cc:697] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Becoming Leader. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:28.655040 28505 consensus_queue.cc:237] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.652977 28482 tablet_bootstrap.cc:654] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:28.661077 28496 consensus_queue.cc:1048] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:28.676831 28330 raft_consensus.cc:2468] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 1.
I20260709 12:26:28.678534 28481 tablet_bootstrap.cc:654] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:28.682866 28496 consensus_queue.cc:1048] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:28.691164 28483 tablet_bootstrap.cc:492] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a: No bootstrap required, opened a new log
I20260709 12:26:28.691920 28483 ts_tablet_manager.cc:1403] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.018s
I20260709 12:26:28.693634 28496 consensus_queue.cc:1048] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:28.693611 28081 catalog_manager.cc:5697] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "a007a2ab17a240d69915bf88b0d077f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:28.702775 28483 raft_consensus.cc:359] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.704288 28483 raft_consensus.cc:385] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.704663 28483 raft_consensus.cc:740] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.718585 28481 tablet_bootstrap.cc:492] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4: No bootstrap required, opened a new log
I20260709 12:26:28.719223 28481 ts_tablet_manager.cc:1403] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4: Time spent bootstrapping tablet: real 0.071s	user 0.009s	sys 0.012s
I20260709 12:26:28.721915 28499 raft_consensus.cc:493] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.722795 28482 tablet_bootstrap.cc:492] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2: No bootstrap required, opened a new log
I20260709 12:26:28.722518 28499 raft_consensus.cc:515] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.723520 28482 ts_tablet_manager.cc:1403] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent bootstrapping tablet: real 0.080s	user 0.015s	sys 0.010s
I20260709 12:26:28.727643 28499 leader_election.cc:290] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:28.728149 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7f40e72e304df3a4e1f0f7a0712493" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:28.730089 28482 raft_consensus.cc:359] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.730970 28482 raft_consensus.cc:385] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.731030 28258 raft_consensus.cc:3060] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.731356 28482 raft_consensus.cc:740] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.735532 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7f40e72e304df3a4e1f0f7a0712493" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:28.737481 28224 leader_election.cc:304] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5f5a402ae145969aaa2c646aa7676a; no voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:28.739276 28482 consensus_queue.cc:260] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.739795 28481 raft_consensus.cc:359] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.740483 28481 raft_consensus.cc:385] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.740760 28481 raft_consensus.cc:740] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.741578 28481 consensus_queue.cc:260] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.741976 28482 ts_tablet_manager.cc:1434] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:26:28.743233 28482 tablet_bootstrap.cc:492] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2: Bootstrap starting.
I20260709 12:26:28.743891 28481 ts_tablet_manager.cc:1434] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.002s
I20260709 12:26:28.734799 28483 consensus_queue.cc:260] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.747905 28483 ts_tablet_manager.cc:1434] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.001s
I20260709 12:26:28.749204 28483 tablet_bootstrap.cc:492] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a: Bootstrap starting.
I20260709 12:26:28.750332 28499 raft_consensus.cc:2749] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:28.775872 28505 consensus_queue.cc:1048] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:28.788856 28482 tablet_bootstrap.cc:654] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:28.793684 28483 tablet_bootstrap.cc:654] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:28.802657 28129 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:28.810012 28483 tablet_bootstrap.cc:492] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a: No bootstrap required, opened a new log
I20260709 12:26:28.810786 28483 ts_tablet_manager.cc:1403] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.005s
I20260709 12:26:28.811484 28522 raft_consensus.cc:493] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.812278 28522 raft_consensus.cc:515] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.814747 28522 leader_election.cc:290] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:28.815100 28468 consensus_queue.cc:1048] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:28.815982 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0392296a999544ee9a994e212c46bbf2" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:28.816689 28183 raft_consensus.cc:2468] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 0.
I20260709 12:26:28.819963 28298 leader_election.cc:304] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: 
I20260709 12:26:28.821146 28522 raft_consensus.cc:2804] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:28.821636 28522 raft_consensus.cc:493] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.822080 28522 raft_consensus.cc:3060] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.822865 28503 raft_consensus.cc:493] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.823050 28483 raft_consensus.cc:359] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.823486 28503 raft_consensus.cc:515] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.823983 28483 raft_consensus.cc:385] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.824314 28483 raft_consensus.cc:740] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.825115 28483 consensus_queue.cc:260] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.827121 28259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0392296a999544ee9a994e212c46bbf2" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:28.827898 28259 raft_consensus.cc:2468] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 0.
I20260709 12:26:28.829842 28483 ts_tablet_manager.cc:1434] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:26:28.830965 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0392296a999544ee9a994e212c46bbf2" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:28.831501 28183 raft_consensus.cc:2468] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 0.
I20260709 12:26:28.833416 28503 leader_election.cc:290] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:28.835551 28223 leader_election.cc:304] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:28.836897 28503 raft_consensus.cc:2804] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:28.840442 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0392296a999544ee9a994e212c46bbf2" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:28.846067 28503 raft_consensus.cc:493] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.846614 28503 raft_consensus.cc:3060] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.841835 28499 consensus_queue.cc:1048] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:28.843503 28482 tablet_bootstrap.cc:492] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2: No bootstrap required, opened a new log
I20260709 12:26:28.847522 28482 ts_tablet_manager.cc:1403] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent bootstrapping tablet: real 0.105s	user 0.021s	sys 0.001s
I20260709 12:26:28.851209 28482 raft_consensus.cc:359] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.852011 28482 raft_consensus.cc:385] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:28.852293 28482 raft_consensus.cc:740] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Initialized, Role: FOLLOWER
I20260709 12:26:28.844554 28468 consensus_queue.cc:1048] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:28.857234 28482 consensus_queue.cc:260] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.865247 28522 raft_consensus.cc:515] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.866794 28330 raft_consensus.cc:2393] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef5f5a402ae145969aaa2c646aa7676a in current term 1: Already voted for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in this term.
I20260709 12:26:28.868110 28482 ts_tablet_manager.cc:1434] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:26:28.876029 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0392296a999544ee9a994e212c46bbf2" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:28.876869 28182 raft_consensus.cc:3060] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.879233 28470 raft_consensus.cc:493] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.879884 28470 raft_consensus.cc:515] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.881999 28470 leader_election.cc:290] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:28.882926 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854aa830a3e14c8c9cdfe10e94c72b1d" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:28.883797 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854aa830a3e14c8c9cdfe10e94c72b1d" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:28.883911 28183 raft_consensus.cc:2468] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 0.
I20260709 12:26:28.884744 28257 raft_consensus.cc:2468] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 0.
I20260709 12:26:28.887213 28298 leader_election.cc:304] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: 
I20260709 12:26:28.889195 28470 raft_consensus.cc:2804] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:28.889734 28470 raft_consensus.cc:493] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.890172 28470 raft_consensus.cc:3060] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.900924 28503 raft_consensus.cc:515] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.901942 28522 leader_election.cc:290] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 1 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:28.903003 28182 raft_consensus.cc:2468] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 1.
I20260709 12:26:28.904006 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0392296a999544ee9a994e212c46bbf2" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:28.904666 28298 leader_election.cc:304] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: 
I20260709 12:26:28.906009 28521 raft_consensus.cc:2804] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:28.906729 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0392296a999544ee9a994e212c46bbf2" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:28.907823 28183 raft_consensus.cc:2393] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ef5f5a402ae145969aaa2c646aa7676a in current term 1: Already voted for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in this term.
I20260709 12:26:28.908169 28257 raft_consensus.cc:2393] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 762fe3ee980d4126b2d1302af1fbe8b2 in current term 1: Already voted for candidate ef5f5a402ae145969aaa2c646aa7676a in this term.
I20260709 12:26:28.916172 28507 raft_consensus.cc:493] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.916738 28507 raft_consensus.cc:515] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.919112 28507 leader_election.cc:290] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:28.920626 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87492f293854900a93fe85ba9e569c6" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:28.920918 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87492f293854900a93fe85ba9e569c6" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:28.921583 28257 raft_consensus.cc:2468] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 0.
I20260709 12:26:28.921708 28330 raft_consensus.cc:2468] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 0.
I20260709 12:26:28.922905 28521 raft_consensus.cc:697] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 LEADER]: Becoming Leader. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Running, Role: LEADER
I20260709 12:26:28.921754 28468 consensus_queue.cc:1048] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:26:28.918025 28503 leader_election.cc:290] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:28.919607 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0392296a999544ee9a994e212c46bbf2" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:28.923137 28149 leader_election.cc:304] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:28.928078 28507 raft_consensus.cc:2804] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:28.928625 28507 raft_consensus.cc:493] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.929036 28507 raft_consensus.cc:3060] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.931445 28224 leader_election.cc:304] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5f5a402ae145969aaa2c646aa7676a; no voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:28.936431 28521 consensus_queue.cc:237] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.938480 28468 raft_consensus.cc:2749] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:28.940377 28507 raft_consensus.cc:515] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.937626 28470 raft_consensus.cc:515] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.944876 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854aa830a3e14c8c9cdfe10e94c72b1d" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:28.945019 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854aa830a3e14c8c9cdfe10e94c72b1d" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:28.945544 28257 raft_consensus.cc:3060] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.945904 28184 raft_consensus.cc:3060] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.952143 28258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87492f293854900a93fe85ba9e569c6" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:28.953454 28258 raft_consensus.cc:3060] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.955435 28470 leader_election.cc:290] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 1 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:28.961833 28184 raft_consensus.cc:2468] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 1.
I20260709 12:26:28.963474 28507 leader_election.cc:290] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:28.953495 28257 raft_consensus.cc:2468] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 1.
I20260709 12:26:28.966121 28298 leader_election.cc:304] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: 
I20260709 12:26:28.967573 28258 raft_consensus.cc:2468] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 1.
I20260709 12:26:28.969131 28333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87492f293854900a93fe85ba9e569c6" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:28.969309 28149 leader_election.cc:304] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:28.969907 28333 raft_consensus.cc:3060] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:28.970191 28507 raft_consensus.cc:2804] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:28.970748 28507 raft_consensus.cc:697] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Becoming Leader. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:28.971596 28507 consensus_queue.cc:237] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.976302 28521 raft_consensus.cc:2804] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:28.977185 28521 raft_consensus.cc:697] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 LEADER]: Becoming Leader. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Running, Role: LEADER
I20260709 12:26:28.978893 28521 consensus_queue.cc:237] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:28.990484 28333 raft_consensus.cc:2468] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 1.
I20260709 12:26:28.983327 28081 catalog_manager.cc:5697] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:29.007666 28079 catalog_manager.cc:5697] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129). New cstate: current_term: 1 leader_uuid: "a007a2ab17a240d69915bf88b0d077f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:29.010759 28081 catalog_manager.cc:5697] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131). New cstate: current_term: 1 leader_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:29.043932 28507 consensus_queue.cc:1048] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:29.044796 28521 consensus_queue.cc:1048] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:29.061496 28521 consensus_queue.cc:1048] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:29.061592 28507 consensus_queue.cc:1048] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:29.292848 28333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61"
dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
mode: GRACEFUL
new_leader_uuid: "a007a2ab17a240d69915bf88b0d077f4"
 from {username='slave'} at 127.0.0.1:43568
I20260709 12:26:29.293537 28333 raft_consensus.cc:606] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 LEADER]: Received request to transfer leadership to TS a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:29.301218 28258 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c05e47844561411c80bf0b4c4afb750c"
dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
mode: GRACEFUL
new_leader_uuid: "a007a2ab17a240d69915bf88b0d077f4"
 from {username='slave'} at 127.0.0.1:43054
I20260709 12:26:29.301833 28258 raft_consensus.cc:606] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Received request to transfer leadership to TS a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:29.311547 28258 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0049d7e49a5246daa1156c4f09a566ae"
dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
mode: GRACEFUL
new_leader_uuid: "a007a2ab17a240d69915bf88b0d077f4"
 from {username='slave'} at 127.0.0.1:43054
I20260709 12:26:29.312178 28258 raft_consensus.cc:606] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Received request to transfer leadership to TS a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:29.318783 28183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64990029b0c741de97237387efd30fcb"
dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
mode: GRACEFUL
new_leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
 from {username='slave'} at 127.0.0.1:46270
I20260709 12:26:29.319525 28183 raft_consensus.cc:606] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Received request to transfer leadership to TS ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:29.325258 28183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85e61260833443b8bc7f6fb485560fec"
dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
mode: GRACEFUL
new_leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
 from {username='slave'} at 127.0.0.1:46270
I20260709 12:26:29.325867 28183 raft_consensus.cc:606] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Received request to transfer leadership to TS ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:29.331431 28331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "854aa830a3e14c8c9cdfe10e94c72b1d"
dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
mode: GRACEFUL
new_leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
 from {username='slave'} at 127.0.0.1:43568
I20260709 12:26:29.332109 28331 raft_consensus.cc:606] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 LEADER]: Received request to transfer leadership to TS ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:29.337982 28183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c87492f293854900a93fe85ba9e569c6"
dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
mode: GRACEFUL
new_leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
 from {username='slave'} at 127.0.0.1:46270
I20260709 12:26:29.338716 28183 raft_consensus.cc:606] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Received request to transfer leadership to TS ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:29.378026 28470 consensus_queue.cc:1048] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:29.381875 28468 raft_consensus.cc:993] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a: : Instructing follower a007a2ab17a240d69915bf88b0d077f4 to start an election
I20260709 12:26:29.382611 28499 raft_consensus.cc:1081] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Signalling peer a007a2ab17a240d69915bf88b0d077f4 to start an election
I20260709 12:26:29.385064 28182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0049d7e49a5246daa1156c4f09a566ae"
dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
 from {username='slave'} at 127.0.0.1:46240
I20260709 12:26:29.385753 28182 raft_consensus.cc:493] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:29.386188 28182 raft_consensus.cc:3060] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.389528 28496 consensus_queue.cc:1048] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:29.394508 28522 consensus_queue.cc:1048] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:29.397631 28182 raft_consensus.cc:515] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:29.404800 28470 raft_consensus.cc:993] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2: : Instructing follower ef5f5a402ae145969aaa2c646aa7676a to start an election
I20260709 12:26:29.405427 28521 raft_consensus.cc:1081] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 LEADER]: Signalling peer ef5f5a402ae145969aaa2c646aa7676a to start an election
I20260709 12:26:29.407735 28256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "854aa830a3e14c8c9cdfe10e94c72b1d"
dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
 from {username='slave'} at 127.0.0.1:43050
I20260709 12:26:29.408886 28256 raft_consensus.cc:493] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:29.408967 28544 raft_consensus.cc:993] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a: : Instructing follower a007a2ab17a240d69915bf88b0d077f4 to start an election
I20260709 12:26:29.409436 28256 raft_consensus.cc:3060] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.410135 28544 raft_consensus.cc:1081] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Signalling peer a007a2ab17a240d69915bf88b0d077f4 to start an election
I20260709 12:26:29.414692 28258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0049d7e49a5246daa1156c4f09a566ae" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:29.414839 28183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c05e47844561411c80bf0b4c4afb750c"
dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
 from {username='slave'} at 127.0.0.1:46240
I20260709 12:26:29.415647 28258 raft_consensus.cc:3055] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:29.415879 28183 raft_consensus.cc:493] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:29.416410 28258 raft_consensus.cc:740] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:29.416795 28183 raft_consensus.cc:3060] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.417450 28258 consensus_queue.cc:260] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:29.418846 28258 raft_consensus.cc:3060] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.423712 28505 raft_consensus.cc:993] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4: : Instructing follower ef5f5a402ae145969aaa2c646aa7676a to start an election
I20260709 12:26:29.424391 28505 raft_consensus.cc:1081] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Signalling peer ef5f5a402ae145969aaa2c646aa7676a to start an election
I20260709 12:26:29.427205 28183 raft_consensus.cc:515] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:29.428416 28182 leader_election.cc:290] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 2 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:29.429719 28183 leader_election.cc:290] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 2 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:29.427686 28256 raft_consensus.cc:515] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:29.431264 28333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0049d7e49a5246daa1156c4f09a566ae" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:29.431883 28333 raft_consensus.cc:3060] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.432674 28256 leader_election.cc:290] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:29.433432 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854aa830a3e14c8c9cdfe10e94c72b1d" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:29.434077 28182 raft_consensus.cc:3060] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.437366 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05e47844561411c80bf0b4c4afb750c" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:29.438216 28331 raft_consensus.cc:3060] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.439551 28259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c87492f293854900a93fe85ba9e569c6"
dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
 from {username='slave'} at 127.0.0.1:43040
I20260709 12:26:29.440456 28259 raft_consensus.cc:493] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:29.440858 28259 raft_consensus.cc:3060] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.442451 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854aa830a3e14c8c9cdfe10e94c72b1d" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:29.443341 28330 raft_consensus.cc:3055] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:29.443468 28505 consensus_queue.cc:1048] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:29.445529 28496 raft_consensus.cc:993] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4: : Instructing follower ef5f5a402ae145969aaa2c646aa7676a to start an election
I20260709 12:26:29.446130 28496 raft_consensus.cc:1081] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Signalling peer ef5f5a402ae145969aaa2c646aa7676a to start an election
I20260709 12:26:29.440802 28258 raft_consensus.cc:2468] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 2.
I20260709 12:26:29.443821 28330 raft_consensus.cc:740] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Running, Role: LEADER
I20260709 12:26:29.448544 28330 consensus_queue.cc:260] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:29.455343 28258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64990029b0c741de97237387efd30fcb"
dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
 from {username='slave'} at 127.0.0.1:43040
I20260709 12:26:29.456333 28258 raft_consensus.cc:493] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:29.456825 28258 raft_consensus.cc:3060] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.455278 28149 leader_election.cc:304] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:29.466313 28333 raft_consensus.cc:2468] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 2.
I20260709 12:26:29.442476 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05e47844561411c80bf0b4c4afb750c" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:29.468137 28256 raft_consensus.cc:3055] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:29.469038 28330 raft_consensus.cc:3060] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.469326 28256 raft_consensus.cc:740] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:29.470453 28256 consensus_queue.cc:260] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:29.471812 28256 raft_consensus.cc:3060] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.473827 28331 raft_consensus.cc:2468] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 2.
I20260709 12:26:29.468976 28505 raft_consensus.cc:2804] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:29.475674 28505 raft_consensus.cc:697] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Becoming Leader. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:29.476565 28148 leader_election.cc:304] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: 
I20260709 12:26:29.480763 28502 raft_consensus.cc:2804] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:29.481381 28502 raft_consensus.cc:697] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Becoming Leader. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:29.480840 28505 consensus_queue.cc:237] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:29.482488 28502 consensus_queue.cc:237] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:29.484335 28256 raft_consensus.cc:2468] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 2.
I20260709 12:26:29.487214 28182 raft_consensus.cc:2468] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 2.
I20260709 12:26:29.479279 28330 raft_consensus.cc:2468] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 2.
I20260709 12:26:29.489219 28258 raft_consensus.cc:515] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:29.489720 28224 leader_election.cc:304] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:29.489841 28259 raft_consensus.cc:515] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:29.490607 28544 raft_consensus.cc:2804] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:29.491376 28544 raft_consensus.cc:697] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Becoming Leader. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:29.492336 28544 consensus_queue.cc:237] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:29.493474 28080 catalog_manager.cc:5697] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 reported cstate change: term changed from 1 to 2, leader changed from ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130) to a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129). New cstate: current_term: 2 leader_uuid: "a007a2ab17a240d69915bf88b0d077f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:29.496305 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64990029b0c741de97237387efd30fcb" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:29.496501 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64990029b0c741de97237387efd30fcb" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:29.497020 28183 raft_consensus.cc:3055] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:29.497155 28330 raft_consensus.cc:3060] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.497411 28183 raft_consensus.cc:740] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:29.498346 28183 consensus_queue.cc:260] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:29.500927 28183 raft_consensus.cc:3060] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.499898 28258 leader_election.cc:290] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:29.513612 28330 raft_consensus.cc:2468] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 2.
I20260709 12:26:29.515062 28224 leader_election.cc:304] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:29.515523 28521 consensus_queue.cc:1048] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:29.516268 28468 raft_consensus.cc:2804] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:29.516801 28468 raft_consensus.cc:697] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Becoming Leader. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:29.517232 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87492f293854900a93fe85ba9e569c6" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:29.517728 28468 consensus_queue.cc:237] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:29.514765 28183 raft_consensus.cc:2468] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 2.
I20260709 12:26:29.517864 28330 raft_consensus.cc:3060] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.515733 28259 leader_election.cc:290] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:29.521301 28080 catalog_manager.cc:5697] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 reported cstate change: term changed from 1 to 2, leader changed from ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130) to a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129). New cstate: current_term: 2 leader_uuid: "a007a2ab17a240d69915bf88b0d077f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:29.523540 28079 catalog_manager.cc:5697] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a reported cstate change: term changed from 1 to 2, leader changed from 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131) to ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130). New cstate: current_term: 2 leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:29.526475 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87492f293854900a93fe85ba9e569c6" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:29.527194 28182 raft_consensus.cc:3055] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:29.527508 28182 raft_consensus.cc:740] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:29.528542 28182 consensus_queue.cc:260] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:29.530095 28182 raft_consensus.cc:3060] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.528568 28330 raft_consensus.cc:2468] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 2.
I20260709 12:26:29.533602 28224 leader_election.cc:304] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:29.534655 28468 raft_consensus.cc:2804] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:29.535159 28468 raft_consensus.cc:697] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Becoming Leader. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:29.536288 28468 consensus_queue.cc:237] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:29.537856 28545 raft_consensus.cc:993] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2: : Instructing follower a007a2ab17a240d69915bf88b0d077f4 to start an election
I20260709 12:26:29.538398 28545 raft_consensus.cc:1081] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 LEADER]: Signalling peer a007a2ab17a240d69915bf88b0d077f4 to start an election
I20260709 12:26:29.539288 28182 raft_consensus.cc:2468] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 2.
I20260709 12:26:29.541868 28183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61"
dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
 from {username='slave'} at 127.0.0.1:46256
I20260709 12:26:29.542462 28183 raft_consensus.cc:493] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:29.542843 28183 raft_consensus.cc:3060] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.542948 28470 consensus_queue.cc:1048] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:29.555342 28079 catalog_manager.cc:5697] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a reported cstate change: term changed from 1 to 2, leader changed from a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129) to ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130). New cstate: current_term: 2 leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:29.557749 28079 catalog_manager.cc:5697] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a reported cstate change: term changed from 1 to 2, leader changed from a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129) to ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130). New cstate: current_term: 2 leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:29.566056 28183 raft_consensus.cc:515] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:29.569444 28183 leader_election.cc:290] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 2 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:29.569392 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:29.570638 28256 raft_consensus.cc:3060] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.570866 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:29.571501 28330 raft_consensus.cc:3055] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:29.571815 28330 raft_consensus.cc:740] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Running, Role: LEADER
I20260709 12:26:29.572621 28330 consensus_queue.cc:260] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:29.573892 28330 raft_consensus.cc:3060] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.581600 28330 raft_consensus.cc:2468] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 2.
I20260709 12:26:29.580966 28256 raft_consensus.cc:2468] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 2.
I20260709 12:26:29.583463 28148 leader_election.cc:304] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: 
I20260709 12:26:29.585218 28502 raft_consensus.cc:2804] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:29.585744 28502 raft_consensus.cc:697] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Becoming Leader. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:29.586660 28502 consensus_queue.cc:237] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:29.594493 28081 catalog_manager.cc:5697] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 reported cstate change: term changed from 1 to 2, leader changed from 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131) to a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129). New cstate: current_term: 2 leader_uuid: "a007a2ab17a240d69915bf88b0d077f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:29.663393 28507 raft_consensus.cc:993] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4: : Instructing follower ef5f5a402ae145969aaa2c646aa7676a to start an election
I20260709 12:26:29.663970 28502 raft_consensus.cc:1081] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Signalling peer ef5f5a402ae145969aaa2c646aa7676a to start an election
I20260709 12:26:29.665763 28256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85e61260833443b8bc7f6fb485560fec"
dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
 from {username='slave'} at 127.0.0.1:43040
I20260709 12:26:29.666320 28256 raft_consensus.cc:493] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:29.666687 28256 raft_consensus.cc:3060] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.673488 28256 raft_consensus.cc:515] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:29.675485 28256 leader_election.cc:290] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:29.676679 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e61260833443b8bc7f6fb485560fec" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:29.676877 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e61260833443b8bc7f6fb485560fec" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:29.677435 28330 raft_consensus.cc:3060] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.677501 28183 raft_consensus.cc:3055] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:29.677975 28183 raft_consensus.cc:740] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:29.679067 28183 consensus_queue.cc:260] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:29.680569 28183 raft_consensus.cc:3060] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.683483 28330 raft_consensus.cc:2468] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 2.
I20260709 12:26:29.684917 28224 leader_election.cc:304] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:29.685786 28468 raft_consensus.cc:2804] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:29.686334 28468 raft_consensus.cc:697] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Becoming Leader. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:29.686825 28183 raft_consensus.cc:2468] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 2.
I20260709 12:26:29.687167 28468 consensus_queue.cc:237] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:29.695065 28081 catalog_manager.cc:5697] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a reported cstate change: term changed from 1 to 2, leader changed from a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129) to ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130). New cstate: current_term: 2 leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:29.868852 28330 raft_consensus.cc:1275] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:29.870365 28507 consensus_queue.cc:1048] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:29.880085 28256 raft_consensus.cc:1275] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:29.882051 28502 consensus_queue.cc:1048] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:29.906378 28330 raft_consensus.cc:1275] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:29.907996 28502 consensus_queue.cc:1048] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:29.919025 28256 raft_consensus.cc:1275] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:29.920562 28507 consensus_queue.cc:1048] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:29.967226 28183 raft_consensus.cc:1275] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Refusing update from remote peer ef5f5a402ae145969aaa2c646aa7676a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:29.968919 28544 consensus_queue.cc:1048] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:29.985088 28330 raft_consensus.cc:1275] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Refusing update from remote peer ef5f5a402ae145969aaa2c646aa7676a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:29.986887 28565 consensus_queue.cc:1048] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:29.988426 28256 raft_consensus.cc:1275] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:29.990001 28505 consensus_queue.cc:1048] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:30.000869 28330 raft_consensus.cc:1275] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:30.002440 28507 consensus_queue.cc:1048] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:30.034502 28333 raft_consensus.cc:1275] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Refusing update from remote peer ef5f5a402ae145969aaa2c646aa7676a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:30.035004 28330 raft_consensus.cc:1275] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Refusing update from remote peer ef5f5a402ae145969aaa2c646aa7676a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:30.035826 28564 consensus_queue.cc:1048] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:30.036806 28565 consensus_queue.cc:1048] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:30.045754 28182 raft_consensus.cc:1275] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Refusing update from remote peer ef5f5a402ae145969aaa2c646aa7676a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:30.048228 28544 consensus_queue.cc:1048] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:30.052258 28182 raft_consensus.cc:1275] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Refusing update from remote peer ef5f5a402ae145969aaa2c646aa7676a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:30.056726 28468 consensus_queue.cc:1048] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:30.187405 28183 raft_consensus.cc:1275] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Refusing update from remote peer ef5f5a402ae145969aaa2c646aa7676a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:30.188741 28468 consensus_queue.cc:1048] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:30.199057 28333 raft_consensus.cc:1275] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Refusing update from remote peer ef5f5a402ae145969aaa2c646aa7676a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:30.200697 28544 consensus_queue.cc:1048] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:32.345480 28079 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34696:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:26:32.367134 28079 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34696:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:26:32.413640 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:32.583978 28256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d085b020751c45dea7e6434ac0bd152b"
dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
mode: GRACEFUL
new_leader_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
 from {username='slave'} at 127.0.0.1:49280
I20260709 12:26:32.598315 28256 raft_consensus.cc:606] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Received request to transfer leadership to TS 762fe3ee980d4126b2d1302af1fbe8b2
W20260709 12:26:32.647370 28605 log.cc:927] Time spent T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:26:32.661162 28617 tablet.cc:1724] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:32.722016 28148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:42713, user_credentials={real_user=slave}} blocked reactor thread for 63855.9us
I20260709 12:26:32.722849 28633 tablet.cc:1724] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:32.725874 28632 tablet.cc:1724] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:32.681806 28149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.130:34303, user_credentials={real_user=slave}} blocked reactor thread for 63397.8us
W20260709 12:26:32.772998 28148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.131:42713, user_credentials={real_user=slave}} blocked reactor thread for 49940.2us
W20260709 12:26:32.774471 28298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.240.129:33263, user_credentials={real_user=slave}} blocked reactor thread for 50313.5us
I20260709 12:26:32.816936 28636 tablet.cc:1724] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:32.832698 28640 tablet.cc:1724] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:32.857299 28180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4ccd09ed5bc42808c274a7a88028d76"
dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
mode: GRACEFUL
new_leader_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
 from {username='slave'} at 127.0.0.1:51932
I20260709 12:26:32.858700 28180 raft_consensus.cc:606] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Received request to transfer leadership to TS 762fe3ee980d4126b2d1302af1fbe8b2
I20260709 12:26:32.808231 28641 tablet.cc:1724] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:32.872624 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:32.873354 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:32.933779 28650 tablet.cc:1724] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:32.941174 28617 tablet.cc:1724] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:32.916085 28647 tablet.cc:1724] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:32.929312 28646 tablet.cc:1724] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:32.980751 28632 tablet.cc:1724] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:32.984195 28652 tablet.cc:1724] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:32.988646 28631 raft_consensus.cc:993] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4: : Instructing follower 762fe3ee980d4126b2d1302af1fbe8b2 to start an election
I20260709 12:26:32.989225 28631 raft_consensus.cc:1081] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Signalling peer 762fe3ee980d4126b2d1302af1fbe8b2 to start an election
I20260709 12:26:32.963338 28633 tablet.cc:1724] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:33.000065 28652 tablet.cc:1724] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:33.018047 28650 tablet.cc:1724] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:33.023308 28616 raft_consensus.cc:993] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a: : Instructing follower 762fe3ee980d4126b2d1302af1fbe8b2 to start an election
I20260709 12:26:33.024047 28616 raft_consensus.cc:1081] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Signalling peer 762fe3ee980d4126b2d1302af1fbe8b2 to start an election
I20260709 12:26:33.026741 28651 tablet.cc:1724] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:33.031314 28331 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4ccd09ed5bc42808c274a7a88028d76"
dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
 from {username='slave'} at 127.0.0.1:43554
I20260709 12:26:33.032128 28331 raft_consensus.cc:493] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:33.032516 28331 raft_consensus.cc:3060] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.019279 28636 tablet.cc:1724] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:33.043632 28641 tablet.cc:1724] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:33.048831 28333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d085b020751c45dea7e6434ac0bd152b"
dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
 from {username='slave'} at 127.0.0.1:43544
I20260709 12:26:33.054229 28333 raft_consensus.cc:493] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:33.054569 28333 raft_consensus.cc:3060] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.069406 28632 tablet.cc:1724] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:33.076920 28331 raft_consensus.cc:515] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:33.081339 28333 raft_consensus.cc:515] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:33.088357 28653 tablet.cc:1724] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:33.093052 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ccd09ed5bc42808c274a7a88028d76" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:33.093829 28181 raft_consensus.cc:3055] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:33.094162 28181 raft_consensus.cc:740] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:33.094951 28181 consensus_queue.cc:260] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:33.101182 28617 tablet.cc:1724] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:33.100111 28646 tablet.cc:1724] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:33.104236 28651 tablet.cc:1724] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:33.107818 28650 tablet.cc:1724] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:33.111521 28181 raft_consensus.cc:3060] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.113860 28258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ccd09ed5bc42808c274a7a88028d76" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:33.114751 28258 raft_consensus.cc:3060] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.101634 28640 tablet.cc:1724] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:33.123716 28331 leader_election.cc:290] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:33.130285 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d085b020751c45dea7e6434ac0bd152b" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:33.130439 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d085b020751c45dea7e6434ac0bd152b" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:33.131083 28256 raft_consensus.cc:3055] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:33.131203 28182 raft_consensus.cc:3060] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.131570 28256 raft_consensus.cc:740] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:33.132259 28653 tablet.cc:1724] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:33.135073 28333 leader_election.cc:290] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 2 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:33.132571 28256 consensus_queue.cc:260] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:33.140627 28256 raft_consensus.cc:3060] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.155088 28653 tablet.cc:1724] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:33.170904 28182 raft_consensus.cc:2468] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 2.
I20260709 12:26:33.172585 28298 leader_election.cc:304] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: 
I20260709 12:26:33.174443 28522 raft_consensus.cc:2804] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:33.175032 28522 raft_consensus.cc:697] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 LEADER]: Becoming Leader. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Running, Role: LEADER
I20260709 12:26:33.175976 28522 consensus_queue.cc:237] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:33.196374 28258 raft_consensus.cc:2468] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 3.
I20260709 12:26:33.199643 28300 leader_election.cc:304] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:33.201071 28522 raft_consensus.cc:2804] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:33.201936 28522 raft_consensus.cc:697] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 LEADER]: Becoming Leader. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Running, Role: LEADER
I20260709 12:26:33.198608 28256 raft_consensus.cc:2468] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 2.
I20260709 12:26:33.202630 28181 raft_consensus.cc:2468] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 3.
I20260709 12:26:33.206553 28522 consensus_queue.cc:237] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:33.219341 28081 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5: soft_deleted_table [id=57ce33f0a797402283d12dfcfac5b805] alter complete (version 1)
I20260709 12:26:33.231396 28079 catalog_manager.cc:5697] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 reported cstate change: term changed from 1 to 2, leader changed from ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130) to 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131). New cstate: current_term: 2 leader_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:33.232867 28079 catalog_manager.cc:5697] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 reported cstate change: term changed from 2 to 3, leader changed from a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129) to 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131). New cstate: current_term: 3 leader_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:33.708484 28256 raft_consensus.cc:1275] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Refusing update from remote peer 762fe3ee980d4126b2d1302af1fbe8b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:33.709964 28522 consensus_queue.cc:1048] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:33.727154 28181 raft_consensus.cc:1275] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Refusing update from remote peer 762fe3ee980d4126b2d1302af1fbe8b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:33.732856 28663 consensus_queue.cc:1048] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:33.749197 28256 raft_consensus.cc:1275] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Refusing update from remote peer 762fe3ee980d4126b2d1302af1fbe8b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:33.750865 28522 consensus_queue.cc:1048] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:33.764253 28181 raft_consensus.cc:1275] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Refusing update from remote peer 762fe3ee980d4126b2d1302af1fbe8b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:33.767133 28664 consensus_queue.cc:1048] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:33.874768 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:33.880254 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:33.880661 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:35.472105 28670 raft_consensus.cc:493] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 762fe3ee980d4126b2d1302af1fbe8b2)
I20260709 12:26:35.473052 28670 raft_consensus.cc:515] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.473942 28669 raft_consensus.cc:493] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:35.476214 28670 leader_election.cc:290] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:35.477157 28669 raft_consensus.cc:515] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.478046 28670 raft_consensus.cc:493] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:35.479182 28670 raft_consensus.cc:515] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.481909 28670 leader_election.cc:290] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:35.483466 28669 leader_election.cc:290] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:35.500331 28669 raft_consensus.cc:493] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:35.501051 28669 raft_consensus.cc:515] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.503559 28669 leader_election.cc:290] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:35.510212 28671 raft_consensus.cc:493] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 762fe3ee980d4126b2d1302af1fbe8b2)
I20260709 12:26:35.511518 28671 raft_consensus.cc:515] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.514634 28671 leader_election.cc:290] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:35.515758 28670 raft_consensus.cc:493] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 762fe3ee980d4126b2d1302af1fbe8b2)
I20260709 12:26:35.516372 28669 raft_consensus.cc:493] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:35.518093 28670 raft_consensus.cc:515] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.519961 28671 raft_consensus.cc:493] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 762fe3ee980d4126b2d1302af1fbe8b2)
I20260709 12:26:35.520877 28671 raft_consensus.cc:515] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.525447 28670 leader_election.cc:290] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:35.525184 28671 leader_election.cc:290] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:35.526649 28674 raft_consensus.cc:493] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 762fe3ee980d4126b2d1302af1fbe8b2)
I20260709 12:26:35.527520 28674 raft_consensus.cc:515] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.530783 28674 leader_election.cc:290] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:35.517378 28669 raft_consensus.cc:515] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.544001 28677 raft_consensus.cc:493] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef5f5a402ae145969aaa2c646aa7676a)
I20260709 12:26:35.556908 28677 raft_consensus.cc:515] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.560230 28674 raft_consensus.cc:493] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 762fe3ee980d4126b2d1302af1fbe8b2)
I20260709 12:26:35.562016 28674 raft_consensus.cc:515] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.562602 28677 leader_election.cc:290] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:35.565095 28677 raft_consensus.cc:493] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef5f5a402ae145969aaa2c646aa7676a)
I20260709 12:26:35.566330 28677 raft_consensus.cc:515] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.565317 28674 leader_election.cc:290] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:35.573489 28674 raft_consensus.cc:493] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef5f5a402ae145969aaa2c646aa7676a)
I20260709 12:26:35.569305 28669 leader_election.cc:290] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:35.575978 28674 raft_consensus.cc:515] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.581570 28256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43040 (request call id 167) took 1472 ms. Trace:
I20260709 12:26:35.582573 28674 leader_election.cc:290] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:35.583983 28673 raft_consensus.cc:493] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef5f5a402ae145969aaa2c646aa7676a)
I20260709 12:26:35.579226 28679 raft_consensus.cc:493] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef5f5a402ae145969aaa2c646aa7676a)
I20260709 12:26:35.611132 28674 raft_consensus.cc:493] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 762fe3ee980d4126b2d1302af1fbe8b2)
I20260709 12:26:35.582057 28256 rpcz_store.cc:276] 0709 12:26:34.108952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.109183 (+   231us) service_pool.cc:224] Handling call
0709 12:26:34.111323 (+  2140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:34.112081 (+   758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:34.112129 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:34.112189 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:34.112243 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:34.138073 (+ 25830us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:35.581476 (+1443403us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:35.612139 28674 raft_consensus.cc:515] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.585764 28675 raft_consensus.cc:493] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef5f5a402ae145969aaa2c646aa7676a)
I20260709 12:26:35.613546 28675 raft_consensus.cc:515] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.615047 28669 raft_consensus.cc:493] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:35.615700 28669 raft_consensus.cc:515] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.618992 28669 leader_election.cc:290] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:35.576349 28677 leader_election.cc:290] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:35.626991 28674 leader_election.cc:290] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:35.584751 28673 raft_consensus.cc:515] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.773068 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0392296a999544ee9a994e212c46bbf2" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:35.773682 28673 leader_election.cc:290] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:35.639412 28675 leader_election.cc:290] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:35.775065 28180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7f40e72e304df3a4e1f0f7a0712493" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:35.775511 28674 raft_consensus.cc:493] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 762fe3ee980d4126b2d1302af1fbe8b2)
I20260709 12:26:35.773826 28184 raft_consensus.cc:2468] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 1.
I20260709 12:26:35.775169 28676 raft_consensus.cc:493] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef5f5a402ae145969aaa2c646aa7676a)
I20260709 12:26:35.776598 28675 raft_consensus.cc:493] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:35.777032 28676 raft_consensus.cc:515] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.777181 28675 raft_consensus.cc:515] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.776150 28674 raft_consensus.cc:515] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.585095 28679 raft_consensus.cc:515] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.855965 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d085b020751c45dea7e6434ac0bd152b" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:35.857008 28184 raft_consensus.cc:2468] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 2.
I20260709 12:26:35.861860 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:35.863626 28679 leader_election.cc:290] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:35.861918 28686 raft_consensus.cc:493] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:35.878690 28675 leader_election.cc:290] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:35.879714 28685 raft_consensus.cc:493] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef5f5a402ae145969aaa2c646aa7676a)
I20260709 12:26:35.878273 28686 raft_consensus.cc:515] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.874692 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0049d7e49a5246daa1156c4f09a566ae" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:35.882915 28686 leader_election.cc:290] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:35.880396 28685 raft_consensus.cc:515] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.894408 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:35.894735 28180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71b973b042c49ba9466c769a907c2b8" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:35.895524 28685 leader_election.cc:290] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:35.896121 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ccd09ed5bc42808c274a7a88028d76" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:35.896785 28181 raft_consensus.cc:2468] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 3.
I20260709 12:26:35.897425 28223 leader_election.cc:304] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:35.898232 28679 raft_consensus.cc:493] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef5f5a402ae145969aaa2c646aa7676a)
I20260709 12:26:35.898331 28223 leader_election.cc:304] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:35.898736 28671 raft_consensus.cc:2804] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:35.899235 28671 raft_consensus.cc:493] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 762fe3ee980d4126b2d1302af1fbe8b2)
I20260709 12:26:35.898895 28679 raft_consensus.cc:515] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.899554 28676 leader_election.cc:290] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:35.899672 28671 raft_consensus.cc:3060] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:35.898425 28674 leader_election.cc:290] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:35.901283 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ab36077d1643788dabe2f6a3af3488" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:35.901995 28182 raft_consensus.cc:2468] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 2.
I20260709 12:26:35.883451 28686 raft_consensus.cc:493] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef5f5a402ae145969aaa2c646aa7676a)
I20260709 12:26:35.899354 28669 raft_consensus.cc:2804] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:35.884075 28673 raft_consensus.cc:493] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:35.908181 28673 raft_consensus.cc:515] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } } peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } }
I20260709 12:26:35.892563 28681 raft_consensus.cc:493] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:35.912506 28681 raft_consensus.cc:515] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.913787 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4749e4e08c14875922b881d4fd5d500" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:35.914623 28181 raft_consensus.cc:2468] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 2.
I20260709 12:26:35.901460 28679 leader_election.cc:290] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:35.902859 28669 raft_consensus.cc:493] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 762fe3ee980d4126b2d1302af1fbe8b2)
I20260709 12:26:35.902843 28686 raft_consensus.cc:515] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.918017 28669 raft_consensus.cc:3060] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:35.915253 28671 raft_consensus.cc:515] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.919720 28675 raft_consensus.cc:493] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef5f5a402ae145969aaa2c646aa7676a)
I20260709 12:26:35.920346 28675 raft_consensus.cc:515] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.921516 28671 leader_election.cc:290] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:35.922701 28676 raft_consensus.cc:493] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef5f5a402ae145969aaa2c646aa7676a)
I20260709 12:26:35.923305 28676 raft_consensus.cc:515] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.927160 28670 raft_consensus.cc:493] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:35.927726 28670 raft_consensus.cc:515] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } } peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } }
I20260709 12:26:35.929908 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbad5c4d8fb6444f880e49cdfec8c39d" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:35.930265 28332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854aa830a3e14c8c9cdfe10e94c72b1d" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:35.933508 28332 raft_consensus.cc:2468] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 2.
I20260709 12:26:35.933725 28334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e61260833443b8bc7f6fb485560fec" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:35.933995 28676 leader_election.cc:290] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:35.930295 28333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d085b020751c45dea7e6434ac0bd152b" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:35.934521 28334 raft_consensus.cc:2468] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 2.
I20260709 12:26:35.934582 28676 raft_consensus.cc:493] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:35.931610 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ab36077d1643788dabe2f6a3af3488" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:35.922736 28687 raft_consensus.cc:493] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:35.932408 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64990029b0c741de97237387efd30fcb" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:35.936070 28334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0392296a999544ee9a994e212c46bbf2" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:35.936594 28330 raft_consensus.cc:2468] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 2.
I20260709 12:26:35.936096 28687 raft_consensus.cc:515] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.938251 28334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "149bf0909a37428b9e09d5580f6342d0" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:35.939026 28334 raft_consensus.cc:2468] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 2.
I20260709 12:26:35.939065 28686 leader_election.cc:290] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:35.919018 28681 leader_election.cc:290] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:35.940450 28687 leader_election.cc:290] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:35.929942 28670 leader_election.cc:290] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713), a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263)
I20260709 12:26:35.935235 28676 raft_consensus.cc:515] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.943219 28223 leader_election.cc:304] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:35.950615 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ccd09ed5bc42808c274a7a88028d76" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:35.950809 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cace777e504d84805965eaafee6018" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:35.951056 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4749e4e08c14875922b881d4fd5d500" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:35.951870 28331 raft_consensus.cc:2468] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 2.
I20260709 12:26:35.952412 28670 raft_consensus.cc:2804] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:35.952913 28670 raft_consensus.cc:493] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 762fe3ee980d4126b2d1302af1fbe8b2)
I20260709 12:26:35.944299 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05e47844561411c80bf0b4c4afb750c" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:35.945155 28180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7f40e72e304df3a4e1f0f7a0712493" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:35.946578 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64990029b0c741de97237387efd30fcb" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:35.956282 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0392296a999544ee9a994e212c46bbf2" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:35.957019 28223 leader_election.cc:304] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:35.958195 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0049d7e49a5246daa1156c4f09a566ae" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:35.958528 28671 raft_consensus.cc:493] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:35.948647 28675 leader_election.cc:290] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:35.959456 28671 raft_consensus.cc:515] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.961469 28672 raft_consensus.cc:2804] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:35.942247 28669 raft_consensus.cc:515] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.962044 28672 raft_consensus.cc:493] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 762fe3ee980d4126b2d1302af1fbe8b2)
I20260709 12:26:35.962427 28672 raft_consensus.cc:3060] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:35.948752 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854aa830a3e14c8c9cdfe10e94c72b1d" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:35.962779 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4749e4e08c14875922b881d4fd5d500" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:35.948738 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0392296a999544ee9a994e212c46bbf2" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:35.953104 28298 leader_election.cc:304] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: 
I20260709 12:26:35.956192 28670 raft_consensus.cc:3060] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:35.964162 28183 raft_consensus.cc:3060] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:35.947168 28676 leader_election.cc:290] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:35.953620 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0049d7e49a5246daa1156c4f09a566ae" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:35.965340 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbad5c4d8fb6444f880e49cdfec8c39d" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:35.943106 28678 raft_consensus.cc:493] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:35.972262 28678 raft_consensus.cc:515] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.974659 28676 raft_consensus.cc:2804] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:35.975075 28676 raft_consensus.cc:493] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef5f5a402ae145969aaa2c646aa7676a)
I20260709 12:26:35.975538 28676 raft_consensus.cc:3060] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:35.978060 28671 leader_election.cc:290] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:35.979231 28256 raft_consensus.cc:1240] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Rejecting Update request from peer 762fe3ee980d4126b2d1302af1fbe8b2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:35.979367 28678 leader_election.cc:290] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:35.980780 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05e47844561411c80bf0b4c4afb750c" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:35.981516 28257 raft_consensus.cc:2468] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 2.
I20260709 12:26:35.981901 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7f40e72e304df3a4e1f0f7a0712493" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:35.982190 28255 raft_consensus.cc:1240] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Rejecting Update request from peer 762fe3ee980d4126b2d1302af1fbe8b2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:35.981537 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7f40e72e304df3a4e1f0f7a0712493" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:35.983143 28256 raft_consensus.cc:2468] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 1.
I20260709 12:26:35.983433 28334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:35.984082 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64990029b0c741de97237387efd30fcb" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:35.984440 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d085b020751c45dea7e6434ac0bd152b" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:35.985464 28256 raft_consensus.cc:2393] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a007a2ab17a240d69915bf88b0d077f4 in current term 3: Already voted for candidate ef5f5a402ae145969aaa2c646aa7676a in this term.
I20260709 12:26:35.985420 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854aa830a3e14c8c9cdfe10e94c72b1d" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:35.986425 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854aa830a3e14c8c9cdfe10e94c72b1d" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:35.987879 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cace777e504d84805965eaafee6018" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:35.988555 28255 raft_consensus.cc:2468] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 2.
I20260709 12:26:35.988451 28670 raft_consensus.cc:515] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.988781 28254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "149bf0909a37428b9e09d5580f6342d0" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:35.989673 28258 raft_consensus.cc:1240] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Rejecting Update request from peer 762fe3ee980d4126b2d1302af1fbe8b2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:35.990603 28672 raft_consensus.cc:515] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:35.991786 28259 raft_consensus.cc:1240] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Rejecting Update request from peer 762fe3ee980d4126b2d1302af1fbe8b2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:35.991621 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0049d7e49a5246daa1156c4f09a566ae" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:35.992755 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ab36077d1643788dabe2f6a3af3488" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:35.992751 28256 raft_consensus.cc:2468] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 2.
I20260709 12:26:35.994843 28673 leader_election.cc:290] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263)
I20260709 12:26:35.995728 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e61260833443b8bc7f6fb485560fec" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:35.996596 28258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:35.996621 28259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:35.997432 28258 raft_consensus.cc:2468] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 2.
I20260709 12:26:35.997918 28259 raft_consensus.cc:2468] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 2.
I20260709 12:26:35.997474 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64990029b0c741de97237387efd30fcb" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:36.000636 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d085b020751c45dea7e6434ac0bd152b" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:36.001991 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e61260833443b8bc7f6fb485560fec" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:36.002051 28333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ab36077d1643788dabe2f6a3af3488" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:36.003082 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87492f293854900a93fe85ba9e569c6" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:36.003245 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ccd09ed5bc42808c274a7a88028d76" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:36.003600 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:36.004004 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05e47844561411c80bf0b4c4afb750c" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:36.004393 28330 raft_consensus.cc:2468] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 2.
I20260709 12:26:36.004633 28332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71b973b042c49ba9466c769a907c2b8" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:36.002311 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cace777e504d84805965eaafee6018" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:35.996685 28183 raft_consensus.cc:2468] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 2.
I20260709 12:26:36.005945 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71b973b042c49ba9466c769a907c2b8" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:36.006441 28332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0392296a999544ee9a994e212c46bbf2" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:36.006664 28257 raft_consensus.cc:2468] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 2.
I20260709 12:26:36.008263 28669 leader_election.cc:290] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:36.008715 28183 raft_consensus.cc:1240] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Rejecting Update request from peer 762fe3ee980d4126b2d1302af1fbe8b2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:36.008598 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0392296a999544ee9a994e212c46bbf2" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:36.009586 28253 raft_consensus.cc:2393] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a007a2ab17a240d69915bf88b0d077f4 in current term 2: Already voted for candidate ef5f5a402ae145969aaa2c646aa7676a in this term.
I20260709 12:26:36.010157 28670 leader_election.cc:290] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 4 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:36.010665 28300 leader_election.cc:304] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2; no voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.011198 28223 leader_election.cc:304] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:36.012393 28678 raft_consensus.cc:2749] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.013199 28258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "149bf0909a37428b9e09d5580f6342d0" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:36.013705 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e61260833443b8bc7f6fb485560fec" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:36.013262 28669 raft_consensus.cc:2804] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:36.014827 28669 raft_consensus.cc:697] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Becoming Leader. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:36.015478 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ccd09ed5bc42808c274a7a88028d76" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:36.015704 28184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:36.016651 28332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cace777e504d84805965eaafee6018" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:36.017081 28180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:36.018101 28258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4749e4e08c14875922b881d4fd5d500" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:36.017998 28678 consensus_queue.cc:1059] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:36.023396 28672 leader_election.cc:290] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:36.018833 28180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71b973b042c49ba9466c769a907c2b8" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:36.024940 28673 consensus_queue.cc:1059] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:36.026213 28148 leader_election.cc:304] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.027083 28679 raft_consensus.cc:2804] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.027459 28679 raft_consensus.cc:493] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef5f5a402ae145969aaa2c646aa7676a)
I20260709 12:26:36.027477 28148 leader_election.cc:304] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4; no voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.027961 28679 raft_consensus.cc:3060] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.028560 28682 raft_consensus.cc:3060] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.028575 28675 raft_consensus.cc:3055] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:36.028855 28148 leader_election.cc:304] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.029260 28675 raft_consensus.cc:740] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Running, Role: LEADER
I20260709 12:26:36.029815 28683 raft_consensus.cc:2804] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.030193 28683 raft_consensus.cc:493] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef5f5a402ae145969aaa2c646aa7676a)
I20260709 12:26:36.030961 28683 raft_consensus.cc:3060] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.030252 28675 consensus_queue.cc:260] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.032871 28675 raft_consensus.cc:3060] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.020437 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "149bf0909a37428b9e09d5580f6342d0" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:36.021143 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87492f293854900a93fe85ba9e569c6" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:36.021317 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ccd09ed5bc42808c274a7a88028d76" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:36.037676 28257 raft_consensus.cc:2393] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a007a2ab17a240d69915bf88b0d077f4 in current term 4: Already voted for candidate ef5f5a402ae145969aaa2c646aa7676a in this term.
I20260709 12:26:36.037302 28682 raft_consensus.cc:2749] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.015767 28669 consensus_queue.cc:237] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.039379 28676 raft_consensus.cc:515] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.040737 28334 raft_consensus.cc:1240] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Rejecting Update request from peer ef5f5a402ae145969aaa2c646aa7676a for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:36.037057 28148 leader_election.cc:304] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4; no voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.022496 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d085b020751c45dea7e6434ac0bd152b" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:36.019285 28300 leader_election.cc:304] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:36.043915 28678 raft_consensus.cc:2804] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.044314 28678 raft_consensus.cc:493] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:36.044641 28678 raft_consensus.cc:3060] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.044689 28300 leader_election.cc:304] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:36.045557 28682 raft_consensus.cc:2749] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.045691 28676 leader_election.cc:290] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:36.045938 28688 consensus_queue.cc:1059] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:36.047333 28689 raft_consensus.cc:3055] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:36.047712 28689 raft_consensus.cc:740] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Running, Role: LEADER
I20260709 12:26:36.047888 28300 leader_election.cc:304] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2; no voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.048770 28673 raft_consensus.cc:2749] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.048688 28689 consensus_queue.cc:260] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.049288 28300 leader_election.cc:304] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2; no voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.050153 28673 raft_consensus.cc:2749] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.050211 28689 raft_consensus.cc:3060] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.044875 28148 leader_election.cc:304] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4; no voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.051541 28682 raft_consensus.cc:2749] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:36.050662 28683 raft_consensus.cc:515] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.051983 28148 leader_election.cc:304] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.052223 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ab36077d1643788dabe2f6a3af3488" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:36.052835 28682 raft_consensus.cc:2804] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.061789 28682 raft_consensus.cc:493] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef5f5a402ae145969aaa2c646aa7676a)
I20260709 12:26:36.046474 28676 raft_consensus.cc:2804] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:36.062252 28682 raft_consensus.cc:3060] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.062376 28676 raft_consensus.cc:493] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:36.062891 28676 raft_consensus.cc:3060] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.064458 28334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05e47844561411c80bf0b4c4afb750c" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:36.065066 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ccd09ed5bc42808c274a7a88028d76" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:36.065793 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ab36077d1643788dabe2f6a3af3488" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:36.067071 28332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d085b020751c45dea7e6434ac0bd152b" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:36.070510 28682 raft_consensus.cc:515] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.053231 28148 leader_election.cc:304] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.053786 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4749e4e08c14875922b881d4fd5d500" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:36.071529 28182 raft_consensus.cc:1240] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Rejecting Update request from peer ef5f5a402ae145969aaa2c646aa7676a for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:36.054414 28683 leader_election.cc:290] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:36.074383 28683 raft_consensus.cc:2804] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.074818 28683 raft_consensus.cc:493] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef5f5a402ae145969aaa2c646aa7676a)
I20260709 12:26:36.075264 28683 raft_consensus.cc:3060] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.075388 28669 consensus_queue.cc:1059] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:26:36.077725 28671 raft_consensus.cc:3055] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:36.078094 28671 raft_consensus.cc:740] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:36.079038 28332 raft_consensus.cc:2468] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 3.
I20260709 12:26:36.079196 28671 consensus_queue.cc:260] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.080404 28676 raft_consensus.cc:515] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.080785 28671 raft_consensus.cc:3060] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.082374 28676 leader_election.cc:290] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 2 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:36.083216 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7f40e72e304df3a4e1f0f7a0712493" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:36.078084 28148 leader_election.cc:304] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4; no voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.055480 28224 leader_election.cc:304] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5f5a402ae145969aaa2c646aa7676a; no voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:36.040412 28679 raft_consensus.cc:515] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.084745 28684 raft_consensus.cc:3060] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.085246 28183 raft_consensus.cc:1240] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Rejecting Update request from peer ef5f5a402ae145969aaa2c646aa7676a for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:36.086448 28679 leader_election.cc:290] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:36.050614 28300 leader_election.cc:304] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:36.058740 28678 raft_consensus.cc:515] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.088039 28300 leader_election.cc:304] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2; no voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.088245 28669 consensus_queue.cc:1059] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:36.088924 28675 raft_consensus.cc:2804] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.089326 28675 raft_consensus.cc:493] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:36.089658 28670 raft_consensus.cc:3055] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:36.090107 28670 raft_consensus.cc:740] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:36.090572 28224 leader_election.cc:304] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5f5a402ae145969aaa2c646aa7676a; no voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:36.090124 28672 raft_consensus.cc:2749] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.089704 28675 raft_consensus.cc:3060] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.089715 28300 leader_election.cc:304] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:36.091652 28690 raft_consensus.cc:2749] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:36.092415 28673 raft_consensus.cc:2749] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.093179 28673 consensus_queue.cc:1059] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:36.093245 28300 leader_election.cc:304] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2; no voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.093961 28688 raft_consensus.cc:2804] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.094214 28687 raft_consensus.cc:3055] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:36.094259 28673 raft_consensus.cc:2749] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.094846 28687 raft_consensus.cc:740] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Running, Role: LEADER
I20260709 12:26:36.090966 28670 consensus_queue.cc:260] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.095899 28687 consensus_queue.cc:260] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.096980 28670 raft_consensus.cc:3060] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.097312 28687 raft_consensus.cc:3060] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.094372 28688 raft_consensus.cc:493] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:36.100281 28688 raft_consensus.cc:3060] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.099889 28683 raft_consensus.cc:515] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.100932 28300 leader_election.cc:304] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:36.101850 28673 raft_consensus.cc:2804] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.102236 28673 raft_consensus.cc:493] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:36.094157 28676 consensus_queue.cc:1059] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:26:36.102756 28673 raft_consensus.cc:3060] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.103318 28685 raft_consensus.cc:3055] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:36.103673 28685 raft_consensus.cc:740] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Running, Role: LEADER
I20260709 12:26:36.103910 28683 leader_election.cc:290] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:36.104651 28685 consensus_queue.cc:260] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.106230 28685 raft_consensus.cc:3060] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.093250 28224 leader_election.cc:304] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5f5a402ae145969aaa2c646aa7676a; no voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:36.102252 28300 leader_election.cc:304] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:36.109050 28690 raft_consensus.cc:2749] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.089478 28678 leader_election.cc:290] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:36.109954 28300 leader_election.cc:304] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2; no voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.110536 28678 raft_consensus.cc:2804] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.110911 28678 raft_consensus.cc:493] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:36.111299 28678 raft_consensus.cc:3060] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.111342 28676 raft_consensus.cc:2749] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.097326 28682 leader_election.cc:290] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:36.114964 28300 leader_election.cc:304] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:36.090962 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05e47844561411c80bf0b4c4afb750c" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:36.118552 28258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7f40e72e304df3a4e1f0f7a0712493" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:36.119735 28673 raft_consensus.cc:515] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.115865 28689 raft_consensus.cc:2804] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.117758 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4749e4e08c14875922b881d4fd5d500" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:36.120007 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05e47844561411c80bf0b4c4afb750c" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:36.120599 28689 raft_consensus.cc:493] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:36.121071 28689 raft_consensus.cc:3060] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.121928 28678 raft_consensus.cc:515] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.124202 28678 leader_election.cc:290] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:36.125640 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:36.127101 28675 raft_consensus.cc:515] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } } peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } }
I20260709 12:26:36.128522 28673 leader_election.cc:290] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:36.129204 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:36.129191 28675 leader_election.cc:290] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263)
I20260709 12:26:36.125948 28183 raft_consensus.cc:1240] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Rejecting Update request from peer ef5f5a402ae145969aaa2c646aa7676a for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:36.129099 28689 raft_consensus.cc:515] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.130254 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cace777e504d84805965eaafee6018" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:36.131595 28684 raft_consensus.cc:2749] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:36.132445 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:36.133530 28690 consensus_queue.cc:1059] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:36.134212 28688 raft_consensus.cc:515] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.134385 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71b973b042c49ba9466c769a907c2b8" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:36.134677 28690 raft_consensus.cc:3055] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:36.135143 28690 raft_consensus.cc:740] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
W20260709 12:26:36.135833 28148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.131:42713, user_credentials={real_user=slave}} blocked reactor thread for 57858.3us
I20260709 12:26:36.136353 28690 consensus_queue.cc:260] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.137007 28148 leader_election.cc:304] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.137826 28690 raft_consensus.cc:3060] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.137995 28688 leader_election.cc:290] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:36.138618 28684 raft_consensus.cc:2804] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.139183 28684 raft_consensus.cc:493] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef5f5a402ae145969aaa2c646aa7676a)
I20260709 12:26:36.140745 28684 raft_consensus.cc:3060] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.140092 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854aa830a3e14c8c9cdfe10e94c72b1d" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:36.140842 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:36.140954 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64990029b0c741de97237387efd30fcb" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:36.142351 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cace777e504d84805965eaafee6018" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:36.140231 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0049d7e49a5246daa1156c4f09a566ae" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:36.142946 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "149bf0909a37428b9e09d5580f6342d0" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:36.134472 28689 leader_election.cc:290] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:36.115657 28224 leader_election.cc:304] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:36.144306 28670 raft_consensus.cc:2804] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.144696 28670 raft_consensus.cc:493] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting leader election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:36.145064 28670 raft_consensus.cc:3060] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.144714 28332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e61260833443b8bc7f6fb485560fec" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:36.148202 28224 leader_election.cc:304] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5f5a402ae145969aaa2c646aa7676a; no voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:36.148801 28330 raft_consensus.cc:1240] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Rejecting Update request from peer a007a2ab17a240d69915bf88b0d077f4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:36.135026 28300 leader_election.cc:304] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2; no voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.150105 28671 raft_consensus.cc:2749] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.150496 28689 raft_consensus.cc:2749] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:36.151085 28300 leader_election.cc:304] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2; no voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.152865 28670 raft_consensus.cc:515] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.153347 28684 raft_consensus.cc:515] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.154250 28224 leader_election.cc:304] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5f5a402ae145969aaa2c646aa7676a; no voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:36.155200 28682 consensus_queue.cc:1059] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:36.156472 28682 raft_consensus.cc:3055] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:36.156889 28682 raft_consensus.cc:740] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:36.156579 28684 leader_election.cc:290] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:36.157436 28670 leader_election.cc:290] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:36.155597 28671 raft_consensus.cc:2749] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.156828 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:36.157917 28332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4749e4e08c14875922b881d4fd5d500" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:36.158895 28332 raft_consensus.cc:2393] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a007a2ab17a240d69915bf88b0d077f4 in current term 3: Already voted for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in this term.
I20260709 12:26:36.157961 28682 consensus_queue.cc:260] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } } peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } }
I20260709 12:26:36.159355 28689 raft_consensus.cc:2749] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.159333 28300 leader_election.cc:304] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2; no voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.160341 28682 raft_consensus.cc:3060] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.160423 28689 raft_consensus.cc:2749] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.160939 28300 leader_election.cc:304] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2; no voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.161790 28689 raft_consensus.cc:2749] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.162266 28300 leader_election.cc:304] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2; no voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.163031 28689 raft_consensus.cc:2749] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.156710 28669 consensus_queue.cc:1059] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:26:36.163640 28300 leader_election.cc:304] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2; no voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.164417 28224 leader_election.cc:304] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5f5a402ae145969aaa2c646aa7676a; no voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:36.164548 28689 raft_consensus.cc:2749] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.164644 28671 raft_consensus.cc:3055] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:36.165166 28671 raft_consensus.cc:740] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:36.165630 28224 leader_election.cc:304] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5f5a402ae145969aaa2c646aa7676a; no voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:36.166033 28671 consensus_queue.cc:260] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.166584 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71b973b042c49ba9466c769a907c2b8" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:36.166776 28224 leader_election.cc:304] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5f5a402ae145969aaa2c646aa7676a; no voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:36.167196 28257 raft_consensus.cc:3060] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.167577 28672 raft_consensus.cc:2749] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:36.170264 28690 raft_consensus.cc:2749] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.167971 28224 leader_election.cc:304] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:36.176265 28257 raft_consensus.cc:2468] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 3.
I20260709 12:26:36.167501 28671 raft_consensus.cc:3060] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.177033 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0049d7e49a5246daa1156c4f09a566ae" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:36.171794 28669 raft_consensus.cc:2749] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.179210 28669 raft_consensus.cc:2804] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:36.179431 28300 leader_election.cc:304] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:36.180408 28669 raft_consensus.cc:697] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 3 LEADER]: Becoming Leader. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:36.181981 28258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64990029b0c741de97237387efd30fcb" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:36.182437 28080 catalog_manager.cc:5697] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a reported cstate change: term changed from 1 to 2, leader changed from 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131) to ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130). New cstate: current_term: 2 leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:36.182294 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854aa830a3e14c8c9cdfe10e94c72b1d" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:36.185871 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4749e4e08c14875922b881d4fd5d500" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:36.182205 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "149bf0909a37428b9e09d5580f6342d0" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:36.188282 28689 raft_consensus.cc:2804] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:36.184975 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e61260833443b8bc7f6fb485560fec" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:36.188846 28689 raft_consensus.cc:697] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 LEADER]: Becoming Leader. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Running, Role: LEADER
I20260709 12:26:36.189894 28689 consensus_queue.cc:237] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.183506 28669 consensus_queue.cc:237] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.193882 28258 raft_consensus.cc:2468] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 3.
I20260709 12:26:36.195127 28332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:36.196072 28332 raft_consensus.cc:2393] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef5f5a402ae145969aaa2c646aa7676a in current term 3: Already voted for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in this term.
I20260709 12:26:36.196552 28256 raft_consensus.cc:2468] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 3.
I20260709 12:26:36.197335 28149 leader_election.cc:304] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4; no voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.197432 28300 leader_election.cc:304] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2; no voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.198302 28689 raft_consensus.cc:2749] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.198454 28682 raft_consensus.cc:2749] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.199608 28149 leader_election.cc:304] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 762fe3ee980d4126b2d1302af1fbe8b2
I20260709 12:26:36.200745 28683 raft_consensus.cc:2804] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:36.201222 28683 raft_consensus.cc:697] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 3 LEADER]: Becoming Leader. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:36.202035 28683 consensus_queue.cc:237] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.204576 28079 catalog_manager.cc:5697] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 reported cstate change: term changed from 2 to 3, leader changed from a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129) to 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131). New cstate: current_term: 3 leader_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:36.205804 28257 raft_consensus.cc:2468] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 3.
I20260709 12:26:36.215883 28224 leader_election.cc:304] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5f5a402ae145969aaa2c646aa7676a; no voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:36.216323 28255 raft_consensus.cc:2468] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 3.
I20260709 12:26:36.217536 28149 leader_election.cc:304] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 762fe3ee980d4126b2d1302af1fbe8b2
I20260709 12:26:36.217772 28669 raft_consensus.cc:2749] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.218812 28683 raft_consensus.cc:2804] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:36.219658 28683 raft_consensus.cc:697] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 3 LEADER]: Becoming Leader. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:36.219962 28149 leader_election.cc:304] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 762fe3ee980d4126b2d1302af1fbe8b2
I20260709 12:26:36.220814 28684 raft_consensus.cc:2804] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:36.221592 28684 raft_consensus.cc:697] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 3 LEADER]: Becoming Leader. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:36.220749 28683 consensus_queue.cc:237] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.221678 28081 catalog_manager.cc:5697] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 reported cstate change: term changed from 2 to 3, leader changed from ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130) to a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129). New cstate: current_term: 3 leader_uuid: "a007a2ab17a240d69915bf88b0d077f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:36.222483 28684 consensus_queue.cc:237] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.227906 28149 leader_election.cc:304] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 762fe3ee980d4126b2d1302af1fbe8b2
I20260709 12:26:36.228818 28682 raft_consensus.cc:2804] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:36.229326 28682 raft_consensus.cc:697] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 3 LEADER]: Becoming Leader. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:36.230247 28682 consensus_queue.cc:237] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.247001 28079 catalog_manager.cc:5697] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a reported cstate change: term changed from 2 to 3, leader changed from 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131) to ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130). New cstate: current_term: 3 leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:36.256217 28081 catalog_manager.cc:5697] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 reported cstate change: term changed from 2 to 3, leader changed from ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130) to a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129). New cstate: current_term: 3 leader_uuid: "a007a2ab17a240d69915bf88b0d077f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:36.257613 28081 catalog_manager.cc:5697] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 reported cstate change: term changed from 2 to 3, leader changed from ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130) to a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129). New cstate: current_term: 3 leader_uuid: "a007a2ab17a240d69915bf88b0d077f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:36.258895 28081 catalog_manager.cc:5697] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 reported cstate change: term changed from 2 to 3, leader changed from ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130) to a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129). New cstate: current_term: 3 leader_uuid: "a007a2ab17a240d69915bf88b0d077f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:36.262048 28255 raft_consensus.cc:1240] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Rejecting Update request from peer a007a2ab17a240d69915bf88b0d077f4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:36.262658 28332 raft_consensus.cc:1240] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Rejecting Update request from peer a007a2ab17a240d69915bf88b0d077f4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:36.264484 28683 consensus_queue.cc:1059] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:36.264691 28684 consensus_queue.cc:1059] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:36.265605 28683 raft_consensus.cc:3055] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:36.265668 28684 raft_consensus.cc:3055] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:36.266126 28683 raft_consensus.cc:740] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:36.266229 28684 raft_consensus.cc:740] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:36.265600 28332 raft_consensus.cc:1240] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Rejecting Update request from peer a007a2ab17a240d69915bf88b0d077f4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:36.267202 28683 consensus_queue.cc:260] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.267453 28684 consensus_queue.cc:260] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.268267 28682 consensus_queue.cc:1059] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:36.268778 28683 raft_consensus.cc:3060] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.268936 28684 raft_consensus.cc:3060] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.269300 28682 raft_consensus.cc:3055] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:36.269698 28682 raft_consensus.cc:740] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:36.270547 28682 consensus_queue.cc:260] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.272128 28682 raft_consensus.cc:3060] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.304338 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:36.311522 28183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217"
dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
mode: GRACEFUL
new_leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
 from {username='slave'} at 127.0.0.1:51932
I20260709 12:26:36.312134 28183 raft_consensus.cc:606] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Received request to transfer leadership to TS ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:36.312458 28183 raft_consensus.cc:614] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:36.313540 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:26:36.314023 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:36.377269 28255 raft_consensus.cc:1240] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Rejecting Update request from peer a007a2ab17a240d69915bf88b0d077f4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:36.379475 28682 consensus_queue.cc:1059] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:36.380625 28683 raft_consensus.cc:3055] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:36.381063 28683 raft_consensus.cc:740] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:36.382057 28683 consensus_queue.cc:260] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.383391 28683 raft_consensus.cc:3060] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.438149 28332 raft_consensus.cc:1240] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Rejecting Update request from peer a007a2ab17a240d69915bf88b0d077f4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:36.439528 28683 consensus_queue.cc:1059] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:36.440620 28682 raft_consensus.cc:3055] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:36.440989 28682 raft_consensus.cc:740] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:36.441743 28682 consensus_queue.cc:260] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.442785 28682 raft_consensus.cc:3060] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:36.472790 28355 debug-util.cc:398] Leaking SignalData structure 0x7b0800341400 after lost signal to thread 17349
W20260709 12:26:36.474494 28355 debug-util.cc:398] Leaking SignalData structure 0x7b080011a600 after lost signal to thread 28115
W20260709 12:26:36.476037 28355 debug-util.cc:398] Leaking SignalData structure 0x7b080010f560 after lost signal to thread 28208
W20260709 12:26:36.477447 28355 debug-util.cc:398] Leaking SignalData structure 0x7b08001237e0 after lost signal to thread 28283
I20260709 12:26:36.477932 28332 raft_consensus.cc:1240] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Rejecting Update request from peer a007a2ab17a240d69915bf88b0d077f4 for earlier term 1. Current term is 2. Ops: []
W20260709 12:26:36.478605 28355 debug-util.cc:398] Leaking SignalData structure 0x7b08003d41a0 after lost signal to thread 28358
I20260709 12:26:36.479509 28682 consensus_queue.cc:1059] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:36.480599 28683 raft_consensus.cc:3055] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:36.480919 28683 raft_consensus.cc:740] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:36.481726 28683 consensus_queue.cc:260] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.482816 28683 raft_consensus.cc:3060] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.538755 28183 raft_consensus.cc:1240] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Rejecting Update request from peer ef5f5a402ae145969aaa2c646aa7676a for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:36.540395 28669 consensus_queue.cc:1059] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:36.541563 28671 raft_consensus.cc:3055] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:36.541888 28671 raft_consensus.cc:740] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:36.542662 28671 consensus_queue.cc:260] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:36.543678 28671 raft_consensus.cc:3060] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.548743 28183 raft_consensus.cc:1275] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Refusing update from remote peer ef5f5a402ae145969aaa2c646aa7676a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:36.550424 28671 consensus_queue.cc:1048] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:36.563567 28332 raft_consensus.cc:1275] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Refusing update from remote peer ef5f5a402ae145969aaa2c646aa7676a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:36.565671 28671 consensus_queue.cc:1048] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:36.596262 28183 raft_consensus.cc:1275] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Refusing update from remote peer ef5f5a402ae145969aaa2c646aa7676a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:36.597589 28671 consensus_queue.cc:1048] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:36.602626 28255 raft_consensus.cc:1275] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:36.604466 28682 consensus_queue.cc:1048] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:36.614346 28332 raft_consensus.cc:1275] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Refusing update from remote peer ef5f5a402ae145969aaa2c646aa7676a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:36.616648 28178 raft_consensus.cc:1275] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Refusing update from remote peer 762fe3ee980d4126b2d1302af1fbe8b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:36.617524 28257 raft_consensus.cc:1275] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:36.618613 28689 consensus_queue.cc:1048] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:36.617816 28671 consensus_queue.cc:1048] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:36.621541 28682 consensus_queue.cc:1048] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:36.629089 28256 raft_consensus.cc:1275] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:36.633206 28683 consensus_queue.cc:1048] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:36.637413 28330 raft_consensus.cc:3060] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.668076 28331 raft_consensus.cc:3060] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.685639 28331 raft_consensus.cc:1275] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:36.692754 28680 consensus_queue.cc:1048] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:36.695582 28331 raft_consensus.cc:3060] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.706983 28334 raft_consensus.cc:1275] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:36.708298 28257 raft_consensus.cc:1275] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Refusing update from remote peer 762fe3ee980d4126b2d1302af1fbe8b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:36.710523 28331 raft_consensus.cc:1275] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:36.708922 28330 raft_consensus.cc:1275] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:36.712968 28688 consensus_queue.cc:1048] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:36.715126 28683 consensus_queue.cc:1048] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:36.714322 28680 consensus_queue.cc:1048] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:36.717152 28683 consensus_queue.cc:1048] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:36.744567 28255 raft_consensus.cc:1275] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:36.747840 28679 consensus_queue.cc:1048] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:37.315357 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:37.322283 28183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4749e4e08c14875922b881d4fd5d500"
dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
mode: GRACEFUL
new_leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
 from {username='slave'} at 127.0.0.1:51932
I20260709 12:26:37.322965 28183 raft_consensus.cc:606] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 3 LEADER]: Received request to transfer leadership to TS ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:37.324896 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:26:37.325486 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:37.361285 28722 raft_consensus.cc:493] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.361945 28722 raft_consensus.cc:515] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.364187 28722 leader_election.cc:290] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:37.365012 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ccd09ed5bc42808c274a7a88028d76" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:37.365365 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ccd09ed5bc42808c274a7a88028d76" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:37.366127 28257 raft_consensus.cc:2468] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 4.
I20260709 12:26:37.367352 28300 leader_election.cc:304] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:37.368310 28722 raft_consensus.cc:2804] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:37.368643 28722 raft_consensus.cc:493] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.368942 28722 raft_consensus.cc:3060] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.374504 28722 raft_consensus.cc:515] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.376361 28722 leader_election.cc:290] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 5 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:37.377491 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ccd09ed5bc42808c274a7a88028d76" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:37.378260 28257 raft_consensus.cc:3060] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.378203 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ccd09ed5bc42808c274a7a88028d76" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:37.385128 28257 raft_consensus.cc:2468] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 5.
I20260709 12:26:37.386272 28300 leader_election.cc:304] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: a007a2ab17a240d69915bf88b0d077f4
I20260709 12:26:37.387246 28722 raft_consensus.cc:2804] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:37.387718 28722 raft_consensus.cc:697] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 5 LEADER]: Becoming Leader. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Running, Role: LEADER
I20260709 12:26:37.388504 28722 consensus_queue.cc:237] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.398345 28081 catalog_manager.cc:5697] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:37.484726 28680 raft_consensus.cc:493] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.485447 28680 raft_consensus.cc:515] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.487879 28680 leader_election.cc:290] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:37.488739 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:37.488941 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:37.489770 28331 raft_consensus.cc:2468] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 3.
I20260709 12:26:37.491021 28148 leader_election.cc:304] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:37.491852 28680 raft_consensus.cc:2804] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:37.492273 28680 raft_consensus.cc:493] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.492646 28680 raft_consensus.cc:3060] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.502718 28680 raft_consensus.cc:515] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.503564 28679 raft_consensus.cc:493] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.504189 28679 raft_consensus.cc:515] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } } peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } }
I20260709 12:26:37.505198 28680 leader_election.cc:290] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 4 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:37.506240 28679 leader_election.cc:290] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:37.506413 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:37.507022 28257 raft_consensus.cc:3060] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.507054 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b46510cb6842b6ae8df00c91fd7217" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:37.508252 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cace777e504d84805965eaafee6018" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:37.508394 28331 raft_consensus.cc:3060] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.508695 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cace777e504d84805965eaafee6018" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:37.508975 28330 raft_consensus.cc:2468] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 3.
I20260709 12:26:37.509343 28255 raft_consensus.cc:2468] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 2.
I20260709 12:26:37.510246 28148 leader_election.cc:304] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: 
I20260709 12:26:37.511631 28679 raft_consensus.cc:2804] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:37.512089 28679 raft_consensus.cc:493] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.512490 28679 raft_consensus.cc:3060] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.517634 28257 raft_consensus.cc:2468] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 4.
I20260709 12:26:37.518447 28331 raft_consensus.cc:2468] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 4.
I20260709 12:26:37.519968 28148 leader_election.cc:304] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: 
I20260709 12:26:37.520551 28679 raft_consensus.cc:515] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } } peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } }
I20260709 12:26:37.520972 28680 raft_consensus.cc:2804] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:37.522845 28680 raft_consensus.cc:697] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 4 LEADER]: Becoming Leader. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:37.524077 28680 consensus_queue.cc:237] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.525138 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cace777e504d84805965eaafee6018" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:37.525843 28331 raft_consensus.cc:3060] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.526413 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cace777e504d84805965eaafee6018" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:37.527009 28257 raft_consensus.cc:3060] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.527993 28679 leader_election.cc:290] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 4 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:37.534194 28257 raft_consensus.cc:2468] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 4.
I20260709 12:26:37.535542 28149 leader_election.cc:304] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:37.536738 28680 raft_consensus.cc:2804] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:37.534204 28331 raft_consensus.cc:2468] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 4.
I20260709 12:26:37.537374 28680 raft_consensus.cc:697] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 4 LEADER]: Becoming Leader. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:37.538400 28680 consensus_queue.cc:237] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } } peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } }
I20260709 12:26:37.541350 28081 catalog_manager.cc:5697] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a007a2ab17a240d69915bf88b0d077f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:37.558037 28081 catalog_manager.cc:5697] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a007a2ab17a240d69915bf88b0d077f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:37.607903 28680 raft_consensus.cc:493] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.608484 28680 raft_consensus.cc:515] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.610837 28680 leader_election.cc:290] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:37.611212 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0049d7e49a5246daa1156c4f09a566ae" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:37.611492 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0049d7e49a5246daa1156c4f09a566ae" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:37.612231 28331 raft_consensus.cc:2468] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 3.
I20260709 12:26:37.613451 28148 leader_election.cc:304] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:37.614272 28680 raft_consensus.cc:2804] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:37.614679 28680 raft_consensus.cc:493] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.615134 28680 raft_consensus.cc:3060] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.625054 28680 raft_consensus.cc:515] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.627496 28680 leader_election.cc:290] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 4 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:37.628244 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0049d7e49a5246daa1156c4f09a566ae" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:37.629156 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0049d7e49a5246daa1156c4f09a566ae" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:37.629854 28331 raft_consensus.cc:3060] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.638890 28331 raft_consensus.cc:2468] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 4.
I20260709 12:26:37.640313 28148 leader_election.cc:304] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:37.641213 28680 raft_consensus.cc:2804] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:37.641683 28680 raft_consensus.cc:697] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 4 LEADER]: Becoming Leader. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:37.642520 28680 consensus_queue.cc:237] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.651844 28081 catalog_manager.cc:5697] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a007a2ab17a240d69915bf88b0d077f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:37.672108 28679 raft_consensus.cc:993] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4: : Instructing follower ef5f5a402ae145969aaa2c646aa7676a to start an election
I20260709 12:26:37.672632 28680 raft_consensus.cc:1081] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 3 LEADER]: Signalling peer ef5f5a402ae145969aaa2c646aa7676a to start an election
I20260709 12:26:37.674629 28257 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4749e4e08c14875922b881d4fd5d500"
dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
 from {username='slave'} at 127.0.0.1:43040
I20260709 12:26:37.675097 28257 raft_consensus.cc:493] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:37.675551 28257 raft_consensus.cc:3060] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.681286 28257 raft_consensus.cc:515] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.683053 28257 leader_election.cc:290] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 4 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:37.684098 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4749e4e08c14875922b881d4fd5d500" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:37.684782 28178 raft_consensus.cc:3055] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:37.685128 28178 raft_consensus.cc:740] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:37.685958 28178 consensus_queue.cc:260] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.687348 28178 raft_consensus.cc:3060] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.688339 28671 raft_consensus.cc:493] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:37.689019 28671 raft_consensus.cc:515] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.693770 28671 leader_election.cc:290] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:37.694406 28671 raft_consensus.cc:493] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:37.696501 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7f40e72e304df3a4e1f0f7a0712493" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:37.697559 28330 raft_consensus.cc:2393] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef5f5a402ae145969aaa2c646aa7676a in current term 2: Already voted for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in this term.
I20260709 12:26:37.694957 28671 raft_consensus.cc:515] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.706920 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:37.707173 28178 raft_consensus.cc:2468] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 4.
I20260709 12:26:37.707940 28330 raft_consensus.cc:2393] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef5f5a402ae145969aaa2c646aa7676a in current term 3: Already voted for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in this term.
I20260709 12:26:37.710649 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7f40e72e304df3a4e1f0f7a0712493" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:37.711433 28183 raft_consensus.cc:2468] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 2.
I20260709 12:26:37.711686 28680 raft_consensus.cc:493] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.712280 28680 raft_consensus.cc:515] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.714999 28223 leader_election.cc:304] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:37.716866 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e61260833443b8bc7f6fb485560fec" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:37.717487 28223 leader_election.cc:304] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 762fe3ee980d4126b2d1302af1fbe8b2
I20260709 12:26:37.716454 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:37.718298 28733 raft_consensus.cc:2804] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:37.718786 28183 raft_consensus.cc:2468] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 3.
I20260709 12:26:37.719144 28732 raft_consensus.cc:2804] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:37.719611 28732 raft_consensus.cc:493] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Starting leader election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:37.720031 28223 leader_election.cc:304] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:37.720117 28732 raft_consensus.cc:3060] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:37.715348 28680 leader_election.cc:290] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:37.720821 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e61260833443b8bc7f6fb485560fec" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:37.722039 28257 raft_consensus.cc:2468] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 3.
I20260709 12:26:37.719931 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4749e4e08c14875922b881d4fd5d500" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:37.724049 28149 leader_election.cc:304] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 762fe3ee980d4126b2d1302af1fbe8b2
I20260709 12:26:37.724913 28679 raft_consensus.cc:2804] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:37.725345 28679 raft_consensus.cc:493] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.725689 28679 raft_consensus.cc:3060] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.726553 28331 raft_consensus.cc:3060] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.729475 28734 raft_consensus.cc:2804] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:37.730034 28734 raft_consensus.cc:493] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting leader election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:37.730086 28671 leader_election.cc:290] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:37.730535 28734 raft_consensus.cc:3060] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:37.736735 28733 raft_consensus.cc:697] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 4 LEADER]: Becoming Leader. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:37.739483 28331 raft_consensus.cc:2468] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 4.
I20260709 12:26:37.740147 28734 raft_consensus.cc:515] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.739593 28733 consensus_queue.cc:237] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.739353 28732 raft_consensus.cc:515] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.743681 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:37.736408 28679 raft_consensus.cc:515] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.746160 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7f40e72e304df3a4e1f0f7a0712493" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:37.746541 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7f40e72e304df3a4e1f0f7a0712493" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:37.752242 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e61260833443b8bc7f6fb485560fec" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:37.752853 28679 leader_election.cc:290] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 4 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:37.752964 28257 raft_consensus.cc:3060] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.753105 28183 raft_consensus.cc:2468] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 3.
I20260709 12:26:37.754382 28223 leader_election.cc:304] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:37.755214 28735 raft_consensus.cc:2804] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:37.755959 28735 raft_consensus.cc:697] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 3 LEADER]: Becoming Leader. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:37.756305 28178 raft_consensus.cc:2468] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5f5a402ae145969aaa2c646aa7676a in term 2.
I20260709 12:26:37.756588 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e61260833443b8bc7f6fb485560fec" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:37.756865 28735 consensus_queue.cc:237] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.760766 28223 leader_election.cc:304] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:37.758811 28734 leader_election.cc:290] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:37.759326 28332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:37.761739 28733 raft_consensus.cc:2804] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:37.763230 28332 raft_consensus.cc:2393] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef5f5a402ae145969aaa2c646aa7676a in current term 3: Already voted for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in this term.
I20260709 12:26:37.763407 28733 raft_consensus.cc:697] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Becoming Leader. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:37.764672 28671 raft_consensus.cc:493] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a007a2ab17a240d69915bf88b0d077f4)
I20260709 12:26:37.764554 28733 consensus_queue.cc:237] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.765447 28671 raft_consensus.cc:515] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.784039 28257 raft_consensus.cc:2468] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 4.
I20260709 12:26:37.776095 28332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0049d7e49a5246daa1156c4f09a566ae" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:37.786258 28332 raft_consensus.cc:2368] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef5f5a402ae145969aaa2c646aa7676a for earlier term 3. Current term is 4.
I20260709 12:26:37.786294 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0049d7e49a5246daa1156c4f09a566ae" candidate_uuid: "ef5f5a402ae145969aaa2c646aa7676a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:37.788008 28224 leader_election.cc:400] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 pre-election: Vote denied by peer 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713) with higher term. Message: Invalid argument: T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef5f5a402ae145969aaa2c646aa7676a for earlier term 3. Current term is 4.
I20260709 12:26:37.788385 28224 leader_election.cc:403] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:37.785144 28331 raft_consensus.cc:2393] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef5f5a402ae145969aaa2c646aa7676a in current term 2: Already voted for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in this term.
I20260709 12:26:37.785250 28671 leader_election.cc:290] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:37.790494 28671 raft_consensus.cc:3060] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.791733 28149 leader_election.cc:304] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 762fe3ee980d4126b2d1302af1fbe8b2
I20260709 12:26:37.785516 28732 leader_election.cc:290] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [CANDIDATE]: Term 2 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:37.771039 28081 catalog_manager.cc:5697] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a reported cstate change: term changed from 3 to 4, leader changed from a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129) to ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130). New cstate: current_term: 4 leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:37.792995 28679 raft_consensus.cc:2804] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:37.793497 28679 raft_consensus.cc:697] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 4 LEADER]: Becoming Leader. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:37.794307 28679 consensus_queue.cc:237] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.801263 28671 raft_consensus.cc:2749] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713) with higher term. Message: Invalid argument: T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef5f5a402ae145969aaa2c646aa7676a for earlier term 3. Current term is 4.
I20260709 12:26:37.810289 28679 raft_consensus.cc:493] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.811187 28679 raft_consensus.cc:515] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.813664 28679 leader_election.cc:290] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:37.813418 28081 catalog_manager.cc:5697] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 reported cstate change: term changed from 2 to 4, leader changed from ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130) to a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129). New cstate: current_term: 4 leader_uuid: "a007a2ab17a240d69915bf88b0d077f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:37.815188 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05e47844561411c80bf0b4c4afb750c" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:37.815546 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05e47844561411c80bf0b4c4afb750c" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" is_pre_election: true
I20260709 12:26:37.816148 28257 raft_consensus.cc:2468] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 2.
I20260709 12:26:37.816433 28331 raft_consensus.cc:2468] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 3.
I20260709 12:26:37.817512 28149 leader_election.cc:304] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:37.818789 28679 raft_consensus.cc:2804] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:37.813793 28079 catalog_manager.cc:5697] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a reported cstate change: term changed from 2 to 3, leader changed from a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129) to ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130). New cstate: current_term: 3 leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:37.819182 28679 raft_consensus.cc:493] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.819808 28679 raft_consensus.cc:3060] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.820407 28079 catalog_manager.cc:5697] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a reported cstate change: term changed from 1 to 2, leader changed from a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129) to ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130). New cstate: current_term: 2 leader_uuid: "ef5f5a402ae145969aaa2c646aa7676a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:37.822539 28722 raft_consensus.cc:493] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.823140 28722 raft_consensus.cc:515] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.825469 28722 leader_election.cc:290] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:37.826884 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ab36077d1643788dabe2f6a3af3488" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:37.827142 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ab36077d1643788dabe2f6a3af3488" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:37.827667 28178 raft_consensus.cc:2468] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 2.
I20260709 12:26:37.828003 28257 raft_consensus.cc:2468] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 3.
I20260709 12:26:37.828477 28679 raft_consensus.cc:515] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.829416 28300 leader_election.cc:304] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:37.832041 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05e47844561411c80bf0b4c4afb750c" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:37.832227 28722 raft_consensus.cc:2804] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:37.832645 28257 raft_consensus.cc:3060] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.832743 28722 raft_consensus.cc:493] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.833289 28722 raft_consensus.cc:3060] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.836833 28723 raft_consensus.cc:493] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef5f5a402ae145969aaa2c646aa7676a)
I20260709 12:26:37.837453 28723 raft_consensus.cc:515] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.839731 28723 leader_election.cc:290] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:37.840579 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e61260833443b8bc7f6fb485560fec" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:37.840829 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e61260833443b8bc7f6fb485560fec" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:37.841638 28255 raft_consensus.cc:2368] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 762fe3ee980d4126b2d1302af1fbe8b2 for earlier term 3. Current term is 4.
I20260709 12:26:37.844178 28300 leader_election.cc:400] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Vote denied by peer ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303) with higher term. Message: Invalid argument: T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 762fe3ee980d4126b2d1302af1fbe8b2 for earlier term 3. Current term is 4.
I20260709 12:26:37.844878 28300 leader_election.cc:403] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:37.847282 28723 raft_consensus.cc:493] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.847903 28723 raft_consensus.cc:515] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.848521 28257 raft_consensus.cc:2468] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 4.
I20260709 12:26:37.849915 28149 leader_election.cc:304] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:37.850288 28723 leader_election.cc:290] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:37.850945 28680 raft_consensus.cc:2804] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:37.851529 28680 raft_consensus.cc:697] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 4 LEADER]: Becoming Leader. State: Replica: a007a2ab17a240d69915bf88b0d077f4, State: Running, Role: LEADER
I20260709 12:26:37.852514 28680 consensus_queue.cc:237] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.853679 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05e47844561411c80bf0b4c4afb750c" candidate_uuid: "a007a2ab17a240d69915bf88b0d077f4" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "762fe3ee980d4126b2d1302af1fbe8b2"
I20260709 12:26:37.853976 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:37.854318 28331 raft_consensus.cc:3060] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.854733 28178 raft_consensus.cc:2468] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 3.
I20260709 12:26:37.854894 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:37.856364 28298 leader_election.cc:304] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: 
I20260709 12:26:37.857630 28723 raft_consensus.cc:3060] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.860620 28679 leader_election.cc:290] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [CANDIDATE]: Term 4 election: Requested vote from peers ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303), 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131:42713)
I20260709 12:26:37.863924 28331 raft_consensus.cc:2468] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a007a2ab17a240d69915bf88b0d077f4 in term 4.
I20260709 12:26:37.870030 28722 raft_consensus.cc:515] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.877796 28723 raft_consensus.cc:2749] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303) with higher term. Message: Invalid argument: T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 762fe3ee980d4126b2d1302af1fbe8b2 for earlier term 3. Current term is 4.
I20260709 12:26:37.878001 28079 catalog_manager.cc:5697] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a007a2ab17a240d69915bf88b0d077f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:37.881018 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ab36077d1643788dabe2f6a3af3488" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:37.881683 28257 raft_consensus.cc:3060] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.890046 28257 raft_consensus.cc:2468] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 4.
I20260709 12:26:37.891510 28300 leader_election.cc:304] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, ef5f5a402ae145969aaa2c646aa7676a; no voters: 
I20260709 12:26:37.896509 28722 leader_election.cc:290] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 4 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:37.896685 28742 raft_consensus.cc:2804] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:37.897161 28742 raft_consensus.cc:493] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.897200 28722 raft_consensus.cc:2804] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:37.897815 28722 raft_consensus.cc:697] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 LEADER]: Becoming Leader. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Running, Role: LEADER
I20260709 12:26:37.898825 28722 consensus_queue.cc:237] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
W20260709 12:26:37.900118 28298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.240.129:33263, user_credentials={real_user=slave}} blocked reactor thread for 43955.4us
I20260709 12:26:37.901166 28742 raft_consensus.cc:3060] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.902124 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ab36077d1643788dabe2f6a3af3488" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:37.902926 28178 raft_consensus.cc:3060] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.904520 28183 raft_consensus.cc:3060] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.910887 28257 raft_consensus.cc:1275] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:37.912591 28680 consensus_queue.cc:1048] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:37.915164 28183 raft_consensus.cc:1275] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 5 FOLLOWER]: Refusing update from remote peer 762fe3ee980d4126b2d1302af1fbe8b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:37.910945 28742 raft_consensus.cc:515] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.920070 28742 leader_election.cc:290] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 4 election: Requested vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:37.921452 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a"
I20260709 12:26:37.921726 28742 consensus_queue.cc:1048] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:37.922273 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb8fe651f554ca7a29cac9646c16b61" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4"
I20260709 12:26:37.922873 28183 raft_consensus.cc:3060] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.921481 28178 raft_consensus.cc:2468] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 4.
I20260709 12:26:37.935837 28183 raft_consensus.cc:2468] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762fe3ee980d4126b2d1302af1fbe8b2 in term 4.
I20260709 12:26:37.937999 28298 leader_election.cc:304] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2, a007a2ab17a240d69915bf88b0d077f4; no voters: ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:37.940218 28742 raft_consensus.cc:2804] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:37.940838 28742 raft_consensus.cc:697] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 LEADER]: Becoming Leader. State: Replica: 762fe3ee980d4126b2d1302af1fbe8b2, State: Running, Role: LEADER
I20260709 12:26:37.941841 28742 consensus_queue.cc:237] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:37.947494 28079 catalog_manager.cc:5697] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:37.958425 28331 raft_consensus.cc:1275] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:37.960821 28680 consensus_queue.cc:1048] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:37.974846 28255 raft_consensus.cc:1275] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 5 FOLLOWER]: Refusing update from remote peer 762fe3ee980d4126b2d1302af1fbe8b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:37.976982 28723 consensus_queue.cc:1048] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:37.999009 28081 catalog_manager.cc:5697] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 reported cstate change: term changed from 3 to 4, leader changed from ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130) to 762fe3ee980d4126b2d1302af1fbe8b2 (127.16.240.131). New cstate: current_term: 4 leader_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:38.025740 28331 raft_consensus.cc:1275] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:38.025945 28257 raft_consensus.cc:1275] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:38.027225 28680 consensus_queue.cc:1048] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:38.027515 28679 consensus_queue.cc:1048] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:38.049300 28331 raft_consensus.cc:1275] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:38.050916 28679 consensus_queue.cc:1048] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:38.068639 28257 raft_consensus.cc:1275] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:38.070688 28679 consensus_queue.cc:1048] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:38.152665 28331 raft_consensus.cc:1275] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Refusing update from remote peer ef5f5a402ae145969aaa2c646aa7676a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:38.153992 28732 consensus_queue.cc:1048] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:38.166563 28183 raft_consensus.cc:1275] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Refusing update from remote peer ef5f5a402ae145969aaa2c646aa7676a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:38.168642 28732 consensus_queue.cc:1048] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:38.238648 28183 raft_consensus.cc:1275] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Refusing update from remote peer ef5f5a402ae145969aaa2c646aa7676a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:38.240523 28733 consensus_queue.cc:1048] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:38.241164 28723 raft_consensus.cc:493] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.241798 28723 raft_consensus.cc:515] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:38.244222 28723 leader_election.cc:290] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263), ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303)
I20260709 12:26:38.245050 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7f40e72e304df3a4e1f0f7a0712493" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a007a2ab17a240d69915bf88b0d077f4" is_pre_election: true
I20260709 12:26:38.245919 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7f40e72e304df3a4e1f0f7a0712493" candidate_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef5f5a402ae145969aaa2c646aa7676a" is_pre_election: true
I20260709 12:26:38.249248 28298 leader_election.cc:304] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762fe3ee980d4126b2d1302af1fbe8b2; no voters: a007a2ab17a240d69915bf88b0d077f4, ef5f5a402ae145969aaa2c646aa7676a
I20260709 12:26:38.250494 28723 raft_consensus.cc:2749] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.257185 28331 raft_consensus.cc:1275] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Refusing update from remote peer ef5f5a402ae145969aaa2c646aa7676a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:38.258641 28732 consensus_queue.cc:1048] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:38.273778 28332 raft_consensus.cc:1240] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 LEADER]: Rejecting Update request from peer ef5f5a402ae145969aaa2c646aa7676a for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:38.273778 28331 raft_consensus.cc:1275] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:38.275251 28733 consensus_queue.cc:1059] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:38.276348 28733 consensus_queue.cc:1243] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [LEADER]: Peer 762fe3ee980d4126b2d1302af1fbe8b2 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:26:38.276847 28732 raft_consensus.cc:3055] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:38.276777 28679 consensus_queue.cc:1048] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:38.277412 28732 raft_consensus.cc:740] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef5f5a402ae145969aaa2c646aa7676a, State: Running, Role: LEADER
I20260709 12:26:38.278309 28732 consensus_queue.cc:260] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 } } peers { permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 } } peers { permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 } }
I20260709 12:26:38.279657 28732 raft_consensus.cc:3060] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:38.292558 28257 raft_consensus.cc:1275] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:38.296520 28679 consensus_queue.cc:1048] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:38.326589 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:38.333423 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:38.334125 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:38.357077 28178 raft_consensus.cc:1275] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Refusing update from remote peer 762fe3ee980d4126b2d1302af1fbe8b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:38.358734 28723 consensus_queue.cc:1048] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:38.369904 28257 raft_consensus.cc:1275] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Refusing update from remote peer 762fe3ee980d4126b2d1302af1fbe8b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:38.376987 28255 raft_consensus.cc:1275] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:38.377607 28740 consensus_queue.cc:1048] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:38.379263 28679 consensus_queue.cc:1048] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:38.394040 28331 raft_consensus.cc:1275] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Refusing update from remote peer a007a2ab17a240d69915bf88b0d077f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:38.395977 28674 consensus_queue.cc:1048] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762fe3ee980d4126b2d1302af1fbe8b2" member_type: VOTER last_known_addr { host: "127.16.240.131" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:38.448289 28255 raft_consensus.cc:1275] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Refusing update from remote peer 762fe3ee980d4126b2d1302af1fbe8b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 12:26:38.448745 28255 pending_rounds.cc:85] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a: Aborting all ops after (but not including) 3
I20260709 12:26:38.448992 28255 pending_rounds.cc:107] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20260709 12:26:38.449290 28255 raft_consensus.cc:2889] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:38.452028 28740 consensus_queue.cc:1048] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5f5a402ae145969aaa2c646aa7676a" member_type: VOTER last_known_addr { host: "127.16.240.130" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:38.463366 28178 raft_consensus.cc:1275] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Refusing update from remote peer 762fe3ee980d4126b2d1302af1fbe8b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:38.466892 28742 consensus_queue.cc:1048] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a007a2ab17a240d69915bf88b0d077f4" member_type: VOTER last_known_addr { host: "127.16.240.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:39.335610 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:39.344691 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:39.345291 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:40.346760 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:40.352209 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:40.352692 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:41.353680 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:41.358747 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:41.359202 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:42.360287 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:42.365805 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:42.366309 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:43.367421 17346 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:43.373029 17346 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:43.373533 17346 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:755: Failure
Expected: (leader.second) != (3), actual: 3 vs 3
I20260709 12:26:44.451011 17346 tablet_server.cc:179] TabletServer@127.16.240.129:0 shutting down...
I20260709 12:26:44.502223 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:44.503229 17346 tablet_replica.cc:333] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4: stopping tablet replica
I20260709 12:26:44.504387 17346 raft_consensus.cc:2243] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.505199 17346 raft_consensus.cc:2272] T 0392296a999544ee9a994e212c46bbf2 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.508172 17346 tablet_replica.cc:333] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4: stopping tablet replica
I20260709 12:26:44.509047 17346 raft_consensus.cc:2243] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.510335 17346 raft_consensus.cc:2272] T 854aa830a3e14c8c9cdfe10e94c72b1d P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.513453 17346 tablet_replica.cc:333] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4: stopping tablet replica
I20260709 12:26:44.514263 17346 raft_consensus.cc:2243] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.515242 17346 raft_consensus.cc:2272] T 85e61260833443b8bc7f6fb485560fec P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.518146 17346 tablet_replica.cc:333] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4: stopping tablet replica
I20260709 12:26:44.519140 17346 raft_consensus.cc:2243] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.520095 17346 raft_consensus.cc:2272] T c87492f293854900a93fe85ba9e569c6 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:44.521368 28223 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 15 similar messages]
I20260709 12:26:44.523646 17346 tablet_replica.cc:333] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4: stopping tablet replica
I20260709 12:26:44.524783 17346 raft_consensus.cc:2243] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 4 LEADER]: Raft consensus shutting down.
W20260709 12:26:44.525226 28223 consensus_peers.cc:597] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a -> Peer a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263): Couldn't send request to peer a007a2ab17a240d69915bf88b0d077f4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:44.526027 17346 raft_consensus.cc:2272] T 0049d7e49a5246daa1156c4f09a566ae P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.530473 17346 tablet_replica.cc:333] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4: stopping tablet replica
I20260709 12:26:44.531337 17346 raft_consensus.cc:2243] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.532428 17346 raft_consensus.cc:2272] T 64990029b0c741de97237387efd30fcb P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.535871 17346 tablet_replica.cc:333] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4: stopping tablet replica
I20260709 12:26:44.536629 17346 raft_consensus.cc:2243] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.537253 17346 raft_consensus.cc:2272] T afb8fe651f554ca7a29cac9646c16b61 P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.540053 17346 tablet_replica.cc:333] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4: stopping tablet replica
I20260709 12:26:44.540743 17346 raft_consensus.cc:2243] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.541332 17346 raft_consensus.cc:2272] T f4749e4e08c14875922b881d4fd5d500 P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.543931 17346 tablet_replica.cc:333] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4: stopping tablet replica
I20260709 12:26:44.544567 17346 raft_consensus.cc:2243] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.545689 17346 raft_consensus.cc:2272] T d2b46510cb6842b6ae8df00c91fd7217 P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.549077 17346 tablet_replica.cc:333] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4: stopping tablet replica
W20260709 12:26:44.549561 28223 consensus_peers.cc:597] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a -> Peer a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263): Couldn't send request to peer a007a2ab17a240d69915bf88b0d077f4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:44.550104 17346 raft_consensus.cc:2243] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.550868 17346 raft_consensus.cc:2272] T d085b020751c45dea7e6434ac0bd152b P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.555176 17346 tablet_replica.cc:333] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4: stopping tablet replica
I20260709 12:26:44.556689 17346 raft_consensus.cc:2243] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.557691 17346 raft_consensus.cc:2272] T 57ab36077d1643788dabe2f6a3af3488 P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.561703 17346 tablet_replica.cc:333] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4: stopping tablet replica
I20260709 12:26:44.562644 17346 raft_consensus.cc:2243] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.564083 17346 raft_consensus.cc:2272] T 149bf0909a37428b9e09d5580f6342d0 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.567188 17346 tablet_replica.cc:333] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4: stopping tablet replica
I20260709 12:26:44.567895 17346 raft_consensus.cc:2243] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.568397 17346 raft_consensus.cc:2272] T cbad5c4d8fb6444f880e49cdfec8c39d P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.571084 17346 tablet_replica.cc:333] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4: stopping tablet replica
I20260709 12:26:44.571875 17346 raft_consensus.cc:2243] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.572921 17346 raft_consensus.cc:2272] T c05e47844561411c80bf0b4c4afb750c P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:44.576615 28223 consensus_peers.cc:597] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a -> Peer a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263): Couldn't send request to peer a007a2ab17a240d69915bf88b0d077f4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:44.576742 17346 tablet_replica.cc:333] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4: stopping tablet replica
I20260709 12:26:44.577626 17346 raft_consensus.cc:2243] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.578174 17346 raft_consensus.cc:2272] T ab7f40e72e304df3a4e1f0f7a0712493 P a007a2ab17a240d69915bf88b0d077f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.580914 17346 tablet_replica.cc:333] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4: stopping tablet replica
I20260709 12:26:44.581516 17346 raft_consensus.cc:2243] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.582077 17346 raft_consensus.cc:2272] T b71b973b042c49ba9466c769a907c2b8 P a007a2ab17a240d69915bf88b0d077f4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.584760 17346 tablet_replica.cc:333] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4: stopping tablet replica
I20260709 12:26:44.585345 17346 raft_consensus.cc:2243] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.585867 17346 raft_consensus.cc:2272] T e4ccd09ed5bc42808c274a7a88028d76 P a007a2ab17a240d69915bf88b0d077f4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.588332 17346 tablet_replica.cc:333] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4: stopping tablet replica
I20260709 12:26:44.588857 17346 raft_consensus.cc:2243] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.589785 17346 raft_consensus.cc:2272] T 09cace777e504d84805965eaafee6018 P a007a2ab17a240d69915bf88b0d077f4 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:44.602280 28298 consensus_peers.cc:597] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 -> Peer a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263): Couldn't send request to peer a007a2ab17a240d69915bf88b0d077f4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:44.644367 17346 tablet_server.cc:196] TabletServer@127.16.240.129:0 shutdown complete.
I20260709 12:26:44.693799 17346 tablet_server.cc:179] TabletServer@127.16.240.130:0 shutting down...
W20260709 12:26:44.717912 28223 consensus_peers.cc:597] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a -> Peer a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263): Couldn't send request to peer a007a2ab17a240d69915bf88b0d077f4. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:33263: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:44.740172 28298 consensus_peers.cc:597] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 -> Peer a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263): Couldn't send request to peer a007a2ab17a240d69915bf88b0d077f4. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:33263: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:44.744908 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:44.746101 17346 tablet_replica.cc:333] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a: stopping tablet replica
I20260709 12:26:44.747002 17346 raft_consensus.cc:2243] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.747596 17346 raft_consensus.cc:2272] T 854aa830a3e14c8c9cdfe10e94c72b1d P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.750324 17346 tablet_replica.cc:333] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a: stopping tablet replica
I20260709 12:26:44.751024 17346 raft_consensus.cc:2243] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.752111 17346 raft_consensus.cc:2272] T 0392296a999544ee9a994e212c46bbf2 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.754544 17346 tablet_replica.cc:333] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a: stopping tablet replica
I20260709 12:26:44.755170 17346 raft_consensus.cc:2243] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.755702 17346 raft_consensus.cc:2272] T 85e61260833443b8bc7f6fb485560fec P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.758191 17346 tablet_replica.cc:333] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a: stopping tablet replica
I20260709 12:26:44.759006 17346 raft_consensus.cc:2243] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.759541 17346 raft_consensus.cc:2272] T 64990029b0c741de97237387efd30fcb P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.762579 17346 tablet_replica.cc:333] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a: stopping tablet replica
I20260709 12:26:44.763254 17346 raft_consensus.cc:2243] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.763893 17346 raft_consensus.cc:2272] T c05e47844561411c80bf0b4c4afb750c P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.766284 17346 tablet_replica.cc:333] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a: stopping tablet replica
I20260709 12:26:44.766933 17346 raft_consensus.cc:2243] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.767490 17346 raft_consensus.cc:2272] T afb8fe651f554ca7a29cac9646c16b61 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.769874 17346 tablet_replica.cc:333] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a: stopping tablet replica
I20260709 12:26:44.770574 17346 raft_consensus.cc:2243] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.771075 17346 raft_consensus.cc:2272] T 57ab36077d1643788dabe2f6a3af3488 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.773372 17346 tablet_replica.cc:333] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a: stopping tablet replica
I20260709 12:26:44.774050 17346 raft_consensus.cc:2243] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.774940 17346 raft_consensus.cc:2272] T d085b020751c45dea7e6434ac0bd152b P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.777549 17346 tablet_replica.cc:333] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a: stopping tablet replica
I20260709 12:26:44.778198 17346 raft_consensus.cc:2243] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.779129 17346 raft_consensus.cc:2272] T cbad5c4d8fb6444f880e49cdfec8c39d P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.781544 17346 tablet_replica.cc:333] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a: stopping tablet replica
I20260709 12:26:44.782169 17346 raft_consensus.cc:2243] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.782682 17346 raft_consensus.cc:2272] T d2b46510cb6842b6ae8df00c91fd7217 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.785025 17346 tablet_replica.cc:333] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a: stopping tablet replica
I20260709 12:26:44.785627 17346 raft_consensus.cc:2243] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.786497 17346 raft_consensus.cc:2272] T f4749e4e08c14875922b881d4fd5d500 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.788832 17346 tablet_replica.cc:333] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a: stopping tablet replica
I20260709 12:26:44.789465 17346 raft_consensus.cc:2243] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.789994 17346 raft_consensus.cc:2272] T 149bf0909a37428b9e09d5580f6342d0 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.792412 17346 tablet_replica.cc:333] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a: stopping tablet replica
I20260709 12:26:44.793292 17346 raft_consensus.cc:2243] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.794517 17346 raft_consensus.cc:2272] T ab7f40e72e304df3a4e1f0f7a0712493 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.797245 17346 tablet_replica.cc:333] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a: stopping tablet replica
I20260709 12:26:44.797922 17346 raft_consensus.cc:2243] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.798519 17346 raft_consensus.cc:2272] T b71b973b042c49ba9466c769a907c2b8 P ef5f5a402ae145969aaa2c646aa7676a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.801259 17346 tablet_replica.cc:333] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a: stopping tablet replica
I20260709 12:26:44.802002 17346 raft_consensus.cc:2243] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.802668 17346 raft_consensus.cc:2272] T e4ccd09ed5bc42808c274a7a88028d76 P ef5f5a402ae145969aaa2c646aa7676a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.805128 17346 tablet_replica.cc:333] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a: stopping tablet replica
I20260709 12:26:44.805774 17346 raft_consensus.cc:2243] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.806723 17346 raft_consensus.cc:2272] T c87492f293854900a93fe85ba9e569c6 P ef5f5a402ae145969aaa2c646aa7676a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.809643 17346 tablet_replica.cc:333] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a: stopping tablet replica
I20260709 12:26:44.810235 17346 raft_consensus.cc:2243] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.810786 17346 raft_consensus.cc:2272] T 0049d7e49a5246daa1156c4f09a566ae P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.813313 17346 tablet_replica.cc:333] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a: stopping tablet replica
I20260709 12:26:44.813823 17346 raft_consensus.cc:2243] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.814396 17346 raft_consensus.cc:2272] T 09cace777e504d84805965eaafee6018 P ef5f5a402ae145969aaa2c646aa7676a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.860831 17346 tablet_server.cc:196] TabletServer@127.16.240.130:0 shutdown complete.
W20260709 12:26:44.910691 28298 consensus_peers.cc:597] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 -> Peer a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263): Couldn't send request to peer a007a2ab17a240d69915bf88b0d077f4. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:33263: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:44.914518 17346 tablet_server.cc:179] TabletServer@127.16.240.131:0 shutting down...
W20260709 12:26:44.940949 28300 consensus_peers.cc:597] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 -> Peer ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303): Couldn't send request to peer ef5f5a402ae145969aaa2c646aa7676a. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:44.952268 17346 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:44.953282 17346 tablet_replica.cc:333] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2: stopping tablet replica
I20260709 12:26:44.954107 17346 raft_consensus.cc:2243] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.954985 17346 raft_consensus.cc:2272] T 854aa830a3e14c8c9cdfe10e94c72b1d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.957710 17346 tablet_replica.cc:333] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2: stopping tablet replica
I20260709 12:26:44.958492 17346 raft_consensus.cc:2243] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.959052 17346 raft_consensus.cc:2272] T 0392296a999544ee9a994e212c46bbf2 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.961480 17346 tablet_replica.cc:333] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2: stopping tablet replica
I20260709 12:26:44.962111 17346 raft_consensus.cc:2243] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.962596 17346 raft_consensus.cc:2272] T 85e61260833443b8bc7f6fb485560fec P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.965027 17346 tablet_replica.cc:333] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2: stopping tablet replica
I20260709 12:26:44.965631 17346 raft_consensus.cc:2243] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.966194 17346 raft_consensus.cc:2272] T 64990029b0c741de97237387efd30fcb P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.968632 17346 tablet_replica.cc:333] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2: stopping tablet replica
I20260709 12:26:44.969247 17346 raft_consensus.cc:2243] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.970175 17346 raft_consensus.cc:2272] T afb8fe651f554ca7a29cac9646c16b61 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.972512 17346 tablet_replica.cc:333] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2: stopping tablet replica
I20260709 12:26:44.973116 17346 raft_consensus.cc:2243] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.973640 17346 raft_consensus.cc:2272] T c87492f293854900a93fe85ba9e569c6 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.975929 17346 tablet_replica.cc:333] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2: stopping tablet replica
I20260709 12:26:44.976630 17346 raft_consensus.cc:2243] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.977095 17346 raft_consensus.cc:2272] T 0049d7e49a5246daa1156c4f09a566ae P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.980183 17346 tablet_replica.cc:333] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2: stopping tablet replica
I20260709 12:26:44.980957 17346 raft_consensus.cc:2243] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.982143 17346 raft_consensus.cc:2272] T 57ab36077d1643788dabe2f6a3af3488 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:44.983006 28298 consensus_peers.cc:597] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 -> Peer a007a2ab17a240d69915bf88b0d077f4 (127.16.240.129:33263): Couldn't send request to peer a007a2ab17a240d69915bf88b0d077f4. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.129:33263: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:44.985149 17346 tablet_replica.cc:333] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2: stopping tablet replica
I20260709 12:26:44.985833 17346 raft_consensus.cc:2243] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.986290 17346 raft_consensus.cc:2272] T d085b020751c45dea7e6434ac0bd152b P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.988667 17346 tablet_replica.cc:333] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2: stopping tablet replica
I20260709 12:26:44.989208 17346 raft_consensus.cc:2243] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.990124 17346 raft_consensus.cc:2272] T e4ccd09ed5bc42808c274a7a88028d76 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.993119 17346 tablet_replica.cc:333] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2: stopping tablet replica
I20260709 12:26:44.993690 17346 raft_consensus.cc:2243] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.994565 17346 raft_consensus.cc:2272] T d2b46510cb6842b6ae8df00c91fd7217 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.997684 17346 tablet_replica.cc:333] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2: stopping tablet replica
I20260709 12:26:44.998247 17346 raft_consensus.cc:2243] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.999111 17346 raft_consensus.cc:2272] T f4749e4e08c14875922b881d4fd5d500 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:45.002290 17346 tablet_replica.cc:333] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2: stopping tablet replica
I20260709 12:26:45.002930 17346 raft_consensus.cc:2243] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:45.003505 17346 raft_consensus.cc:2272] T 149bf0909a37428b9e09d5580f6342d0 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:45.006124 28300 consensus_peers.cc:597] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 -> Peer ef5f5a402ae145969aaa2c646aa7676a (127.16.240.130:34303): Couldn't send request to peer ef5f5a402ae145969aaa2c646aa7676a. Status: Network error: Client connection negotiation failed: client connection to 127.16.240.130:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:45.006318 17346 tablet_replica.cc:333] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2: stopping tablet replica
I20260709 12:26:45.007083 17346 raft_consensus.cc:2243] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:45.007648 17346 raft_consensus.cc:2272] T cbad5c4d8fb6444f880e49cdfec8c39d P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:45.010269 17346 tablet_replica.cc:333] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2: stopping tablet replica
I20260709 12:26:45.010859 17346 raft_consensus.cc:2243] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:45.011417 17346 raft_consensus.cc:2272] T c05e47844561411c80bf0b4c4afb750c P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:45.014062 17346 tablet_replica.cc:333] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2: stopping tablet replica
I20260709 12:26:45.014678 17346 raft_consensus.cc:2243] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:45.015635 17346 raft_consensus.cc:2272] T b71b973b042c49ba9466c769a907c2b8 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:45.018338 17346 tablet_replica.cc:333] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2: stopping tablet replica
I20260709 12:26:45.019073 17346 raft_consensus.cc:2243] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:45.019702 17346 raft_consensus.cc:2272] T ab7f40e72e304df3a4e1f0f7a0712493 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:45.022101 17346 tablet_replica.cc:333] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2: stopping tablet replica
I20260709 12:26:45.022594 17346 raft_consensus.cc:2243] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:45.023175 17346 raft_consensus.cc:2272] T 09cace777e504d84805965eaafee6018 P 762fe3ee980d4126b2d1302af1fbe8b2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:45.089830 17346 tablet_server.cc:196] TabletServer@127.16.240.131:0 shutdown complete.
I20260709 12:26:45.133802 17346 master.cc:562] Master@127.16.240.190:36433 shutting down...
I20260709 12:26:45.165278 17346 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:45.166010 17346 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:45.166412 17346 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8a06ecf9378b447ca4d131f0019999c5: stopping tablet replica
I20260709 12:26:45.189791 17346 master.cc:584] Master@127.16.240.190:36433 shutdown complete.
I20260709 12:26:45.230378 17346 test_util.cc:182] -----------------------------------------------
I20260709 12:26:45.230643 17346 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-tasks0ZKUT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599638884573-17346-0
[  FAILED  ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1, where GetParam() = true (22703 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (45173 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (366168 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1, where GetParam() = true

 1 FAILED TEST
I20260709 12:26:45.238631 17346 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2238 messages since previous log ~34 seconds ago
I20260709 12:26:45.238873 17346 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2238 messages since previous log ~34 seconds ago
I20260709 12:26:45.239046 17346 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2234 messages since previous log ~34 seconds ago
I20260709 12:26:45.239240 17346 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~54 seconds ago
I20260709 12:26:45.239413 17346 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~54 seconds ago
I20260709 12:26:45.239601 17346 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:5227: suppressed but not reported on 4 messages since previous log ~132 seconds ago
I20260709 12:26:45.239867 17346 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~179 seconds ago
I20260709 12:26:45.240064 17346 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~172 seconds ago
I20260709 12:26:45.240231 17346 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 1 messages since previous log ~172 seconds ago
I20260709 12:26:45.240449 17346 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 9 messages since previous log ~0 seconds ago
I20260709 12:26:45.240738 17346 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~21 seconds ago
